Aug 15 05:25:02 user nova-compute[73391]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Aug 15 05:25:05 user nova-compute[73391]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=73391) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 15 05:25:05 user nova-compute[73391]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=73391) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 15 05:25:05 user nova-compute[73391]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=73391) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Aug 15 05:25:05 user nova-compute[73391]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Aug 15 05:25:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:25:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:25:05 user nova-compute[73391]: INFO nova.virt.driver [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] Loading compute driver 'libvirt.LibvirtDriver'
Aug 15 05:25:06 user nova-compute[73391]: INFO nova.compute.provider_config [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] Acquiring lock "singleton_lock" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] Acquired lock "singleton_lock" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] Releasing lock "singleton_lock" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] Full set of CONF: {{(pid=73391) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] ******************************************************************************** {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] Configuration options gathered from: {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] ================================================================================ {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] allow_resize_to_same_host      = True {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] arq_binding_timeout            = 300 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] backdoor_port                  = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] backdoor_socket                = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] block_device_allocate_retries  = 300 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] block_device_allocate_retries_interval = 5 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cert                           = self.pem {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] compute_monitors               = [] {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] config_dir                     = [] {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] config_drive_format            = iso9660 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] config_source                  = [] {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] console_host                   = user {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] control_exchange               = nova {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cpu_allocation_ratio           = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] daemon                         = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] debug                          = True {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] default_access_ip_network_name = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] default_availability_zone      = nova {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] default_ephemeral_format       = ext4 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] default_schedule_zone          = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] disk_allocation_ratio          = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] enable_new_services            = True {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] enabled_apis                   = ['osapi_compute'] {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] enabled_ssl_apis               = [] {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] flat_injected                  = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] force_config_drive             = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] force_raw_images               = True {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] graceful_shutdown_timeout      = 5 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] heal_instance_info_cache_interval = 60 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] host                           = user {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] instance_build_timeout         = 0 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] instance_delete_interval       = 300 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] instance_format                = [instance: %(uuid)s]  {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] instance_name_template         = instance-%08x {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] instance_usage_audit           = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] instance_usage_audit_period    = month {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] internal_service_availability_zone = internal {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] key                            = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] live_migration_retry_count     = 30 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] log_config_append              = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] log_dir                        = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] log_file                       = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] log_options                    = True {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] log_rotate_interval            = 1 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] log_rotate_interval_type       = days {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] log_rotation_type              = none {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] long_rpc_timeout               = 1800 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] max_concurrent_builds          = 10 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] max_concurrent_live_migrations = 1 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] max_concurrent_snapshots       = 5 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] max_local_block_devices        = 3 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] max_logfile_count              = 30 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] max_logfile_size_mb            = 200 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] maximum_instance_delete_attempts = 5 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] metadata_listen                = 0.0.0.0 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] metadata_listen_port           = 8775 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] metadata_workers               = 3 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] migrate_max_retries            = -1 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] mkisofs_cmd                    = genisoimage {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] my_ip                          = 10.0.0.210 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] network_allocate_retries       = 0 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] osapi_compute_listen_port      = 8774 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] osapi_compute_unique_server_name_scope =  {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] osapi_compute_workers          = 3 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] password_length                = 12 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] periodic_enable                = True {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] periodic_fuzzy_delay           = 60 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] pointer_model                  = ps2mouse {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] preallocate_images             = none {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] publish_errors                 = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] pybasedir                      = /opt/stack/nova {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] ram_allocation_ratio           = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] rate_limit_burst               = 0 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] rate_limit_except_level        = CRITICAL {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] rate_limit_interval            = 0 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] reboot_timeout                 = 0 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] reclaim_instance_interval      = 0 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] record                         = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] reimage_timeout_per_gb         = 60 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] report_interval                = 120 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] rescue_timeout                 = 0 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] reserved_host_cpus             = 0 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] reserved_host_disk_mb          = 0 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] reserved_host_memory_mb        = 512 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] reserved_huge_pages            = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] resize_confirm_window          = 0 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] resize_fs_using_block_device   = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] resume_guests_state_on_host_boot = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] rpc_response_timeout           = 60 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] run_external_periodic_tasks    = True {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] running_deleted_instance_action = reap {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] running_deleted_instance_poll_interval = 1800 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] running_deleted_instance_timeout = 0 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] scheduler_instance_sync_interval = 120 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] service_down_time              = 720 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] servicegroup_driver            = db {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] shelved_offload_time           = 0 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] shelved_poll_interval          = 3600 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] shutdown_timeout               = 0 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] source_is_ipv6                 = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] ssl_only                       = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] state_path                     = /opt/stack/data/nova {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] sync_power_state_interval      = 600 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] sync_power_state_pool_size     = 1000 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] syslog_log_facility            = LOG_USER {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] tempdir                        = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] timeout_nbd                    = 10 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] transport_url                  = **** {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] update_resources_interval      = 0 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] use_cow_images                 = True {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] use_eventlog                   = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] use_journal                    = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] use_json                       = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] use_rootwrap_daemon            = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] use_stderr                     = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] use_syslog                     = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vcpu_pin_set                   = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vif_plugging_is_fatal          = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vif_plugging_timeout           = 0 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] virt_mkfs                      = [] {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] volume_usage_poll_interval     = 0 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] watch_log_file                 = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] web                            = /usr/share/spice-html5 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_concurrency.disable_process_locking = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] api.auth_strategy              = keystone {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] api.compute_link_prefix        = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] api.dhcp_domain                = novalocal {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] api.enable_instance_password   = True {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] api.glance_link_prefix         = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] api.instance_list_per_project_cells = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] api.list_records_by_skipping_down_cells = True {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] api.local_metadata_per_cell    = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] api.max_limit                  = 1000 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] api.metadata_cache_expiration  = 15 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] api.neutron_default_tenant_id  = default {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] api.use_forwarded_for          = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] api.use_neutron_default_nets   = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] api.vendordata_dynamic_targets = [] {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] api.vendordata_jsonfile_path   = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cache.backend                  = dogpile.cache.memcached {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cache.backend_argument         = **** {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cache.config_prefix            = cache.oslo {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cache.dead_timeout             = 60.0 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cache.debug_cache_backend      = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cache.enable_retry_client      = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cache.enable_socket_keepalive  = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cache.enabled                  = True {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cache.expiration_time          = 600 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cache.hashclient_retry_attempts = 2 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cache.memcache_dead_retry      = 300 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cache.memcache_password        =  {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cache.memcache_pool_maxsize    = 10 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cache.memcache_sasl_enabled    = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cache.memcache_username        =  {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cache.proxies                  = [] {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cache.retry_attempts           = 2 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cache.retry_delay              = 0.0 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cache.socket_keepalive_count   = 1 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cache.socket_keepalive_idle    = 1 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cache.socket_keepalive_interval = 1 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cache.tls_allowed_ciphers      = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cache.tls_cafile               = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cache.tls_certfile             = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cache.tls_enabled              = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cache.tls_keyfile              = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cinder.auth_section            = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cinder.auth_type               = password {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cinder.cafile                  = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cinder.certfile                = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cinder.collect_timing          = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cinder.cross_az_attach         = True {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cinder.debug                   = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cinder.endpoint_template       = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cinder.http_retries            = 3 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cinder.insecure                = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cinder.keyfile                 = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cinder.os_region_name          = RegionOne {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cinder.split_loggers           = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cinder.timeout                 = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] compute.cpu_dedicated_set      = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] compute.cpu_shared_set         = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] compute.image_type_exclude_list = [] {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] compute.max_concurrent_disk_ops = 0 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] compute.max_disk_devices_to_attach = -1 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] compute.resource_provider_association_refresh = 300 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] compute.shutdown_retry_interval = 10 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] conductor.workers              = 3 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] console.allowed_origins        = [] {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] console.ssl_ciphers            = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] console.ssl_minimum_version    = default {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] consoleauth.token_ttl          = 600 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cyborg.cafile                  = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cyborg.certfile                = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cyborg.collect_timing          = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cyborg.connect_retries         = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cyborg.connect_retry_delay     = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cyborg.endpoint_override       = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cyborg.insecure                = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cyborg.keyfile                 = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cyborg.max_version             = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cyborg.min_version             = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cyborg.region_name             = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cyborg.service_name            = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cyborg.service_type            = accelerator {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cyborg.split_loggers           = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cyborg.status_code_retries     = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cyborg.status_code_retry_delay = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cyborg.timeout                 = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] cyborg.version                 = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] database.backend               = sqlalchemy {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] database.connection            = **** {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] database.connection_debug      = 0 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] database.connection_parameters =  {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] database.connection_recycle_time = 3600 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] database.connection_trace      = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] database.db_inc_retry_interval = True {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] database.db_max_retries        = 20 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] database.db_max_retry_interval = 10 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] database.db_retry_interval     = 1 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] database.max_overflow          = 50 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] database.max_pool_size         = 5 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] database.max_retries           = 10 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] database.mysql_enable_ndb      = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] database.mysql_wsrep_sync_wait = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] database.pool_timeout          = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] database.retry_interval        = 10 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] database.slave_connection      = **** {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] database.sqlite_synchronous    = True {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] api_database.backend           = sqlalchemy {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] api_database.connection        = **** {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] api_database.connection_debug  = 0 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] api_database.connection_parameters =  {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] api_database.connection_recycle_time = 3600 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] api_database.connection_trace  = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] api_database.db_inc_retry_interval = True {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] api_database.db_max_retries    = 20 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] api_database.db_max_retry_interval = 10 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] api_database.db_retry_interval = 1 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] api_database.max_overflow      = 50 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] api_database.max_pool_size     = 5 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] api_database.max_retries       = 10 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] api_database.mysql_enable_ndb  = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] api_database.pool_timeout      = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] api_database.retry_interval    = 10 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] api_database.slave_connection  = **** {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] api_database.sqlite_synchronous = True {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] devices.enabled_mdev_types     = [] {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] ephemeral_storage_encryption.enabled = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] glance.api_servers             = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] glance.cafile                  = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] glance.certfile                = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] glance.collect_timing          = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] glance.connect_retries         = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] glance.connect_retry_delay     = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] glance.debug                   = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] glance.default_trusted_certificate_ids = [] {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] glance.enable_certificate_validation = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] glance.enable_rbd_download     = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] glance.endpoint_override       = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] glance.insecure                = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] glance.keyfile                 = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] glance.max_version             = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] glance.min_version             = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] glance.num_retries             = 3 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] glance.rbd_ceph_conf           =  {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] glance.rbd_connect_timeout     = 5 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] glance.rbd_pool                =  {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] glance.rbd_user                =  {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] glance.region_name             = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] glance.service_name            = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] glance.service_type            = image {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] glance.split_loggers           = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] glance.status_code_retries     = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] glance.status_code_retry_delay = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] glance.timeout                 = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] glance.verify_glance_signatures = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] glance.version                 = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] guestfs.debug                  = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] hyperv.config_drive_cdrom      = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] hyperv.config_drive_inject_password = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] hyperv.enable_instance_metrics_collection = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] hyperv.enable_remotefx         = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] hyperv.instances_path_share    =  {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] hyperv.iscsi_initiator_list    = [] {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] hyperv.limit_cpu_features      = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] hyperv.power_state_check_timeframe = 60 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] hyperv.use_multipath_io        = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] hyperv.volume_attach_retry_count = 10 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] hyperv.vswitch_name            = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] mks.enabled                    = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] image_cache.manager_interval   = 2400 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] image_cache.precache_concurrency = 1 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] image_cache.remove_unused_base_images = True {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] image_cache.subdirectory_name  = _base {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] ironic.api_max_retries         = 60 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] ironic.api_retry_interval      = 2 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] ironic.auth_section            = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] ironic.auth_type               = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] ironic.cafile                  = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] ironic.certfile                = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] ironic.collect_timing          = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] ironic.connect_retries         = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] ironic.connect_retry_delay     = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] ironic.endpoint_override       = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] ironic.insecure                = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] ironic.keyfile                 = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] ironic.max_version             = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] ironic.min_version             = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] ironic.partition_key           = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] ironic.peer_list               = [] {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] ironic.region_name             = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] ironic.serial_console_state_timeout = 10 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] ironic.service_name            = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] ironic.service_type            = baremetal {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] ironic.split_loggers           = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] ironic.status_code_retries     = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] ironic.status_code_retry_delay = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] ironic.timeout                 = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] ironic.version                 = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] key_manager.fixed_key          = **** {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] barbican.barbican_api_version  = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] barbican.barbican_endpoint     = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] barbican.barbican_endpoint_type = public {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] barbican.barbican_region_name  = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] barbican.cafile                = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] barbican.certfile              = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] barbican.collect_timing        = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] barbican.insecure              = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] barbican.keyfile               = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] barbican.number_of_retries     = 60 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] barbican.retry_delay           = 1 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] barbican.send_service_user_token = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] barbican.split_loggers         = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] barbican.timeout               = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] barbican.verify_ssl            = True {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] barbican.verify_ssl_path       = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] barbican_service_user.auth_section = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] barbican_service_user.auth_type = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] barbican_service_user.cafile   = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] barbican_service_user.certfile = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] barbican_service_user.collect_timing = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] barbican_service_user.insecure = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] barbican_service_user.keyfile  = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] barbican_service_user.split_loggers = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] barbican_service_user.timeout  = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vault.approle_role_id          = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vault.approle_secret_id        = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vault.cafile                   = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vault.certfile                 = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vault.collect_timing           = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vault.insecure                 = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vault.keyfile                  = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vault.kv_mountpoint            = secret {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vault.kv_version               = 2 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vault.namespace                = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vault.root_token_id            = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vault.split_loggers            = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vault.ssl_ca_crt_file          = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vault.timeout                  = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vault.use_ssl                  = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] keystone.cafile                = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] keystone.certfile              = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] keystone.collect_timing        = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] keystone.connect_retries       = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] keystone.connect_retry_delay   = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] keystone.endpoint_override     = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] keystone.insecure              = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] keystone.keyfile               = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] keystone.max_version           = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] keystone.min_version           = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] keystone.region_name           = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] keystone.service_name          = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] keystone.service_type          = identity {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] keystone.split_loggers         = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] keystone.status_code_retries   = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] keystone.status_code_retry_delay = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] keystone.timeout               = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] keystone.version               = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.connection_uri         =  {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.cpu_mode               = custom {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: WARNING oslo_config.cfg [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.cpu_power_governor_high = performance {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.cpu_power_governor_low = powersave {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.cpu_power_management   = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.device_detach_attempts = 8 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.device_detach_timeout  = 20 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.disk_cachemodes        = [] {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.disk_prefix            = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.enabled_perf_events    = [] {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.file_backed_memory     = 0 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.gid_maps               = [] {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.hw_disk_discard        = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.hw_machine_type        = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.images_rbd_glance_store_name =  {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.images_rbd_pool        = rbd {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.images_type            = default {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.images_volume_group    = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.inject_key             = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.inject_partition       = -2 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.inject_password        = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.iscsi_iface            = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.iser_use_multipath     = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.live_migration_bandwidth = 0 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.live_migration_downtime = 500 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.live_migration_inbound_addr = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.live_migration_permit_post_copy = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.live_migration_scheme  = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.live_migration_timeout_action = abort {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.live_migration_tunnelled = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: WARNING oslo_config.cfg [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Aug 15 05:25:06 user nova-compute[73391]: live_migration_uri is deprecated for removal in favor of two other options that
Aug 15 05:25:06 user nova-compute[73391]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Aug 15 05:25:06 user nova-compute[73391]: and ``live_migration_inbound_addr`` respectively.
Aug 15 05:25:06 user nova-compute[73391]: ).  Its value may be silently ignored in the future.
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.live_migration_with_native_tls = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.max_queues             = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.nfs_mount_options      = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.num_memory_encrypted_guests = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.num_pcie_ports         = 0 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.pmem_namespaces        = [] {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.quobyte_client_cfg     = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.rbd_secret_uuid        = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.rbd_user               = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.remote_filesystem_transport = ssh {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.rescue_image_id        = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.rescue_kernel_id       = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.rescue_ramdisk_id      = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.rx_queue_size          = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.smbfs_mount_options    =  {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.snapshot_compression   = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.snapshot_image_format  = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.sparse_logical_volumes = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.swtpm_enabled          = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.swtpm_group            = tss {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.swtpm_user             = tss {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.sysinfo_serial         = unique {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.tb_cache_size          = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.tx_queue_size          = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.uid_maps               = [] {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.use_virtio_for_bridges = True {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.virt_type              = kvm {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.volume_clear           = zero {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.volume_clear_size      = 0 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.volume_use_multipath   = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.vzstorage_cache_path   = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.vzstorage_mount_user   = stack {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] neutron.auth_section           = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] neutron.auth_type              = password {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] neutron.cafile                 = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] neutron.certfile               = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] neutron.collect_timing         = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] neutron.connect_retries        = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] neutron.connect_retry_delay    = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] neutron.default_floating_pool  = public {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] neutron.endpoint_override      = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] neutron.extension_sync_interval = 600 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] neutron.http_retries           = 3 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] neutron.insecure               = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] neutron.keyfile                = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] neutron.max_version            = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] neutron.min_version            = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] neutron.ovs_bridge             = br-int {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] neutron.physnets               = [] {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] neutron.region_name            = RegionOne {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] neutron.service_metadata_proxy = True {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] neutron.service_name           = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] neutron.service_type           = network {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] neutron.split_loggers          = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] neutron.status_code_retries    = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] neutron.status_code_retry_delay = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] neutron.timeout                = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] neutron.version                = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] notifications.bdms_in_notifications = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] notifications.default_level    = INFO {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] notifications.notification_format = unversioned {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] notifications.notify_on_state_change = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] pci.alias                      = [] {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] pci.device_spec                = [] {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] pci.report_in_placement        = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] placement.auth_section         = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] placement.auth_type            = password {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] placement.cafile               = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] placement.certfile             = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] placement.collect_timing       = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] placement.connect_retries      = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] placement.connect_retry_delay  = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] placement.default_domain_id    = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] placement.default_domain_name  = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] placement.domain_id            = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] placement.domain_name          = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] placement.endpoint_override    = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] placement.insecure             = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] placement.keyfile              = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] placement.max_version          = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] placement.min_version          = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] placement.password             = **** {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] placement.project_domain_id    = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] placement.project_domain_name  = Default {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] placement.project_id           = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] placement.project_name         = service {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] placement.region_name          = RegionOne {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] placement.service_name         = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] placement.service_type         = placement {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] placement.split_loggers        = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] placement.status_code_retries  = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] placement.status_code_retry_delay = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] placement.system_scope         = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] placement.timeout              = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] placement.trust_id             = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] placement.user_domain_id       = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] placement.user_domain_name     = Default {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] placement.user_id              = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] placement.username             = placement {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] placement.version              = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] quota.cores                    = 20 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] quota.count_usage_from_placement = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] quota.injected_file_content_bytes = 10240 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] quota.injected_file_path_length = 255 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] quota.injected_files           = 5 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] quota.instances                = 10 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] quota.key_pairs                = 100 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] quota.metadata_items           = 128 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] quota.ram                      = 51200 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] quota.recheck_quota            = True {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] quota.server_group_members     = 10 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] quota.server_groups            = 10 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] rdp.enabled                    = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] scheduler.image_metadata_prefilter = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] scheduler.max_attempts         = 3 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] scheduler.max_placement_results = 1000 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] scheduler.query_placement_for_availability_zone = True {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] scheduler.query_placement_for_image_type_support = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] scheduler.workers              = 3 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] filter_scheduler.host_subset_size = 1 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] filter_scheduler.isolated_hosts = [] {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] filter_scheduler.isolated_images = [] {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] filter_scheduler.pci_in_placement = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] filter_scheduler.track_instance_changes = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] metrics.required               = True {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] metrics.weight_multiplier      = 1.0 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] metrics.weight_setting         = [] {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] serial_console.enabled         = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] serial_console.port_range      = 10000:20000 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] serial_console.serialproxy_port = 6083 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] service_user.auth_section      = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] service_user.auth_type         = password {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] service_user.cafile            = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] service_user.certfile          = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] service_user.collect_timing    = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] service_user.insecure          = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] service_user.keyfile           = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] service_user.send_service_user_token = True {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] service_user.split_loggers     = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] service_user.timeout           = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] spice.agent_enabled            = True {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] spice.enabled                  = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] spice.html5proxy_port          = 6082 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] spice.image_compression        = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] spice.jpeg_compression         = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] spice.playback_compression     = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] spice.server_listen            = 127.0.0.1 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] spice.streaming_mode           = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] spice.zlib_compression         = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] upgrade_levels.baseapi         = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] upgrade_levels.cert            = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] upgrade_levels.compute         = auto {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] upgrade_levels.conductor       = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] upgrade_levels.scheduler       = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vendordata_dynamic_auth.auth_section = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vendordata_dynamic_auth.auth_type = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vendordata_dynamic_auth.cafile = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vendordata_dynamic_auth.certfile = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vendordata_dynamic_auth.insecure = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vendordata_dynamic_auth.keyfile = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vendordata_dynamic_auth.timeout = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vmware.api_retry_count         = 10 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vmware.ca_file                 = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vmware.cache_prefix            = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vmware.cluster_name            = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vmware.connection_pool_size    = 10 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vmware.console_delay_seconds   = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vmware.datastore_regex         = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vmware.host_ip                 = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vmware.host_password           = **** {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vmware.host_port               = 443 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vmware.host_username           = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vmware.insecure                = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vmware.integration_bridge      = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vmware.maximum_objects         = 100 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vmware.pbm_default_policy      = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vmware.pbm_enabled             = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vmware.pbm_wsdl_location       = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vmware.serial_port_proxy_uri   = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vmware.serial_port_service_uri = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vmware.task_poll_interval      = 0.5 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vmware.use_linked_clone        = True {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vmware.vnc_keymap              = en-us {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vmware.vnc_port                = 5900 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vmware.vnc_port_total          = 10000 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vnc.auth_schemes               = ['none'] {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vnc.enabled                    = True {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vnc.novncproxy_port            = 6080 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vnc.server_listen              = 0.0.0.0 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vnc.vencrypt_ca_certs          = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vnc.vencrypt_client_cert       = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vnc.vencrypt_client_key        = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] workarounds.disable_rootwrap   = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] workarounds.enable_numa_live_migration = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] workarounds.libvirt_disable_apic = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] wsgi.client_socket_timeout     = 900 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] wsgi.default_pool_size         = 1000 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] wsgi.keep_alive                = True {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] wsgi.max_header_line           = 16384 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] wsgi.ssl_ca_file               = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] wsgi.ssl_cert_file             = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] wsgi.ssl_key_file              = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] wsgi.tcp_keepidle              = 600 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] zvm.ca_file                    = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] zvm.cloud_connector_url        = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] zvm.reachable_timeout          = 300 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_policy.enforce_new_defaults = True {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_policy.enforce_scope      = True {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_policy.policy_default_rule = default {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_policy.policy_file        = policy.yaml {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] profiler.connection_string     = messaging:// {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] profiler.enabled               = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] profiler.es_doc_type           = notification {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] profiler.es_scroll_size        = 10000 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] profiler.es_scroll_time        = 2m {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] profiler.filter_error_trace    = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] profiler.hmac_keys             = **** {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] profiler.sentinel_service_name = mymaster {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] profiler.socket_timeout        = 0.1 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] profiler.trace_requests        = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] profiler.trace_sqlalchemy      = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] profiler_jaeger.process_tags   = {} {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] profiler_jaeger.service_name_prefix = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] profiler_otlp.service_name_prefix = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] remote_debug.host              = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] remote_debug.port              = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_messaging_rabbit.ssl      = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_messaging_notifications.retry = -1 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_messaging_notifications.transport_url = **** {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_limit.auth_section        = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_limit.auth_type           = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_limit.cafile              = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_limit.certfile            = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_limit.collect_timing      = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_limit.connect_retries     = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_limit.connect_retry_delay = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_limit.endpoint_id         = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_limit.endpoint_override   = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_limit.insecure            = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_limit.keyfile             = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_limit.max_version         = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_limit.min_version         = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_limit.region_name         = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_limit.service_name        = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_limit.service_type        = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_limit.split_loggers       = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_limit.status_code_retries = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_limit.status_code_retry_delay = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_limit.timeout             = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_limit.valid_interfaces    = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_limit.version             = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_reports.file_event_handler = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] oslo_reports.log_dir           = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vif_plug_ovs_privileged.group  = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] vif_plug_ovs_privileged.user   = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] os_vif_linux_bridge.flat_interface = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] os_vif_ovs.isolate_vif         = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] os_vif_ovs.per_port_bridge     = False {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] os_brick.lock_path             = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] privsep_osbrick.capabilities   = [21] {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] privsep_osbrick.group          = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] privsep_osbrick.helper_command = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] privsep_osbrick.user           = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] nova_sys_admin.group           = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] nova_sys_admin.helper_command  = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] nova_sys_admin.user            = None {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG oslo_service.service [None req-ce438c56-1df2-438e-bc5a-48338787d731 None None] ******************************************************************************** {{(pid=73391) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Aug 15 05:25:06 user nova-compute[73391]: INFO nova.service [-] Starting compute node (version 0.0.0)
Aug 15 05:25:06 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Starting native event thread {{(pid=73391) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Starting green dispatch thread {{(pid=73391) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Starting connection event dispatch thread {{(pid=73391) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Connecting to libvirt: qemu:///system {{(pid=73391) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f774cc20dc0> {{(pid=73391) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Aug 15 05:25:06 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f774cc20dc0> {{(pid=73391) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Aug 15 05:25:06 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Connection event '1' reason 'None'
Aug 15 05:25:06 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 15 05:25:06 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.mount [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Initialising _HostMountState generation 0 {{(pid=73391) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Aug 15 05:25:13 user nova-compute[73391]: INFO nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Libvirt host capabilities <capabilities>
Aug 15 05:25:13 user nova-compute[73391]:   <host>
Aug 15 05:25:13 user nova-compute[73391]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Aug 15 05:25:13 user nova-compute[73391]:     <cpu>
Aug 15 05:25:13 user nova-compute[73391]:       <arch>x86_64</arch>
Aug 15 05:25:13 user nova-compute[73391]:       <model>IvyBridge-IBRS</model>
Aug 15 05:25:13 user nova-compute[73391]:       <vendor>Intel</vendor>
Aug 15 05:25:13 user nova-compute[73391]:       <microcode version='1070'/>
Aug 15 05:25:13 user nova-compute[73391]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Aug 15 05:25:13 user nova-compute[73391]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature name='ss'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature name='vmx'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature name='pcid'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature name='osxsave'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature name='hypervisor'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature name='arat'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature name='tsc_adjust'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature name='md-clear'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature name='stibp'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature name='arch-capabilities'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature name='ssbd'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature name='invtsc'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature name='rsba'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature name='skip-l1dfl-vmentry'/>
Aug 15 05:25:13 user nova-compute[73391]:       <pages unit='KiB' size='4'/>
Aug 15 05:25:13 user nova-compute[73391]:       <pages unit='KiB' size='2048'/>
Aug 15 05:25:13 user nova-compute[73391]:     </cpu>
Aug 15 05:25:13 user nova-compute[73391]:     <power_management>
Aug 15 05:25:13 user nova-compute[73391]:       <suspend_mem/>
Aug 15 05:25:13 user nova-compute[73391]:       <suspend_disk/>
Aug 15 05:25:13 user nova-compute[73391]:       <suspend_hybrid/>
Aug 15 05:25:13 user nova-compute[73391]:     </power_management>
Aug 15 05:25:13 user nova-compute[73391]:     <iommu support='no'/>
Aug 15 05:25:13 user nova-compute[73391]:     <migration_features>
Aug 15 05:25:13 user nova-compute[73391]:       <live/>
Aug 15 05:25:13 user nova-compute[73391]:       <uri_transports>
Aug 15 05:25:13 user nova-compute[73391]:         <uri_transport>tcp</uri_transport>
Aug 15 05:25:13 user nova-compute[73391]:         <uri_transport>rdma</uri_transport>
Aug 15 05:25:13 user nova-compute[73391]:       </uri_transports>
Aug 15 05:25:13 user nova-compute[73391]:     </migration_features>
Aug 15 05:25:13 user nova-compute[73391]:     <topology>
Aug 15 05:25:13 user nova-compute[73391]:       <cells num='2'>
Aug 15 05:25:13 user nova-compute[73391]:         <cell id='0'>
Aug 15 05:25:13 user nova-compute[73391]:           <memory unit='KiB'>8189224</memory>
Aug 15 05:25:13 user nova-compute[73391]:           <pages unit='KiB' size='4'>2047306</pages>
Aug 15 05:25:13 user nova-compute[73391]:           <pages unit='KiB' size='2048'>0</pages>
Aug 15 05:25:13 user nova-compute[73391]:           <distances>
Aug 15 05:25:13 user nova-compute[73391]:             <sibling id='0' value='10'/>
Aug 15 05:25:13 user nova-compute[73391]:             <sibling id='1' value='20'/>
Aug 15 05:25:13 user nova-compute[73391]:           </distances>
Aug 15 05:25:13 user nova-compute[73391]:           <cpus num='6'>
Aug 15 05:25:13 user nova-compute[73391]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Aug 15 05:25:13 user nova-compute[73391]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Aug 15 05:25:13 user nova-compute[73391]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Aug 15 05:25:13 user nova-compute[73391]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Aug 15 05:25:13 user nova-compute[73391]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Aug 15 05:25:13 user nova-compute[73391]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Aug 15 05:25:13 user nova-compute[73391]:           </cpus>
Aug 15 05:25:13 user nova-compute[73391]:         </cell>
Aug 15 05:25:13 user nova-compute[73391]:         <cell id='1'>
Aug 15 05:25:13 user nova-compute[73391]:           <memory unit='KiB'>8206492</memory>
Aug 15 05:25:13 user nova-compute[73391]:           <pages unit='KiB' size='4'>2051623</pages>
Aug 15 05:25:13 user nova-compute[73391]:           <pages unit='KiB' size='2048'>0</pages>
Aug 15 05:25:13 user nova-compute[73391]:           <distances>
Aug 15 05:25:13 user nova-compute[73391]:             <sibling id='0' value='20'/>
Aug 15 05:25:13 user nova-compute[73391]:             <sibling id='1' value='10'/>
Aug 15 05:25:13 user nova-compute[73391]:           </distances>
Aug 15 05:25:13 user nova-compute[73391]:           <cpus num='6'>
Aug 15 05:25:13 user nova-compute[73391]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Aug 15 05:25:13 user nova-compute[73391]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Aug 15 05:25:13 user nova-compute[73391]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Aug 15 05:25:13 user nova-compute[73391]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Aug 15 05:25:13 user nova-compute[73391]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Aug 15 05:25:13 user nova-compute[73391]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Aug 15 05:25:13 user nova-compute[73391]:           </cpus>
Aug 15 05:25:13 user nova-compute[73391]:         </cell>
Aug 15 05:25:13 user nova-compute[73391]:       </cells>
Aug 15 05:25:13 user nova-compute[73391]:     </topology>
Aug 15 05:25:13 user nova-compute[73391]:     <cache>
Aug 15 05:25:13 user nova-compute[73391]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Aug 15 05:25:13 user nova-compute[73391]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Aug 15 05:25:13 user nova-compute[73391]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Aug 15 05:25:13 user nova-compute[73391]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Aug 15 05:25:13 user nova-compute[73391]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Aug 15 05:25:13 user nova-compute[73391]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Aug 15 05:25:13 user nova-compute[73391]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Aug 15 05:25:13 user nova-compute[73391]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Aug 15 05:25:13 user nova-compute[73391]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Aug 15 05:25:13 user nova-compute[73391]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Aug 15 05:25:13 user nova-compute[73391]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Aug 15 05:25:13 user nova-compute[73391]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Aug 15 05:25:13 user nova-compute[73391]:     </cache>
Aug 15 05:25:13 user nova-compute[73391]:     <secmodel>
Aug 15 05:25:13 user nova-compute[73391]:       <model>apparmor</model>
Aug 15 05:25:13 user nova-compute[73391]:       <doi>0</doi>
Aug 15 05:25:13 user nova-compute[73391]:     </secmodel>
Aug 15 05:25:13 user nova-compute[73391]:     <secmodel>
Aug 15 05:25:13 user nova-compute[73391]:       <model>dac</model>
Aug 15 05:25:13 user nova-compute[73391]:       <doi>0</doi>
Aug 15 05:25:13 user nova-compute[73391]:       <baselabel type='kvm'>+64055:+108</baselabel>
Aug 15 05:25:13 user nova-compute[73391]:       <baselabel type='qemu'>+64055:+108</baselabel>
Aug 15 05:25:13 user nova-compute[73391]:     </secmodel>
Aug 15 05:25:13 user nova-compute[73391]:   </host>
Aug 15 05:25:13 user nova-compute[73391]:   <guest>
Aug 15 05:25:13 user nova-compute[73391]:     <os_type>hvm</os_type>
Aug 15 05:25:13 user nova-compute[73391]:     <arch name='alpha'>
Aug 15 05:25:13 user nova-compute[73391]:       <wordsize>64</wordsize>
Aug 15 05:25:13 user nova-compute[73391]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='4'>clipper</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <domain type='qemu'/>
Aug 15 05:25:13 user nova-compute[73391]:     </arch>
Aug 15 05:25:13 user nova-compute[73391]:     <features>
Aug 15 05:25:13 user nova-compute[73391]:       <cpuselection/>
Aug 15 05:25:13 user nova-compute[73391]:       <deviceboot/>
Aug 15 05:25:13 user nova-compute[73391]:       <disksnapshot default='on' toggle='no'/>
Aug 15 05:25:13 user nova-compute[73391]:     </features>
Aug 15 05:25:13 user nova-compute[73391]:   </guest>
Aug 15 05:25:13 user nova-compute[73391]:   <guest>
Aug 15 05:25:13 user nova-compute[73391]:     <os_type>hvm</os_type>
Aug 15 05:25:13 user nova-compute[73391]:     <arch name='armv6l'>
Aug 15 05:25:13 user nova-compute[73391]:       <wordsize>32</wordsize>
Aug 15 05:25:13 user nova-compute[73391]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>integratorcp</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>borzoi</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>spitz</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2'>nuri</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2'>musca-b1</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>versatileab</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>kzm</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2'>musca-a</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2'>smdkc210</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>sx1</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>z2</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>tosa</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='4'>sabrelite</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>realview-eb</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>n810</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>n800</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>versatilepb</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>terrier</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>mainstone</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='4'>midway</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>musicpal</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>microbit</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>cubieboard</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>verdex</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>netduino2</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='4'>raspi2b</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>cheetah</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='4'>highbank</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>akita</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>connex</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>collie</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>raspi0</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <domain type='qemu'/>
Aug 15 05:25:13 user nova-compute[73391]:     </arch>
Aug 15 05:25:13 user nova-compute[73391]:     <features>
Aug 15 05:25:13 user nova-compute[73391]:       <cpuselection/>
Aug 15 05:25:13 user nova-compute[73391]:       <deviceboot/>
Aug 15 05:25:13 user nova-compute[73391]:       <disksnapshot default='on' toggle='no'/>
Aug 15 05:25:13 user nova-compute[73391]:     </features>
Aug 15 05:25:13 user nova-compute[73391]:   </guest>
Aug 15 05:25:13 user nova-compute[73391]:   <guest>
Aug 15 05:25:13 user nova-compute[73391]:     <os_type>hvm</os_type>
Aug 15 05:25:13 user nova-compute[73391]:     <arch name='armv7l'>
Aug 15 05:25:13 user nova-compute[73391]:       <wordsize>32</wordsize>
Aug 15 05:25:13 user nova-compute[73391]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>integratorcp</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>borzoi</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>spitz</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2'>nuri</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2'>musca-b1</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>versatileab</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>kzm</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2'>musca-a</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2'>smdkc210</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>sx1</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>z2</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>tosa</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='4'>sabrelite</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>realview-eb</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>n810</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>n800</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>versatilepb</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>terrier</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>mainstone</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='4'>midway</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>musicpal</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>microbit</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>cubieboard</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>verdex</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>netduino2</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='4'>raspi2b</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>cheetah</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='4'>highbank</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>akita</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>connex</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>collie</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>raspi0</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <domain type='qemu'/>
Aug 15 05:25:13 user nova-compute[73391]:     </arch>
Aug 15 05:25:13 user nova-compute[73391]:     <features>
Aug 15 05:25:13 user nova-compute[73391]:       <cpuselection/>
Aug 15 05:25:13 user nova-compute[73391]:       <deviceboot/>
Aug 15 05:25:13 user nova-compute[73391]:       <disksnapshot default='on' toggle='no'/>
Aug 15 05:25:13 user nova-compute[73391]:     </features>
Aug 15 05:25:13 user nova-compute[73391]:   </guest>
Aug 15 05:25:13 user nova-compute[73391]:   <guest>
Aug 15 05:25:13 user nova-compute[73391]:     <os_type>hvm</os_type>
Aug 15 05:25:13 user nova-compute[73391]:     <arch name='aarch64'>
Aug 15 05:25:13 user nova-compute[73391]:       <wordsize>64</wordsize>
Aug 15 05:25:13 user nova-compute[73391]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>integratorcp</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2'>ast2600-evb</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>borzoi</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>spitz</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>virt-2.7</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2'>nuri</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>romulus-bmc</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='512'>virt-3.0</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='512'>virt-5.0</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2'>npcm750-evb</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>virt-2.10</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2'>rainier-bmc</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>mps3-an547</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>virt-2.8</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2'>musca-b1</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>versatileab</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>kzm</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2'>musca-a</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='512'>virt-3.1</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='512'>virt-5.1</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2'>smdkc210</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>sx1</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>virt-2.11</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>imx25-pdk</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>virt-2.9</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='4'>orangepi-pc</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>z2</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='512'>virt-5.2</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>tosa</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>mps2-an500</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>virt-2.12</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2'>mps2-an521</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='4'>sabrelite</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>mps2-an511</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>canon-a1100</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>realview-eb</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>emcraft-sf2</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>realview-pb-a8</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='512'>sbsa-ref</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='512'>virt-4.0</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>raspi1ap</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>palmetto-bmc</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>sx1-v1</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>n810</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>g220a-bmc</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>n800</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2'>tacoma-bmc</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='512'>virt-4.1</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2'>quanta-gsj</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>versatilepb</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>terrier</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>mainstone</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='512'>virt-4.2</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2'>mps3-an524</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2'>kudo-bmc</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='4'>vexpress-a9</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='4'>midway</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>musicpal</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>lm3s811evb</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>lm3s6965evb</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>microbit</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>mps2-an505</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>mps2-an385</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='512'>virt-6.0</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='4'>raspi3ap</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>cubieboard</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>verdex</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>netduino2</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>mps2-an386</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='512'>virt-6.1</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='4'>raspi3b</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='4'>raspi2b</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='4'>vexpress-a15</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2'>fuji-bmc</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='512'>virt-6.2</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>cheetah</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>virt-2.6</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>ast2500-evb</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='4'>highbank</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>akita</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>connex</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>netduinoplus2</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>collie</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>raspi0</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <domain type='qemu'/>
Aug 15 05:25:13 user nova-compute[73391]:     </arch>
Aug 15 05:25:13 user nova-compute[73391]:     <features>
Aug 15 05:25:13 user nova-compute[73391]:       <acpi default='on' toggle='yes'/>
Aug 15 05:25:13 user nova-compute[73391]:       <cpuselection/>
Aug 15 05:25:13 user nova-compute[73391]:       <deviceboot/>
Aug 15 05:25:13 user nova-compute[73391]:       <disksnapshot default='on' toggle='no'/>
Aug 15 05:25:13 user nova-compute[73391]:     </features>
Aug 15 05:25:13 user nova-compute[73391]:   </guest>
Aug 15 05:25:13 user nova-compute[73391]:   <guest>
Aug 15 05:25:13 user nova-compute[73391]:     <os_type>hvm</os_type>
Aug 15 05:25:13 user nova-compute[73391]:     <arch name='cris'>
Aug 15 05:25:13 user nova-compute[73391]:       <wordsize>32</wordsize>
Aug 15 05:25:13 user nova-compute[73391]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>axis-dev88</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <domain type='qemu'/>
Aug 15 05:25:13 user nova-compute[73391]:     </arch>
Aug 15 05:25:13 user nova-compute[73391]:     <features>
Aug 15 05:25:13 user nova-compute[73391]:       <cpuselection/>
Aug 15 05:25:13 user nova-compute[73391]:       <deviceboot/>
Aug 15 05:25:13 user nova-compute[73391]:       <disksnapshot default='on' toggle='no'/>
Aug 15 05:25:13 user nova-compute[73391]:     </features>
Aug 15 05:25:13 user nova-compute[73391]:   </guest>
Aug 15 05:25:13 user nova-compute[73391]:   <guest>
Aug 15 05:25:13 user nova-compute[73391]:     <os_type>hvm</os_type>
Aug 15 05:25:13 user nova-compute[73391]:     <arch name='i686'>
Aug 15 05:25:13 user nova-compute[73391]:       <wordsize>32</wordsize>
Aug 15 05:25:13 user nova-compute[73391]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>x-remote</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>isapc</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>microvm</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <domain type='qemu'/>
Aug 15 05:25:13 user nova-compute[73391]:       <domain type='kvm'/>
Aug 15 05:25:13 user nova-compute[73391]:     </arch>
Aug 15 05:25:13 user nova-compute[73391]:     <features>
Aug 15 05:25:13 user nova-compute[73391]:       <pae/>
Aug 15 05:25:13 user nova-compute[73391]:       <nonpae/>
Aug 15 05:25:13 user nova-compute[73391]:       <acpi default='on' toggle='yes'/>
Aug 15 05:25:13 user nova-compute[73391]:       <apic default='on' toggle='no'/>
Aug 15 05:25:13 user nova-compute[73391]:       <cpuselection/>
Aug 15 05:25:13 user nova-compute[73391]:       <deviceboot/>
Aug 15 05:25:13 user nova-compute[73391]:       <disksnapshot default='on' toggle='no'/>
Aug 15 05:25:13 user nova-compute[73391]:     </features>
Aug 15 05:25:13 user nova-compute[73391]:   </guest>
Aug 15 05:25:13 user nova-compute[73391]:   <guest>
Aug 15 05:25:13 user nova-compute[73391]:     <os_type>hvm</os_type>
Aug 15 05:25:13 user nova-compute[73391]:     <arch name='m68k'>
Aug 15 05:25:13 user nova-compute[73391]:       <wordsize>32</wordsize>
Aug 15 05:25:13 user nova-compute[73391]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>mcf5208evb</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>an5206</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>virt-6.0</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>q800</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>virt-6.2</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>next-cube</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>virt-6.1</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <domain type='qemu'/>
Aug 15 05:25:13 user nova-compute[73391]:     </arch>
Aug 15 05:25:13 user nova-compute[73391]:     <features>
Aug 15 05:25:13 user nova-compute[73391]:       <cpuselection/>
Aug 15 05:25:13 user nova-compute[73391]:       <deviceboot/>
Aug 15 05:25:13 user nova-compute[73391]:       <disksnapshot default='on' toggle='no'/>
Aug 15 05:25:13 user nova-compute[73391]:     </features>
Aug 15 05:25:13 user nova-compute[73391]:   </guest>
Aug 15 05:25:13 user nova-compute[73391]:   <guest>
Aug 15 05:25:13 user nova-compute[73391]:     <os_type>hvm</os_type>
Aug 15 05:25:13 user nova-compute[73391]:     <arch name='microblaze'>
Aug 15 05:25:13 user nova-compute[73391]:       <wordsize>32</wordsize>
Aug 15 05:25:13 user nova-compute[73391]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <domain type='qemu'/>
Aug 15 05:25:13 user nova-compute[73391]:     </arch>
Aug 15 05:25:13 user nova-compute[73391]:     <features>
Aug 15 05:25:13 user nova-compute[73391]:       <cpuselection/>
Aug 15 05:25:13 user nova-compute[73391]:       <deviceboot/>
Aug 15 05:25:13 user nova-compute[73391]:       <disksnapshot default='on' toggle='no'/>
Aug 15 05:25:13 user nova-compute[73391]:     </features>
Aug 15 05:25:13 user nova-compute[73391]:   </guest>
Aug 15 05:25:13 user nova-compute[73391]:   <guest>
Aug 15 05:25:13 user nova-compute[73391]:     <os_type>hvm</os_type>
Aug 15 05:25:13 user nova-compute[73391]:     <arch name='microblazeel'>
Aug 15 05:25:13 user nova-compute[73391]:       <wordsize>32</wordsize>
Aug 15 05:25:13 user nova-compute[73391]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>petalogix-ml605</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <domain type='qemu'/>
Aug 15 05:25:13 user nova-compute[73391]:     </arch>
Aug 15 05:25:13 user nova-compute[73391]:     <features>
Aug 15 05:25:13 user nova-compute[73391]:       <cpuselection/>
Aug 15 05:25:13 user nova-compute[73391]:       <deviceboot/>
Aug 15 05:25:13 user nova-compute[73391]:       <disksnapshot default='on' toggle='no'/>
Aug 15 05:25:13 user nova-compute[73391]:     </features>
Aug 15 05:25:13 user nova-compute[73391]:   </guest>
Aug 15 05:25:13 user nova-compute[73391]:   <guest>
Aug 15 05:25:13 user nova-compute[73391]:     <os_type>hvm</os_type>
Aug 15 05:25:13 user nova-compute[73391]:     <arch name='mips'>
Aug 15 05:25:13 user nova-compute[73391]:       <wordsize>32</wordsize>
Aug 15 05:25:13 user nova-compute[73391]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='16'>malta</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>mipssim</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <domain type='qemu'/>
Aug 15 05:25:13 user nova-compute[73391]:     </arch>
Aug 15 05:25:13 user nova-compute[73391]:     <features>
Aug 15 05:25:13 user nova-compute[73391]:       <cpuselection/>
Aug 15 05:25:13 user nova-compute[73391]:       <deviceboot/>
Aug 15 05:25:13 user nova-compute[73391]:       <disksnapshot default='on' toggle='no'/>
Aug 15 05:25:13 user nova-compute[73391]:     </features>
Aug 15 05:25:13 user nova-compute[73391]:   </guest>
Aug 15 05:25:13 user nova-compute[73391]:   <guest>
Aug 15 05:25:13 user nova-compute[73391]:     <os_type>hvm</os_type>
Aug 15 05:25:13 user nova-compute[73391]:     <arch name='mipsel'>
Aug 15 05:25:13 user nova-compute[73391]:       <wordsize>32</wordsize>
Aug 15 05:25:13 user nova-compute[73391]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='16'>malta</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>mipssim</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <domain type='qemu'/>
Aug 15 05:25:13 user nova-compute[73391]:     </arch>
Aug 15 05:25:13 user nova-compute[73391]:     <features>
Aug 15 05:25:13 user nova-compute[73391]:       <cpuselection/>
Aug 15 05:25:13 user nova-compute[73391]:       <deviceboot/>
Aug 15 05:25:13 user nova-compute[73391]:       <disksnapshot default='on' toggle='no'/>
Aug 15 05:25:13 user nova-compute[73391]:     </features>
Aug 15 05:25:13 user nova-compute[73391]:   </guest>
Aug 15 05:25:13 user nova-compute[73391]:   <guest>
Aug 15 05:25:13 user nova-compute[73391]:     <os_type>hvm</os_type>
Aug 15 05:25:13 user nova-compute[73391]:     <arch name='mips64'>
Aug 15 05:25:13 user nova-compute[73391]:       <wordsize>64</wordsize>
Aug 15 05:25:13 user nova-compute[73391]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='16'>malta</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>mipssim</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>pica61</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>magnum</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <domain type='qemu'/>
Aug 15 05:25:13 user nova-compute[73391]:     </arch>
Aug 15 05:25:13 user nova-compute[73391]:     <features>
Aug 15 05:25:13 user nova-compute[73391]:       <cpuselection/>
Aug 15 05:25:13 user nova-compute[73391]:       <deviceboot/>
Aug 15 05:25:13 user nova-compute[73391]:       <disksnapshot default='on' toggle='no'/>
Aug 15 05:25:13 user nova-compute[73391]:     </features>
Aug 15 05:25:13 user nova-compute[73391]:   </guest>
Aug 15 05:25:13 user nova-compute[73391]:   <guest>
Aug 15 05:25:13 user nova-compute[73391]:     <os_type>hvm</os_type>
Aug 15 05:25:13 user nova-compute[73391]:     <arch name='mips64el'>
Aug 15 05:25:13 user nova-compute[73391]:       <wordsize>64</wordsize>
Aug 15 05:25:13 user nova-compute[73391]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='16'>malta</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='16'>loongson3-virt</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>mipssim</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>pica61</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>magnum</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='16'>boston</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>fuloong2e</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <domain type='qemu'/>
Aug 15 05:25:13 user nova-compute[73391]:     </arch>
Aug 15 05:25:13 user nova-compute[73391]:     <features>
Aug 15 05:25:13 user nova-compute[73391]:       <cpuselection/>
Aug 15 05:25:13 user nova-compute[73391]:       <deviceboot/>
Aug 15 05:25:13 user nova-compute[73391]:       <disksnapshot default='on' toggle='no'/>
Aug 15 05:25:13 user nova-compute[73391]:     </features>
Aug 15 05:25:13 user nova-compute[73391]:   </guest>
Aug 15 05:25:13 user nova-compute[73391]:   <guest>
Aug 15 05:25:13 user nova-compute[73391]:     <os_type>hvm</os_type>
Aug 15 05:25:13 user nova-compute[73391]:     <arch name='ppc'>
Aug 15 05:25:13 user nova-compute[73391]:       <wordsize>32</wordsize>
Aug 15 05:25:13 user nova-compute[73391]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>g3beige</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>mac99</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='32'>ppce500</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>pegasos2</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>sam460ex</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>bamboo</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>40p</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>ref405ep</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>taihu</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <domain type='qemu'/>
Aug 15 05:25:13 user nova-compute[73391]:     </arch>
Aug 15 05:25:13 user nova-compute[73391]:     <features>
Aug 15 05:25:13 user nova-compute[73391]:       <cpuselection/>
Aug 15 05:25:13 user nova-compute[73391]:       <deviceboot/>
Aug 15 05:25:13 user nova-compute[73391]:       <disksnapshot default='on' toggle='no'/>
Aug 15 05:25:13 user nova-compute[73391]:     </features>
Aug 15 05:25:13 user nova-compute[73391]:   </guest>
Aug 15 05:25:13 user nova-compute[73391]:   <guest>
Aug 15 05:25:13 user nova-compute[73391]:     <os_type>hvm</os_type>
Aug 15 05:25:13 user nova-compute[73391]:     <arch name='ppc64'>
Aug 15 05:25:13 user nova-compute[73391]:       <wordsize>64</wordsize>
Aug 15 05:25:13 user nova-compute[73391]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2048'>powernv9</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>taihu</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2048'>powernv10</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='32'>ppce500</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>40p</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>pegasos2</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>bamboo</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>g3beige</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>mac99</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>sam460ex</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>ref405ep</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2048'>powernv8</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <domain type='qemu'/>
Aug 15 05:25:13 user nova-compute[73391]:     </arch>
Aug 15 05:25:13 user nova-compute[73391]:     <features>
Aug 15 05:25:13 user nova-compute[73391]:       <cpuselection/>
Aug 15 05:25:13 user nova-compute[73391]:       <deviceboot/>
Aug 15 05:25:13 user nova-compute[73391]:       <disksnapshot default='on' toggle='no'/>
Aug 15 05:25:13 user nova-compute[73391]:     </features>
Aug 15 05:25:13 user nova-compute[73391]:   </guest>
Aug 15 05:25:13 user nova-compute[73391]:   <guest>
Aug 15 05:25:13 user nova-compute[73391]:     <os_type>hvm</os_type>
Aug 15 05:25:13 user nova-compute[73391]:     <arch name='ppc64le'>
Aug 15 05:25:13 user nova-compute[73391]:       <wordsize>64</wordsize>
Aug 15 05:25:13 user nova-compute[73391]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2048'>powernv9</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>taihu</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='15'>mpc8544ds</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2048'>powernv10</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='32'>ppce500</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>40p</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>pegasos2</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>bamboo</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>g3beige</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>virtex-ml507</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>mac99</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>sam460ex</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>ref405ep</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2048'>powernv8</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <domain type='qemu'/>
Aug 15 05:25:13 user nova-compute[73391]:     </arch>
Aug 15 05:25:13 user nova-compute[73391]:     <features>
Aug 15 05:25:13 user nova-compute[73391]:       <cpuselection/>
Aug 15 05:25:13 user nova-compute[73391]:       <deviceboot/>
Aug 15 05:25:13 user nova-compute[73391]:       <disksnapshot default='on' toggle='no'/>
Aug 15 05:25:13 user nova-compute[73391]:     </features>
Aug 15 05:25:13 user nova-compute[73391]:   </guest>
Aug 15 05:25:13 user nova-compute[73391]:   <guest>
Aug 15 05:25:13 user nova-compute[73391]:     <os_type>hvm</os_type>
Aug 15 05:25:13 user nova-compute[73391]:     <arch name='riscv32'>
Aug 15 05:25:13 user nova-compute[73391]:       <wordsize>32</wordsize>
Aug 15 05:25:13 user nova-compute[73391]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='8'>spike</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>opentitan</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='5'>sifive_u</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>sifive_e</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='8'>virt</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <domain type='qemu'/>
Aug 15 05:25:13 user nova-compute[73391]:     </arch>
Aug 15 05:25:13 user nova-compute[73391]:     <features>
Aug 15 05:25:13 user nova-compute[73391]:       <cpuselection/>
Aug 15 05:25:13 user nova-compute[73391]:       <deviceboot/>
Aug 15 05:25:13 user nova-compute[73391]:       <disksnapshot default='on' toggle='no'/>
Aug 15 05:25:13 user nova-compute[73391]:     </features>
Aug 15 05:25:13 user nova-compute[73391]:   </guest>
Aug 15 05:25:13 user nova-compute[73391]:   <guest>
Aug 15 05:25:13 user nova-compute[73391]:     <os_type>hvm</os_type>
Aug 15 05:25:13 user nova-compute[73391]:     <arch name='riscv64'>
Aug 15 05:25:13 user nova-compute[73391]:       <wordsize>64</wordsize>
Aug 15 05:25:13 user nova-compute[73391]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='8'>spike</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='5'>sifive_u</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>shakti_c</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>sifive_e</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='8'>virt</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <domain type='qemu'/>
Aug 15 05:25:13 user nova-compute[73391]:     </arch>
Aug 15 05:25:13 user nova-compute[73391]:     <features>
Aug 15 05:25:13 user nova-compute[73391]:       <cpuselection/>
Aug 15 05:25:13 user nova-compute[73391]:       <deviceboot/>
Aug 15 05:25:13 user nova-compute[73391]:       <disksnapshot default='on' toggle='no'/>
Aug 15 05:25:13 user nova-compute[73391]:     </features>
Aug 15 05:25:13 user nova-compute[73391]:   </guest>
Aug 15 05:25:13 user nova-compute[73391]:   <guest>
Aug 15 05:25:13 user nova-compute[73391]:     <os_type>hvm</os_type>
Aug 15 05:25:13 user nova-compute[73391]:     <arch name='s390x'>
Aug 15 05:25:13 user nova-compute[73391]:       <wordsize>64</wordsize>
Aug 15 05:25:13 user nova-compute[73391]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <domain type='qemu'/>
Aug 15 05:25:13 user nova-compute[73391]:     </arch>
Aug 15 05:25:13 user nova-compute[73391]:     <features>
Aug 15 05:25:13 user nova-compute[73391]:       <cpuselection/>
Aug 15 05:25:13 user nova-compute[73391]:       <deviceboot/>
Aug 15 05:25:13 user nova-compute[73391]:       <disksnapshot default='on' toggle='no'/>
Aug 15 05:25:13 user nova-compute[73391]:     </features>
Aug 15 05:25:13 user nova-compute[73391]:   </guest>
Aug 15 05:25:13 user nova-compute[73391]:   <guest>
Aug 15 05:25:13 user nova-compute[73391]:     <os_type>hvm</os_type>
Aug 15 05:25:13 user nova-compute[73391]:     <arch name='sh4'>
Aug 15 05:25:13 user nova-compute[73391]:       <wordsize>32</wordsize>
Aug 15 05:25:13 user nova-compute[73391]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>shix</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>r2d</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <domain type='qemu'/>
Aug 15 05:25:13 user nova-compute[73391]:     </arch>
Aug 15 05:25:13 user nova-compute[73391]:     <features>
Aug 15 05:25:13 user nova-compute[73391]:       <cpuselection/>
Aug 15 05:25:13 user nova-compute[73391]:       <deviceboot/>
Aug 15 05:25:13 user nova-compute[73391]:       <disksnapshot default='on' toggle='no'/>
Aug 15 05:25:13 user nova-compute[73391]:     </features>
Aug 15 05:25:13 user nova-compute[73391]:   </guest>
Aug 15 05:25:13 user nova-compute[73391]:   <guest>
Aug 15 05:25:13 user nova-compute[73391]:     <os_type>hvm</os_type>
Aug 15 05:25:13 user nova-compute[73391]:     <arch name='sh4eb'>
Aug 15 05:25:13 user nova-compute[73391]:       <wordsize>64</wordsize>
Aug 15 05:25:13 user nova-compute[73391]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>shix</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>r2d</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <domain type='qemu'/>
Aug 15 05:25:13 user nova-compute[73391]:     </arch>
Aug 15 05:25:13 user nova-compute[73391]:     <features>
Aug 15 05:25:13 user nova-compute[73391]:       <cpuselection/>
Aug 15 05:25:13 user nova-compute[73391]:       <deviceboot/>
Aug 15 05:25:13 user nova-compute[73391]:       <disksnapshot default='on' toggle='no'/>
Aug 15 05:25:13 user nova-compute[73391]:     </features>
Aug 15 05:25:13 user nova-compute[73391]:   </guest>
Aug 15 05:25:13 user nova-compute[73391]:   <guest>
Aug 15 05:25:13 user nova-compute[73391]:     <os_type>hvm</os_type>
Aug 15 05:25:13 user nova-compute[73391]:     <arch name='sparc'>
Aug 15 05:25:13 user nova-compute[73391]:       <wordsize>32</wordsize>
Aug 15 05:25:13 user nova-compute[73391]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>SS-5</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='4'>SS-20</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>LX</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>SPARCClassic</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>leon3_generic</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>SPARCbook</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>SS-4</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='4'>SS-600MP</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='4'>SS-10</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>Voyager</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <domain type='qemu'/>
Aug 15 05:25:13 user nova-compute[73391]:     </arch>
Aug 15 05:25:13 user nova-compute[73391]:     <features>
Aug 15 05:25:13 user nova-compute[73391]:       <cpuselection/>
Aug 15 05:25:13 user nova-compute[73391]:       <deviceboot/>
Aug 15 05:25:13 user nova-compute[73391]:       <disksnapshot default='on' toggle='no'/>
Aug 15 05:25:13 user nova-compute[73391]:     </features>
Aug 15 05:25:13 user nova-compute[73391]:   </guest>
Aug 15 05:25:13 user nova-compute[73391]:   <guest>
Aug 15 05:25:13 user nova-compute[73391]:     <os_type>hvm</os_type>
Aug 15 05:25:13 user nova-compute[73391]:     <arch name='sparc64'>
Aug 15 05:25:13 user nova-compute[73391]:       <wordsize>64</wordsize>
Aug 15 05:25:13 user nova-compute[73391]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>sun4u</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>niagara</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>sun4v</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <domain type='qemu'/>
Aug 15 05:25:13 user nova-compute[73391]:     </arch>
Aug 15 05:25:13 user nova-compute[73391]:     <features>
Aug 15 05:25:13 user nova-compute[73391]:       <cpuselection/>
Aug 15 05:25:13 user nova-compute[73391]:       <deviceboot/>
Aug 15 05:25:13 user nova-compute[73391]:       <disksnapshot default='on' toggle='no'/>
Aug 15 05:25:13 user nova-compute[73391]:     </features>
Aug 15 05:25:13 user nova-compute[73391]:   </guest>
Aug 15 05:25:13 user nova-compute[73391]:   <guest>
Aug 15 05:25:13 user nova-compute[73391]:     <os_type>hvm</os_type>
Aug 15 05:25:13 user nova-compute[73391]:     <arch name='x86_64'>
Aug 15 05:25:13 user nova-compute[73391]:       <wordsize>64</wordsize>
Aug 15 05:25:13 user nova-compute[73391]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-artful</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>x-remote</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='1'>isapc</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-disco</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-impish</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-focal</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>microvm</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <domain type='qemu'/>
Aug 15 05:25:13 user nova-compute[73391]:       <domain type='kvm'/>
Aug 15 05:25:13 user nova-compute[73391]:     </arch>
Aug 15 05:25:13 user nova-compute[73391]:     <features>
Aug 15 05:25:13 user nova-compute[73391]:       <acpi default='on' toggle='yes'/>
Aug 15 05:25:13 user nova-compute[73391]:       <apic default='on' toggle='no'/>
Aug 15 05:25:13 user nova-compute[73391]:       <cpuselection/>
Aug 15 05:25:13 user nova-compute[73391]:       <deviceboot/>
Aug 15 05:25:13 user nova-compute[73391]:       <disksnapshot default='on' toggle='no'/>
Aug 15 05:25:13 user nova-compute[73391]:     </features>
Aug 15 05:25:13 user nova-compute[73391]:   </guest>
Aug 15 05:25:13 user nova-compute[73391]:   <guest>
Aug 15 05:25:13 user nova-compute[73391]:     <os_type>hvm</os_type>
Aug 15 05:25:13 user nova-compute[73391]:     <arch name='xtensa'>
Aug 15 05:25:13 user nova-compute[73391]:       <wordsize>32</wordsize>
Aug 15 05:25:13 user nova-compute[73391]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='4'>sim</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='32'>kc705</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='32'>ml605</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='32'>virt</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='32'>lx200</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='32'>lx60</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <domain type='qemu'/>
Aug 15 05:25:13 user nova-compute[73391]:     </arch>
Aug 15 05:25:13 user nova-compute[73391]:     <features>
Aug 15 05:25:13 user nova-compute[73391]:       <cpuselection/>
Aug 15 05:25:13 user nova-compute[73391]:       <deviceboot/>
Aug 15 05:25:13 user nova-compute[73391]:       <disksnapshot default='on' toggle='no'/>
Aug 15 05:25:13 user nova-compute[73391]:     </features>
Aug 15 05:25:13 user nova-compute[73391]:   </guest>
Aug 15 05:25:13 user nova-compute[73391]:   <guest>
Aug 15 05:25:13 user nova-compute[73391]:     <os_type>hvm</os_type>
Aug 15 05:25:13 user nova-compute[73391]:     <arch name='xtensaeb'>
Aug 15 05:25:13 user nova-compute[73391]:       <wordsize>32</wordsize>
Aug 15 05:25:13 user nova-compute[73391]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='4'>sim</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='32'>kc705</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='32'>ml605</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='32'>ml605-nommu</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='32'>virt</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='32'>lx60-nommu</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='32'>lx200</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='32'>lx200-nommu</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='32'>lx60</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <machine maxCpus='32'>kc705-nommu</machine>
Aug 15 05:25:13 user nova-compute[73391]:       <domain type='qemu'/>
Aug 15 05:25:13 user nova-compute[73391]:     </arch>
Aug 15 05:25:13 user nova-compute[73391]:     <features>
Aug 15 05:25:13 user nova-compute[73391]:       <cpuselection/>
Aug 15 05:25:13 user nova-compute[73391]:       <deviceboot/>
Aug 15 05:25:13 user nova-compute[73391]:       <disksnapshot default='on' toggle='no'/>
Aug 15 05:25:13 user nova-compute[73391]:     </features>
Aug 15 05:25:13 user nova-compute[73391]:   </guest>
Aug 15 05:25:13 user nova-compute[73391]: </capabilities>
Aug 15 05:25:13 user nova-compute[73391]: 
Aug 15 05:25:13 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=73391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 05:25:13 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=73391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 05:25:13 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=73391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 05:25:13 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 05:25:13 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 05:25:13 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=73391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 05:25:13 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=73391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 05:25:13 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=73391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 05:25:13 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=73391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 05:25:13 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=73391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 05:25:13 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=73391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 05:25:13 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'pc', 'ubuntu-q35', 'q35'} {{(pid=73391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 05:25:13 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Aug 15 05:25:13 user nova-compute[73391]: <domainCapabilities>
Aug 15 05:25:13 user nova-compute[73391]:   <path>/usr/bin/qemu-system-i386</path>
Aug 15 05:25:13 user nova-compute[73391]:   <domain>kvm</domain>
Aug 15 05:25:13 user nova-compute[73391]:   <machine>pc-i440fx-jammy</machine>
Aug 15 05:25:13 user nova-compute[73391]:   <arch>i686</arch>
Aug 15 05:25:13 user nova-compute[73391]:   <vcpu max='255'/>
Aug 15 05:25:13 user nova-compute[73391]:   <iothreads supported='yes'/>
Aug 15 05:25:13 user nova-compute[73391]:   <os supported='yes'>
Aug 15 05:25:13 user nova-compute[73391]:     <enum name='firmware'/>
Aug 15 05:25:13 user nova-compute[73391]:     <loader supported='yes'>
Aug 15 05:25:13 user nova-compute[73391]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 15 05:25:13 user nova-compute[73391]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 15 05:25:13 user nova-compute[73391]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 15 05:25:13 user nova-compute[73391]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 15 05:25:13 user nova-compute[73391]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='type'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>rom</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>pflash</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='readonly'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>yes</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>no</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='secure'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>no</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:     </loader>
Aug 15 05:25:13 user nova-compute[73391]:   </os>
Aug 15 05:25:13 user nova-compute[73391]:   <cpu>
Aug 15 05:25:13 user nova-compute[73391]:     <mode name='host-passthrough' supported='yes'>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='hostPassthroughMigratable'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>off</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:     </mode>
Aug 15 05:25:13 user nova-compute[73391]:     <mode name='maximum' supported='yes'>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='maximumMigratable'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>on</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>off</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:     </mode>
Aug 15 05:25:13 user nova-compute[73391]:     <mode name='host-model' supported='yes'>
Aug 15 05:25:13 user nova-compute[73391]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 05:25:13 user nova-compute[73391]:       <vendor>Intel</vendor>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='ss'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='vmx'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='pcid'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='hypervisor'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='arat'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='umip'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='md-clear'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='stibp'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='ssbd'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='ibpb'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='ibrs'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='amd-stibp'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='disable' name='erms'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='disable' name='lm'/>
Aug 15 05:25:13 user nova-compute[73391]:     </mode>
Aug 15 05:25:13 user nova-compute[73391]:     <mode name='custom' supported='yes'>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>qemu64</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='yes'>qemu32</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>phenom</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='yes'>pentium3</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='yes'>pentium2</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='yes'>pentium</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>n270</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>kvm64</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='yes'>kvm32</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='yes'>coreduo</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>core2duo</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>athlon</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Westmere-IBRS</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Westmere</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Snowridge</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Skylake-Server</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Skylake-Client</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>SandyBridge</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Penryn</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Opteron_G5</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Opteron_G4</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Opteron_G3</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Opteron_G2</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Opteron_G1</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Nehalem-IBRS</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Nehalem</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>IvyBridge</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Icelake-Server</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Haswell</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>EPYC-Rome</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>EPYC-Milan</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>EPYC</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Dhyana</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Cooperlake</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Conroe</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Broadwell</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='yes'>486</model>
Aug 15 05:25:13 user nova-compute[73391]:     </mode>
Aug 15 05:25:13 user nova-compute[73391]:   </cpu>
Aug 15 05:25:13 user nova-compute[73391]:   <memoryBacking supported='yes'>
Aug 15 05:25:13 user nova-compute[73391]:     <enum name='sourceType'>
Aug 15 05:25:13 user nova-compute[73391]:       <value>file</value>
Aug 15 05:25:13 user nova-compute[73391]:       <value>anonymous</value>
Aug 15 05:25:13 user nova-compute[73391]:       <value>memfd</value>
Aug 15 05:25:13 user nova-compute[73391]:     </enum>
Aug 15 05:25:13 user nova-compute[73391]:   </memoryBacking>
Aug 15 05:25:13 user nova-compute[73391]:   <devices>
Aug 15 05:25:13 user nova-compute[73391]:     <disk supported='yes'>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='diskDevice'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>disk</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>cdrom</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>floppy</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>lun</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='bus'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>ide</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>fdc</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>scsi</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>virtio</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>usb</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>sata</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='model'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>virtio</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>virtio-transitional</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>virtio-non-transitional</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:     </disk>
Aug 15 05:25:13 user nova-compute[73391]:     <graphics supported='yes'>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='type'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>sdl</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>vnc</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>spice</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>egl-headless</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:     </graphics>
Aug 15 05:25:13 user nova-compute[73391]:     <video supported='yes'>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='modelType'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>vga</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>cirrus</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>vmvga</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>qxl</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>virtio</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>none</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>bochs</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>ramfb</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:     </video>
Aug 15 05:25:13 user nova-compute[73391]:     <hostdev supported='yes'>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='mode'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>subsystem</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='startupPolicy'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>default</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>mandatory</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>requisite</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>optional</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='subsysType'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>usb</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>pci</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>scsi</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='capsType'/>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='pciBackend'/>
Aug 15 05:25:13 user nova-compute[73391]:     </hostdev>
Aug 15 05:25:13 user nova-compute[73391]:     <rng supported='yes'>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='model'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>virtio</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>virtio-transitional</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>virtio-non-transitional</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='backendModel'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>random</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>egd</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>builtin</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:     </rng>
Aug 15 05:25:13 user nova-compute[73391]:     <filesystem supported='yes'>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='driverType'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>path</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>handle</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>virtiofs</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:     </filesystem>
Aug 15 05:25:13 user nova-compute[73391]:     <tpm supported='yes'>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='model'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>tpm-tis</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>tpm-crb</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='backendModel'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>passthrough</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>emulator</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:     </tpm>
Aug 15 05:25:13 user nova-compute[73391]:   </devices>
Aug 15 05:25:13 user nova-compute[73391]:   <features>
Aug 15 05:25:13 user nova-compute[73391]:     <gic supported='no'/>
Aug 15 05:25:13 user nova-compute[73391]:     <vmcoreinfo supported='yes'/>
Aug 15 05:25:13 user nova-compute[73391]:     <genid supported='yes'/>
Aug 15 05:25:13 user nova-compute[73391]:     <backingStoreInput supported='yes'/>
Aug 15 05:25:13 user nova-compute[73391]:     <backup supported='yes'/>
Aug 15 05:25:13 user nova-compute[73391]:     <sev supported='no'/>
Aug 15 05:25:13 user nova-compute[73391]:   </features>
Aug 15 05:25:13 user nova-compute[73391]: </domainCapabilities>
Aug 15 05:25:13 user nova-compute[73391]:  {{(pid=73391) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 05:25:13 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Aug 15 05:25:13 user nova-compute[73391]: <domainCapabilities>
Aug 15 05:25:13 user nova-compute[73391]:   <path>/usr/bin/qemu-system-i386</path>
Aug 15 05:25:13 user nova-compute[73391]:   <domain>kvm</domain>
Aug 15 05:25:13 user nova-compute[73391]:   <machine>pc-i440fx-6.2</machine>
Aug 15 05:25:13 user nova-compute[73391]:   <arch>i686</arch>
Aug 15 05:25:13 user nova-compute[73391]:   <vcpu max='255'/>
Aug 15 05:25:13 user nova-compute[73391]:   <iothreads supported='yes'/>
Aug 15 05:25:13 user nova-compute[73391]:   <os supported='yes'>
Aug 15 05:25:13 user nova-compute[73391]:     <enum name='firmware'/>
Aug 15 05:25:13 user nova-compute[73391]:     <loader supported='yes'>
Aug 15 05:25:13 user nova-compute[73391]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 15 05:25:13 user nova-compute[73391]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 15 05:25:13 user nova-compute[73391]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 15 05:25:13 user nova-compute[73391]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 15 05:25:13 user nova-compute[73391]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='type'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>rom</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>pflash</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='readonly'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>yes</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>no</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='secure'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>no</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:     </loader>
Aug 15 05:25:13 user nova-compute[73391]:   </os>
Aug 15 05:25:13 user nova-compute[73391]:   <cpu>
Aug 15 05:25:13 user nova-compute[73391]:     <mode name='host-passthrough' supported='yes'>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='hostPassthroughMigratable'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>off</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:     </mode>
Aug 15 05:25:13 user nova-compute[73391]:     <mode name='maximum' supported='yes'>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='maximumMigratable'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>on</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>off</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:     </mode>
Aug 15 05:25:13 user nova-compute[73391]:     <mode name='host-model' supported='yes'>
Aug 15 05:25:13 user nova-compute[73391]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 05:25:13 user nova-compute[73391]:       <vendor>Intel</vendor>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='ss'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='vmx'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='pcid'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='hypervisor'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='arat'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='umip'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='md-clear'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='stibp'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='ssbd'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='ibpb'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='ibrs'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='amd-stibp'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='disable' name='erms'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='disable' name='lm'/>
Aug 15 05:25:13 user nova-compute[73391]:     </mode>
Aug 15 05:25:13 user nova-compute[73391]:     <mode name='custom' supported='yes'>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>qemu64</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='yes'>qemu32</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>phenom</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='yes'>pentium3</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='yes'>pentium2</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='yes'>pentium</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>n270</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>kvm64</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='yes'>kvm32</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='yes'>coreduo</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>core2duo</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>athlon</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Westmere-IBRS</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Westmere</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Snowridge</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Skylake-Server</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Skylake-Client</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>SandyBridge</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Penryn</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Opteron_G5</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Opteron_G4</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Opteron_G3</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Opteron_G2</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Opteron_G1</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Nehalem-IBRS</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Nehalem</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>IvyBridge</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Icelake-Server</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Haswell</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>EPYC-Rome</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>EPYC-Milan</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>EPYC</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Dhyana</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Cooperlake</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Conroe</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Broadwell</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='yes'>486</model>
Aug 15 05:25:13 user nova-compute[73391]:     </mode>
Aug 15 05:25:13 user nova-compute[73391]:   </cpu>
Aug 15 05:25:13 user nova-compute[73391]:   <memoryBacking supported='yes'>
Aug 15 05:25:13 user nova-compute[73391]:     <enum name='sourceType'>
Aug 15 05:25:13 user nova-compute[73391]:       <value>file</value>
Aug 15 05:25:13 user nova-compute[73391]:       <value>anonymous</value>
Aug 15 05:25:13 user nova-compute[73391]:       <value>memfd</value>
Aug 15 05:25:13 user nova-compute[73391]:     </enum>
Aug 15 05:25:13 user nova-compute[73391]:   </memoryBacking>
Aug 15 05:25:13 user nova-compute[73391]:   <devices>
Aug 15 05:25:13 user nova-compute[73391]:     <disk supported='yes'>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='diskDevice'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>disk</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>cdrom</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>floppy</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>lun</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='bus'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>ide</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>fdc</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>scsi</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>virtio</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>usb</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>sata</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='model'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>virtio</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>virtio-transitional</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>virtio-non-transitional</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:     </disk>
Aug 15 05:25:13 user nova-compute[73391]:     <graphics supported='yes'>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='type'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>sdl</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>vnc</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>spice</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>egl-headless</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:     </graphics>
Aug 15 05:25:13 user nova-compute[73391]:     <video supported='yes'>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='modelType'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>vga</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>cirrus</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>vmvga</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>qxl</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>virtio</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>none</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>bochs</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>ramfb</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:     </video>
Aug 15 05:25:13 user nova-compute[73391]:     <hostdev supported='yes'>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='mode'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>subsystem</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='startupPolicy'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>default</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>mandatory</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>requisite</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>optional</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='subsysType'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>usb</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>pci</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>scsi</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='capsType'/>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='pciBackend'/>
Aug 15 05:25:13 user nova-compute[73391]:     </hostdev>
Aug 15 05:25:13 user nova-compute[73391]:     <rng supported='yes'>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='model'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>virtio</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>virtio-transitional</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>virtio-non-transitional</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='backendModel'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>random</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>egd</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>builtin</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:     </rng>
Aug 15 05:25:13 user nova-compute[73391]:     <filesystem supported='yes'>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='driverType'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>path</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>handle</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>virtiofs</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:     </filesystem>
Aug 15 05:25:13 user nova-compute[73391]:     <tpm supported='yes'>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='model'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>tpm-tis</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>tpm-crb</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='backendModel'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>passthrough</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>emulator</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:     </tpm>
Aug 15 05:25:13 user nova-compute[73391]:   </devices>
Aug 15 05:25:13 user nova-compute[73391]:   <features>
Aug 15 05:25:13 user nova-compute[73391]:     <gic supported='no'/>
Aug 15 05:25:13 user nova-compute[73391]:     <vmcoreinfo supported='yes'/>
Aug 15 05:25:13 user nova-compute[73391]:     <genid supported='yes'/>
Aug 15 05:25:13 user nova-compute[73391]:     <backingStoreInput supported='yes'/>
Aug 15 05:25:13 user nova-compute[73391]:     <backup supported='yes'/>
Aug 15 05:25:13 user nova-compute[73391]:     <sev supported='no'/>
Aug 15 05:25:13 user nova-compute[73391]:   </features>
Aug 15 05:25:13 user nova-compute[73391]: </domainCapabilities>
Aug 15 05:25:13 user nova-compute[73391]:  {{(pid=73391) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 05:25:13 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Aug 15 05:25:13 user nova-compute[73391]: <domainCapabilities>
Aug 15 05:25:13 user nova-compute[73391]:   <path>/usr/bin/qemu-system-i386</path>
Aug 15 05:25:13 user nova-compute[73391]:   <domain>kvm</domain>
Aug 15 05:25:13 user nova-compute[73391]:   <machine>pc-q35-jammy</machine>
Aug 15 05:25:13 user nova-compute[73391]:   <arch>i686</arch>
Aug 15 05:25:13 user nova-compute[73391]:   <vcpu max='288'/>
Aug 15 05:25:13 user nova-compute[73391]:   <iothreads supported='yes'/>
Aug 15 05:25:13 user nova-compute[73391]:   <os supported='yes'>
Aug 15 05:25:13 user nova-compute[73391]:     <enum name='firmware'/>
Aug 15 05:25:13 user nova-compute[73391]:     <loader supported='yes'>
Aug 15 05:25:13 user nova-compute[73391]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 15 05:25:13 user nova-compute[73391]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 15 05:25:13 user nova-compute[73391]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 15 05:25:13 user nova-compute[73391]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 15 05:25:13 user nova-compute[73391]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='type'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>rom</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>pflash</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='readonly'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>yes</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>no</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='secure'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>no</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:     </loader>
Aug 15 05:25:13 user nova-compute[73391]:   </os>
Aug 15 05:25:13 user nova-compute[73391]:   <cpu>
Aug 15 05:25:13 user nova-compute[73391]:     <mode name='host-passthrough' supported='yes'>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='hostPassthroughMigratable'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>off</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:     </mode>
Aug 15 05:25:13 user nova-compute[73391]:     <mode name='maximum' supported='yes'>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='maximumMigratable'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>on</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>off</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:     </mode>
Aug 15 05:25:13 user nova-compute[73391]:     <mode name='host-model' supported='yes'>
Aug 15 05:25:13 user nova-compute[73391]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 05:25:13 user nova-compute[73391]:       <vendor>Intel</vendor>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='ss'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='vmx'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='pcid'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='hypervisor'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='arat'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='umip'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='md-clear'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='stibp'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='ssbd'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='ibpb'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='ibrs'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='amd-stibp'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='disable' name='erms'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='disable' name='lm'/>
Aug 15 05:25:13 user nova-compute[73391]:     </mode>
Aug 15 05:25:13 user nova-compute[73391]:     <mode name='custom' supported='yes'>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>qemu64</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='yes'>qemu32</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>phenom</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='yes'>pentium3</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='yes'>pentium2</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='yes'>pentium</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>n270</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>kvm64</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='yes'>kvm32</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='yes'>coreduo</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>core2duo</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>athlon</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Westmere-IBRS</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Westmere</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Snowridge</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Skylake-Server</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Skylake-Client</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>SandyBridge</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Penryn</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Opteron_G5</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Opteron_G4</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Opteron_G3</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Opteron_G2</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Opteron_G1</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Nehalem-IBRS</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Nehalem</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>IvyBridge</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Icelake-Server</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Haswell</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>EPYC-Rome</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>EPYC-Milan</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>EPYC</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Dhyana</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Cooperlake</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Conroe</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>Broadwell</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='yes'>486</model>
Aug 15 05:25:13 user nova-compute[73391]:     </mode>
Aug 15 05:25:13 user nova-compute[73391]:   </cpu>
Aug 15 05:25:13 user nova-compute[73391]:   <memoryBacking supported='yes'>
Aug 15 05:25:13 user nova-compute[73391]:     <enum name='sourceType'>
Aug 15 05:25:13 user nova-compute[73391]:       <value>file</value>
Aug 15 05:25:13 user nova-compute[73391]:       <value>anonymous</value>
Aug 15 05:25:13 user nova-compute[73391]:       <value>memfd</value>
Aug 15 05:25:13 user nova-compute[73391]:     </enum>
Aug 15 05:25:13 user nova-compute[73391]:   </memoryBacking>
Aug 15 05:25:13 user nova-compute[73391]:   <devices>
Aug 15 05:25:13 user nova-compute[73391]:     <disk supported='yes'>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='diskDevice'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>disk</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>cdrom</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>floppy</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>lun</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='bus'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>fdc</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>scsi</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>virtio</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>usb</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>sata</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='model'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>virtio</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>virtio-transitional</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>virtio-non-transitional</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:     </disk>
Aug 15 05:25:13 user nova-compute[73391]:     <graphics supported='yes'>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='type'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>sdl</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>vnc</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>spice</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>egl-headless</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:     </graphics>
Aug 15 05:25:13 user nova-compute[73391]:     <video supported='yes'>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='modelType'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>vga</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>cirrus</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>vmvga</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>qxl</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>virtio</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>none</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>bochs</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>ramfb</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:     </video>
Aug 15 05:25:13 user nova-compute[73391]:     <hostdev supported='yes'>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='mode'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>subsystem</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='startupPolicy'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>default</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>mandatory</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>requisite</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>optional</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='subsysType'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>usb</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>pci</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>scsi</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='capsType'/>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='pciBackend'/>
Aug 15 05:25:13 user nova-compute[73391]:     </hostdev>
Aug 15 05:25:13 user nova-compute[73391]:     <rng supported='yes'>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='model'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>virtio</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>virtio-transitional</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>virtio-non-transitional</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='backendModel'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>random</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>egd</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>builtin</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:     </rng>
Aug 15 05:25:13 user nova-compute[73391]:     <filesystem supported='yes'>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='driverType'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>path</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>handle</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>virtiofs</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:     </filesystem>
Aug 15 05:25:13 user nova-compute[73391]:     <tpm supported='yes'>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='model'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>tpm-tis</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>tpm-crb</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='backendModel'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>passthrough</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>emulator</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:     </tpm>
Aug 15 05:25:13 user nova-compute[73391]:   </devices>
Aug 15 05:25:13 user nova-compute[73391]:   <features>
Aug 15 05:25:13 user nova-compute[73391]:     <gic supported='no'/>
Aug 15 05:25:13 user nova-compute[73391]:     <vmcoreinfo supported='yes'/>
Aug 15 05:25:13 user nova-compute[73391]:     <genid supported='yes'/>
Aug 15 05:25:13 user nova-compute[73391]:     <backingStoreInput supported='yes'/>
Aug 15 05:25:13 user nova-compute[73391]:     <backup supported='yes'/>
Aug 15 05:25:13 user nova-compute[73391]:     <sev supported='no'/>
Aug 15 05:25:13 user nova-compute[73391]:   </features>
Aug 15 05:25:13 user nova-compute[73391]: </domainCapabilities>
Aug 15 05:25:13 user nova-compute[73391]:  {{(pid=73391) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 05:25:13 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Aug 15 05:25:13 user nova-compute[73391]: <domainCapabilities>
Aug 15 05:25:13 user nova-compute[73391]:   <path>/usr/bin/qemu-system-i386</path>
Aug 15 05:25:13 user nova-compute[73391]:   <domain>kvm</domain>
Aug 15 05:25:13 user nova-compute[73391]:   <machine>pc-q35-6.2</machine>
Aug 15 05:25:13 user nova-compute[73391]:   <arch>i686</arch>
Aug 15 05:25:13 user nova-compute[73391]:   <vcpu max='288'/>
Aug 15 05:25:13 user nova-compute[73391]:   <iothreads supported='yes'/>
Aug 15 05:25:13 user nova-compute[73391]:   <os supported='yes'>
Aug 15 05:25:13 user nova-compute[73391]:     <enum name='firmware'/>
Aug 15 05:25:13 user nova-compute[73391]:     <loader supported='yes'>
Aug 15 05:25:13 user nova-compute[73391]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Aug 15 05:25:13 user nova-compute[73391]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Aug 15 05:25:13 user nova-compute[73391]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Aug 15 05:25:13 user nova-compute[73391]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Aug 15 05:25:13 user nova-compute[73391]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='type'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>rom</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>pflash</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='readonly'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>yes</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>no</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='secure'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>no</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:     </loader>
Aug 15 05:25:13 user nova-compute[73391]:   </os>
Aug 15 05:25:13 user nova-compute[73391]:   <cpu>
Aug 15 05:25:13 user nova-compute[73391]:     <mode name='host-passthrough' supported='yes'>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='hostPassthroughMigratable'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>off</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:     </mode>
Aug 15 05:25:13 user nova-compute[73391]:     <mode name='maximum' supported='yes'>
Aug 15 05:25:13 user nova-compute[73391]:       <enum name='maximumMigratable'>
Aug 15 05:25:13 user nova-compute[73391]:         <value>on</value>
Aug 15 05:25:13 user nova-compute[73391]:         <value>off</value>
Aug 15 05:25:13 user nova-compute[73391]:       </enum>
Aug 15 05:25:13 user nova-compute[73391]:     </mode>
Aug 15 05:25:13 user nova-compute[73391]:     <mode name='host-model' supported='yes'>
Aug 15 05:25:13 user nova-compute[73391]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 05:25:13 user nova-compute[73391]:       <vendor>Intel</vendor>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='ss'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='vmx'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='pcid'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='hypervisor'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='arat'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='umip'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='md-clear'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='stibp'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='ssbd'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='ibpb'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='ibrs'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='amd-stibp'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='disable' name='erms'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 05:25:13 user nova-compute[73391]:       <feature policy='disable' name='lm'/>
Aug 15 05:25:13 user nova-compute[73391]:     </mode>
Aug 15 05:25:13 user nova-compute[73391]:     <mode name='custom' supported='yes'>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>qemu64</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='yes'>qemu32</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>phenom</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='yes'>pentium3</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='yes'>pentium2</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='yes'>pentium</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>n270</model>
Aug 15 05:25:13 user nova-compute[73391]:       <model usable='no'>kvm64</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>kvm32</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>coreduo</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>core2duo</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>athlon</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Westmere-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Westmere</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Snowridge</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Skylake-Server</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Skylake-Client</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>SandyBridge</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Penryn</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Opteron_G5</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Opteron_G4</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Opteron_G3</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Opteron_G2</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Opteron_G1</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Nehalem-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Nehalem</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>IvyBridge</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Icelake-Server</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Haswell</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>EPYC-Rome</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>EPYC-Milan</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>EPYC</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Dhyana</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Cooperlake</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Conroe</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Broadwell</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>486</model>
Aug 15 05:25:14 user nova-compute[73391]:     </mode>
Aug 15 05:25:14 user nova-compute[73391]:   </cpu>
Aug 15 05:25:14 user nova-compute[73391]:   <memoryBacking supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:     <enum name='sourceType'>
Aug 15 05:25:14 user nova-compute[73391]:       <value>file</value>
Aug 15 05:25:14 user nova-compute[73391]:       <value>anonymous</value>
Aug 15 05:25:14 user nova-compute[73391]:       <value>memfd</value>
Aug 15 05:25:14 user nova-compute[73391]:     </enum>
Aug 15 05:25:14 user nova-compute[73391]:   </memoryBacking>
Aug 15 05:25:14 user nova-compute[73391]:   <devices>
Aug 15 05:25:14 user nova-compute[73391]:     <disk supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='diskDevice'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>disk</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>cdrom</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>floppy</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>lun</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='bus'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>fdc</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>scsi</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>virtio</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>usb</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>sata</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='model'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>virtio</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>virtio-transitional</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>virtio-non-transitional</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:     </disk>
Aug 15 05:25:14 user nova-compute[73391]:     <graphics supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='type'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>sdl</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>vnc</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>spice</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>egl-headless</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:     </graphics>
Aug 15 05:25:14 user nova-compute[73391]:     <video supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='modelType'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>vga</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>cirrus</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>vmvga</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>qxl</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>virtio</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>none</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>bochs</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>ramfb</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:     </video>
Aug 15 05:25:14 user nova-compute[73391]:     <hostdev supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='mode'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>subsystem</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='startupPolicy'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>default</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>mandatory</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>requisite</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>optional</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='subsysType'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>usb</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>pci</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>scsi</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='capsType'/>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='pciBackend'/>
Aug 15 05:25:14 user nova-compute[73391]:     </hostdev>
Aug 15 05:25:14 user nova-compute[73391]:     <rng supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='model'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>virtio</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>virtio-transitional</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>virtio-non-transitional</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='backendModel'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>random</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>egd</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>builtin</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:     </rng>
Aug 15 05:25:14 user nova-compute[73391]:     <filesystem supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='driverType'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>path</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>handle</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>virtiofs</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:     </filesystem>
Aug 15 05:25:14 user nova-compute[73391]:     <tpm supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='model'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>tpm-tis</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>tpm-crb</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='backendModel'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>passthrough</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>emulator</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:     </tpm>
Aug 15 05:25:14 user nova-compute[73391]:   </devices>
Aug 15 05:25:14 user nova-compute[73391]:   <features>
Aug 15 05:25:14 user nova-compute[73391]:     <gic supported='no'/>
Aug 15 05:25:14 user nova-compute[73391]:     <vmcoreinfo supported='yes'/>
Aug 15 05:25:14 user nova-compute[73391]:     <genid supported='yes'/>
Aug 15 05:25:14 user nova-compute[73391]:     <backingStoreInput supported='yes'/>
Aug 15 05:25:14 user nova-compute[73391]:     <backup supported='yes'/>
Aug 15 05:25:14 user nova-compute[73391]:     <sev supported='no'/>
Aug 15 05:25:14 user nova-compute[73391]:   </features>
Aug 15 05:25:14 user nova-compute[73391]: </domainCapabilities>
Aug 15 05:25:14 user nova-compute[73391]:  {{(pid=73391) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=73391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=73391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=73391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=73391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=73391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=73391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=73391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=73391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=73391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=73391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=73391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=73391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=73391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=73391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=73391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=73391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=73391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=73391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=73391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=73391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=73391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=73391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=73391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=73391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=73391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=73391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=73391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=73391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=73391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=73391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=73391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=73391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=73391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=73391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'pc', 'ubuntu-q35', 'q35'} {{(pid=73391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Aug 15 05:25:14 user nova-compute[73391]: <domainCapabilities>
Aug 15 05:25:14 user nova-compute[73391]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 15 05:25:14 user nova-compute[73391]:   <domain>kvm</domain>
Aug 15 05:25:14 user nova-compute[73391]:   <machine>pc-i440fx-jammy</machine>
Aug 15 05:25:14 user nova-compute[73391]:   <arch>x86_64</arch>
Aug 15 05:25:14 user nova-compute[73391]:   <vcpu max='255'/>
Aug 15 05:25:14 user nova-compute[73391]:   <iothreads supported='yes'/>
Aug 15 05:25:14 user nova-compute[73391]:   <os supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:     <enum name='firmware'>
Aug 15 05:25:14 user nova-compute[73391]:       <value>efi</value>
Aug 15 05:25:14 user nova-compute[73391]:     </enum>
Aug 15 05:25:14 user nova-compute[73391]:     <loader supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='type'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>rom</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>pflash</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='readonly'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>yes</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>no</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='secure'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>no</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:     </loader>
Aug 15 05:25:14 user nova-compute[73391]:   </os>
Aug 15 05:25:14 user nova-compute[73391]:   <cpu>
Aug 15 05:25:14 user nova-compute[73391]:     <mode name='host-passthrough' supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='hostPassthroughMigratable'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>on</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>off</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:     </mode>
Aug 15 05:25:14 user nova-compute[73391]:     <mode name='maximum' supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='maximumMigratable'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>on</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>off</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:     </mode>
Aug 15 05:25:14 user nova-compute[73391]:     <mode name='host-model' supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <vendor>Intel</vendor>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='ss'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='vmx'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='pcid'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='hypervisor'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='arat'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='umip'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='md-clear'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='stibp'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='ssbd'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='invtsc'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='ibpb'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='ibrs'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='amd-stibp'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='rsba'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='pschange-mc-no'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='disable' name='erms'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 05:25:14 user nova-compute[73391]:     </mode>
Aug 15 05:25:14 user nova-compute[73391]:     <mode name='custom' supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>qemu64</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>qemu32</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>phenom</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>pentium3</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>pentium2</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>pentium</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>n270</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>kvm64</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>kvm32</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>coreduo</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>core2duo</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>athlon</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>Westmere-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>Westmere</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Snowridge</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Skylake-Server</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Skylake-Client</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>SandyBridge</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>Penryn</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Opteron_G5</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Opteron_G4</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Opteron_G3</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Opteron_G2</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>Opteron_G1</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>Nehalem</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>IvyBridge</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Icelake-Server</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Haswell</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>EPYC-Rome</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>EPYC-Milan</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>EPYC</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Dhyana</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Cooperlake</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>Conroe</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Broadwell</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>486</model>
Aug 15 05:25:14 user nova-compute[73391]:     </mode>
Aug 15 05:25:14 user nova-compute[73391]:   </cpu>
Aug 15 05:25:14 user nova-compute[73391]:   <memoryBacking supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:     <enum name='sourceType'>
Aug 15 05:25:14 user nova-compute[73391]:       <value>file</value>
Aug 15 05:25:14 user nova-compute[73391]:       <value>anonymous</value>
Aug 15 05:25:14 user nova-compute[73391]:       <value>memfd</value>
Aug 15 05:25:14 user nova-compute[73391]:     </enum>
Aug 15 05:25:14 user nova-compute[73391]:   </memoryBacking>
Aug 15 05:25:14 user nova-compute[73391]:   <devices>
Aug 15 05:25:14 user nova-compute[73391]:     <disk supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='diskDevice'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>disk</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>cdrom</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>floppy</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>lun</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='bus'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>ide</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>fdc</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>scsi</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>virtio</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>usb</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>sata</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='model'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>virtio</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>virtio-transitional</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>virtio-non-transitional</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:     </disk>
Aug 15 05:25:14 user nova-compute[73391]:     <graphics supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='type'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>sdl</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>vnc</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>spice</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>egl-headless</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:     </graphics>
Aug 15 05:25:14 user nova-compute[73391]:     <video supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='modelType'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>vga</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>cirrus</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>vmvga</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>qxl</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>virtio</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>none</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>bochs</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>ramfb</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:     </video>
Aug 15 05:25:14 user nova-compute[73391]:     <hostdev supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='mode'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>subsystem</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='startupPolicy'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>default</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>mandatory</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>requisite</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>optional</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='subsysType'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>usb</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>pci</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>scsi</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='capsType'/>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='pciBackend'/>
Aug 15 05:25:14 user nova-compute[73391]:     </hostdev>
Aug 15 05:25:14 user nova-compute[73391]:     <rng supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='model'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>virtio</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>virtio-transitional</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>virtio-non-transitional</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='backendModel'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>random</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>egd</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>builtin</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:     </rng>
Aug 15 05:25:14 user nova-compute[73391]:     <filesystem supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='driverType'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>path</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>handle</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>virtiofs</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:     </filesystem>
Aug 15 05:25:14 user nova-compute[73391]:     <tpm supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='model'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>tpm-tis</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>tpm-crb</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='backendModel'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>passthrough</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>emulator</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:     </tpm>
Aug 15 05:25:14 user nova-compute[73391]:   </devices>
Aug 15 05:25:14 user nova-compute[73391]:   <features>
Aug 15 05:25:14 user nova-compute[73391]:     <gic supported='no'/>
Aug 15 05:25:14 user nova-compute[73391]:     <vmcoreinfo supported='yes'/>
Aug 15 05:25:14 user nova-compute[73391]:     <genid supported='yes'/>
Aug 15 05:25:14 user nova-compute[73391]:     <backingStoreInput supported='yes'/>
Aug 15 05:25:14 user nova-compute[73391]:     <backup supported='yes'/>
Aug 15 05:25:14 user nova-compute[73391]:     <sev supported='no'/>
Aug 15 05:25:14 user nova-compute[73391]:   </features>
Aug 15 05:25:14 user nova-compute[73391]: </domainCapabilities>
Aug 15 05:25:14 user nova-compute[73391]:  {{(pid=73391) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Aug 15 05:25:14 user nova-compute[73391]: <domainCapabilities>
Aug 15 05:25:14 user nova-compute[73391]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 15 05:25:14 user nova-compute[73391]:   <domain>kvm</domain>
Aug 15 05:25:14 user nova-compute[73391]:   <machine>pc-i440fx-6.2</machine>
Aug 15 05:25:14 user nova-compute[73391]:   <arch>x86_64</arch>
Aug 15 05:25:14 user nova-compute[73391]:   <vcpu max='255'/>
Aug 15 05:25:14 user nova-compute[73391]:   <iothreads supported='yes'/>
Aug 15 05:25:14 user nova-compute[73391]:   <os supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:     <enum name='firmware'>
Aug 15 05:25:14 user nova-compute[73391]:       <value>efi</value>
Aug 15 05:25:14 user nova-compute[73391]:     </enum>
Aug 15 05:25:14 user nova-compute[73391]:     <loader supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='type'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>rom</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>pflash</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='readonly'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>yes</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>no</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='secure'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>no</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:     </loader>
Aug 15 05:25:14 user nova-compute[73391]:   </os>
Aug 15 05:25:14 user nova-compute[73391]:   <cpu>
Aug 15 05:25:14 user nova-compute[73391]:     <mode name='host-passthrough' supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='hostPassthroughMigratable'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>on</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>off</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:     </mode>
Aug 15 05:25:14 user nova-compute[73391]:     <mode name='maximum' supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='maximumMigratable'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>on</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>off</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:     </mode>
Aug 15 05:25:14 user nova-compute[73391]:     <mode name='host-model' supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <vendor>Intel</vendor>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='ss'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='vmx'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='pcid'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='hypervisor'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='arat'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='umip'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='md-clear'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='stibp'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='ssbd'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='invtsc'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='ibpb'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='ibrs'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='amd-stibp'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='rsba'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='pschange-mc-no'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='disable' name='erms'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 05:25:14 user nova-compute[73391]:     </mode>
Aug 15 05:25:14 user nova-compute[73391]:     <mode name='custom' supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>qemu64</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>qemu32</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>phenom</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>pentium3</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>pentium2</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>pentium</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>n270</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>kvm64</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>kvm32</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>coreduo</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>core2duo</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>athlon</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>Westmere-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>Westmere</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Snowridge</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Skylake-Server</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Skylake-Client</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>SandyBridge</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>Penryn</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Opteron_G5</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Opteron_G4</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Opteron_G3</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Opteron_G2</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>Opteron_G1</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>Nehalem</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>IvyBridge</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Icelake-Server</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Haswell</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>EPYC-Rome</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>EPYC-Milan</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>EPYC</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Dhyana</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Cooperlake</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>Conroe</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Broadwell</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>486</model>
Aug 15 05:25:14 user nova-compute[73391]:     </mode>
Aug 15 05:25:14 user nova-compute[73391]:   </cpu>
Aug 15 05:25:14 user nova-compute[73391]:   <memoryBacking supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:     <enum name='sourceType'>
Aug 15 05:25:14 user nova-compute[73391]:       <value>file</value>
Aug 15 05:25:14 user nova-compute[73391]:       <value>anonymous</value>
Aug 15 05:25:14 user nova-compute[73391]:       <value>memfd</value>
Aug 15 05:25:14 user nova-compute[73391]:     </enum>
Aug 15 05:25:14 user nova-compute[73391]:   </memoryBacking>
Aug 15 05:25:14 user nova-compute[73391]:   <devices>
Aug 15 05:25:14 user nova-compute[73391]:     <disk supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='diskDevice'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>disk</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>cdrom</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>floppy</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>lun</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='bus'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>ide</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>fdc</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>scsi</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>virtio</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>usb</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>sata</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='model'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>virtio</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>virtio-transitional</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>virtio-non-transitional</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:     </disk>
Aug 15 05:25:14 user nova-compute[73391]:     <graphics supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='type'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>sdl</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>vnc</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>spice</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>egl-headless</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:     </graphics>
Aug 15 05:25:14 user nova-compute[73391]:     <video supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='modelType'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>vga</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>cirrus</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>vmvga</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>qxl</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>virtio</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>none</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>bochs</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>ramfb</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:     </video>
Aug 15 05:25:14 user nova-compute[73391]:     <hostdev supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='mode'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>subsystem</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='startupPolicy'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>default</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>mandatory</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>requisite</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>optional</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='subsysType'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>usb</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>pci</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>scsi</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='capsType'/>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='pciBackend'/>
Aug 15 05:25:14 user nova-compute[73391]:     </hostdev>
Aug 15 05:25:14 user nova-compute[73391]:     <rng supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='model'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>virtio</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>virtio-transitional</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>virtio-non-transitional</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='backendModel'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>random</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>egd</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>builtin</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:     </rng>
Aug 15 05:25:14 user nova-compute[73391]:     <filesystem supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='driverType'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>path</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>handle</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>virtiofs</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:     </filesystem>
Aug 15 05:25:14 user nova-compute[73391]:     <tpm supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='model'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>tpm-tis</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>tpm-crb</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='backendModel'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>passthrough</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>emulator</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:     </tpm>
Aug 15 05:25:14 user nova-compute[73391]:   </devices>
Aug 15 05:25:14 user nova-compute[73391]:   <features>
Aug 15 05:25:14 user nova-compute[73391]:     <gic supported='no'/>
Aug 15 05:25:14 user nova-compute[73391]:     <vmcoreinfo supported='yes'/>
Aug 15 05:25:14 user nova-compute[73391]:     <genid supported='yes'/>
Aug 15 05:25:14 user nova-compute[73391]:     <backingStoreInput supported='yes'/>
Aug 15 05:25:14 user nova-compute[73391]:     <backup supported='yes'/>
Aug 15 05:25:14 user nova-compute[73391]:     <sev supported='no'/>
Aug 15 05:25:14 user nova-compute[73391]:   </features>
Aug 15 05:25:14 user nova-compute[73391]: </domainCapabilities>
Aug 15 05:25:14 user nova-compute[73391]:  {{(pid=73391) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Aug 15 05:25:14 user nova-compute[73391]: <domainCapabilities>
Aug 15 05:25:14 user nova-compute[73391]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 15 05:25:14 user nova-compute[73391]:   <domain>kvm</domain>
Aug 15 05:25:14 user nova-compute[73391]:   <machine>pc-q35-jammy</machine>
Aug 15 05:25:14 user nova-compute[73391]:   <arch>x86_64</arch>
Aug 15 05:25:14 user nova-compute[73391]:   <vcpu max='288'/>
Aug 15 05:25:14 user nova-compute[73391]:   <iothreads supported='yes'/>
Aug 15 05:25:14 user nova-compute[73391]:   <os supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:     <enum name='firmware'>
Aug 15 05:25:14 user nova-compute[73391]:       <value>efi</value>
Aug 15 05:25:14 user nova-compute[73391]:     </enum>
Aug 15 05:25:14 user nova-compute[73391]:     <loader supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 15 05:25:14 user nova-compute[73391]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 15 05:25:14 user nova-compute[73391]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='type'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>rom</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>pflash</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='readonly'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>yes</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>no</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='secure'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>yes</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>no</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:     </loader>
Aug 15 05:25:14 user nova-compute[73391]:   </os>
Aug 15 05:25:14 user nova-compute[73391]:   <cpu>
Aug 15 05:25:14 user nova-compute[73391]:     <mode name='host-passthrough' supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='hostPassthroughMigratable'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>on</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>off</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:     </mode>
Aug 15 05:25:14 user nova-compute[73391]:     <mode name='maximum' supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='maximumMigratable'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>on</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>off</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:     </mode>
Aug 15 05:25:14 user nova-compute[73391]:     <mode name='host-model' supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <vendor>Intel</vendor>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='ss'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='vmx'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='pcid'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='hypervisor'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='arat'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='umip'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='md-clear'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='stibp'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='ssbd'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='invtsc'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='ibpb'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='ibrs'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='amd-stibp'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='rsba'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='pschange-mc-no'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='disable' name='erms'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 05:25:14 user nova-compute[73391]:     </mode>
Aug 15 05:25:14 user nova-compute[73391]:     <mode name='custom' supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>qemu64</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>qemu32</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>phenom</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>pentium3</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>pentium2</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>pentium</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>n270</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>kvm64</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>kvm32</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>coreduo</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>core2duo</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>athlon</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>Westmere-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>Westmere</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Snowridge</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Skylake-Server</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Skylake-Client</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>SandyBridge</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>Penryn</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Opteron_G5</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Opteron_G4</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Opteron_G3</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Opteron_G2</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>Opteron_G1</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>Nehalem</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>IvyBridge</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Icelake-Server</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Haswell</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>EPYC-Rome</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>EPYC-Milan</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>EPYC</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Dhyana</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Cooperlake</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>Conroe</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Broadwell</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>486</model>
Aug 15 05:25:14 user nova-compute[73391]:     </mode>
Aug 15 05:25:14 user nova-compute[73391]:   </cpu>
Aug 15 05:25:14 user nova-compute[73391]:   <memoryBacking supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:     <enum name='sourceType'>
Aug 15 05:25:14 user nova-compute[73391]:       <value>file</value>
Aug 15 05:25:14 user nova-compute[73391]:       <value>anonymous</value>
Aug 15 05:25:14 user nova-compute[73391]:       <value>memfd</value>
Aug 15 05:25:14 user nova-compute[73391]:     </enum>
Aug 15 05:25:14 user nova-compute[73391]:   </memoryBacking>
Aug 15 05:25:14 user nova-compute[73391]:   <devices>
Aug 15 05:25:14 user nova-compute[73391]:     <disk supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='diskDevice'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>disk</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>cdrom</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>floppy</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>lun</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='bus'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>fdc</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>scsi</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>virtio</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>usb</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>sata</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='model'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>virtio</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>virtio-transitional</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>virtio-non-transitional</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:     </disk>
Aug 15 05:25:14 user nova-compute[73391]:     <graphics supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='type'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>sdl</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>vnc</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>spice</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>egl-headless</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:     </graphics>
Aug 15 05:25:14 user nova-compute[73391]:     <video supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='modelType'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>vga</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>cirrus</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>vmvga</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>qxl</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>virtio</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>none</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>bochs</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>ramfb</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:     </video>
Aug 15 05:25:14 user nova-compute[73391]:     <hostdev supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='mode'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>subsystem</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='startupPolicy'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>default</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>mandatory</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>requisite</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>optional</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='subsysType'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>usb</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>pci</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>scsi</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='capsType'/>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='pciBackend'/>
Aug 15 05:25:14 user nova-compute[73391]:     </hostdev>
Aug 15 05:25:14 user nova-compute[73391]:     <rng supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='model'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>virtio</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>virtio-transitional</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>virtio-non-transitional</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='backendModel'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>random</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>egd</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>builtin</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:     </rng>
Aug 15 05:25:14 user nova-compute[73391]:     <filesystem supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='driverType'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>path</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>handle</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>virtiofs</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:     </filesystem>
Aug 15 05:25:14 user nova-compute[73391]:     <tpm supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='model'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>tpm-tis</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>tpm-crb</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='backendModel'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>passthrough</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>emulator</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:     </tpm>
Aug 15 05:25:14 user nova-compute[73391]:   </devices>
Aug 15 05:25:14 user nova-compute[73391]:   <features>
Aug 15 05:25:14 user nova-compute[73391]:     <gic supported='no'/>
Aug 15 05:25:14 user nova-compute[73391]:     <vmcoreinfo supported='yes'/>
Aug 15 05:25:14 user nova-compute[73391]:     <genid supported='yes'/>
Aug 15 05:25:14 user nova-compute[73391]:     <backingStoreInput supported='yes'/>
Aug 15 05:25:14 user nova-compute[73391]:     <backup supported='yes'/>
Aug 15 05:25:14 user nova-compute[73391]:     <sev supported='no'/>
Aug 15 05:25:14 user nova-compute[73391]:   </features>
Aug 15 05:25:14 user nova-compute[73391]: </domainCapabilities>
Aug 15 05:25:14 user nova-compute[73391]:  {{(pid=73391) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Aug 15 05:25:14 user nova-compute[73391]: <domainCapabilities>
Aug 15 05:25:14 user nova-compute[73391]:   <path>/usr/bin/qemu-system-x86_64</path>
Aug 15 05:25:14 user nova-compute[73391]:   <domain>kvm</domain>
Aug 15 05:25:14 user nova-compute[73391]:   <machine>pc-q35-6.2</machine>
Aug 15 05:25:14 user nova-compute[73391]:   <arch>x86_64</arch>
Aug 15 05:25:14 user nova-compute[73391]:   <vcpu max='288'/>
Aug 15 05:25:14 user nova-compute[73391]:   <iothreads supported='yes'/>
Aug 15 05:25:14 user nova-compute[73391]:   <os supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:     <enum name='firmware'>
Aug 15 05:25:14 user nova-compute[73391]:       <value>efi</value>
Aug 15 05:25:14 user nova-compute[73391]:     </enum>
Aug 15 05:25:14 user nova-compute[73391]:     <loader supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Aug 15 05:25:14 user nova-compute[73391]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Aug 15 05:25:14 user nova-compute[73391]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='type'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>rom</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>pflash</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='readonly'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>yes</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>no</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='secure'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>yes</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>no</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:     </loader>
Aug 15 05:25:14 user nova-compute[73391]:   </os>
Aug 15 05:25:14 user nova-compute[73391]:   <cpu>
Aug 15 05:25:14 user nova-compute[73391]:     <mode name='host-passthrough' supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='hostPassthroughMigratable'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>on</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>off</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:     </mode>
Aug 15 05:25:14 user nova-compute[73391]:     <mode name='maximum' supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='maximumMigratable'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>on</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>off</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:     </mode>
Aug 15 05:25:14 user nova-compute[73391]:     <mode name='host-model' supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <vendor>Intel</vendor>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='ss'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='vmx'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='pcid'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='hypervisor'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='arat'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='tsc_adjust'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='umip'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='md-clear'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='stibp'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='arch-capabilities'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='ssbd'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='invtsc'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='ibpb'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='ibrs'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='amd-stibp'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='amd-ssbd'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='rsba'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='require' name='pschange-mc-no'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='disable' name='erms'/>
Aug 15 05:25:14 user nova-compute[73391]:       <feature policy='disable' name='xsaveopt'/>
Aug 15 05:25:14 user nova-compute[73391]:     </mode>
Aug 15 05:25:14 user nova-compute[73391]:     <mode name='custom' supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>qemu64</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>qemu32</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>phenom</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>pentium3</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>pentium2</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>pentium</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>n270</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>kvm64</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>kvm32</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>coreduo</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>core2duo</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>athlon</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>Westmere-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>Westmere</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Snowridge</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Skylake-Server-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Skylake-Server</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Skylake-Client-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Skylake-Client</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>SandyBridge-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>SandyBridge</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>Penryn</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Opteron_G5</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Opteron_G4</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Opteron_G3</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Opteron_G2</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>Opteron_G1</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>Nehalem-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>Nehalem</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>IvyBridge-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>IvyBridge</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Icelake-Server-noTSX</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Icelake-Server</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Haswell-noTSX</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Haswell-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Haswell</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>EPYC-Rome</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>EPYC-Milan</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>EPYC-IBPB</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>EPYC</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Dhyana</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Cooperlake</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>Conroe</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Cascadelake-Server</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Broadwell-noTSX</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Broadwell-IBRS</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='no'>Broadwell</model>
Aug 15 05:25:14 user nova-compute[73391]:       <model usable='yes'>486</model>
Aug 15 05:25:14 user nova-compute[73391]:     </mode>
Aug 15 05:25:14 user nova-compute[73391]:   </cpu>
Aug 15 05:25:14 user nova-compute[73391]:   <memoryBacking supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:     <enum name='sourceType'>
Aug 15 05:25:14 user nova-compute[73391]:       <value>file</value>
Aug 15 05:25:14 user nova-compute[73391]:       <value>anonymous</value>
Aug 15 05:25:14 user nova-compute[73391]:       <value>memfd</value>
Aug 15 05:25:14 user nova-compute[73391]:     </enum>
Aug 15 05:25:14 user nova-compute[73391]:   </memoryBacking>
Aug 15 05:25:14 user nova-compute[73391]:   <devices>
Aug 15 05:25:14 user nova-compute[73391]:     <disk supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='diskDevice'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>disk</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>cdrom</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>floppy</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>lun</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='bus'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>fdc</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>scsi</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>virtio</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>usb</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>sata</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='model'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>virtio</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>virtio-transitional</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>virtio-non-transitional</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:     </disk>
Aug 15 05:25:14 user nova-compute[73391]:     <graphics supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='type'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>sdl</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>vnc</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>spice</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>egl-headless</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:     </graphics>
Aug 15 05:25:14 user nova-compute[73391]:     <video supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='modelType'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>vga</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>cirrus</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>vmvga</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>qxl</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>virtio</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>none</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>bochs</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>ramfb</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:     </video>
Aug 15 05:25:14 user nova-compute[73391]:     <hostdev supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='mode'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>subsystem</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='startupPolicy'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>default</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>mandatory</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>requisite</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>optional</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='subsysType'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>usb</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>pci</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>scsi</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='capsType'/>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='pciBackend'/>
Aug 15 05:25:14 user nova-compute[73391]:     </hostdev>
Aug 15 05:25:14 user nova-compute[73391]:     <rng supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='model'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>virtio</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>virtio-transitional</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>virtio-non-transitional</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='backendModel'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>random</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>egd</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>builtin</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:     </rng>
Aug 15 05:25:14 user nova-compute[73391]:     <filesystem supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='driverType'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>path</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>handle</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>virtiofs</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:     </filesystem>
Aug 15 05:25:14 user nova-compute[73391]:     <tpm supported='yes'>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='model'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>tpm-tis</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>tpm-crb</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:       <enum name='backendModel'>
Aug 15 05:25:14 user nova-compute[73391]:         <value>passthrough</value>
Aug 15 05:25:14 user nova-compute[73391]:         <value>emulator</value>
Aug 15 05:25:14 user nova-compute[73391]:       </enum>
Aug 15 05:25:14 user nova-compute[73391]:     </tpm>
Aug 15 05:25:14 user nova-compute[73391]:   </devices>
Aug 15 05:25:14 user nova-compute[73391]:   <features>
Aug 15 05:25:14 user nova-compute[73391]:     <gic supported='no'/>
Aug 15 05:25:14 user nova-compute[73391]:     <vmcoreinfo supported='yes'/>
Aug 15 05:25:14 user nova-compute[73391]:     <genid supported='yes'/>
Aug 15 05:25:14 user nova-compute[73391]:     <backingStoreInput supported='yes'/>
Aug 15 05:25:14 user nova-compute[73391]:     <backup supported='yes'/>
Aug 15 05:25:14 user nova-compute[73391]:     <sev supported='no'/>
Aug 15 05:25:14 user nova-compute[73391]:   </features>
Aug 15 05:25:14 user nova-compute[73391]: </domainCapabilities>
Aug 15 05:25:14 user nova-compute[73391]:  {{(pid=73391) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=73391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=73391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=73391) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=73391) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Checking secure boot support for host arch (x86_64) {{(pid=73391) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Checking secure boot support for host arch (x86_64) {{(pid=73391) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Checking secure boot support for host arch (x86_64) {{(pid=73391) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Checking secure boot support for host arch (x86_64) {{(pid=73391) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Checking secure boot support for host arch (x86_64) {{(pid=73391) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Aug 15 05:25:14 user nova-compute[73391]: INFO nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Secure Boot support detected
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] cpu compare xml: <cpu match="exact">
Aug 15 05:25:14 user nova-compute[73391]:   <model>Nehalem</model>
Aug 15 05:25:14 user nova-compute[73391]: </cpu>
Aug 15 05:25:14 user nova-compute[73391]:  {{(pid=73391) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Aug 15 05:25:14 user nova-compute[73391]: INFO nova.virt.node [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Generated node identity 771708bd-6a2a-4e0c-9869-46d45e6b1896
Aug 15 05:25:14 user nova-compute[73391]: INFO nova.virt.node [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Wrote node identity 771708bd-6a2a-4e0c-9869-46d45e6b1896 to /opt/stack/data/nova/compute_id
Aug 15 05:25:14 user nova-compute[73391]: WARNING nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Compute nodes ['771708bd-6a2a-4e0c-9869-46d45e6b1896'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Aug 15 05:25:14 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Aug 15 05:25:14 user nova-compute[73391]: WARNING nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Aug 15 05:25:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Auditing locally available compute resources for user (node: user) {{(pid=73391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 05:25:14 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:25:14 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Hypervisor/Node resource view: name=user free_ram=10864MB free_disk=26.201244354248047GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:25:14 user nova-compute[73391]: WARNING nova.compute.resource_tracker [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] No compute node record for user:771708bd-6a2a-4e0c-9869-46d45e6b1896: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 771708bd-6a2a-4e0c-9869-46d45e6b1896 could not be found.
Aug 15 05:25:14 user nova-compute[73391]: INFO nova.compute.resource_tracker [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Compute node record created for user:user with uuid: 771708bd-6a2a-4e0c-9869-46d45e6b1896
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 05:25:14 user nova-compute[73391]: INFO nova.scheduler.client.report [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [req-ea016cc9-471d-456a-a7a7-7c4c1af00c4a] Created resource provider record via placement API for resource provider with UUID 771708bd-6a2a-4e0c-9869-46d45e6b1896 and name user.
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=73391) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Aug 15 05:25:14 user nova-compute[73391]: INFO nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] kernel doesn't support AMD SEV
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Updating inventory in ProviderTree for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Libvirt baseline CPU <cpu>
Aug 15 05:25:14 user nova-compute[73391]:   <arch>x86_64</arch>
Aug 15 05:25:14 user nova-compute[73391]:   <model>Nehalem</model>
Aug 15 05:25:14 user nova-compute[73391]:   <vendor>Intel</vendor>
Aug 15 05:25:14 user nova-compute[73391]:   <topology sockets="6" cores="1" threads="1"/>
Aug 15 05:25:14 user nova-compute[73391]: </cpu>
Aug 15 05:25:14 user nova-compute[73391]:  {{(pid=73391) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Updated inventory for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Updating resource provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 generation from 0 to 1 during operation: update_inventory {{(pid=73391) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 15 05:25:14 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Updating inventory in ProviderTree for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 05:25:15 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Updating resource provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 generation from 1 to 2 during operation: update_traits {{(pid=73391) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Aug 15 05:25:15 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Compute_service record updated for user:user {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 05:25:15 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.618s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:25:15 user nova-compute[73391]: DEBUG nova.service [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Creating RPC server for service compute {{(pid=73391) start /opt/stack/nova/nova/service.py:182}}
Aug 15 05:25:15 user nova-compute[73391]: DEBUG nova.service [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Join ServiceGroup membership for this service compute {{(pid=73391) start /opt/stack/nova/nova/service.py:199}}
Aug 15 05:25:15 user nova-compute[73391]: DEBUG nova.servicegroup.drivers.db [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=73391) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Aug 15 05:25:35 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:25:35 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:26:05 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:26:05 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:26:05 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Starting heal instance info cache {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 05:26:05 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Rebuilding the list of instances to heal {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 05:26:05 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Didn't find any instances for network info cache update. {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 05:26:05 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:26:05 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:26:05 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:26:05 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:26:05 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:26:05 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:26:05 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 05:26:05 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:26:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:26:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:26:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:26:05 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Auditing locally available compute resources for user (node: user) {{(pid=73391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 05:26:06 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:26:06 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:26:06 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Hypervisor/Node resource view: name=user free_ram=10246MB free_disk=26.104888916015625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 05:26:06 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:26:06 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:26:06 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 05:26:06 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 05:26:06 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:26:06 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:26:06 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Compute_service record updated for user:user {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 05:26:06 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.192s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:27:06 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:27:06 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:27:06 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:27:06 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Starting heal instance info cache {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 05:27:06 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Rebuilding the list of instances to heal {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 05:27:06 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Didn't find any instances for network info cache update. {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 05:27:06 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:27:06 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:27:06 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:27:06 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:27:06 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:27:06 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:27:06 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:27:06 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Auditing locally available compute resources for user (node: user) {{(pid=73391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 05:27:06 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:27:06 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:27:06 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Hypervisor/Node resource view: name=user free_ram=10182MB free_disk=26.151012420654297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 05:27:06 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:27:06 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:27:06 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 05:27:06 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 05:27:06 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:27:06 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:27:06 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Compute_service record updated for user:user {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 05:27:06 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.102s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:27:07 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:27:07 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:27:07 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 05:27:07 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:28:05 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:28:05 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:28:06 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:28:06 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:28:06 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:28:06 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:28:06 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:28:06 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:28:06 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:28:06 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Auditing locally available compute resources for user (node: user) {{(pid=73391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 05:28:07 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:28:07 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:28:07 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Hypervisor/Node resource view: name=user free_ram=10198MB free_disk=25.935237884521484GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 05:28:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:28:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:28:07 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 05:28:07 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 05:28:07 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:28:07 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:28:07 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Compute_service record updated for user:user {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 05:28:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.251s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:28:08 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:28:08 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Starting heal instance info cache {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 05:28:08 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Rebuilding the list of instances to heal {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 05:28:08 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Didn't find any instances for network info cache update. {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 05:28:08 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:28:08 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 05:28:09 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:29:05 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:29:05 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:29:06 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:29:06 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:29:06 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquiring lock "8f08782b-f793-415e-b0d6-5caad1c3d426" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:29:06 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "8f08782b-f793-415e-b0d6-5caad1c3d426" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:29:06 user nova-compute[73391]: DEBUG nova.compute.manager [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Starting instance... {{(pid=73391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 05:29:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:29:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:29:07 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 05:29:07 user nova-compute[73391]: INFO nova.compute.claims [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Claim successful on node user
Aug 15 05:29:07 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:29:07 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:29:07 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:29:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.386s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:29:07 user nova-compute[73391]: DEBUG nova.compute.manager [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Start building networks asynchronously for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 05:29:08 user nova-compute[73391]: DEBUG nova.compute.manager [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Allocating IP information in the background. {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 05:29:08 user nova-compute[73391]: DEBUG nova.network.neutron [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] allocate_for_instance() {{(pid=73391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 05:29:08 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 05:29:08 user nova-compute[73391]: DEBUG nova.compute.manager [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Start building block device mappings for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 05:29:08 user nova-compute[73391]: DEBUG nova.compute.manager [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Start spawning the instance on the hypervisor. {{(pid=73391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 05:29:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Creating instance directory {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 05:29:08 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Creating image(s)
Aug 15 05:29:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquiring lock "/opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:29:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "/opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:29:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "/opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:29:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquiring lock "999b315ba87151d8252d543312ae7790e7e1583b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:29:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:29:08 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:29:08 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:29:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:29:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:29:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:29:08 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Auditing locally available compute resources for user (node: user) {{(pid=73391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 05:29:09 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:29:09 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:29:09 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Hypervisor/Node resource view: name=user free_ram=9380MB free_disk=25.957721710205078GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 05:29:09 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:29:09 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:29:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b.part --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:29:09 user nova-compute[73391]: DEBUG nova.policy [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '887f0846cf554e12acf92a663f5ab266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b9acbe11654053bb905e7c92558a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73391) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 05:29:09 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 8f08782b-f793-415e-b0d6-5caad1c3d426 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:29:09 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 05:29:09 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 05:29:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b.part --force-share --output=json" returned: 0 in 0.169s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:29:09 user nova-compute[73391]: DEBUG nova.virt.images [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] 191b1dad-305e-4d1c-9b15-515ec59a3278 was qcow2, converting to raw {{(pid=73391) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 05:29:09 user nova-compute[73391]: DEBUG nova.privsep.utils [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73391) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 05:29:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b.part /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b.converted {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:29:09 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:29:10 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:29:10 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Compute_service record updated for user:user {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 05:29:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.970s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:29:10 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b.part /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b.converted" returned: 0 in 0.195s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:29:10 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b.converted --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:29:10 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b.converted --force-share --output=json" returned: 0 in 0.210s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:29:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.985s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:29:10 user nova-compute[73391]: INFO oslo.privsep.daemon [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp3lj351_h/privsep.sock']
Aug 15 05:29:10 user sudo[82696]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp3lj351_h/privsep.sock
Aug 15 05:29:10 user sudo[82696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 15 05:29:11 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:29:11 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Starting heal instance info cache {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 05:29:11 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Rebuilding the list of instances to heal {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 05:29:11 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Skipping network cache update for instance because it is Building. {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 15 05:29:11 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Didn't find any instances for network info cache update. {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 05:29:11 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:29:11 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 05:29:11 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:29:12 user nova-compute[73391]: DEBUG nova.network.neutron [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Successfully created port: 13c5a27d-b6c3-424b-a876-068d047fad28 {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 05:29:12 user sudo[82696]: pam_unix(sudo:session): session closed for user root
Aug 15 05:29:12 user nova-compute[73391]: INFO oslo.privsep.daemon [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Spawned new privsep daemon via rootwrap
Aug 15 05:29:12 user nova-compute[73391]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 15 05:29:12 user nova-compute[73391]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 15 05:29:12 user nova-compute[73391]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Aug 15 05:29:12 user nova-compute[73391]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82700
Aug 15 05:29:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:29:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.197s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:29:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquiring lock "999b315ba87151d8252d543312ae7790e7e1583b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:29:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:29:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:29:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.184s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:29:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk 1073741824 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:29:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk 1073741824" returned: 0 in 0.097s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:29:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.297s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:29:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:29:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.230s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:29:12 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk. size=1073741824 {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 05:29:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:29:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:29:13 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Cannot resize image /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk to a smaller size. {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 05:29:13 user nova-compute[73391]: DEBUG nova.objects.instance [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lazy-loading 'migration_context' on Instance uuid 8f08782b-f793-415e-b0d6-5caad1c3d426 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:29:13 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Created local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 05:29:13 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Ensure instance console log exists: /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 05:29:13 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:29:13 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:29:13 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:29:16 user nova-compute[73391]: DEBUG nova.network.neutron [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Successfully updated port: 13c5a27d-b6c3-424b-a876-068d047fad28 {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:29:16 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquiring lock "refresh_cache-8f08782b-f793-415e-b0d6-5caad1c3d426" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:29:16 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquired lock "refresh_cache-8f08782b-f793-415e-b0d6-5caad1c3d426" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:29:16 user nova-compute[73391]: DEBUG nova.network.neutron [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:29:16 user nova-compute[73391]: DEBUG nova.network.neutron [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:29:16 user nova-compute[73391]: DEBUG nova.compute.manager [req-81047645-b268-4715-87f4-742d7e6c3a49 req-15584a4d-5527-4d53-bc52-0c44787ab6de service nova] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Received event network-changed-13c5a27d-b6c3-424b-a876-068d047fad28 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:29:16 user nova-compute[73391]: DEBUG nova.compute.manager [req-81047645-b268-4715-87f4-742d7e6c3a49 req-15584a4d-5527-4d53-bc52-0c44787ab6de service nova] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Refreshing instance network info cache due to event network-changed-13c5a27d-b6c3-424b-a876-068d047fad28. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:29:16 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-81047645-b268-4715-87f4-742d7e6c3a49 req-15584a4d-5527-4d53-bc52-0c44787ab6de service nova] Acquiring lock "refresh_cache-8f08782b-f793-415e-b0d6-5caad1c3d426" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:29:17 user nova-compute[73391]: DEBUG nova.network.neutron [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Updating instance_info_cache with network_info: [{"id": "13c5a27d-b6c3-424b-a876-068d047fad28", "address": "fa:16:3e:61:0b:53", "network": {"id": "70d88082-aea7-48bb-abb4-d77d264aaf01", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b9acbe11654053bb905e7c92558a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c5a27d-b6", "ovs_interfaceid": "13c5a27d-b6c3-424b-a876-068d047fad28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:29:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Releasing lock "refresh_cache-8f08782b-f793-415e-b0d6-5caad1c3d426" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:29:17 user nova-compute[73391]: DEBUG nova.compute.manager [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Instance network_info: |[{"id": "13c5a27d-b6c3-424b-a876-068d047fad28", "address": "fa:16:3e:61:0b:53", "network": {"id": "70d88082-aea7-48bb-abb4-d77d264aaf01", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b9acbe11654053bb905e7c92558a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c5a27d-b6", "ovs_interfaceid": "13c5a27d-b6c3-424b-a876-068d047fad28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 05:29:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-81047645-b268-4715-87f4-742d7e6c3a49 req-15584a4d-5527-4d53-bc52-0c44787ab6de service nova] Acquired lock "refresh_cache-8f08782b-f793-415e-b0d6-5caad1c3d426" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:29:17 user nova-compute[73391]: DEBUG nova.network.neutron [req-81047645-b268-4715-87f4-742d7e6c3a49 req-15584a4d-5527-4d53-bc52-0c44787ab6de service nova] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Refreshing network info cache for port 13c5a27d-b6c3-424b-a876-068d047fad28 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:29:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Start _get_guest_xml network_info=[{"id": "13c5a27d-b6c3-424b-a876-068d047fad28", "address": "fa:16:3e:61:0b:53", "network": {"id": "70d88082-aea7-48bb-abb4-d77d264aaf01", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b9acbe11654053bb905e7c92558a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c5a27d-b6", "ovs_interfaceid": "13c5a27d-b6c3-424b-a876-068d047fad28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '191b1dad-305e-4d1c-9b15-515ec59a3278'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:29:17 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:29:17 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:29:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:29:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:29:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:29:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:29:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:29:17 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:29:17 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:29:17 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:29:17 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:29:17 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:29:17 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:29:17 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:29:17 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:29:17 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:29:17 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:29:17 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:29:17 user nova-compute[73391]: DEBUG nova.privsep.utils [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73391) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 05:29:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:29:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-547612131',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-547612131',id=1,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83b9acbe11654053bb905e7c92558a35',ramdisk_id='',reservation_id='r-l60ytipu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1045163116',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:29:08Z,user_data=None,user_id='887f0846cf554e12acf92a663f5ab266',uuid=8f08782b-f793-415e-b0d6-5caad1c3d426,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13c5a27d-b6c3-424b-a876-068d047fad28", "address": "fa:16:3e:61:0b:53", "network": {"id": "70d88082-aea7-48bb-abb4-d77d264aaf01", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b9acbe11654053bb905e7c92558a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c5a27d-b6", "ovs_interfaceid": "13c5a27d-b6c3-424b-a876-068d047fad28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:29:17 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Converting VIF {"id": "13c5a27d-b6c3-424b-a876-068d047fad28", "address": "fa:16:3e:61:0b:53", "network": {"id": "70d88082-aea7-48bb-abb4-d77d264aaf01", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b9acbe11654053bb905e7c92558a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c5a27d-b6", "ovs_interfaceid": "13c5a27d-b6c3-424b-a876-068d047fad28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:29:17 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:0b:53,bridge_name='br-int',has_traffic_filtering=True,id=13c5a27d-b6c3-424b-a876-068d047fad28,network=Network(70d88082-aea7-48bb-abb4-d77d264aaf01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13c5a27d-b6') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:29:17 user nova-compute[73391]: DEBUG nova.objects.instance [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lazy-loading 'pci_devices' on Instance uuid 8f08782b-f793-415e-b0d6-5caad1c3d426 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:29:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:29:17 user nova-compute[73391]:   <uuid>8f08782b-f793-415e-b0d6-5caad1c3d426</uuid>
Aug 15 05:29:17 user nova-compute[73391]:   <name>instance-00000001</name>
Aug 15 05:29:17 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:29:17 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:29:17 user nova-compute[73391]:   <metadata>
Aug 15 05:29:17 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:29:17 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:29:17 user nova-compute[73391]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-547612131</nova:name>
Aug 15 05:29:17 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:29:17</nova:creationTime>
Aug 15 05:29:17 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:29:17 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:29:17 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:29:17 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:29:17 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:29:17 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:29:17 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:29:17 user nova-compute[73391]:       <nova:owner>
Aug 15 05:29:17 user nova-compute[73391]:         <nova:user uuid="887f0846cf554e12acf92a663f5ab266">tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member</nova:user>
Aug 15 05:29:17 user nova-compute[73391]:         <nova:project uuid="83b9acbe11654053bb905e7c92558a35">tempest-ServerBootFromVolumeStableRescueTest-1045163116</nova:project>
Aug 15 05:29:17 user nova-compute[73391]:       </nova:owner>
Aug 15 05:29:17 user nova-compute[73391]:       <nova:root type="image" uuid="191b1dad-305e-4d1c-9b15-515ec59a3278"/>
Aug 15 05:29:17 user nova-compute[73391]:       <nova:ports>
Aug 15 05:29:17 user nova-compute[73391]:         <nova:port uuid="13c5a27d-b6c3-424b-a876-068d047fad28">
Aug 15 05:29:17 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 05:29:17 user nova-compute[73391]:         </nova:port>
Aug 15 05:29:17 user nova-compute[73391]:       </nova:ports>
Aug 15 05:29:17 user nova-compute[73391]:     </nova:instance>
Aug 15 05:29:17 user nova-compute[73391]:   </metadata>
Aug 15 05:29:17 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:29:17 user nova-compute[73391]:     <system>
Aug 15 05:29:17 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:29:17 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:29:17 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:29:17 user nova-compute[73391]:       <entry name="serial">8f08782b-f793-415e-b0d6-5caad1c3d426</entry>
Aug 15 05:29:17 user nova-compute[73391]:       <entry name="uuid">8f08782b-f793-415e-b0d6-5caad1c3d426</entry>
Aug 15 05:29:17 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:29:17 user nova-compute[73391]:     </system>
Aug 15 05:29:17 user nova-compute[73391]:   </sysinfo>
Aug 15 05:29:17 user nova-compute[73391]:   <os>
Aug 15 05:29:17 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:29:17 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:29:17 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:29:17 user nova-compute[73391]:   </os>
Aug 15 05:29:17 user nova-compute[73391]:   <features>
Aug 15 05:29:17 user nova-compute[73391]:     <acpi/>
Aug 15 05:29:17 user nova-compute[73391]:     <apic/>
Aug 15 05:29:17 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:29:17 user nova-compute[73391]:   </features>
Aug 15 05:29:17 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:29:17 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:29:17 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:29:17 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:29:17 user nova-compute[73391]:   </clock>
Aug 15 05:29:17 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:29:17 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:29:17 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:29:17 user nova-compute[73391]:   </cpu>
Aug 15 05:29:17 user nova-compute[73391]:   <devices>
Aug 15 05:29:17 user nova-compute[73391]:     <disk type="file" device="disk">
Aug 15 05:29:17 user nova-compute[73391]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 05:29:17 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk"/>
Aug 15 05:29:17 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:29:17 user nova-compute[73391]:     </disk>
Aug 15 05:29:17 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:29:17 user nova-compute[73391]:       <mac address="fa:16:3e:61:0b:53"/>
Aug 15 05:29:17 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:29:17 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:29:17 user nova-compute[73391]:       <target dev="tap13c5a27d-b6"/>
Aug 15 05:29:17 user nova-compute[73391]:     </interface>
Aug 15 05:29:17 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:29:17 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/console.log" append="off"/>
Aug 15 05:29:17 user nova-compute[73391]:     </serial>
Aug 15 05:29:17 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:29:17 user nova-compute[73391]:     <video>
Aug 15 05:29:17 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:29:17 user nova-compute[73391]:     </video>
Aug 15 05:29:17 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:29:17 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:29:17 user nova-compute[73391]:     </rng>
Aug 15 05:29:17 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:29:17 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:29:17 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:29:17 user nova-compute[73391]:     </memballoon>
Aug 15 05:29:17 user nova-compute[73391]:   </devices>
Aug 15 05:29:17 user nova-compute[73391]: </domain>
Aug 15 05:29:17 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:29:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:29:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-547612131',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-547612131',id=1,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83b9acbe11654053bb905e7c92558a35',ramdisk_id='',reservation_id='r-l60ytipu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1045163116',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:29:08Z,user_data=None,user_id='887f0846cf554e12acf92a663f5ab266',uuid=8f08782b-f793-415e-b0d6-5caad1c3d426,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13c5a27d-b6c3-424b-a876-068d047fad28", "address": "fa:16:3e:61:0b:53", "network": {"id": "70d88082-aea7-48bb-abb4-d77d264aaf01", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b9acbe11654053bb905e7c92558a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c5a27d-b6", "ovs_interfaceid": "13c5a27d-b6c3-424b-a876-068d047fad28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:29:17 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Converting VIF {"id": "13c5a27d-b6c3-424b-a876-068d047fad28", "address": "fa:16:3e:61:0b:53", "network": {"id": "70d88082-aea7-48bb-abb4-d77d264aaf01", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b9acbe11654053bb905e7c92558a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c5a27d-b6", "ovs_interfaceid": "13c5a27d-b6c3-424b-a876-068d047fad28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:29:17 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:0b:53,bridge_name='br-int',has_traffic_filtering=True,id=13c5a27d-b6c3-424b-a876-068d047fad28,network=Network(70d88082-aea7-48bb-abb4-d77d264aaf01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13c5a27d-b6') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:29:17 user nova-compute[73391]: DEBUG os_vif [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:0b:53,bridge_name='br-int',has_traffic_filtering=True,id=13c5a27d-b6c3-424b-a876-068d047fad28,network=Network(70d88082-aea7-48bb-abb4-d77d264aaf01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13c5a27d-b6') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:29:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Created schema index Interface.name {{(pid=73391) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 15 05:29:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Created schema index Port.name {{(pid=73391) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 15 05:29:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Created schema index Bridge.name {{(pid=73391) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Aug 15 05:29:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 05:29:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [POLLOUT] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 05:29:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:18 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Acquiring lock "782c3d06-ef9e-4ca4-a03b-86f0e6d458a2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:29:18 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Lock "782c3d06-ef9e-4ca4-a03b-86f0e6d458a2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:29:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:29:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:29:18 user nova-compute[73391]: INFO oslo.privsep.daemon [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpd0627ywl/privsep.sock']
Aug 15 05:29:18 user sudo[82728]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpd0627ywl/privsep.sock
Aug 15 05:29:18 user sudo[82728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 15 05:29:18 user nova-compute[73391]: DEBUG nova.compute.manager [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Starting instance... {{(pid=73391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 05:29:18 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:29:18 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:29:18 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 05:29:18 user nova-compute[73391]: INFO nova.compute.claims [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Claim successful on node user
Aug 15 05:29:18 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:29:18 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:29:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:18 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.306s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:29:18 user nova-compute[73391]: DEBUG nova.compute.manager [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Start building networks asynchronously for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 05:29:18 user nova-compute[73391]: DEBUG nova.compute.manager [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Allocating IP information in the background. {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 05:29:18 user nova-compute[73391]: DEBUG nova.network.neutron [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] allocate_for_instance() {{(pid=73391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 05:29:18 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 05:29:18 user nova-compute[73391]: DEBUG nova.compute.manager [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Start building block device mappings for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 05:29:19 user nova-compute[73391]: DEBUG nova.compute.manager [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Start spawning the instance on the hypervisor. {{(pid=73391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 05:29:19 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Creating instance directory {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 05:29:19 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Creating image(s)
Aug 15 05:29:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Acquiring lock "/opt/stack/data/nova/instances/782c3d06-ef9e-4ca4-a03b-86f0e6d458a2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:29:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Lock "/opt/stack/data/nova/instances/782c3d06-ef9e-4ca4-a03b-86f0e6d458a2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:29:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Lock "/opt/stack/data/nova/instances/782c3d06-ef9e-4ca4-a03b-86f0e6d458a2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:29:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:29:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.215s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:29:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Acquiring lock "999b315ba87151d8252d543312ae7790e7e1583b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:29:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:29:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:29:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.166s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:29:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/782c3d06-ef9e-4ca4-a03b-86f0e6d458a2/disk 1073741824 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:29:19 user nova-compute[73391]: DEBUG nova.policy [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '983afbd9c0fe421db4cfe0dd75d45b1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f76918aa37f848008c8466a38bac1908', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73391) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 05:29:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/782c3d06-ef9e-4ca4-a03b-86f0e6d458a2/disk 1073741824" returned: 0 in 0.047s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:29:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.216s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:29:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:29:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.238s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:29:19 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Checking if we can resize image /opt/stack/data/nova/instances/782c3d06-ef9e-4ca4-a03b-86f0e6d458a2/disk. size=1073741824 {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 05:29:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c3d06-ef9e-4ca4-a03b-86f0e6d458a2/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:29:19 user nova-compute[73391]: DEBUG nova.network.neutron [req-81047645-b268-4715-87f4-742d7e6c3a49 req-15584a4d-5527-4d53-bc52-0c44787ab6de service nova] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Updated VIF entry in instance network info cache for port 13c5a27d-b6c3-424b-a876-068d047fad28. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:29:19 user nova-compute[73391]: DEBUG nova.network.neutron [req-81047645-b268-4715-87f4-742d7e6c3a49 req-15584a4d-5527-4d53-bc52-0c44787ab6de service nova] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Updating instance_info_cache with network_info: [{"id": "13c5a27d-b6c3-424b-a876-068d047fad28", "address": "fa:16:3e:61:0b:53", "network": {"id": "70d88082-aea7-48bb-abb4-d77d264aaf01", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b9acbe11654053bb905e7c92558a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c5a27d-b6", "ovs_interfaceid": "13c5a27d-b6c3-424b-a876-068d047fad28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:29:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-81047645-b268-4715-87f4-742d7e6c3a49 req-15584a4d-5527-4d53-bc52-0c44787ab6de service nova] Releasing lock "refresh_cache-8f08782b-f793-415e-b0d6-5caad1c3d426" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:29:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c3d06-ef9e-4ca4-a03b-86f0e6d458a2/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:29:19 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Cannot resize image /opt/stack/data/nova/instances/782c3d06-ef9e-4ca4-a03b-86f0e6d458a2/disk to a smaller size. {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 05:29:19 user nova-compute[73391]: DEBUG nova.objects.instance [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Lazy-loading 'migration_context' on Instance uuid 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:29:19 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Created local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 05:29:19 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Ensure instance console log exists: /opt/stack/data/nova/instances/782c3d06-ef9e-4ca4-a03b-86f0e6d458a2/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 05:29:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:29:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:29:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:29:20 user sudo[82728]: pam_unix(sudo:session): session closed for user root
Aug 15 05:29:20 user nova-compute[73391]: INFO oslo.privsep.daemon [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Spawned new privsep daemon via rootwrap
Aug 15 05:29:20 user nova-compute[73391]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 15 05:29:20 user nova-compute[73391]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 15 05:29:20 user nova-compute[73391]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Aug 15 05:29:20 user nova-compute[73391]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 82748
Aug 15 05:29:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap13c5a27d-b6, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:29:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap13c5a27d-b6, col_values=(('external_ids', {'iface-id': '13c5a27d-b6c3-424b-a876-068d047fad28', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:0b:53', 'vm-uuid': '8f08782b-f793-415e-b0d6-5caad1c3d426'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:29:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:29:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:20 user nova-compute[73391]: INFO os_vif [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:0b:53,bridge_name='br-int',has_traffic_filtering=True,id=13c5a27d-b6c3-424b-a876-068d047fad28,network=Network(70d88082-aea7-48bb-abb4-d77d264aaf01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13c5a27d-b6')
Aug 15 05:29:20 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:29:20 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] No VIF found with MAC fa:16:3e:61:0b:53, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:29:21 user nova-compute[73391]: DEBUG nova.network.neutron [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Successfully created port: 39b441c5-fe40-4e06-9dcc-b11135805efe {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 05:29:21 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:21 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:21 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:21 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:23 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077363.4502404, 8f08782b-f793-415e-b0d6-5caad1c3d426 => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:29:23 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] VM Resumed (Lifecycle Event)
Aug 15 05:29:23 user nova-compute[73391]: DEBUG nova.compute.manager [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:29:23 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Guest created on hypervisor {{(pid=73391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 05:29:23 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Instance spawned successfully.
Aug 15 05:29:23 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 05:29:23 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:29:23 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Found default for hw_cdrom_bus of ide {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:29:23 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Found default for hw_disk_bus of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:29:23 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Found default for hw_input_bus of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:29:23 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Found default for hw_pointer_model of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:29:23 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Found default for hw_video_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:29:23 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Found default for hw_vif_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:29:23 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:29:23 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:29:23 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077363.4531236, 8f08782b-f793-415e-b0d6-5caad1c3d426 => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:29:23 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] VM Started (Lifecycle Event)
Aug 15 05:29:23 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:29:23 user nova-compute[73391]: INFO nova.compute.manager [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Took 15.33 seconds to spawn the instance on the hypervisor.
Aug 15 05:29:23 user nova-compute[73391]: DEBUG nova.compute.manager [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:29:23 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:29:23 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:23 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:29:23 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:23 user nova-compute[73391]: INFO nova.compute.manager [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Took 16.35 seconds to build instance.
Aug 15 05:29:23 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-01bec90b-3a84-4b3e-88da-76e3fed1cf2e tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "8f08782b-f793-415e-b0d6-5caad1c3d426" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.930s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:29:24 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquiring lock "6ac9d5dc-56be-402f-b9d4-3327bdfd9220" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:29:24 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "6ac9d5dc-56be-402f-b9d4-3327bdfd9220" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:29:24 user nova-compute[73391]: DEBUG nova.compute.manager [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Starting instance... {{(pid=73391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 05:29:24 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:29:24 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:29:24 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 05:29:24 user nova-compute[73391]: INFO nova.compute.claims [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Claim successful on node user
Aug 15 05:29:24 user nova-compute[73391]: DEBUG nova.network.neutron [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Successfully updated port: 39b441c5-fe40-4e06-9dcc-b11135805efe {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:29:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Acquiring lock "refresh_cache-782c3d06-ef9e-4ca4-a03b-86f0e6d458a2" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:29:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Acquired lock "refresh_cache-782c3d06-ef9e-4ca4-a03b-86f0e6d458a2" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:29:25 user nova-compute[73391]: DEBUG nova.network.neutron [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:29:25 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:29:25 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:29:25 user nova-compute[73391]: DEBUG nova.network.neutron [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:29:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.422s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:29:25 user nova-compute[73391]: DEBUG nova.compute.manager [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Start building networks asynchronously for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 05:29:25 user nova-compute[73391]: DEBUG nova.compute.manager [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Allocating IP information in the background. {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 05:29:25 user nova-compute[73391]: DEBUG nova.network.neutron [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] allocate_for_instance() {{(pid=73391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 05:29:25 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 05:29:25 user nova-compute[73391]: DEBUG nova.compute.manager [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Start building block device mappings for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 05:29:25 user nova-compute[73391]: DEBUG nova.compute.manager [req-2e5a6ef2-b284-4a9f-ac29-c26a017d7a57 req-56f95d19-c664-42aa-ab43-6cbbbc3652db service nova] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Received event network-changed-39b441c5-fe40-4e06-9dcc-b11135805efe {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:29:25 user nova-compute[73391]: DEBUG nova.compute.manager [req-2e5a6ef2-b284-4a9f-ac29-c26a017d7a57 req-56f95d19-c664-42aa-ab43-6cbbbc3652db service nova] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Refreshing instance network info cache due to event network-changed-39b441c5-fe40-4e06-9dcc-b11135805efe. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:29:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2e5a6ef2-b284-4a9f-ac29-c26a017d7a57 req-56f95d19-c664-42aa-ab43-6cbbbc3652db service nova] Acquiring lock "refresh_cache-782c3d06-ef9e-4ca4-a03b-86f0e6d458a2" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:29:25 user nova-compute[73391]: DEBUG nova.policy [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '124dcfde552147e2978970386274c70a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b01853a82243369bd71dc0dbedb5d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73391) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 05:29:25 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:25 user nova-compute[73391]: DEBUG nova.compute.manager [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Start spawning the instance on the hypervisor. {{(pid=73391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 05:29:25 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Creating instance directory {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 05:29:25 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Creating image(s)
Aug 15 05:29:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquiring lock "/opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:29:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "/opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:29:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "/opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:29:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:29:25 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.211s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:29:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquiring lock "999b315ba87151d8252d543312ae7790e7e1583b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:29:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:29:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:29:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.214s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:29:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk 1073741824 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:29:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk 1073741824" returned: 0 in 0.056s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:29:26 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:29:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:29:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.179s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:29:26 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk. size=1073741824 {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 05:29:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:29:26 user nova-compute[73391]: DEBUG nova.network.neutron [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Updating instance_info_cache with network_info: [{"id": "39b441c5-fe40-4e06-9dcc-b11135805efe", "address": "fa:16:3e:0c:87:08", "network": {"id": "7b58b377-f2fd-4b5c-9bb3-4e7fa4c10faf", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1135444746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76918aa37f848008c8466a38bac1908", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b441c5-fe", "ovs_interfaceid": "39b441c5-fe40-4e06-9dcc-b11135805efe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:29:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:29:26 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Cannot resize image /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk to a smaller size. {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 05:29:26 user nova-compute[73391]: DEBUG nova.objects.instance [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lazy-loading 'migration_context' on Instance uuid 6ac9d5dc-56be-402f-b9d4-3327bdfd9220 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:29:26 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Releasing lock "refresh_cache-782c3d06-ef9e-4ca4-a03b-86f0e6d458a2" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:29:26 user nova-compute[73391]: DEBUG nova.compute.manager [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Instance network_info: |[{"id": "39b441c5-fe40-4e06-9dcc-b11135805efe", "address": "fa:16:3e:0c:87:08", "network": {"id": "7b58b377-f2fd-4b5c-9bb3-4e7fa4c10faf", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1135444746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76918aa37f848008c8466a38bac1908", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b441c5-fe", "ovs_interfaceid": "39b441c5-fe40-4e06-9dcc-b11135805efe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 05:29:26 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2e5a6ef2-b284-4a9f-ac29-c26a017d7a57 req-56f95d19-c664-42aa-ab43-6cbbbc3652db service nova] Acquired lock "refresh_cache-782c3d06-ef9e-4ca4-a03b-86f0e6d458a2" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:29:26 user nova-compute[73391]: DEBUG nova.network.neutron [req-2e5a6ef2-b284-4a9f-ac29-c26a017d7a57 req-56f95d19-c664-42aa-ab43-6cbbbc3652db service nova] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Refreshing network info cache for port 39b441c5-fe40-4e06-9dcc-b11135805efe {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:29:26 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Start _get_guest_xml network_info=[{"id": "39b441c5-fe40-4e06-9dcc-b11135805efe", "address": "fa:16:3e:0c:87:08", "network": {"id": "7b58b377-f2fd-4b5c-9bb3-4e7fa4c10faf", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1135444746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76918aa37f848008c8466a38bac1908", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b441c5-fe", "ovs_interfaceid": "39b441c5-fe40-4e06-9dcc-b11135805efe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '191b1dad-305e-4d1c-9b15-515ec59a3278'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:29:26 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Created local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 05:29:26 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Ensure instance console log exists: /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 05:29:26 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:29:26 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:29:26 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:29:26 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:29:26 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:29:26 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:29:26 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:29:26 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:29:26 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:29:26 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:29:26 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:29:26 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:29:26 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:29:26 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:29:26 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:29:26 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:29:26 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:29:26 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:29:26 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:29:26 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:29:26 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:29:26 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:29:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1595978663',display_name='tempest-DeleteServersTestJSON-server-1595978663',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1595978663',id=2,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f76918aa37f848008c8466a38bac1908',ramdisk_id='',reservation_id='r-p7z2rvlx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1058379781',owner_user_name='tempest-DeleteServersTestJSON-1058379781-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:29:19Z,user_data=None,user_id='983afbd9c0fe421db4cfe0dd75d45b1b',uuid=782c3d06-ef9e-4ca4-a03b-86f0e6d458a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39b441c5-fe40-4e06-9dcc-b11135805efe", "address": "fa:16:3e:0c:87:08", "network": {"id": "7b58b377-f2fd-4b5c-9bb3-4e7fa4c10faf", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1135444746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76918aa37f848008c8466a38bac1908", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b441c5-fe", "ovs_interfaceid": "39b441c5-fe40-4e06-9dcc-b11135805efe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:29:26 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Converting VIF {"id": "39b441c5-fe40-4e06-9dcc-b11135805efe", "address": "fa:16:3e:0c:87:08", "network": {"id": "7b58b377-f2fd-4b5c-9bb3-4e7fa4c10faf", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1135444746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76918aa37f848008c8466a38bac1908", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b441c5-fe", "ovs_interfaceid": "39b441c5-fe40-4e06-9dcc-b11135805efe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:29:26 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:87:08,bridge_name='br-int',has_traffic_filtering=True,id=39b441c5-fe40-4e06-9dcc-b11135805efe,network=Network(7b58b377-f2fd-4b5c-9bb3-4e7fa4c10faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39b441c5-fe') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:29:26 user nova-compute[73391]: DEBUG nova.objects.instance [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Lazy-loading 'pci_devices' on Instance uuid 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:29:26 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:29:26 user nova-compute[73391]:   <uuid>782c3d06-ef9e-4ca4-a03b-86f0e6d458a2</uuid>
Aug 15 05:29:26 user nova-compute[73391]:   <name>instance-00000002</name>
Aug 15 05:29:26 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:29:26 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:29:26 user nova-compute[73391]:   <metadata>
Aug 15 05:29:26 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:29:26 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:29:26 user nova-compute[73391]:       <nova:name>tempest-DeleteServersTestJSON-server-1595978663</nova:name>
Aug 15 05:29:26 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:29:26</nova:creationTime>
Aug 15 05:29:26 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:29:26 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:29:26 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:29:26 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:29:26 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:29:26 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:29:26 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:29:26 user nova-compute[73391]:       <nova:owner>
Aug 15 05:29:26 user nova-compute[73391]:         <nova:user uuid="983afbd9c0fe421db4cfe0dd75d45b1b">tempest-DeleteServersTestJSON-1058379781-project-member</nova:user>
Aug 15 05:29:26 user nova-compute[73391]:         <nova:project uuid="f76918aa37f848008c8466a38bac1908">tempest-DeleteServersTestJSON-1058379781</nova:project>
Aug 15 05:29:26 user nova-compute[73391]:       </nova:owner>
Aug 15 05:29:26 user nova-compute[73391]:       <nova:root type="image" uuid="191b1dad-305e-4d1c-9b15-515ec59a3278"/>
Aug 15 05:29:26 user nova-compute[73391]:       <nova:ports>
Aug 15 05:29:26 user nova-compute[73391]:         <nova:port uuid="39b441c5-fe40-4e06-9dcc-b11135805efe">
Aug 15 05:29:26 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 05:29:26 user nova-compute[73391]:         </nova:port>
Aug 15 05:29:26 user nova-compute[73391]:       </nova:ports>
Aug 15 05:29:26 user nova-compute[73391]:     </nova:instance>
Aug 15 05:29:26 user nova-compute[73391]:   </metadata>
Aug 15 05:29:26 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:29:26 user nova-compute[73391]:     <system>
Aug 15 05:29:26 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:29:26 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:29:26 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:29:26 user nova-compute[73391]:       <entry name="serial">782c3d06-ef9e-4ca4-a03b-86f0e6d458a2</entry>
Aug 15 05:29:26 user nova-compute[73391]:       <entry name="uuid">782c3d06-ef9e-4ca4-a03b-86f0e6d458a2</entry>
Aug 15 05:29:26 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:29:26 user nova-compute[73391]:     </system>
Aug 15 05:29:26 user nova-compute[73391]:   </sysinfo>
Aug 15 05:29:26 user nova-compute[73391]:   <os>
Aug 15 05:29:26 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:29:26 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:29:26 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:29:26 user nova-compute[73391]:   </os>
Aug 15 05:29:26 user nova-compute[73391]:   <features>
Aug 15 05:29:26 user nova-compute[73391]:     <acpi/>
Aug 15 05:29:26 user nova-compute[73391]:     <apic/>
Aug 15 05:29:26 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:29:26 user nova-compute[73391]:   </features>
Aug 15 05:29:26 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:29:26 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:29:26 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:29:26 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:29:26 user nova-compute[73391]:   </clock>
Aug 15 05:29:26 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:29:26 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:29:26 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:29:26 user nova-compute[73391]:   </cpu>
Aug 15 05:29:26 user nova-compute[73391]:   <devices>
Aug 15 05:29:26 user nova-compute[73391]:     <disk type="file" device="disk">
Aug 15 05:29:26 user nova-compute[73391]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 05:29:26 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/782c3d06-ef9e-4ca4-a03b-86f0e6d458a2/disk"/>
Aug 15 05:29:26 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:29:26 user nova-compute[73391]:     </disk>
Aug 15 05:29:26 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:29:26 user nova-compute[73391]:       <mac address="fa:16:3e:0c:87:08"/>
Aug 15 05:29:26 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:29:26 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:29:26 user nova-compute[73391]:       <target dev="tap39b441c5-fe"/>
Aug 15 05:29:26 user nova-compute[73391]:     </interface>
Aug 15 05:29:26 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:29:26 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/782c3d06-ef9e-4ca4-a03b-86f0e6d458a2/console.log" append="off"/>
Aug 15 05:29:26 user nova-compute[73391]:     </serial>
Aug 15 05:29:26 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:29:26 user nova-compute[73391]:     <video>
Aug 15 05:29:26 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:29:26 user nova-compute[73391]:     </video>
Aug 15 05:29:26 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:29:26 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:29:26 user nova-compute[73391]:     </rng>
Aug 15 05:29:26 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:29:26 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:29:26 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:29:26 user nova-compute[73391]:     </memballoon>
Aug 15 05:29:26 user nova-compute[73391]:   </devices>
Aug 15 05:29:26 user nova-compute[73391]: </domain>
Aug 15 05:29:26 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:29:26 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:29:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1595978663',display_name='tempest-DeleteServersTestJSON-server-1595978663',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1595978663',id=2,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f76918aa37f848008c8466a38bac1908',ramdisk_id='',reservation_id='r-p7z2rvlx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1058379781',owner_user_name='tempest-DeleteServersTestJSON-1058379781-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:29:19Z,user_data=None,user_id='983afbd9c0fe421db4cfe0dd75d45b1b',uuid=782c3d06-ef9e-4ca4-a03b-86f0e6d458a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39b441c5-fe40-4e06-9dcc-b11135805efe", "address": "fa:16:3e:0c:87:08", "network": {"id": "7b58b377-f2fd-4b5c-9bb3-4e7fa4c10faf", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1135444746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76918aa37f848008c8466a38bac1908", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b441c5-fe", "ovs_interfaceid": "39b441c5-fe40-4e06-9dcc-b11135805efe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:29:26 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Converting VIF {"id": "39b441c5-fe40-4e06-9dcc-b11135805efe", "address": "fa:16:3e:0c:87:08", "network": {"id": "7b58b377-f2fd-4b5c-9bb3-4e7fa4c10faf", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1135444746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76918aa37f848008c8466a38bac1908", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b441c5-fe", "ovs_interfaceid": "39b441c5-fe40-4e06-9dcc-b11135805efe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:29:26 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:87:08,bridge_name='br-int',has_traffic_filtering=True,id=39b441c5-fe40-4e06-9dcc-b11135805efe,network=Network(7b58b377-f2fd-4b5c-9bb3-4e7fa4c10faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39b441c5-fe') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:29:26 user nova-compute[73391]: DEBUG os_vif [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:87:08,bridge_name='br-int',has_traffic_filtering=True,id=39b441c5-fe40-4e06-9dcc-b11135805efe,network=Network(7b58b377-f2fd-4b5c-9bb3-4e7fa4c10faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39b441c5-fe') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:29:26 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:26 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:29:26 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:29:26 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:26 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap39b441c5-fe, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:29:26 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap39b441c5-fe, col_values=(('external_ids', {'iface-id': '39b441c5-fe40-4e06-9dcc-b11135805efe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:87:08', 'vm-uuid': '782c3d06-ef9e-4ca4-a03b-86f0e6d458a2'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:29:26 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:26 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:29:26 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:26 user nova-compute[73391]: INFO os_vif [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:87:08,bridge_name='br-int',has_traffic_filtering=True,id=39b441c5-fe40-4e06-9dcc-b11135805efe,network=Network(7b58b377-f2fd-4b5c-9bb3-4e7fa4c10faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39b441c5-fe')
Aug 15 05:29:26 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:29:26 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] No VIF found with MAC fa:16:3e:0c:87:08, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:29:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Acquiring lock "18c8138a-4efc-403f-8b42-e5080c6a51d3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:29:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "18c8138a-4efc-403f-8b42-e5080c6a51d3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:29:27 user nova-compute[73391]: DEBUG nova.compute.manager [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Starting instance... {{(pid=73391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 05:29:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:29:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:29:27 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 05:29:27 user nova-compute[73391]: INFO nova.compute.claims [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Claim successful on node user
Aug 15 05:29:27 user nova-compute[73391]: DEBUG nova.network.neutron [req-2e5a6ef2-b284-4a9f-ac29-c26a017d7a57 req-56f95d19-c664-42aa-ab43-6cbbbc3652db service nova] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Updated VIF entry in instance network info cache for port 39b441c5-fe40-4e06-9dcc-b11135805efe. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:29:27 user nova-compute[73391]: DEBUG nova.network.neutron [req-2e5a6ef2-b284-4a9f-ac29-c26a017d7a57 req-56f95d19-c664-42aa-ab43-6cbbbc3652db service nova] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Updating instance_info_cache with network_info: [{"id": "39b441c5-fe40-4e06-9dcc-b11135805efe", "address": "fa:16:3e:0c:87:08", "network": {"id": "7b58b377-f2fd-4b5c-9bb3-4e7fa4c10faf", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1135444746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76918aa37f848008c8466a38bac1908", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b441c5-fe", "ovs_interfaceid": "39b441c5-fe40-4e06-9dcc-b11135805efe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:29:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2e5a6ef2-b284-4a9f-ac29-c26a017d7a57 req-56f95d19-c664-42aa-ab43-6cbbbc3652db service nova] Releasing lock "refresh_cache-782c3d06-ef9e-4ca4-a03b-86f0e6d458a2" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:29:28 user nova-compute[73391]: DEBUG nova.network.neutron [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Successfully created port: 9cde10e9-3186-4680-8e4d-a3bb0d8600d0 {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 05:29:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:28 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:29:28 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:29:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.545s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:29:28 user nova-compute[73391]: DEBUG nova.compute.manager [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Start building networks asynchronously for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 05:29:28 user nova-compute[73391]: DEBUG nova.compute.manager [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Allocating IP information in the background. {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 05:29:28 user nova-compute[73391]: DEBUG nova.network.neutron [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] allocate_for_instance() {{(pid=73391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 05:29:28 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 05:29:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:28 user nova-compute[73391]: DEBUG nova.compute.manager [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Start building block device mappings for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 05:29:28 user nova-compute[73391]: DEBUG nova.compute.manager [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Start spawning the instance on the hypervisor. {{(pid=73391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 05:29:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Creating instance directory {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 05:29:28 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Creating image(s)
Aug 15 05:29:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Acquiring lock "/opt/stack/data/nova/instances/18c8138a-4efc-403f-8b42-e5080c6a51d3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:29:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "/opt/stack/data/nova/instances/18c8138a-4efc-403f-8b42-e5080c6a51d3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:29:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "/opt/stack/data/nova/instances/18c8138a-4efc-403f-8b42-e5080c6a51d3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:29:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:29:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:28 user nova-compute[73391]: DEBUG nova.policy [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4c932032fc884b14b9268d5df91d45ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88871d09f7e347a4b9104a558604f2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73391) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 05:29:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.236s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:29:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Acquiring lock "999b315ba87151d8252d543312ae7790e7e1583b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:29:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:29:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:29:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.223s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:29:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/18c8138a-4efc-403f-8b42-e5080c6a51d3/disk 1073741824 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:29:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/18c8138a-4efc-403f-8b42-e5080c6a51d3/disk 1073741824" returned: 0 in 0.045s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:29:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:29:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:29:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.229s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:29:29 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Checking if we can resize image /opt/stack/data/nova/instances/18c8138a-4efc-403f-8b42-e5080c6a51d3/disk. size=1073741824 {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 05:29:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c8138a-4efc-403f-8b42-e5080c6a51d3/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:29:29 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c8138a-4efc-403f-8b42-e5080c6a51d3/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:29:29 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Cannot resize image /opt/stack/data/nova/instances/18c8138a-4efc-403f-8b42-e5080c6a51d3/disk to a smaller size. {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 05:29:29 user nova-compute[73391]: DEBUG nova.objects.instance [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lazy-loading 'migration_context' on Instance uuid 18c8138a-4efc-403f-8b42-e5080c6a51d3 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:29:29 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Created local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 05:29:29 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Ensure instance console log exists: /opt/stack/data/nova/instances/18c8138a-4efc-403f-8b42-e5080c6a51d3/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 05:29:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:29:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:29:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:29:30 user nova-compute[73391]: DEBUG nova.network.neutron [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Successfully created port: bf92cfab-6648-42bd-b9f0-2a6f38562165 {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 05:29:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:30 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077370.5468986, 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2 => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:29:30 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] VM Resumed (Lifecycle Event)
Aug 15 05:29:30 user nova-compute[73391]: DEBUG nova.compute.manager [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:29:30 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Guest created on hypervisor {{(pid=73391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 05:29:30 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Instance spawned successfully.
Aug 15 05:29:30 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 05:29:30 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:29:30 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:29:30 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Found default for hw_cdrom_bus of ide {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:29:30 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Found default for hw_disk_bus of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:29:30 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Found default for hw_input_bus of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:29:30 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Found default for hw_pointer_model of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:29:30 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Found default for hw_video_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:29:30 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Found default for hw_vif_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:29:30 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:29:30 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077370.54867, 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2 => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:29:30 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] VM Started (Lifecycle Event)
Aug 15 05:29:30 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:29:30 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:29:30 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:29:30 user nova-compute[73391]: INFO nova.compute.manager [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Took 11.68 seconds to spawn the instance on the hypervisor.
Aug 15 05:29:30 user nova-compute[73391]: DEBUG nova.compute.manager [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:29:30 user nova-compute[73391]: INFO nova.compute.manager [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Took 12.40 seconds to build instance.
Aug 15 05:29:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-5be3a106-ede7-40be-a6c5-6bb2d8510879 tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Lock "782c3d06-ef9e-4ca4-a03b-86f0e6d458a2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.618s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:29:31 user nova-compute[73391]: DEBUG nova.network.neutron [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Successfully updated port: 9cde10e9-3186-4680-8e4d-a3bb0d8600d0 {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:29:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquiring lock "refresh_cache-6ac9d5dc-56be-402f-b9d4-3327bdfd9220" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:29:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquired lock "refresh_cache-6ac9d5dc-56be-402f-b9d4-3327bdfd9220" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:29:31 user nova-compute[73391]: DEBUG nova.network.neutron [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:29:31 user nova-compute[73391]: DEBUG nova.compute.manager [req-2ee3467c-f654-4e79-a49f-a2e3001b3722 req-7c5a3450-900b-4d6e-9fe4-9e3c3d7b7d0d service nova] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Received event network-changed-9cde10e9-3186-4680-8e4d-a3bb0d8600d0 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:29:31 user nova-compute[73391]: DEBUG nova.compute.manager [req-2ee3467c-f654-4e79-a49f-a2e3001b3722 req-7c5a3450-900b-4d6e-9fe4-9e3c3d7b7d0d service nova] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Refreshing instance network info cache due to event network-changed-9cde10e9-3186-4680-8e4d-a3bb0d8600d0. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:29:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2ee3467c-f654-4e79-a49f-a2e3001b3722 req-7c5a3450-900b-4d6e-9fe4-9e3c3d7b7d0d service nova] Acquiring lock "refresh_cache-6ac9d5dc-56be-402f-b9d4-3327bdfd9220" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:29:31 user nova-compute[73391]: DEBUG nova.network.neutron [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:29:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:32 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:32 user nova-compute[73391]: DEBUG nova.network.neutron [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Successfully updated port: bf92cfab-6648-42bd-b9f0-2a6f38562165 {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:29:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Acquiring lock "refresh_cache-18c8138a-4efc-403f-8b42-e5080c6a51d3" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:29:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Acquired lock "refresh_cache-18c8138a-4efc-403f-8b42-e5080c6a51d3" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:29:32 user nova-compute[73391]: DEBUG nova.network.neutron [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:29:32 user nova-compute[73391]: DEBUG nova.compute.manager [req-64336e13-025c-47d6-988c-52bca03a12cd req-ac020640-7aa2-4975-b2dc-237763d10a8c service nova] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Received event network-changed-bf92cfab-6648-42bd-b9f0-2a6f38562165 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:29:32 user nova-compute[73391]: DEBUG nova.compute.manager [req-64336e13-025c-47d6-988c-52bca03a12cd req-ac020640-7aa2-4975-b2dc-237763d10a8c service nova] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Refreshing instance network info cache due to event network-changed-bf92cfab-6648-42bd-b9f0-2a6f38562165. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:29:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-64336e13-025c-47d6-988c-52bca03a12cd req-ac020640-7aa2-4975-b2dc-237763d10a8c service nova] Acquiring lock "refresh_cache-18c8138a-4efc-403f-8b42-e5080c6a51d3" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:29:32 user nova-compute[73391]: DEBUG nova.network.neutron [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.network.neutron [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Updating instance_info_cache with network_info: [{"id": "9cde10e9-3186-4680-8e4d-a3bb0d8600d0", "address": "fa:16:3e:50:39:e0", "network": {"id": "610f78de-5741-4743-815d-d12ba05f8000", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1518164868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b01853a82243369bd71dc0dbedb5d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cde10e9-31", "ovs_interfaceid": "9cde10e9-3186-4680-8e4d-a3bb0d8600d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Releasing lock "refresh_cache-6ac9d5dc-56be-402f-b9d4-3327bdfd9220" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.compute.manager [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Instance network_info: |[{"id": "9cde10e9-3186-4680-8e4d-a3bb0d8600d0", "address": "fa:16:3e:50:39:e0", "network": {"id": "610f78de-5741-4743-815d-d12ba05f8000", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1518164868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b01853a82243369bd71dc0dbedb5d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cde10e9-31", "ovs_interfaceid": "9cde10e9-3186-4680-8e4d-a3bb0d8600d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2ee3467c-f654-4e79-a49f-a2e3001b3722 req-7c5a3450-900b-4d6e-9fe4-9e3c3d7b7d0d service nova] Acquired lock "refresh_cache-6ac9d5dc-56be-402f-b9d4-3327bdfd9220" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.network.neutron [req-2ee3467c-f654-4e79-a49f-a2e3001b3722 req-7c5a3450-900b-4d6e-9fe4-9e3c3d7b7d0d service nova] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Refreshing network info cache for port 9cde10e9-3186-4680-8e4d-a3bb0d8600d0 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Start _get_guest_xml network_info=[{"id": "9cde10e9-3186-4680-8e4d-a3bb0d8600d0", "address": "fa:16:3e:50:39:e0", "network": {"id": "610f78de-5741-4743-815d-d12ba05f8000", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1518164868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b01853a82243369bd71dc0dbedb5d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cde10e9-31", "ovs_interfaceid": "9cde10e9-3186-4680-8e4d-a3bb0d8600d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '191b1dad-305e-4d1c-9b15-515ec59a3278'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:29:33 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:29:33 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:29:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-435247843',display_name='tempest-ServerActionsTestOtherA-server-435247843',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-435247843',id=3,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNF3pif1QWXVpHrEIxShzB1xE/c22B7LSOZtRDzcmt7Dk63BIrH6/RWzxjN8WpKbyeDl3Aa13tDu+mUrmV6NfezccRAEecdR4P4btA7xRgsBIkQydnisHIujmlpX6Glrow==',key_name='tempest-keypair-512432776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60b01853a82243369bd71dc0dbedb5d6',ramdisk_id='',reservation_id='r-v8i1e7fi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1927429987',owner_user_name='tempest-ServerActionsTestOtherA-1927429987-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:29:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='124dcfde552147e2978970386274c70a',uuid=6ac9d5dc-56be-402f-b9d4-3327bdfd9220,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9cde10e9-3186-4680-8e4d-a3bb0d8600d0", "address": "fa:16:3e:50:39:e0", "network": {"id": "610f78de-5741-4743-815d-d12ba05f8000", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1518164868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b01853a82243369bd71dc0dbedb5d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cde10e9-31", "ovs_interfaceid": "9cde10e9-3186-4680-8e4d-a3bb0d8600d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Converting VIF {"id": "9cde10e9-3186-4680-8e4d-a3bb0d8600d0", "address": "fa:16:3e:50:39:e0", "network": {"id": "610f78de-5741-4743-815d-d12ba05f8000", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1518164868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b01853a82243369bd71dc0dbedb5d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cde10e9-31", "ovs_interfaceid": "9cde10e9-3186-4680-8e4d-a3bb0d8600d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:39:e0,bridge_name='br-int',has_traffic_filtering=True,id=9cde10e9-3186-4680-8e4d-a3bb0d8600d0,network=Network(610f78de-5741-4743-815d-d12ba05f8000),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cde10e9-31') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.objects.instance [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lazy-loading 'pci_devices' on Instance uuid 6ac9d5dc-56be-402f-b9d4-3327bdfd9220 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.network.neutron [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Updating instance_info_cache with network_info: [{"id": "bf92cfab-6648-42bd-b9f0-2a6f38562165", "address": "fa:16:3e:ba:49:5f", "network": {"id": "f67152a9-4f18-4d7f-9d3e-5e517bd46813", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-731866550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88871d09f7e347a4b9104a558604f2f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf92cfab-66", "ovs_interfaceid": "bf92cfab-6648-42bd-b9f0-2a6f38562165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:29:33 user nova-compute[73391]:   <uuid>6ac9d5dc-56be-402f-b9d4-3327bdfd9220</uuid>
Aug 15 05:29:33 user nova-compute[73391]:   <name>instance-00000003</name>
Aug 15 05:29:33 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:29:33 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:29:33 user nova-compute[73391]:   <metadata>
Aug 15 05:29:33 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:29:33 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:29:33 user nova-compute[73391]:       <nova:name>tempest-ServerActionsTestOtherA-server-435247843</nova:name>
Aug 15 05:29:33 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:29:33</nova:creationTime>
Aug 15 05:29:33 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:29:33 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:29:33 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:29:33 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:29:33 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:29:33 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:29:33 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:29:33 user nova-compute[73391]:       <nova:owner>
Aug 15 05:29:33 user nova-compute[73391]:         <nova:user uuid="124dcfde552147e2978970386274c70a">tempest-ServerActionsTestOtherA-1927429987-project-member</nova:user>
Aug 15 05:29:33 user nova-compute[73391]:         <nova:project uuid="60b01853a82243369bd71dc0dbedb5d6">tempest-ServerActionsTestOtherA-1927429987</nova:project>
Aug 15 05:29:33 user nova-compute[73391]:       </nova:owner>
Aug 15 05:29:33 user nova-compute[73391]:       <nova:root type="image" uuid="191b1dad-305e-4d1c-9b15-515ec59a3278"/>
Aug 15 05:29:33 user nova-compute[73391]:       <nova:ports>
Aug 15 05:29:33 user nova-compute[73391]:         <nova:port uuid="9cde10e9-3186-4680-8e4d-a3bb0d8600d0">
Aug 15 05:29:33 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 15 05:29:33 user nova-compute[73391]:         </nova:port>
Aug 15 05:29:33 user nova-compute[73391]:       </nova:ports>
Aug 15 05:29:33 user nova-compute[73391]:     </nova:instance>
Aug 15 05:29:33 user nova-compute[73391]:   </metadata>
Aug 15 05:29:33 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:29:33 user nova-compute[73391]:     <system>
Aug 15 05:29:33 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:29:33 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:29:33 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:29:33 user nova-compute[73391]:       <entry name="serial">6ac9d5dc-56be-402f-b9d4-3327bdfd9220</entry>
Aug 15 05:29:33 user nova-compute[73391]:       <entry name="uuid">6ac9d5dc-56be-402f-b9d4-3327bdfd9220</entry>
Aug 15 05:29:33 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:29:33 user nova-compute[73391]:     </system>
Aug 15 05:29:33 user nova-compute[73391]:   </sysinfo>
Aug 15 05:29:33 user nova-compute[73391]:   <os>
Aug 15 05:29:33 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:29:33 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:29:33 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:29:33 user nova-compute[73391]:   </os>
Aug 15 05:29:33 user nova-compute[73391]:   <features>
Aug 15 05:29:33 user nova-compute[73391]:     <acpi/>
Aug 15 05:29:33 user nova-compute[73391]:     <apic/>
Aug 15 05:29:33 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:29:33 user nova-compute[73391]:   </features>
Aug 15 05:29:33 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:29:33 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:29:33 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:29:33 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:29:33 user nova-compute[73391]:   </clock>
Aug 15 05:29:33 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:29:33 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:29:33 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:29:33 user nova-compute[73391]:   </cpu>
Aug 15 05:29:33 user nova-compute[73391]:   <devices>
Aug 15 05:29:33 user nova-compute[73391]:     <disk type="file" device="disk">
Aug 15 05:29:33 user nova-compute[73391]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 05:29:33 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk"/>
Aug 15 05:29:33 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:29:33 user nova-compute[73391]:     </disk>
Aug 15 05:29:33 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:29:33 user nova-compute[73391]:       <mac address="fa:16:3e:50:39:e0"/>
Aug 15 05:29:33 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:29:33 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:29:33 user nova-compute[73391]:       <target dev="tap9cde10e9-31"/>
Aug 15 05:29:33 user nova-compute[73391]:     </interface>
Aug 15 05:29:33 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:29:33 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/console.log" append="off"/>
Aug 15 05:29:33 user nova-compute[73391]:     </serial>
Aug 15 05:29:33 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:29:33 user nova-compute[73391]:     <video>
Aug 15 05:29:33 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:29:33 user nova-compute[73391]:     </video>
Aug 15 05:29:33 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:29:33 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:29:33 user nova-compute[73391]:     </rng>
Aug 15 05:29:33 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:29:33 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:29:33 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:29:33 user nova-compute[73391]:     </memballoon>
Aug 15 05:29:33 user nova-compute[73391]:   </devices>
Aug 15 05:29:33 user nova-compute[73391]: </domain>
Aug 15 05:29:33 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:29:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-435247843',display_name='tempest-ServerActionsTestOtherA-server-435247843',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-435247843',id=3,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNF3pif1QWXVpHrEIxShzB1xE/c22B7LSOZtRDzcmt7Dk63BIrH6/RWzxjN8WpKbyeDl3Aa13tDu+mUrmV6NfezccRAEecdR4P4btA7xRgsBIkQydnisHIujmlpX6Glrow==',key_name='tempest-keypair-512432776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60b01853a82243369bd71dc0dbedb5d6',ramdisk_id='',reservation_id='r-v8i1e7fi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1927429987',owner_user_name='tempest-ServerActionsTestOtherA-1927429987-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:29:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='124dcfde552147e2978970386274c70a',uuid=6ac9d5dc-56be-402f-b9d4-3327bdfd9220,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9cde10e9-3186-4680-8e4d-a3bb0d8600d0", "address": "fa:16:3e:50:39:e0", "network": {"id": "610f78de-5741-4743-815d-d12ba05f8000", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1518164868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b01853a82243369bd71dc0dbedb5d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cde10e9-31", "ovs_interfaceid": "9cde10e9-3186-4680-8e4d-a3bb0d8600d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Converting VIF {"id": "9cde10e9-3186-4680-8e4d-a3bb0d8600d0", "address": "fa:16:3e:50:39:e0", "network": {"id": "610f78de-5741-4743-815d-d12ba05f8000", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1518164868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b01853a82243369bd71dc0dbedb5d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cde10e9-31", "ovs_interfaceid": "9cde10e9-3186-4680-8e4d-a3bb0d8600d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:39:e0,bridge_name='br-int',has_traffic_filtering=True,id=9cde10e9-3186-4680-8e4d-a3bb0d8600d0,network=Network(610f78de-5741-4743-815d-d12ba05f8000),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cde10e9-31') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG os_vif [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:39:e0,bridge_name='br-int',has_traffic_filtering=True,id=9cde10e9-3186-4680-8e4d-a3bb0d8600d0,network=Network(610f78de-5741-4743-815d-d12ba05f8000),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cde10e9-31') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9cde10e9-31, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9cde10e9-31, col_values=(('external_ids', {'iface-id': '9cde10e9-3186-4680-8e4d-a3bb0d8600d0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:39:e0', 'vm-uuid': '6ac9d5dc-56be-402f-b9d4-3327bdfd9220'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Releasing lock "refresh_cache-18c8138a-4efc-403f-8b42-e5080c6a51d3" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.compute.manager [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Instance network_info: |[{"id": "bf92cfab-6648-42bd-b9f0-2a6f38562165", "address": "fa:16:3e:ba:49:5f", "network": {"id": "f67152a9-4f18-4d7f-9d3e-5e517bd46813", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-731866550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88871d09f7e347a4b9104a558604f2f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf92cfab-66", "ovs_interfaceid": "bf92cfab-6648-42bd-b9f0-2a6f38562165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-64336e13-025c-47d6-988c-52bca03a12cd req-ac020640-7aa2-4975-b2dc-237763d10a8c service nova] Acquired lock "refresh_cache-18c8138a-4efc-403f-8b42-e5080c6a51d3" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.network.neutron [req-64336e13-025c-47d6-988c-52bca03a12cd req-ac020640-7aa2-4975-b2dc-237763d10a8c service nova] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Refreshing network info cache for port bf92cfab-6648-42bd-b9f0-2a6f38562165 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Start _get_guest_xml network_info=[{"id": "bf92cfab-6648-42bd-b9f0-2a6f38562165", "address": "fa:16:3e:ba:49:5f", "network": {"id": "f67152a9-4f18-4d7f-9d3e-5e517bd46813", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-731866550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88871d09f7e347a4b9104a558604f2f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf92cfab-66", "ovs_interfaceid": "bf92cfab-6648-42bd-b9f0-2a6f38562165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '191b1dad-305e-4d1c-9b15-515ec59a3278'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:29:33 user nova-compute[73391]: INFO os_vif [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:39:e0,bridge_name='br-int',has_traffic_filtering=True,id=9cde10e9-3186-4680-8e4d-a3bb0d8600d0,network=Network(610f78de-5741-4743-815d-d12ba05f8000),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cde10e9-31')
Aug 15 05:29:33 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:29:33 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:29:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1277477436',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1277477436',id=4,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+vdfT2KUhLvPzx3dX+PrdTohkqxawdWMutgX8a450R3MvuBVzacV3c2EJESUdzVmjzs1fL7ALVh4jlwXHV/wX8tRMRsuEAx2ENCOBZxjSP5MZ2JRhfupI25RQTizDxiw==',key_name='tempest-keypair-700723771',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88871d09f7e347a4b9104a558604f2f6',ramdisk_id='',reservation_id='r-j1g463qr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1774553789',owner_user_name='tempest-AttachVolumeShelveTestJSON-1774553789-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:29:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c932032fc884b14b9268d5df91d45ea',uuid=18c8138a-4efc-403f-8b42-e5080c6a51d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf92cfab-6648-42bd-b9f0-2a6f38562165", "address": "fa:16:3e:ba:49:5f", "network": {"id": "f67152a9-4f18-4d7f-9d3e-5e517bd46813", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-731866550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88871d09f7e347a4b9104a558604f2f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf92cfab-66", "ovs_interfaceid": "bf92cfab-6648-42bd-b9f0-2a6f38562165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Converting VIF {"id": "bf92cfab-6648-42bd-b9f0-2a6f38562165", "address": "fa:16:3e:ba:49:5f", "network": {"id": "f67152a9-4f18-4d7f-9d3e-5e517bd46813", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-731866550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88871d09f7e347a4b9104a558604f2f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf92cfab-66", "ovs_interfaceid": "bf92cfab-6648-42bd-b9f0-2a6f38562165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:49:5f,bridge_name='br-int',has_traffic_filtering=True,id=bf92cfab-6648-42bd-b9f0-2a6f38562165,network=Network(f67152a9-4f18-4d7f-9d3e-5e517bd46813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf92cfab-66') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.objects.instance [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lazy-loading 'pci_devices' on Instance uuid 18c8138a-4efc-403f-8b42-e5080c6a51d3 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] No VIF found with MAC fa:16:3e:50:39:e0, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:29:33 user nova-compute[73391]:   <uuid>18c8138a-4efc-403f-8b42-e5080c6a51d3</uuid>
Aug 15 05:29:33 user nova-compute[73391]:   <name>instance-00000004</name>
Aug 15 05:29:33 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:29:33 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:29:33 user nova-compute[73391]:   <metadata>
Aug 15 05:29:33 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:29:33 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:29:33 user nova-compute[73391]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1277477436</nova:name>
Aug 15 05:29:33 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:29:33</nova:creationTime>
Aug 15 05:29:33 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:29:33 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:29:33 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:29:33 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:29:33 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:29:33 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:29:33 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:29:33 user nova-compute[73391]:       <nova:owner>
Aug 15 05:29:33 user nova-compute[73391]:         <nova:user uuid="4c932032fc884b14b9268d5df91d45ea">tempest-AttachVolumeShelveTestJSON-1774553789-project-member</nova:user>
Aug 15 05:29:33 user nova-compute[73391]:         <nova:project uuid="88871d09f7e347a4b9104a558604f2f6">tempest-AttachVolumeShelveTestJSON-1774553789</nova:project>
Aug 15 05:29:33 user nova-compute[73391]:       </nova:owner>
Aug 15 05:29:33 user nova-compute[73391]:       <nova:root type="image" uuid="191b1dad-305e-4d1c-9b15-515ec59a3278"/>
Aug 15 05:29:33 user nova-compute[73391]:       <nova:ports>
Aug 15 05:29:33 user nova-compute[73391]:         <nova:port uuid="bf92cfab-6648-42bd-b9f0-2a6f38562165">
Aug 15 05:29:33 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 05:29:33 user nova-compute[73391]:         </nova:port>
Aug 15 05:29:33 user nova-compute[73391]:       </nova:ports>
Aug 15 05:29:33 user nova-compute[73391]:     </nova:instance>
Aug 15 05:29:33 user nova-compute[73391]:   </metadata>
Aug 15 05:29:33 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:29:33 user nova-compute[73391]:     <system>
Aug 15 05:29:33 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:29:33 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:29:33 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:29:33 user nova-compute[73391]:       <entry name="serial">18c8138a-4efc-403f-8b42-e5080c6a51d3</entry>
Aug 15 05:29:33 user nova-compute[73391]:       <entry name="uuid">18c8138a-4efc-403f-8b42-e5080c6a51d3</entry>
Aug 15 05:29:33 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:29:33 user nova-compute[73391]:     </system>
Aug 15 05:29:33 user nova-compute[73391]:   </sysinfo>
Aug 15 05:29:33 user nova-compute[73391]:   <os>
Aug 15 05:29:33 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:29:33 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:29:33 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:29:33 user nova-compute[73391]:   </os>
Aug 15 05:29:33 user nova-compute[73391]:   <features>
Aug 15 05:29:33 user nova-compute[73391]:     <acpi/>
Aug 15 05:29:33 user nova-compute[73391]:     <apic/>
Aug 15 05:29:33 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:29:33 user nova-compute[73391]:   </features>
Aug 15 05:29:33 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:29:33 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:29:33 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:29:33 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:29:33 user nova-compute[73391]:   </clock>
Aug 15 05:29:33 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:29:33 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:29:33 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:29:33 user nova-compute[73391]:   </cpu>
Aug 15 05:29:33 user nova-compute[73391]:   <devices>
Aug 15 05:29:33 user nova-compute[73391]:     <disk type="file" device="disk">
Aug 15 05:29:33 user nova-compute[73391]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 05:29:33 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/18c8138a-4efc-403f-8b42-e5080c6a51d3/disk"/>
Aug 15 05:29:33 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:29:33 user nova-compute[73391]:     </disk>
Aug 15 05:29:33 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:29:33 user nova-compute[73391]:       <mac address="fa:16:3e:ba:49:5f"/>
Aug 15 05:29:33 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:29:33 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:29:33 user nova-compute[73391]:       <target dev="tapbf92cfab-66"/>
Aug 15 05:29:33 user nova-compute[73391]:     </interface>
Aug 15 05:29:33 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:29:33 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/18c8138a-4efc-403f-8b42-e5080c6a51d3/console.log" append="off"/>
Aug 15 05:29:33 user nova-compute[73391]:     </serial>
Aug 15 05:29:33 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:29:33 user nova-compute[73391]:     <video>
Aug 15 05:29:33 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:29:33 user nova-compute[73391]:     </video>
Aug 15 05:29:33 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:29:33 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:29:33 user nova-compute[73391]:     </rng>
Aug 15 05:29:33 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:29:33 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:29:33 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:29:33 user nova-compute[73391]:     </memballoon>
Aug 15 05:29:33 user nova-compute[73391]:   </devices>
Aug 15 05:29:33 user nova-compute[73391]: </domain>
Aug 15 05:29:33 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:29:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1277477436',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1277477436',id=4,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+vdfT2KUhLvPzx3dX+PrdTohkqxawdWMutgX8a450R3MvuBVzacV3c2EJESUdzVmjzs1fL7ALVh4jlwXHV/wX8tRMRsuEAx2ENCOBZxjSP5MZ2JRhfupI25RQTizDxiw==',key_name='tempest-keypair-700723771',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88871d09f7e347a4b9104a558604f2f6',ramdisk_id='',reservation_id='r-j1g463qr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1774553789',owner_user_name='tempest-AttachVolumeShelveTestJSON-1774553789-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:29:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c932032fc884b14b9268d5df91d45ea',uuid=18c8138a-4efc-403f-8b42-e5080c6a51d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bf92cfab-6648-42bd-b9f0-2a6f38562165", "address": "fa:16:3e:ba:49:5f", "network": {"id": "f67152a9-4f18-4d7f-9d3e-5e517bd46813", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-731866550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88871d09f7e347a4b9104a558604f2f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf92cfab-66", "ovs_interfaceid": "bf92cfab-6648-42bd-b9f0-2a6f38562165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Converting VIF {"id": "bf92cfab-6648-42bd-b9f0-2a6f38562165", "address": "fa:16:3e:ba:49:5f", "network": {"id": "f67152a9-4f18-4d7f-9d3e-5e517bd46813", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-731866550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88871d09f7e347a4b9104a558604f2f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf92cfab-66", "ovs_interfaceid": "bf92cfab-6648-42bd-b9f0-2a6f38562165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:49:5f,bridge_name='br-int',has_traffic_filtering=True,id=bf92cfab-6648-42bd-b9f0-2a6f38562165,network=Network(f67152a9-4f18-4d7f-9d3e-5e517bd46813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf92cfab-66') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG os_vif [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:49:5f,bridge_name='br-int',has_traffic_filtering=True,id=bf92cfab-6648-42bd-b9f0-2a6f38562165,network=Network(f67152a9-4f18-4d7f-9d3e-5e517bd46813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf92cfab-66') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf92cfab-66, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbf92cfab-66, col_values=(('external_ids', {'iface-id': 'bf92cfab-6648-42bd-b9f0-2a6f38562165', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:49:5f', 'vm-uuid': '18c8138a-4efc-403f-8b42-e5080c6a51d3'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:33 user nova-compute[73391]: INFO os_vif [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:49:5f,bridge_name='br-int',has_traffic_filtering=True,id=bf92cfab-6648-42bd-b9f0-2a6f38562165,network=Network(f67152a9-4f18-4d7f-9d3e-5e517bd46813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf92cfab-66')
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] No VIF found with MAC fa:16:3e:ba:49:5f, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:34 user nova-compute[73391]: DEBUG nova.network.neutron [req-2ee3467c-f654-4e79-a49f-a2e3001b3722 req-7c5a3450-900b-4d6e-9fe4-9e3c3d7b7d0d service nova] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Updated VIF entry in instance network info cache for port 9cde10e9-3186-4680-8e4d-a3bb0d8600d0. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:29:34 user nova-compute[73391]: DEBUG nova.network.neutron [req-2ee3467c-f654-4e79-a49f-a2e3001b3722 req-7c5a3450-900b-4d6e-9fe4-9e3c3d7b7d0d service nova] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Updating instance_info_cache with network_info: [{"id": "9cde10e9-3186-4680-8e4d-a3bb0d8600d0", "address": "fa:16:3e:50:39:e0", "network": {"id": "610f78de-5741-4743-815d-d12ba05f8000", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1518164868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b01853a82243369bd71dc0dbedb5d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cde10e9-31", "ovs_interfaceid": "9cde10e9-3186-4680-8e4d-a3bb0d8600d0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:29:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2ee3467c-f654-4e79-a49f-a2e3001b3722 req-7c5a3450-900b-4d6e-9fe4-9e3c3d7b7d0d service nova] Releasing lock "refresh_cache-6ac9d5dc-56be-402f-b9d4-3327bdfd9220" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:29:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:34 user nova-compute[73391]: DEBUG nova.network.neutron [req-64336e13-025c-47d6-988c-52bca03a12cd req-ac020640-7aa2-4975-b2dc-237763d10a8c service nova] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Updated VIF entry in instance network info cache for port bf92cfab-6648-42bd-b9f0-2a6f38562165. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:29:34 user nova-compute[73391]: DEBUG nova.network.neutron [req-64336e13-025c-47d6-988c-52bca03a12cd req-ac020640-7aa2-4975-b2dc-237763d10a8c service nova] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Updating instance_info_cache with network_info: [{"id": "bf92cfab-6648-42bd-b9f0-2a6f38562165", "address": "fa:16:3e:ba:49:5f", "network": {"id": "f67152a9-4f18-4d7f-9d3e-5e517bd46813", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-731866550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88871d09f7e347a4b9104a558604f2f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf92cfab-66", "ovs_interfaceid": "bf92cfab-6648-42bd-b9f0-2a6f38562165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:29:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-64336e13-025c-47d6-988c-52bca03a12cd req-ac020640-7aa2-4975-b2dc-237763d10a8c service nova] Releasing lock "refresh_cache-18c8138a-4efc-403f-8b42-e5080c6a51d3" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:29:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:36 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:36 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:36 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:36 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:37 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:37 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:37 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:37 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:37 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:37 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:38 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:38 user nova-compute[73391]: DEBUG nova.compute.manager [req-468f4c00-57c1-47b5-9bad-dd1f3c0961e7 req-64b165cb-f0ad-40e3-b856-9743b28bcbda service nova] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Received event network-vif-plugged-39b441c5-fe40-4e06-9dcc-b11135805efe {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:29:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-468f4c00-57c1-47b5-9bad-dd1f3c0961e7 req-64b165cb-f0ad-40e3-b856-9743b28bcbda service nova] Acquiring lock "782c3d06-ef9e-4ca4-a03b-86f0e6d458a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:29:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-468f4c00-57c1-47b5-9bad-dd1f3c0961e7 req-64b165cb-f0ad-40e3-b856-9743b28bcbda service nova] Lock "782c3d06-ef9e-4ca4-a03b-86f0e6d458a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:29:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-468f4c00-57c1-47b5-9bad-dd1f3c0961e7 req-64b165cb-f0ad-40e3-b856-9743b28bcbda service nova] Lock "782c3d06-ef9e-4ca4-a03b-86f0e6d458a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:29:38 user nova-compute[73391]: DEBUG nova.compute.manager [req-468f4c00-57c1-47b5-9bad-dd1f3c0961e7 req-64b165cb-f0ad-40e3-b856-9743b28bcbda service nova] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] No waiting events found dispatching network-vif-plugged-39b441c5-fe40-4e06-9dcc-b11135805efe {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:29:38 user nova-compute[73391]: WARNING nova.compute.manager [req-468f4c00-57c1-47b5-9bad-dd1f3c0961e7 req-64b165cb-f0ad-40e3-b856-9743b28bcbda service nova] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Received unexpected event network-vif-plugged-39b441c5-fe40-4e06-9dcc-b11135805efe for instance with vm_state active and task_state None.
Aug 15 05:29:38 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:39 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077379.9281716, 18c8138a-4efc-403f-8b42-e5080c6a51d3 => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:29:39 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] VM Resumed (Lifecycle Event)
Aug 15 05:29:39 user nova-compute[73391]: DEBUG nova.compute.manager [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:29:39 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Guest created on hypervisor {{(pid=73391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 05:29:39 user nova-compute[73391]: DEBUG nova.compute.manager [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:29:39 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Guest created on hypervisor {{(pid=73391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 05:29:39 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Instance spawned successfully.
Aug 15 05:29:39 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 05:29:39 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Instance spawned successfully.
Aug 15 05:29:39 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 05:29:39 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:29:39 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:29:39 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Found default for hw_cdrom_bus of ide {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:29:39 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Found default for hw_disk_bus of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:29:39 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Found default for hw_input_bus of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:29:39 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Found default for hw_pointer_model of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:29:39 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Found default for hw_video_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:29:39 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Found default for hw_vif_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:29:40 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:29:40 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077379.9299798, 18c8138a-4efc-403f-8b42-e5080c6a51d3 => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:29:40 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] VM Started (Lifecycle Event)
Aug 15 05:29:40 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Found default for hw_cdrom_bus of ide {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:29:40 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Found default for hw_disk_bus of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:29:40 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Found default for hw_input_bus of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:29:40 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Found default for hw_pointer_model of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:29:40 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Found default for hw_video_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:29:40 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Found default for hw_vif_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:29:40 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:29:40 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:29:40 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:29:40 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077379.9375706, 6ac9d5dc-56be-402f-b9d4-3327bdfd9220 => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:29:40 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] VM Resumed (Lifecycle Event)
Aug 15 05:29:40 user nova-compute[73391]: INFO nova.compute.manager [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Took 11.47 seconds to spawn the instance on the hypervisor.
Aug 15 05:29:40 user nova-compute[73391]: DEBUG nova.compute.manager [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:29:40 user nova-compute[73391]: INFO nova.compute.manager [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Took 14.54 seconds to spawn the instance on the hypervisor.
Aug 15 05:29:40 user nova-compute[73391]: DEBUG nova.compute.manager [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:29:40 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:29:40 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:29:40 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:29:40 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077379.9378176, 6ac9d5dc-56be-402f-b9d4-3327bdfd9220 => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:29:40 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] VM Started (Lifecycle Event)
Aug 15 05:29:40 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:29:40 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:29:40 user nova-compute[73391]: INFO nova.compute.manager [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Took 12.53 seconds to build instance.
Aug 15 05:29:40 user nova-compute[73391]: INFO nova.compute.manager [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Took 15.52 seconds to build instance.
Aug 15 05:29:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c7ecada2-8784-474c-98db-86278e042242 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "18c8138a-4efc-403f-8b42-e5080c6a51d3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.709s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:29:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ec8f4921-4a54-492d-a183-34e0137c7431 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "6ac9d5dc-56be-402f-b9d4-3327bdfd9220" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.773s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:29:40 user nova-compute[73391]: DEBUG nova.compute.manager [req-3fb2f0e0-31fb-4fcb-a882-b02b8005cec2 req-80990db4-a23b-49f1-a1bf-17dfca97353e service nova] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Received event network-vif-plugged-39b441c5-fe40-4e06-9dcc-b11135805efe {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:29:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-3fb2f0e0-31fb-4fcb-a882-b02b8005cec2 req-80990db4-a23b-49f1-a1bf-17dfca97353e service nova] Acquiring lock "782c3d06-ef9e-4ca4-a03b-86f0e6d458a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:29:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-3fb2f0e0-31fb-4fcb-a882-b02b8005cec2 req-80990db4-a23b-49f1-a1bf-17dfca97353e service nova] Lock "782c3d06-ef9e-4ca4-a03b-86f0e6d458a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:29:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-3fb2f0e0-31fb-4fcb-a882-b02b8005cec2 req-80990db4-a23b-49f1-a1bf-17dfca97353e service nova] Lock "782c3d06-ef9e-4ca4-a03b-86f0e6d458a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:29:40 user nova-compute[73391]: DEBUG nova.compute.manager [req-3fb2f0e0-31fb-4fcb-a882-b02b8005cec2 req-80990db4-a23b-49f1-a1bf-17dfca97353e service nova] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] No waiting events found dispatching network-vif-plugged-39b441c5-fe40-4e06-9dcc-b11135805efe {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:29:40 user nova-compute[73391]: WARNING nova.compute.manager [req-3fb2f0e0-31fb-4fcb-a882-b02b8005cec2 req-80990db4-a23b-49f1-a1bf-17dfca97353e service nova] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Received unexpected event network-vif-plugged-39b441c5-fe40-4e06-9dcc-b11135805efe for instance with vm_state active and task_state None.
Aug 15 05:29:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Acquiring lock "4b9f5970-65c5-4eff-a4bf-d18a9c916c90" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:29:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Lock "4b9f5970-65c5-4eff-a4bf-d18a9c916c90" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:29:42 user nova-compute[73391]: DEBUG nova.compute.manager [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Starting instance... {{(pid=73391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 05:29:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:29:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:29:42 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 05:29:42 user nova-compute[73391]: INFO nova.compute.claims [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Claim successful on node user
Aug 15 05:29:43 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:29:43 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:29:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.389s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:29:43 user nova-compute[73391]: DEBUG nova.compute.manager [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Start building networks asynchronously for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 05:29:43 user nova-compute[73391]: DEBUG nova.compute.manager [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Allocating IP information in the background. {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 05:29:43 user nova-compute[73391]: DEBUG nova.network.neutron [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] allocate_for_instance() {{(pid=73391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 05:29:43 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 05:29:43 user nova-compute[73391]: DEBUG nova.compute.manager [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Start building block device mappings for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 05:29:43 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:43 user nova-compute[73391]: DEBUG nova.policy [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1ec3b8ac7ed748b49325a372f164f931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2058584e624e869bf316e4cee4d669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73391) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 05:29:43 user nova-compute[73391]: DEBUG nova.compute.manager [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Start spawning the instance on the hypervisor. {{(pid=73391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 05:29:43 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Creating instance directory {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 05:29:43 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Creating image(s)
Aug 15 05:29:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Acquiring lock "/opt/stack/data/nova/instances/4b9f5970-65c5-4eff-a4bf-d18a9c916c90/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:29:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Lock "/opt/stack/data/nova/instances/4b9f5970-65c5-4eff-a4bf-d18a9c916c90/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:29:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Lock "/opt/stack/data/nova/instances/4b9f5970-65c5-4eff-a4bf-d18a9c916c90/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:29:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:29:43 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.312s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:29:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Acquiring lock "999b315ba87151d8252d543312ae7790e7e1583b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:29:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.019s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:29:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:29:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.243s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:29:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/4b9f5970-65c5-4eff-a4bf-d18a9c916c90/disk 1073741824 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:29:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/4b9f5970-65c5-4eff-a4bf-d18a9c916c90/disk 1073741824" returned: 0 in 0.090s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:29:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.345s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:29:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:29:44 user nova-compute[73391]: DEBUG nova.network.neutron [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Successfully created port: a5f1c5ab-e060-450e-82ee-aa1e4b0ee019 {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 05:29:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.365s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:29:44 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4b9f5970-65c5-4eff-a4bf-d18a9c916c90/disk. size=1073741824 {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 05:29:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b9f5970-65c5-4eff-a4bf-d18a9c916c90/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:29:45 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b9f5970-65c5-4eff-a4bf-d18a9c916c90/disk --force-share --output=json" returned: 0 in 0.300s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:29:45 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Cannot resize image /opt/stack/data/nova/instances/4b9f5970-65c5-4eff-a4bf-d18a9c916c90/disk to a smaller size. {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 05:29:45 user nova-compute[73391]: DEBUG nova.objects.instance [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Lazy-loading 'migration_context' on Instance uuid 4b9f5970-65c5-4eff-a4bf-d18a9c916c90 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:29:45 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Created local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 05:29:45 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Ensure instance console log exists: /opt/stack/data/nova/instances/4b9f5970-65c5-4eff-a4bf-d18a9c916c90/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 05:29:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:29:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:29:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:29:46 user nova-compute[73391]: DEBUG nova.network.neutron [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Successfully updated port: a5f1c5ab-e060-450e-82ee-aa1e4b0ee019 {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:29:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Acquiring lock "refresh_cache-4b9f5970-65c5-4eff-a4bf-d18a9c916c90" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:29:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Acquired lock "refresh_cache-4b9f5970-65c5-4eff-a4bf-d18a9c916c90" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:29:46 user nova-compute[73391]: DEBUG nova.network.neutron [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:29:46 user nova-compute[73391]: DEBUG nova.network.neutron [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:29:46 user nova-compute[73391]: DEBUG nova.compute.manager [req-8e30ff59-81aa-474a-a70c-a49dc693a223 req-d48bace9-4fdd-4f7a-91d6-ddb1b3ff79e6 service nova] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Received event network-changed-a5f1c5ab-e060-450e-82ee-aa1e4b0ee019 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:29:46 user nova-compute[73391]: DEBUG nova.compute.manager [req-8e30ff59-81aa-474a-a70c-a49dc693a223 req-d48bace9-4fdd-4f7a-91d6-ddb1b3ff79e6 service nova] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Refreshing instance network info cache due to event network-changed-a5f1c5ab-e060-450e-82ee-aa1e4b0ee019. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:29:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-8e30ff59-81aa-474a-a70c-a49dc693a223 req-d48bace9-4fdd-4f7a-91d6-ddb1b3ff79e6 service nova] Acquiring lock "refresh_cache-4b9f5970-65c5-4eff-a4bf-d18a9c916c90" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:29:46 user nova-compute[73391]: DEBUG nova.network.neutron [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Updating instance_info_cache with network_info: [{"id": "a5f1c5ab-e060-450e-82ee-aa1e4b0ee019", "address": "fa:16:3e:11:2e:cb", "network": {"id": "f69631d8-9da0-4c6d-8530-e8c455942703", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-108520740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d2058584e624e869bf316e4cee4d669", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f1c5ab-e0", "ovs_interfaceid": "a5f1c5ab-e060-450e-82ee-aa1e4b0ee019", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:29:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Releasing lock "refresh_cache-4b9f5970-65c5-4eff-a4bf-d18a9c916c90" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:29:46 user nova-compute[73391]: DEBUG nova.compute.manager [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Instance network_info: |[{"id": "a5f1c5ab-e060-450e-82ee-aa1e4b0ee019", "address": "fa:16:3e:11:2e:cb", "network": {"id": "f69631d8-9da0-4c6d-8530-e8c455942703", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-108520740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d2058584e624e869bf316e4cee4d669", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f1c5ab-e0", "ovs_interfaceid": "a5f1c5ab-e060-450e-82ee-aa1e4b0ee019", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 05:29:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-8e30ff59-81aa-474a-a70c-a49dc693a223 req-d48bace9-4fdd-4f7a-91d6-ddb1b3ff79e6 service nova] Acquired lock "refresh_cache-4b9f5970-65c5-4eff-a4bf-d18a9c916c90" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:29:46 user nova-compute[73391]: DEBUG nova.network.neutron [req-8e30ff59-81aa-474a-a70c-a49dc693a223 req-d48bace9-4fdd-4f7a-91d6-ddb1b3ff79e6 service nova] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Refreshing network info cache for port a5f1c5ab-e060-450e-82ee-aa1e4b0ee019 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:29:47 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Start _get_guest_xml network_info=[{"id": "a5f1c5ab-e060-450e-82ee-aa1e4b0ee019", "address": "fa:16:3e:11:2e:cb", "network": {"id": "f69631d8-9da0-4c6d-8530-e8c455942703", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-108520740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d2058584e624e869bf316e4cee4d669", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f1c5ab-e0", "ovs_interfaceid": "a5f1c5ab-e060-450e-82ee-aa1e4b0ee019", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '191b1dad-305e-4d1c-9b15-515ec59a3278'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:29:47 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:29:47 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:29:47 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:29:47 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:29:47 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:29:47 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:29:47 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:29:47 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:29:47 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:29:47 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:29:47 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:29:47 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:29:47 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:29:47 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:29:47 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:29:47 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:29:47 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:29:47 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:29:47 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:29:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-970370290',display_name='tempest-VolumesAdminNegativeTest-server-970370290',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-970370290',id=5,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFoiRjTcSXoXGPSXt2dEaJ1TUHvJ1iPvsuzQhjrsR1YOhdaQJiulCl/8vOJk0v7OZvBwniIpJfz7axQVLkiI5SNTmVeph0GnKHTfvZs+VtUlSTdMOXW7raJqYhasrmIz3Q==',key_name='tempest-keypair-1763529189',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d2058584e624e869bf316e4cee4d669',ramdisk_id='',reservation_id='r-lsi795rg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1183783318',owner_user_name='tempest-VolumesAdminNegativeTest-1183783318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:29:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ec3b8ac7ed748b49325a372f164f931',uuid=4b9f5970-65c5-4eff-a4bf-d18a9c916c90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5f1c5ab-e060-450e-82ee-aa1e4b0ee019", "address": "fa:16:3e:11:2e:cb", "network": {"id": "f69631d8-9da0-4c6d-8530-e8c455942703", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-108520740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d2058584e624e869bf316e4cee4d669", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f1c5ab-e0", "ovs_interfaceid": "a5f1c5ab-e060-450e-82ee-aa1e4b0ee019", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:29:47 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Converting VIF {"id": "a5f1c5ab-e060-450e-82ee-aa1e4b0ee019", "address": "fa:16:3e:11:2e:cb", "network": {"id": "f69631d8-9da0-4c6d-8530-e8c455942703", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-108520740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d2058584e624e869bf316e4cee4d669", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f1c5ab-e0", "ovs_interfaceid": "a5f1c5ab-e060-450e-82ee-aa1e4b0ee019", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:29:47 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:2e:cb,bridge_name='br-int',has_traffic_filtering=True,id=a5f1c5ab-e060-450e-82ee-aa1e4b0ee019,network=Network(f69631d8-9da0-4c6d-8530-e8c455942703),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5f1c5ab-e0') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:29:47 user nova-compute[73391]: DEBUG nova.objects.instance [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b9f5970-65c5-4eff-a4bf-d18a9c916c90 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:29:47 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:29:47 user nova-compute[73391]:   <uuid>4b9f5970-65c5-4eff-a4bf-d18a9c916c90</uuid>
Aug 15 05:29:47 user nova-compute[73391]:   <name>instance-00000005</name>
Aug 15 05:29:47 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:29:47 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:29:47 user nova-compute[73391]:   <metadata>
Aug 15 05:29:47 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:29:47 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:29:47 user nova-compute[73391]:       <nova:name>tempest-VolumesAdminNegativeTest-server-970370290</nova:name>
Aug 15 05:29:47 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:29:47</nova:creationTime>
Aug 15 05:29:47 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:29:47 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:29:47 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:29:47 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:29:47 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:29:47 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:29:47 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:29:47 user nova-compute[73391]:       <nova:owner>
Aug 15 05:29:47 user nova-compute[73391]:         <nova:user uuid="1ec3b8ac7ed748b49325a372f164f931">tempest-VolumesAdminNegativeTest-1183783318-project-member</nova:user>
Aug 15 05:29:47 user nova-compute[73391]:         <nova:project uuid="9d2058584e624e869bf316e4cee4d669">tempest-VolumesAdminNegativeTest-1183783318</nova:project>
Aug 15 05:29:47 user nova-compute[73391]:       </nova:owner>
Aug 15 05:29:47 user nova-compute[73391]:       <nova:root type="image" uuid="191b1dad-305e-4d1c-9b15-515ec59a3278"/>
Aug 15 05:29:47 user nova-compute[73391]:       <nova:ports>
Aug 15 05:29:47 user nova-compute[73391]:         <nova:port uuid="a5f1c5ab-e060-450e-82ee-aa1e4b0ee019">
Aug 15 05:29:47 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 15 05:29:47 user nova-compute[73391]:         </nova:port>
Aug 15 05:29:47 user nova-compute[73391]:       </nova:ports>
Aug 15 05:29:47 user nova-compute[73391]:     </nova:instance>
Aug 15 05:29:47 user nova-compute[73391]:   </metadata>
Aug 15 05:29:47 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:29:47 user nova-compute[73391]:     <system>
Aug 15 05:29:47 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:29:47 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:29:47 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:29:47 user nova-compute[73391]:       <entry name="serial">4b9f5970-65c5-4eff-a4bf-d18a9c916c90</entry>
Aug 15 05:29:47 user nova-compute[73391]:       <entry name="uuid">4b9f5970-65c5-4eff-a4bf-d18a9c916c90</entry>
Aug 15 05:29:47 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:29:47 user nova-compute[73391]:     </system>
Aug 15 05:29:47 user nova-compute[73391]:   </sysinfo>
Aug 15 05:29:47 user nova-compute[73391]:   <os>
Aug 15 05:29:47 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:29:47 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:29:47 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:29:47 user nova-compute[73391]:   </os>
Aug 15 05:29:47 user nova-compute[73391]:   <features>
Aug 15 05:29:47 user nova-compute[73391]:     <acpi/>
Aug 15 05:29:47 user nova-compute[73391]:     <apic/>
Aug 15 05:29:47 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:29:47 user nova-compute[73391]:   </features>
Aug 15 05:29:47 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:29:47 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:29:47 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:29:47 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:29:47 user nova-compute[73391]:   </clock>
Aug 15 05:29:47 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:29:47 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:29:47 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:29:47 user nova-compute[73391]:   </cpu>
Aug 15 05:29:47 user nova-compute[73391]:   <devices>
Aug 15 05:29:47 user nova-compute[73391]:     <disk type="file" device="disk">
Aug 15 05:29:47 user nova-compute[73391]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 05:29:47 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/4b9f5970-65c5-4eff-a4bf-d18a9c916c90/disk"/>
Aug 15 05:29:47 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:29:47 user nova-compute[73391]:     </disk>
Aug 15 05:29:47 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:29:47 user nova-compute[73391]:       <mac address="fa:16:3e:11:2e:cb"/>
Aug 15 05:29:47 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:29:47 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:29:47 user nova-compute[73391]:       <target dev="tapa5f1c5ab-e0"/>
Aug 15 05:29:47 user nova-compute[73391]:     </interface>
Aug 15 05:29:47 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:29:47 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/4b9f5970-65c5-4eff-a4bf-d18a9c916c90/console.log" append="off"/>
Aug 15 05:29:47 user nova-compute[73391]:     </serial>
Aug 15 05:29:47 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:29:47 user nova-compute[73391]:     <video>
Aug 15 05:29:47 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:29:47 user nova-compute[73391]:     </video>
Aug 15 05:29:47 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:29:47 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:29:47 user nova-compute[73391]:     </rng>
Aug 15 05:29:47 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:29:47 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:29:47 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:29:47 user nova-compute[73391]:     </memballoon>
Aug 15 05:29:47 user nova-compute[73391]:   </devices>
Aug 15 05:29:47 user nova-compute[73391]: </domain>
Aug 15 05:29:47 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:29:47 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:29:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-970370290',display_name='tempest-VolumesAdminNegativeTest-server-970370290',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-970370290',id=5,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFoiRjTcSXoXGPSXt2dEaJ1TUHvJ1iPvsuzQhjrsR1YOhdaQJiulCl/8vOJk0v7OZvBwniIpJfz7axQVLkiI5SNTmVeph0GnKHTfvZs+VtUlSTdMOXW7raJqYhasrmIz3Q==',key_name='tempest-keypair-1763529189',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d2058584e624e869bf316e4cee4d669',ramdisk_id='',reservation_id='r-lsi795rg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1183783318',owner_user_name='tempest-VolumesAdminNegativeTest-1183783318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:29:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ec3b8ac7ed748b49325a372f164f931',uuid=4b9f5970-65c5-4eff-a4bf-d18a9c916c90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5f1c5ab-e060-450e-82ee-aa1e4b0ee019", "address": "fa:16:3e:11:2e:cb", "network": {"id": "f69631d8-9da0-4c6d-8530-e8c455942703", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-108520740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d2058584e624e869bf316e4cee4d669", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f1c5ab-e0", "ovs_interfaceid": "a5f1c5ab-e060-450e-82ee-aa1e4b0ee019", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:29:47 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Converting VIF {"id": "a5f1c5ab-e060-450e-82ee-aa1e4b0ee019", "address": "fa:16:3e:11:2e:cb", "network": {"id": "f69631d8-9da0-4c6d-8530-e8c455942703", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-108520740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d2058584e624e869bf316e4cee4d669", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f1c5ab-e0", "ovs_interfaceid": "a5f1c5ab-e060-450e-82ee-aa1e4b0ee019", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:29:47 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:11:2e:cb,bridge_name='br-int',has_traffic_filtering=True,id=a5f1c5ab-e060-450e-82ee-aa1e4b0ee019,network=Network(f69631d8-9da0-4c6d-8530-e8c455942703),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5f1c5ab-e0') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:29:47 user nova-compute[73391]: DEBUG os_vif [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:2e:cb,bridge_name='br-int',has_traffic_filtering=True,id=a5f1c5ab-e060-450e-82ee-aa1e4b0ee019,network=Network(f69631d8-9da0-4c6d-8530-e8c455942703),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5f1c5ab-e0') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:29:47 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:47 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:29:47 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:29:47 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:47 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa5f1c5ab-e0, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:29:47 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa5f1c5ab-e0, col_values=(('external_ids', {'iface-id': 'a5f1c5ab-e060-450e-82ee-aa1e4b0ee019', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:11:2e:cb', 'vm-uuid': '4b9f5970-65c5-4eff-a4bf-d18a9c916c90'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:29:47 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:47 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:29:47 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:47 user nova-compute[73391]: INFO os_vif [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:11:2e:cb,bridge_name='br-int',has_traffic_filtering=True,id=a5f1c5ab-e060-450e-82ee-aa1e4b0ee019,network=Network(f69631d8-9da0-4c6d-8530-e8c455942703),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5f1c5ab-e0')
Aug 15 05:29:47 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:29:47 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] No VIF found with MAC fa:16:3e:11:2e:cb, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:29:47 user nova-compute[73391]: DEBUG nova.network.neutron [req-8e30ff59-81aa-474a-a70c-a49dc693a223 req-d48bace9-4fdd-4f7a-91d6-ddb1b3ff79e6 service nova] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Updated VIF entry in instance network info cache for port a5f1c5ab-e060-450e-82ee-aa1e4b0ee019. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:29:47 user nova-compute[73391]: DEBUG nova.network.neutron [req-8e30ff59-81aa-474a-a70c-a49dc693a223 req-d48bace9-4fdd-4f7a-91d6-ddb1b3ff79e6 service nova] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Updating instance_info_cache with network_info: [{"id": "a5f1c5ab-e060-450e-82ee-aa1e4b0ee019", "address": "fa:16:3e:11:2e:cb", "network": {"id": "f69631d8-9da0-4c6d-8530-e8c455942703", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-108520740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d2058584e624e869bf316e4cee4d669", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f1c5ab-e0", "ovs_interfaceid": "a5f1c5ab-e060-450e-82ee-aa1e4b0ee019", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:29:47 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-8e30ff59-81aa-474a-a70c-a49dc693a223 req-d48bace9-4fdd-4f7a-91d6-ddb1b3ff79e6 service nova] Releasing lock "refresh_cache-4b9f5970-65c5-4eff-a4bf-d18a9c916c90" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:29:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:49 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:49 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:49 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:49 user nova-compute[73391]: DEBUG nova.compute.manager [req-1985f54b-d5b1-4732-aa7d-0c4f78f3b919 req-736aa87e-42d7-4387-9672-4240e4da432c service nova] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Received event network-vif-plugged-13c5a27d-b6c3-424b-a876-068d047fad28 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:29:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-1985f54b-d5b1-4732-aa7d-0c4f78f3b919 req-736aa87e-42d7-4387-9672-4240e4da432c service nova] Acquiring lock "8f08782b-f793-415e-b0d6-5caad1c3d426-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:29:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-1985f54b-d5b1-4732-aa7d-0c4f78f3b919 req-736aa87e-42d7-4387-9672-4240e4da432c service nova] Lock "8f08782b-f793-415e-b0d6-5caad1c3d426-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:29:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-1985f54b-d5b1-4732-aa7d-0c4f78f3b919 req-736aa87e-42d7-4387-9672-4240e4da432c service nova] Lock "8f08782b-f793-415e-b0d6-5caad1c3d426-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:29:49 user nova-compute[73391]: DEBUG nova.compute.manager [req-1985f54b-d5b1-4732-aa7d-0c4f78f3b919 req-736aa87e-42d7-4387-9672-4240e4da432c service nova] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] No waiting events found dispatching network-vif-plugged-13c5a27d-b6c3-424b-a876-068d047fad28 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:29:49 user nova-compute[73391]: WARNING nova.compute.manager [req-1985f54b-d5b1-4732-aa7d-0c4f78f3b919 req-736aa87e-42d7-4387-9672-4240e4da432c service nova] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Received unexpected event network-vif-plugged-13c5a27d-b6c3-424b-a876-068d047fad28 for instance with vm_state active and task_state None.
Aug 15 05:29:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Acquiring lock "df00c15a-2512-41d0-9857-edb50374897e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:29:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Lock "df00c15a-2512-41d0-9857-edb50374897e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:29:51 user nova-compute[73391]: DEBUG nova.compute.manager [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] [instance: df00c15a-2512-41d0-9857-edb50374897e] Starting instance... {{(pid=73391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 05:29:51 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077391.7191455, 4b9f5970-65c5-4eff-a4bf-d18a9c916c90 => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:29:51 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] VM Resumed (Lifecycle Event)
Aug 15 05:29:51 user nova-compute[73391]: DEBUG nova.compute.manager [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:29:51 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Guest created on hypervisor {{(pid=73391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 05:29:51 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Instance spawned successfully.
Aug 15 05:29:51 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 05:29:51 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:29:51 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:29:51 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:29:51 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077391.7241685, 4b9f5970-65c5-4eff-a4bf-d18a9c916c90 => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:29:51 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] VM Started (Lifecycle Event)
Aug 15 05:29:51 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Found default for hw_cdrom_bus of ide {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:29:51 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Found default for hw_disk_bus of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:29:51 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Found default for hw_input_bus of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:29:51 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Found default for hw_pointer_model of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:29:51 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Found default for hw_video_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:29:51 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Found default for hw_vif_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:29:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:29:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:29:51 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:29:51 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 05:29:51 user nova-compute[73391]: INFO nova.compute.claims [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] [instance: df00c15a-2512-41d0-9857-edb50374897e] Claim successful on node user
Aug 15 05:29:51 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:29:51 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:29:51 user nova-compute[73391]: INFO nova.compute.manager [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Took 8.27 seconds to spawn the instance on the hypervisor.
Aug 15 05:29:51 user nova-compute[73391]: DEBUG nova.compute.manager [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:29:52 user nova-compute[73391]: DEBUG nova.compute.manager [req-f7d9d3bf-285b-4f4c-8573-94c8f15da791 req-e831b2f2-d75a-4be6-933d-c4b7e27c279f service nova] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Received event network-vif-plugged-13c5a27d-b6c3-424b-a876-068d047fad28 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:29:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f7d9d3bf-285b-4f4c-8573-94c8f15da791 req-e831b2f2-d75a-4be6-933d-c4b7e27c279f service nova] Acquiring lock "8f08782b-f793-415e-b0d6-5caad1c3d426-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:29:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f7d9d3bf-285b-4f4c-8573-94c8f15da791 req-e831b2f2-d75a-4be6-933d-c4b7e27c279f service nova] Lock "8f08782b-f793-415e-b0d6-5caad1c3d426-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:29:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f7d9d3bf-285b-4f4c-8573-94c8f15da791 req-e831b2f2-d75a-4be6-933d-c4b7e27c279f service nova] Lock "8f08782b-f793-415e-b0d6-5caad1c3d426-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:29:52 user nova-compute[73391]: DEBUG nova.compute.manager [req-f7d9d3bf-285b-4f4c-8573-94c8f15da791 req-e831b2f2-d75a-4be6-933d-c4b7e27c279f service nova] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] No waiting events found dispatching network-vif-plugged-13c5a27d-b6c3-424b-a876-068d047fad28 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:29:52 user nova-compute[73391]: WARNING nova.compute.manager [req-f7d9d3bf-285b-4f4c-8573-94c8f15da791 req-e831b2f2-d75a-4be6-933d-c4b7e27c279f service nova] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Received unexpected event network-vif-plugged-13c5a27d-b6c3-424b-a876-068d047fad28 for instance with vm_state active and task_state None.
Aug 15 05:29:52 user nova-compute[73391]: DEBUG nova.compute.manager [req-f7d9d3bf-285b-4f4c-8573-94c8f15da791 req-e831b2f2-d75a-4be6-933d-c4b7e27c279f service nova] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Received event network-vif-plugged-9cde10e9-3186-4680-8e4d-a3bb0d8600d0 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:29:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f7d9d3bf-285b-4f4c-8573-94c8f15da791 req-e831b2f2-d75a-4be6-933d-c4b7e27c279f service nova] Acquiring lock "6ac9d5dc-56be-402f-b9d4-3327bdfd9220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:29:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f7d9d3bf-285b-4f4c-8573-94c8f15da791 req-e831b2f2-d75a-4be6-933d-c4b7e27c279f service nova] Lock "6ac9d5dc-56be-402f-b9d4-3327bdfd9220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:29:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f7d9d3bf-285b-4f4c-8573-94c8f15da791 req-e831b2f2-d75a-4be6-933d-c4b7e27c279f service nova] Lock "6ac9d5dc-56be-402f-b9d4-3327bdfd9220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:29:52 user nova-compute[73391]: DEBUG nova.compute.manager [req-f7d9d3bf-285b-4f4c-8573-94c8f15da791 req-e831b2f2-d75a-4be6-933d-c4b7e27c279f service nova] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] No waiting events found dispatching network-vif-plugged-9cde10e9-3186-4680-8e4d-a3bb0d8600d0 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:29:52 user nova-compute[73391]: WARNING nova.compute.manager [req-f7d9d3bf-285b-4f4c-8573-94c8f15da791 req-e831b2f2-d75a-4be6-933d-c4b7e27c279f service nova] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Received unexpected event network-vif-plugged-9cde10e9-3186-4680-8e4d-a3bb0d8600d0 for instance with vm_state active and task_state None.
Aug 15 05:29:52 user nova-compute[73391]: DEBUG nova.compute.manager [req-f7d9d3bf-285b-4f4c-8573-94c8f15da791 req-e831b2f2-d75a-4be6-933d-c4b7e27c279f service nova] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Received event network-vif-plugged-9cde10e9-3186-4680-8e4d-a3bb0d8600d0 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:29:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f7d9d3bf-285b-4f4c-8573-94c8f15da791 req-e831b2f2-d75a-4be6-933d-c4b7e27c279f service nova] Acquiring lock "6ac9d5dc-56be-402f-b9d4-3327bdfd9220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:29:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f7d9d3bf-285b-4f4c-8573-94c8f15da791 req-e831b2f2-d75a-4be6-933d-c4b7e27c279f service nova] Lock "6ac9d5dc-56be-402f-b9d4-3327bdfd9220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:29:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f7d9d3bf-285b-4f4c-8573-94c8f15da791 req-e831b2f2-d75a-4be6-933d-c4b7e27c279f service nova] Lock "6ac9d5dc-56be-402f-b9d4-3327bdfd9220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:29:52 user nova-compute[73391]: DEBUG nova.compute.manager [req-f7d9d3bf-285b-4f4c-8573-94c8f15da791 req-e831b2f2-d75a-4be6-933d-c4b7e27c279f service nova] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] No waiting events found dispatching network-vif-plugged-9cde10e9-3186-4680-8e4d-a3bb0d8600d0 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:29:52 user nova-compute[73391]: WARNING nova.compute.manager [req-f7d9d3bf-285b-4f4c-8573-94c8f15da791 req-e831b2f2-d75a-4be6-933d-c4b7e27c279f service nova] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Received unexpected event network-vif-plugged-9cde10e9-3186-4680-8e4d-a3bb0d8600d0 for instance with vm_state active and task_state None.
Aug 15 05:29:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Acquiring lock "0169df15-335e-46e6-a5c8-9deb7095bb84" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:29:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Lock "0169df15-335e-46e6-a5c8-9deb7095bb84" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:29:52 user nova-compute[73391]: DEBUG nova.compute.manager [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Starting instance... {{(pid=73391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 05:29:52 user nova-compute[73391]: INFO nova.compute.manager [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Took 9.40 seconds to build instance.
Aug 15 05:29:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d2cb0ae6-7309-478d-8dba-3612cf5bb3df tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Lock "4b9f5970-65c5-4eff-a4bf-d18a9c916c90" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.535s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:29:52 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:29:52 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:29:52 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:29:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.507s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:29:52 user nova-compute[73391]: DEBUG nova.compute.manager [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] [instance: df00c15a-2512-41d0-9857-edb50374897e] Start building networks asynchronously for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 05:29:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.142s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:29:52 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 05:29:52 user nova-compute[73391]: INFO nova.compute.claims [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Claim successful on node user
Aug 15 05:29:52 user nova-compute[73391]: DEBUG nova.compute.manager [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] [instance: df00c15a-2512-41d0-9857-edb50374897e] Allocating IP information in the background. {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 05:29:52 user nova-compute[73391]: DEBUG nova.network.neutron [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] [instance: df00c15a-2512-41d0-9857-edb50374897e] allocate_for_instance() {{(pid=73391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 05:29:52 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] [instance: df00c15a-2512-41d0-9857-edb50374897e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 05:29:52 user nova-compute[73391]: DEBUG nova.compute.manager [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] [instance: df00c15a-2512-41d0-9857-edb50374897e] Start building block device mappings for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 05:29:52 user nova-compute[73391]: DEBUG nova.policy [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '42f8f8600f9a4d81a72afbaf2bbd53a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2905fedccc4085a38a905192ba079b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73391) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 05:29:52 user nova-compute[73391]: DEBUG nova.compute.manager [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] [instance: df00c15a-2512-41d0-9857-edb50374897e] Start spawning the instance on the hypervisor. {{(pid=73391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 05:29:52 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] [instance: df00c15a-2512-41d0-9857-edb50374897e] Creating instance directory {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 05:29:52 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] [instance: df00c15a-2512-41d0-9857-edb50374897e] Creating image(s)
Aug 15 05:29:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Acquiring lock "/opt/stack/data/nova/instances/df00c15a-2512-41d0-9857-edb50374897e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:29:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Lock "/opt/stack/data/nova/instances/df00c15a-2512-41d0-9857-edb50374897e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:29:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Lock "/opt/stack/data/nova/instances/df00c15a-2512-41d0-9857-edb50374897e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:29:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:29:52 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:29:53 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:29:53 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.220s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:29:53 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Acquiring lock "999b315ba87151d8252d543312ae7790e7e1583b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:29:53 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:29:53 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:29:53 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.747s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:29:53 user nova-compute[73391]: DEBUG nova.compute.manager [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Start building networks asynchronously for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 05:29:53 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Acquiring lock "ee96866e-7ee0-46a1-be1a-60439a52d513" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:29:53 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Lock "ee96866e-7ee0-46a1-be1a-60439a52d513" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:29:53 user nova-compute[73391]: DEBUG nova.compute.manager [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Allocating IP information in the background. {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 05:29:53 user nova-compute[73391]: DEBUG nova.network.neutron [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] allocate_for_instance() {{(pid=73391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 05:29:53 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 05:29:53 user nova-compute[73391]: DEBUG nova.compute.manager [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Starting instance... {{(pid=73391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 05:29:53 user nova-compute[73391]: DEBUG nova.compute.manager [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Start building block device mappings for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 05:29:53 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.230s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:29:53 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/df00c15a-2512-41d0-9857-edb50374897e/disk 1073741824 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:29:53 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/df00c15a-2512-41d0-9857-edb50374897e/disk 1073741824" returned: 0 in 0.074s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:29:53 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.357s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:29:53 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:29:53 user nova-compute[73391]: DEBUG nova.policy [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4cffa0765f9d4d0297e7f5d1b43b639a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a845478f29ec418db07b467f5d47f753', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73391) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 05:29:53 user nova-compute[73391]: DEBUG nova.compute.manager [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Start spawning the instance on the hypervisor. {{(pid=73391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 05:29:53 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Creating instance directory {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 05:29:53 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Creating image(s)
Aug 15 05:29:53 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Acquiring lock "/opt/stack/data/nova/instances/0169df15-335e-46e6-a5c8-9deb7095bb84/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:29:53 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Lock "/opt/stack/data/nova/instances/0169df15-335e-46e6-a5c8-9deb7095bb84/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:29:53 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Lock "/opt/stack/data/nova/instances/0169df15-335e-46e6-a5c8-9deb7095bb84/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:29:53 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:29:53 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:29:53 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:29:53 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 05:29:53 user nova-compute[73391]: INFO nova.compute.claims [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Claim successful on node user
Aug 15 05:29:53 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.211s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:29:53 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Checking if we can resize image /opt/stack/data/nova/instances/df00c15a-2512-41d0-9857-edb50374897e/disk. size=1073741824 {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 05:29:53 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df00c15a-2512-41d0-9857-edb50374897e/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:29:53 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:53 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.318s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:29:53 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Acquiring lock "999b315ba87151d8252d543312ae7790e7e1583b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:29:53 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:29:53 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:29:53 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:53 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df00c15a-2512-41d0-9857-edb50374897e/disk --force-share --output=json" returned: 0 in 0.295s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:29:53 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Cannot resize image /opt/stack/data/nova/instances/df00c15a-2512-41d0-9857-edb50374897e/disk to a smaller size. {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 05:29:53 user nova-compute[73391]: DEBUG nova.objects.instance [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Lazy-loading 'migration_context' on Instance uuid df00c15a-2512-41d0-9857-edb50374897e {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:29:53 user nova-compute[73391]: DEBUG nova.network.neutron [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] [instance: df00c15a-2512-41d0-9857-edb50374897e] Successfully created port: c065ab29-c8d1-463f-bf12-7921829c9ede {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 05:29:53 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] [instance: df00c15a-2512-41d0-9857-edb50374897e] Created local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 05:29:53 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] [instance: df00c15a-2512-41d0-9857-edb50374897e] Ensure instance console log exists: /opt/stack/data/nova/instances/df00c15a-2512-41d0-9857-edb50374897e/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 05:29:53 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:29:53 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.006s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:29:53 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:29:54 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.249s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:29:54 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/0169df15-335e-46e6-a5c8-9deb7095bb84/disk 1073741824 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:29:54 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/0169df15-335e-46e6-a5c8-9deb7095bb84/disk 1073741824" returned: 0 in 0.080s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:29:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.334s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:29:54 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:29:54 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:29:54 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:29:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.781s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:29:54 user nova-compute[73391]: DEBUG nova.compute.manager [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Start building networks asynchronously for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 05:29:54 user nova-compute[73391]: DEBUG nova.network.neutron [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Successfully created port: 57ecc71f-8eb7-4129-bed4-3e085ce44291 {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 05:29:54 user nova-compute[73391]: DEBUG nova.compute.manager [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Allocating IP information in the background. {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 05:29:54 user nova-compute[73391]: DEBUG nova.network.neutron [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] allocate_for_instance() {{(pid=73391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 05:29:54 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.274s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:29:54 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0169df15-335e-46e6-a5c8-9deb7095bb84/disk. size=1073741824 {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 05:29:54 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0169df15-335e-46e6-a5c8-9deb7095bb84/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:29:54 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 05:29:54 user nova-compute[73391]: DEBUG nova.compute.manager [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Start building block device mappings for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 05:29:54 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0169df15-335e-46e6-a5c8-9deb7095bb84/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:29:54 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Cannot resize image /opt/stack/data/nova/instances/0169df15-335e-46e6-a5c8-9deb7095bb84/disk to a smaller size. {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 05:29:54 user nova-compute[73391]: DEBUG nova.objects.instance [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Lazy-loading 'migration_context' on Instance uuid 0169df15-335e-46e6-a5c8-9deb7095bb84 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:29:54 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Created local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 05:29:54 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Ensure instance console log exists: /opt/stack/data/nova/instances/0169df15-335e-46e6-a5c8-9deb7095bb84/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 05:29:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:29:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:29:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:29:54 user nova-compute[73391]: DEBUG nova.compute.manager [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Start spawning the instance on the hypervisor. {{(pid=73391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 05:29:54 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Creating instance directory {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 05:29:54 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Creating image(s)
Aug 15 05:29:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Acquiring lock "/opt/stack/data/nova/instances/ee96866e-7ee0-46a1-be1a-60439a52d513/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:29:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Lock "/opt/stack/data/nova/instances/ee96866e-7ee0-46a1-be1a-60439a52d513/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:29:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Lock "/opt/stack/data/nova/instances/ee96866e-7ee0-46a1-be1a-60439a52d513/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:29:54 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:29:54 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.246s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:29:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Acquiring lock "999b315ba87151d8252d543312ae7790e7e1583b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:29:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:29:54 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:29:55 user nova-compute[73391]: DEBUG nova.network.neutron [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] [instance: df00c15a-2512-41d0-9857-edb50374897e] Successfully updated port: c065ab29-c8d1-463f-bf12-7921829c9ede {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:29:55 user nova-compute[73391]: DEBUG nova.compute.manager [req-0f49c52b-e61e-4b4e-a685-a98533ff3a82 req-208867e8-4479-4448-a9b6-64ac7f2769e5 service nova] [instance: df00c15a-2512-41d0-9857-edb50374897e] Received event network-changed-c065ab29-c8d1-463f-bf12-7921829c9ede {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:29:55 user nova-compute[73391]: DEBUG nova.compute.manager [req-0f49c52b-e61e-4b4e-a685-a98533ff3a82 req-208867e8-4479-4448-a9b6-64ac7f2769e5 service nova] [instance: df00c15a-2512-41d0-9857-edb50374897e] Refreshing instance network info cache due to event network-changed-c065ab29-c8d1-463f-bf12-7921829c9ede. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:29:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-0f49c52b-e61e-4b4e-a685-a98533ff3a82 req-208867e8-4479-4448-a9b6-64ac7f2769e5 service nova] Acquiring lock "refresh_cache-df00c15a-2512-41d0-9857-edb50374897e" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:29:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-0f49c52b-e61e-4b4e-a685-a98533ff3a82 req-208867e8-4479-4448-a9b6-64ac7f2769e5 service nova] Acquired lock "refresh_cache-df00c15a-2512-41d0-9857-edb50374897e" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:29:55 user nova-compute[73391]: DEBUG nova.network.neutron [req-0f49c52b-e61e-4b4e-a685-a98533ff3a82 req-208867e8-4479-4448-a9b6-64ac7f2769e5 service nova] [instance: df00c15a-2512-41d0-9857-edb50374897e] Refreshing network info cache for port c065ab29-c8d1-463f-bf12-7921829c9ede {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:29:55 user nova-compute[73391]: DEBUG nova.policy [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '58ec85e797fc4986ab7e771c98a56d67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ff822a831e849e69cc772f2ff4b2c20', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73391) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 05:29:55 user nova-compute[73391]: DEBUG nova.network.neutron [req-0f49c52b-e61e-4b4e-a685-a98533ff3a82 req-208867e8-4479-4448-a9b6-64ac7f2769e5 service nova] [instance: df00c15a-2512-41d0-9857-edb50374897e] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:29:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.239s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:29:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/ee96866e-7ee0-46a1-be1a-60439a52d513/disk 1073741824 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:29:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Acquiring lock "refresh_cache-df00c15a-2512-41d0-9857-edb50374897e" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:29:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/ee96866e-7ee0-46a1-be1a-60439a52d513/disk 1073741824" returned: 0 in 0.066s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:29:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.314s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:29:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:29:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.193s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:29:55 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ee96866e-7ee0-46a1-be1a-60439a52d513/disk. size=1073741824 {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 05:29:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee96866e-7ee0-46a1-be1a-60439a52d513/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:29:55 user nova-compute[73391]: DEBUG nova.network.neutron [req-0f49c52b-e61e-4b4e-a685-a98533ff3a82 req-208867e8-4479-4448-a9b6-64ac7f2769e5 service nova] [instance: df00c15a-2512-41d0-9857-edb50374897e] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:29:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-0f49c52b-e61e-4b4e-a685-a98533ff3a82 req-208867e8-4479-4448-a9b6-64ac7f2769e5 service nova] Releasing lock "refresh_cache-df00c15a-2512-41d0-9857-edb50374897e" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:29:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Acquired lock "refresh_cache-df00c15a-2512-41d0-9857-edb50374897e" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:29:55 user nova-compute[73391]: DEBUG nova.network.neutron [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] [instance: df00c15a-2512-41d0-9857-edb50374897e] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:29:55 user nova-compute[73391]: DEBUG nova.network.neutron [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] [instance: df00c15a-2512-41d0-9857-edb50374897e] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:29:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee96866e-7ee0-46a1-be1a-60439a52d513/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:29:55 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Cannot resize image /opt/stack/data/nova/instances/ee96866e-7ee0-46a1-be1a-60439a52d513/disk to a smaller size. {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 05:29:55 user nova-compute[73391]: DEBUG nova.objects.instance [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Lazy-loading 'migration_context' on Instance uuid ee96866e-7ee0-46a1-be1a-60439a52d513 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:29:55 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Created local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 05:29:55 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Ensure instance console log exists: /opt/stack/data/nova/instances/ee96866e-7ee0-46a1-be1a-60439a52d513/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 05:29:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:29:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:29:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:29:55 user nova-compute[73391]: DEBUG nova.network.neutron [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Successfully updated port: 57ecc71f-8eb7-4129-bed4-3e085ce44291 {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:29:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Acquiring lock "refresh_cache-0169df15-335e-46e6-a5c8-9deb7095bb84" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:29:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Acquired lock "refresh_cache-0169df15-335e-46e6-a5c8-9deb7095bb84" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:29:55 user nova-compute[73391]: DEBUG nova.network.neutron [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:29:55 user nova-compute[73391]: DEBUG nova.compute.manager [req-60bf78a5-8f29-4dec-bb14-18db1454ba42 req-56fe6f21-930a-45c0-95b5-67f7977ba2f4 service nova] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Received event network-changed-57ecc71f-8eb7-4129-bed4-3e085ce44291 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:29:55 user nova-compute[73391]: DEBUG nova.compute.manager [req-60bf78a5-8f29-4dec-bb14-18db1454ba42 req-56fe6f21-930a-45c0-95b5-67f7977ba2f4 service nova] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Refreshing instance network info cache due to event network-changed-57ecc71f-8eb7-4129-bed4-3e085ce44291. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:29:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-60bf78a5-8f29-4dec-bb14-18db1454ba42 req-56fe6f21-930a-45c0-95b5-67f7977ba2f4 service nova] Acquiring lock "refresh_cache-0169df15-335e-46e6-a5c8-9deb7095bb84" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:29:55 user nova-compute[73391]: DEBUG nova.network.neutron [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG nova.network.neutron [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] [instance: df00c15a-2512-41d0-9857-edb50374897e] Updating instance_info_cache with network_info: [{"id": "c065ab29-c8d1-463f-bf12-7921829c9ede", "address": "fa:16:3e:92:27:fb", "network": {"id": "6605a4f0-a8e4-4044-a7d3-36dd84d3870c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-694227201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d2905fedccc4085a38a905192ba079b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc065ab29-c8", "ovs_interfaceid": "c065ab29-c8d1-463f-bf12-7921829c9ede", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Releasing lock "refresh_cache-df00c15a-2512-41d0-9857-edb50374897e" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG nova.compute.manager [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] [instance: df00c15a-2512-41d0-9857-edb50374897e] Instance network_info: |[{"id": "c065ab29-c8d1-463f-bf12-7921829c9ede", "address": "fa:16:3e:92:27:fb", "network": {"id": "6605a4f0-a8e4-4044-a7d3-36dd84d3870c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-694227201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d2905fedccc4085a38a905192ba079b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc065ab29-c8", "ovs_interfaceid": "c065ab29-c8d1-463f-bf12-7921829c9ede", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] [instance: df00c15a-2512-41d0-9857-edb50374897e] Start _get_guest_xml network_info=[{"id": "c065ab29-c8d1-463f-bf12-7921829c9ede", "address": "fa:16:3e:92:27:fb", "network": {"id": "6605a4f0-a8e4-4044-a7d3-36dd84d3870c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-694227201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d2905fedccc4085a38a905192ba079b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc065ab29-c8", "ovs_interfaceid": "c065ab29-c8d1-463f-bf12-7921829c9ede", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '191b1dad-305e-4d1c-9b15-515ec59a3278'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:29:56 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:29:56 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:29:56 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T05:29:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1483983120',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1483983120',id=6,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2gCgxFYyHMvanjOmlhgs+PtTOvShgOshpOoTRWbXBVti5EI5YAHx014n7qsJi2J2bJRkI0PBGeXP5u90VAUBx25BB0y6ovoKoEveKinIqcQDUv9GNl+Dqk3GoYb9mVVg==',key_name='tempest-keypair-1486183318',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d2905fedccc4085a38a905192ba079b',ramdisk_id='',reservation_id='r-j2lev19d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1390153553',owner_user_name='tempest-TaggedAttachmentsTest-1390153553-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:29:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='42f8f8600f9a4d81a72afbaf2bbd53a5',uuid=df00c15a-2512-41d0-9857-edb50374897e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c065ab29-c8d1-463f-bf12-7921829c9ede", "address": "fa:16:3e:92:27:fb", "network": {"id": "6605a4f0-a8e4-4044-a7d3-36dd84d3870c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-694227201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d2905fedccc4085a38a905192ba079b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc065ab29-c8", "ovs_interfaceid": "c065ab29-c8d1-463f-bf12-7921829c9ede", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Converting VIF {"id": "c065ab29-c8d1-463f-bf12-7921829c9ede", "address": "fa:16:3e:92:27:fb", "network": {"id": "6605a4f0-a8e4-4044-a7d3-36dd84d3870c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-694227201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d2905fedccc4085a38a905192ba079b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc065ab29-c8", "ovs_interfaceid": "c065ab29-c8d1-463f-bf12-7921829c9ede", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:27:fb,bridge_name='br-int',has_traffic_filtering=True,id=c065ab29-c8d1-463f-bf12-7921829c9ede,network=Network(6605a4f0-a8e4-4044-a7d3-36dd84d3870c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc065ab29-c8') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG nova.objects.instance [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Lazy-loading 'pci_devices' on Instance uuid df00c15a-2512-41d0-9857-edb50374897e {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] [instance: df00c15a-2512-41d0-9857-edb50374897e] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:29:56 user nova-compute[73391]:   <uuid>df00c15a-2512-41d0-9857-edb50374897e</uuid>
Aug 15 05:29:56 user nova-compute[73391]:   <name>instance-00000006</name>
Aug 15 05:29:56 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:29:56 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:29:56 user nova-compute[73391]:   <metadata>
Aug 15 05:29:56 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:29:56 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:29:56 user nova-compute[73391]:       <nova:name>tempest-device-tagging-server-1483983120</nova:name>
Aug 15 05:29:56 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:29:56</nova:creationTime>
Aug 15 05:29:56 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:29:56 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:29:56 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:29:56 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:29:56 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:29:56 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:29:56 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:29:56 user nova-compute[73391]:       <nova:owner>
Aug 15 05:29:56 user nova-compute[73391]:         <nova:user uuid="42f8f8600f9a4d81a72afbaf2bbd53a5">tempest-TaggedAttachmentsTest-1390153553-project-member</nova:user>
Aug 15 05:29:56 user nova-compute[73391]:         <nova:project uuid="1d2905fedccc4085a38a905192ba079b">tempest-TaggedAttachmentsTest-1390153553</nova:project>
Aug 15 05:29:56 user nova-compute[73391]:       </nova:owner>
Aug 15 05:29:56 user nova-compute[73391]:       <nova:root type="image" uuid="191b1dad-305e-4d1c-9b15-515ec59a3278"/>
Aug 15 05:29:56 user nova-compute[73391]:       <nova:ports>
Aug 15 05:29:56 user nova-compute[73391]:         <nova:port uuid="c065ab29-c8d1-463f-bf12-7921829c9ede">
Aug 15 05:29:56 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 05:29:56 user nova-compute[73391]:         </nova:port>
Aug 15 05:29:56 user nova-compute[73391]:       </nova:ports>
Aug 15 05:29:56 user nova-compute[73391]:     </nova:instance>
Aug 15 05:29:56 user nova-compute[73391]:   </metadata>
Aug 15 05:29:56 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:29:56 user nova-compute[73391]:     <system>
Aug 15 05:29:56 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:29:56 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:29:56 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:29:56 user nova-compute[73391]:       <entry name="serial">df00c15a-2512-41d0-9857-edb50374897e</entry>
Aug 15 05:29:56 user nova-compute[73391]:       <entry name="uuid">df00c15a-2512-41d0-9857-edb50374897e</entry>
Aug 15 05:29:56 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:29:56 user nova-compute[73391]:     </system>
Aug 15 05:29:56 user nova-compute[73391]:   </sysinfo>
Aug 15 05:29:56 user nova-compute[73391]:   <os>
Aug 15 05:29:56 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:29:56 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:29:56 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:29:56 user nova-compute[73391]:   </os>
Aug 15 05:29:56 user nova-compute[73391]:   <features>
Aug 15 05:29:56 user nova-compute[73391]:     <acpi/>
Aug 15 05:29:56 user nova-compute[73391]:     <apic/>
Aug 15 05:29:56 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:29:56 user nova-compute[73391]:   </features>
Aug 15 05:29:56 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:29:56 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:29:56 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:29:56 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:29:56 user nova-compute[73391]:   </clock>
Aug 15 05:29:56 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:29:56 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:29:56 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:29:56 user nova-compute[73391]:   </cpu>
Aug 15 05:29:56 user nova-compute[73391]:   <devices>
Aug 15 05:29:56 user nova-compute[73391]:     <disk type="file" device="disk">
Aug 15 05:29:56 user nova-compute[73391]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 05:29:56 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/df00c15a-2512-41d0-9857-edb50374897e/disk"/>
Aug 15 05:29:56 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:29:56 user nova-compute[73391]:     </disk>
Aug 15 05:29:56 user nova-compute[73391]:     <disk type="file" device="cdrom">
Aug 15 05:29:56 user nova-compute[73391]:       <driver name="qemu" type="raw" cache="none"/>
Aug 15 05:29:56 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/df00c15a-2512-41d0-9857-edb50374897e/disk.config"/>
Aug 15 05:29:56 user nova-compute[73391]:       <target dev="hda" bus="ide"/>
Aug 15 05:29:56 user nova-compute[73391]:     </disk>
Aug 15 05:29:56 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:29:56 user nova-compute[73391]:       <mac address="fa:16:3e:92:27:fb"/>
Aug 15 05:29:56 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:29:56 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:29:56 user nova-compute[73391]:       <target dev="tapc065ab29-c8"/>
Aug 15 05:29:56 user nova-compute[73391]:     </interface>
Aug 15 05:29:56 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:29:56 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/df00c15a-2512-41d0-9857-edb50374897e/console.log" append="off"/>
Aug 15 05:29:56 user nova-compute[73391]:     </serial>
Aug 15 05:29:56 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:29:56 user nova-compute[73391]:     <video>
Aug 15 05:29:56 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:29:56 user nova-compute[73391]:     </video>
Aug 15 05:29:56 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:29:56 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:29:56 user nova-compute[73391]:     </rng>
Aug 15 05:29:56 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:29:56 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:29:56 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:29:56 user nova-compute[73391]:     </memballoon>
Aug 15 05:29:56 user nova-compute[73391]:   </devices>
Aug 15 05:29:56 user nova-compute[73391]: </domain>
Aug 15 05:29:56 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T05:29:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1483983120',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1483983120',id=6,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2gCgxFYyHMvanjOmlhgs+PtTOvShgOshpOoTRWbXBVti5EI5YAHx014n7qsJi2J2bJRkI0PBGeXP5u90VAUBx25BB0y6ovoKoEveKinIqcQDUv9GNl+Dqk3GoYb9mVVg==',key_name='tempest-keypair-1486183318',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1d2905fedccc4085a38a905192ba079b',ramdisk_id='',reservation_id='r-j2lev19d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1390153553',owner_user_name='tempest-TaggedAttachmentsTest-1390153553-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:29:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='42f8f8600f9a4d81a72afbaf2bbd53a5',uuid=df00c15a-2512-41d0-9857-edb50374897e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c065ab29-c8d1-463f-bf12-7921829c9ede", "address": "fa:16:3e:92:27:fb", "network": {"id": "6605a4f0-a8e4-4044-a7d3-36dd84d3870c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-694227201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d2905fedccc4085a38a905192ba079b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc065ab29-c8", "ovs_interfaceid": "c065ab29-c8d1-463f-bf12-7921829c9ede", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Converting VIF {"id": "c065ab29-c8d1-463f-bf12-7921829c9ede", "address": "fa:16:3e:92:27:fb", "network": {"id": "6605a4f0-a8e4-4044-a7d3-36dd84d3870c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-694227201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d2905fedccc4085a38a905192ba079b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc065ab29-c8", "ovs_interfaceid": "c065ab29-c8d1-463f-bf12-7921829c9ede", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:27:fb,bridge_name='br-int',has_traffic_filtering=True,id=c065ab29-c8d1-463f-bf12-7921829c9ede,network=Network(6605a4f0-a8e4-4044-a7d3-36dd84d3870c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc065ab29-c8') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG os_vif [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:27:fb,bridge_name='br-int',has_traffic_filtering=True,id=c065ab29-c8d1-463f-bf12-7921829c9ede,network=Network(6605a4f0-a8e4-4044-a7d3-36dd84d3870c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc065ab29-c8') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc065ab29-c8, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc065ab29-c8, col_values=(('external_ids', {'iface-id': 'c065ab29-c8d1-463f-bf12-7921829c9ede', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:27:fb', 'vm-uuid': 'df00c15a-2512-41d0-9857-edb50374897e'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:56 user nova-compute[73391]: INFO os_vif [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:27:fb,bridge_name='br-int',has_traffic_filtering=True,id=c065ab29-c8d1-463f-bf12-7921829c9ede,network=Network(6605a4f0-a8e4-4044-a7d3-36dd84d3870c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc065ab29-c8')
Aug 15 05:29:56 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] No BDM found with device name hda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] No VIF found with MAC fa:16:3e:92:27:fb, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:29:56 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] [instance: df00c15a-2512-41d0-9857-edb50374897e] Using config drive
Aug 15 05:29:56 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] [instance: df00c15a-2512-41d0-9857-edb50374897e] Creating config drive at /opt/stack/data/nova/instances/df00c15a-2512-41d0-9857-edb50374897e/disk.config
Aug 15 05:29:56 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/df00c15a-2512-41d0-9857-edb50374897e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpbssfq5g0 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG nova.network.neutron [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Successfully created port: b6fe7cdf-66e0-40f5-a5df-b99d43175add {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/df00c15a-2512-41d0-9857-edb50374897e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpbssfq5g0" returned: 0 in 0.059s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG nova.network.neutron [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Updating instance_info_cache with network_info: [{"id": "57ecc71f-8eb7-4129-bed4-3e085ce44291", "address": "fa:16:3e:09:d0:87", "network": {"id": "5cff12e9-5977-4f76-b8c9-f166bdb40ffe", "bridge": "br-int", "label": "tempest-TestVolumeSwap-440667944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a845478f29ec418db07b467f5d47f753", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57ecc71f-8e", "ovs_interfaceid": "57ecc71f-8eb7-4129-bed4-3e085ce44291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Releasing lock "refresh_cache-0169df15-335e-46e6-a5c8-9deb7095bb84" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG nova.compute.manager [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Instance network_info: |[{"id": "57ecc71f-8eb7-4129-bed4-3e085ce44291", "address": "fa:16:3e:09:d0:87", "network": {"id": "5cff12e9-5977-4f76-b8c9-f166bdb40ffe", "bridge": "br-int", "label": "tempest-TestVolumeSwap-440667944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a845478f29ec418db07b467f5d47f753", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57ecc71f-8e", "ovs_interfaceid": "57ecc71f-8eb7-4129-bed4-3e085ce44291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-60bf78a5-8f29-4dec-bb14-18db1454ba42 req-56fe6f21-930a-45c0-95b5-67f7977ba2f4 service nova] Acquired lock "refresh_cache-0169df15-335e-46e6-a5c8-9deb7095bb84" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG nova.network.neutron [req-60bf78a5-8f29-4dec-bb14-18db1454ba42 req-56fe6f21-930a-45c0-95b5-67f7977ba2f4 service nova] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Refreshing network info cache for port 57ecc71f-8eb7-4129-bed4-3e085ce44291 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Start _get_guest_xml network_info=[{"id": "57ecc71f-8eb7-4129-bed4-3e085ce44291", "address": "fa:16:3e:09:d0:87", "network": {"id": "5cff12e9-5977-4f76-b8c9-f166bdb40ffe", "bridge": "br-int", "label": "tempest-TestVolumeSwap-440667944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a845478f29ec418db07b467f5d47f753", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57ecc71f-8e", "ovs_interfaceid": "57ecc71f-8eb7-4129-bed4-3e085ce44291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '191b1dad-305e-4d1c-9b15-515ec59a3278'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:29:56 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:29:56 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:29:56 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:29:56 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:29:57 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:29:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-516794791',display_name='tempest-TestVolumeSwap-server-516794791',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-516794791',id=7,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtDKbF4Pl70MHN7gp19OmCBsNRSEKdMcGS9/K02eXD9H0YtBmg9vYc5H7bbTPNy5r/9WXx4K0EW6L1hN6CAnV02oXTKcZyJ2/xehN/J0spF9FiQQNQSoXXedzGtIYwh8w==',key_name='tempest-keypair-399201667',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a845478f29ec418db07b467f5d47f753',ramdisk_id='',reservation_id='r-f3x40bgb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-571689350',owner_user_name='tempest-TestVolumeSwap-571689350-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:29:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4cffa0765f9d4d0297e7f5d1b43b639a',uuid=0169df15-335e-46e6-a5c8-9deb7095bb84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57ecc71f-8eb7-4129-bed4-3e085ce44291", "address": "fa:16:3e:09:d0:87", "network": {"id": "5cff12e9-5977-4f76-b8c9-f166bdb40ffe", "bridge": "br-int", "label": "tempest-TestVolumeSwap-440667944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a845478f29ec418db07b467f5d47f753", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57ecc71f-8e", "ovs_interfaceid": "57ecc71f-8eb7-4129-bed4-3e085ce44291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:29:57 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Converting VIF {"id": "57ecc71f-8eb7-4129-bed4-3e085ce44291", "address": "fa:16:3e:09:d0:87", "network": {"id": "5cff12e9-5977-4f76-b8c9-f166bdb40ffe", "bridge": "br-int", "label": "tempest-TestVolumeSwap-440667944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a845478f29ec418db07b467f5d47f753", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57ecc71f-8e", "ovs_interfaceid": "57ecc71f-8eb7-4129-bed4-3e085ce44291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:29:57 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:d0:87,bridge_name='br-int',has_traffic_filtering=True,id=57ecc71f-8eb7-4129-bed4-3e085ce44291,network=Network(5cff12e9-5977-4f76-b8c9-f166bdb40ffe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57ecc71f-8e') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:29:57 user nova-compute[73391]: DEBUG nova.objects.instance [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Lazy-loading 'pci_devices' on Instance uuid 0169df15-335e-46e6-a5c8-9deb7095bb84 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:29:57 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:29:57 user nova-compute[73391]:   <uuid>0169df15-335e-46e6-a5c8-9deb7095bb84</uuid>
Aug 15 05:29:57 user nova-compute[73391]:   <name>instance-00000007</name>
Aug 15 05:29:57 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:29:57 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:29:57 user nova-compute[73391]:   <metadata>
Aug 15 05:29:57 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:29:57 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:29:57 user nova-compute[73391]:       <nova:name>tempest-TestVolumeSwap-server-516794791</nova:name>
Aug 15 05:29:57 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:29:56</nova:creationTime>
Aug 15 05:29:57 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:29:57 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:29:57 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:29:57 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:29:57 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:29:57 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:29:57 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:29:57 user nova-compute[73391]:       <nova:owner>
Aug 15 05:29:57 user nova-compute[73391]:         <nova:user uuid="4cffa0765f9d4d0297e7f5d1b43b639a">tempest-TestVolumeSwap-571689350-project-member</nova:user>
Aug 15 05:29:57 user nova-compute[73391]:         <nova:project uuid="a845478f29ec418db07b467f5d47f753">tempest-TestVolumeSwap-571689350</nova:project>
Aug 15 05:29:57 user nova-compute[73391]:       </nova:owner>
Aug 15 05:29:57 user nova-compute[73391]:       <nova:root type="image" uuid="191b1dad-305e-4d1c-9b15-515ec59a3278"/>
Aug 15 05:29:57 user nova-compute[73391]:       <nova:ports>
Aug 15 05:29:57 user nova-compute[73391]:         <nova:port uuid="57ecc71f-8eb7-4129-bed4-3e085ce44291">
Aug 15 05:29:57 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 05:29:57 user nova-compute[73391]:         </nova:port>
Aug 15 05:29:57 user nova-compute[73391]:       </nova:ports>
Aug 15 05:29:57 user nova-compute[73391]:     </nova:instance>
Aug 15 05:29:57 user nova-compute[73391]:   </metadata>
Aug 15 05:29:57 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:29:57 user nova-compute[73391]:     <system>
Aug 15 05:29:57 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:29:57 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:29:57 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:29:57 user nova-compute[73391]:       <entry name="serial">0169df15-335e-46e6-a5c8-9deb7095bb84</entry>
Aug 15 05:29:57 user nova-compute[73391]:       <entry name="uuid">0169df15-335e-46e6-a5c8-9deb7095bb84</entry>
Aug 15 05:29:57 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:29:57 user nova-compute[73391]:     </system>
Aug 15 05:29:57 user nova-compute[73391]:   </sysinfo>
Aug 15 05:29:57 user nova-compute[73391]:   <os>
Aug 15 05:29:57 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:29:57 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:29:57 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:29:57 user nova-compute[73391]:   </os>
Aug 15 05:29:57 user nova-compute[73391]:   <features>
Aug 15 05:29:57 user nova-compute[73391]:     <acpi/>
Aug 15 05:29:57 user nova-compute[73391]:     <apic/>
Aug 15 05:29:57 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:29:57 user nova-compute[73391]:   </features>
Aug 15 05:29:57 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:29:57 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:29:57 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:29:57 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:29:57 user nova-compute[73391]:   </clock>
Aug 15 05:29:57 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:29:57 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:29:57 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:29:57 user nova-compute[73391]:   </cpu>
Aug 15 05:29:57 user nova-compute[73391]:   <devices>
Aug 15 05:29:57 user nova-compute[73391]:     <disk type="file" device="disk">
Aug 15 05:29:57 user nova-compute[73391]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 05:29:57 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/0169df15-335e-46e6-a5c8-9deb7095bb84/disk"/>
Aug 15 05:29:57 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:29:57 user nova-compute[73391]:     </disk>
Aug 15 05:29:57 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:29:57 user nova-compute[73391]:       <mac address="fa:16:3e:09:d0:87"/>
Aug 15 05:29:57 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:29:57 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:29:57 user nova-compute[73391]:       <target dev="tap57ecc71f-8e"/>
Aug 15 05:29:57 user nova-compute[73391]:     </interface>
Aug 15 05:29:57 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:29:57 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/0169df15-335e-46e6-a5c8-9deb7095bb84/console.log" append="off"/>
Aug 15 05:29:57 user nova-compute[73391]:     </serial>
Aug 15 05:29:57 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:29:57 user nova-compute[73391]:     <video>
Aug 15 05:29:57 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:29:57 user nova-compute[73391]:     </video>
Aug 15 05:29:57 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:29:57 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:29:57 user nova-compute[73391]:     </rng>
Aug 15 05:29:57 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:29:57 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:29:57 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:29:57 user nova-compute[73391]:     </memballoon>
Aug 15 05:29:57 user nova-compute[73391]:   </devices>
Aug 15 05:29:57 user nova-compute[73391]: </domain>
Aug 15 05:29:57 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:29:57 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:29:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-516794791',display_name='tempest-TestVolumeSwap-server-516794791',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-516794791',id=7,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtDKbF4Pl70MHN7gp19OmCBsNRSEKdMcGS9/K02eXD9H0YtBmg9vYc5H7bbTPNy5r/9WXx4K0EW6L1hN6CAnV02oXTKcZyJ2/xehN/J0spF9FiQQNQSoXXedzGtIYwh8w==',key_name='tempest-keypair-399201667',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a845478f29ec418db07b467f5d47f753',ramdisk_id='',reservation_id='r-f3x40bgb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-571689350',owner_user_name='tempest-TestVolumeSwap-571689350-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:29:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4cffa0765f9d4d0297e7f5d1b43b639a',uuid=0169df15-335e-46e6-a5c8-9deb7095bb84,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57ecc71f-8eb7-4129-bed4-3e085ce44291", "address": "fa:16:3e:09:d0:87", "network": {"id": "5cff12e9-5977-4f76-b8c9-f166bdb40ffe", "bridge": "br-int", "label": "tempest-TestVolumeSwap-440667944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a845478f29ec418db07b467f5d47f753", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57ecc71f-8e", "ovs_interfaceid": "57ecc71f-8eb7-4129-bed4-3e085ce44291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:29:57 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Converting VIF {"id": "57ecc71f-8eb7-4129-bed4-3e085ce44291", "address": "fa:16:3e:09:d0:87", "network": {"id": "5cff12e9-5977-4f76-b8c9-f166bdb40ffe", "bridge": "br-int", "label": "tempest-TestVolumeSwap-440667944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a845478f29ec418db07b467f5d47f753", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57ecc71f-8e", "ovs_interfaceid": "57ecc71f-8eb7-4129-bed4-3e085ce44291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:29:57 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:d0:87,bridge_name='br-int',has_traffic_filtering=True,id=57ecc71f-8eb7-4129-bed4-3e085ce44291,network=Network(5cff12e9-5977-4f76-b8c9-f166bdb40ffe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57ecc71f-8e') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:29:57 user nova-compute[73391]: DEBUG os_vif [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:d0:87,bridge_name='br-int',has_traffic_filtering=True,id=57ecc71f-8eb7-4129-bed4-3e085ce44291,network=Network(5cff12e9-5977-4f76-b8c9-f166bdb40ffe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57ecc71f-8e') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:29:57 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:57 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:29:57 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:29:57 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:57 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap57ecc71f-8e, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:29:57 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap57ecc71f-8e, col_values=(('external_ids', {'iface-id': '57ecc71f-8eb7-4129-bed4-3e085ce44291', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:d0:87', 'vm-uuid': '0169df15-335e-46e6-a5c8-9deb7095bb84'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:29:57 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:57 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:29:57 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:57 user nova-compute[73391]: INFO os_vif [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:d0:87,bridge_name='br-int',has_traffic_filtering=True,id=57ecc71f-8eb7-4129-bed4-3e085ce44291,network=Network(5cff12e9-5977-4f76-b8c9-f166bdb40ffe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57ecc71f-8e')
Aug 15 05:29:57 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:29:57 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] No VIF found with MAC fa:16:3e:09:d0:87, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:29:57 user nova-compute[73391]: DEBUG nova.compute.manager [req-87ec4db0-fc03-492f-9f4a-438acf67a8fc req-ddff765b-2c77-4754-8b21-2313193c2f35 service nova] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Received event network-vif-plugged-bf92cfab-6648-42bd-b9f0-2a6f38562165 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:29:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-87ec4db0-fc03-492f-9f4a-438acf67a8fc req-ddff765b-2c77-4754-8b21-2313193c2f35 service nova] Acquiring lock "18c8138a-4efc-403f-8b42-e5080c6a51d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:29:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-87ec4db0-fc03-492f-9f4a-438acf67a8fc req-ddff765b-2c77-4754-8b21-2313193c2f35 service nova] Lock "18c8138a-4efc-403f-8b42-e5080c6a51d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:29:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-87ec4db0-fc03-492f-9f4a-438acf67a8fc req-ddff765b-2c77-4754-8b21-2313193c2f35 service nova] Lock "18c8138a-4efc-403f-8b42-e5080c6a51d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:29:57 user nova-compute[73391]: DEBUG nova.compute.manager [req-87ec4db0-fc03-492f-9f4a-438acf67a8fc req-ddff765b-2c77-4754-8b21-2313193c2f35 service nova] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] No waiting events found dispatching network-vif-plugged-bf92cfab-6648-42bd-b9f0-2a6f38562165 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:29:57 user nova-compute[73391]: WARNING nova.compute.manager [req-87ec4db0-fc03-492f-9f4a-438acf67a8fc req-ddff765b-2c77-4754-8b21-2313193c2f35 service nova] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Received unexpected event network-vif-plugged-bf92cfab-6648-42bd-b9f0-2a6f38562165 for instance with vm_state active and task_state None.
Aug 15 05:29:57 user nova-compute[73391]: DEBUG nova.compute.manager [req-87ec4db0-fc03-492f-9f4a-438acf67a8fc req-ddff765b-2c77-4754-8b21-2313193c2f35 service nova] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Received event network-vif-plugged-bf92cfab-6648-42bd-b9f0-2a6f38562165 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:29:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-87ec4db0-fc03-492f-9f4a-438acf67a8fc req-ddff765b-2c77-4754-8b21-2313193c2f35 service nova] Acquiring lock "18c8138a-4efc-403f-8b42-e5080c6a51d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:29:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-87ec4db0-fc03-492f-9f4a-438acf67a8fc req-ddff765b-2c77-4754-8b21-2313193c2f35 service nova] Lock "18c8138a-4efc-403f-8b42-e5080c6a51d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:29:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-87ec4db0-fc03-492f-9f4a-438acf67a8fc req-ddff765b-2c77-4754-8b21-2313193c2f35 service nova] Lock "18c8138a-4efc-403f-8b42-e5080c6a51d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:29:57 user nova-compute[73391]: DEBUG nova.compute.manager [req-87ec4db0-fc03-492f-9f4a-438acf67a8fc req-ddff765b-2c77-4754-8b21-2313193c2f35 service nova] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] No waiting events found dispatching network-vif-plugged-bf92cfab-6648-42bd-b9f0-2a6f38562165 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:29:57 user nova-compute[73391]: WARNING nova.compute.manager [req-87ec4db0-fc03-492f-9f4a-438acf67a8fc req-ddff765b-2c77-4754-8b21-2313193c2f35 service nova] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Received unexpected event network-vif-plugged-bf92cfab-6648-42bd-b9f0-2a6f38562165 for instance with vm_state active and task_state None.
Aug 15 05:29:57 user nova-compute[73391]: DEBUG nova.compute.manager [req-87ec4db0-fc03-492f-9f4a-438acf67a8fc req-ddff765b-2c77-4754-8b21-2313193c2f35 service nova] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Received event network-vif-plugged-a5f1c5ab-e060-450e-82ee-aa1e4b0ee019 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:29:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-87ec4db0-fc03-492f-9f4a-438acf67a8fc req-ddff765b-2c77-4754-8b21-2313193c2f35 service nova] Acquiring lock "4b9f5970-65c5-4eff-a4bf-d18a9c916c90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:29:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-87ec4db0-fc03-492f-9f4a-438acf67a8fc req-ddff765b-2c77-4754-8b21-2313193c2f35 service nova] Lock "4b9f5970-65c5-4eff-a4bf-d18a9c916c90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:29:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-87ec4db0-fc03-492f-9f4a-438acf67a8fc req-ddff765b-2c77-4754-8b21-2313193c2f35 service nova] Lock "4b9f5970-65c5-4eff-a4bf-d18a9c916c90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:29:57 user nova-compute[73391]: DEBUG nova.compute.manager [req-87ec4db0-fc03-492f-9f4a-438acf67a8fc req-ddff765b-2c77-4754-8b21-2313193c2f35 service nova] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] No waiting events found dispatching network-vif-plugged-a5f1c5ab-e060-450e-82ee-aa1e4b0ee019 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:29:57 user nova-compute[73391]: WARNING nova.compute.manager [req-87ec4db0-fc03-492f-9f4a-438acf67a8fc req-ddff765b-2c77-4754-8b21-2313193c2f35 service nova] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Received unexpected event network-vif-plugged-a5f1c5ab-e060-450e-82ee-aa1e4b0ee019 for instance with vm_state active and task_state None.
Aug 15 05:29:58 user nova-compute[73391]: DEBUG nova.network.neutron [req-60bf78a5-8f29-4dec-bb14-18db1454ba42 req-56fe6f21-930a-45c0-95b5-67f7977ba2f4 service nova] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Updated VIF entry in instance network info cache for port 57ecc71f-8eb7-4129-bed4-3e085ce44291. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:29:58 user nova-compute[73391]: DEBUG nova.network.neutron [req-60bf78a5-8f29-4dec-bb14-18db1454ba42 req-56fe6f21-930a-45c0-95b5-67f7977ba2f4 service nova] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Updating instance_info_cache with network_info: [{"id": "57ecc71f-8eb7-4129-bed4-3e085ce44291", "address": "fa:16:3e:09:d0:87", "network": {"id": "5cff12e9-5977-4f76-b8c9-f166bdb40ffe", "bridge": "br-int", "label": "tempest-TestVolumeSwap-440667944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a845478f29ec418db07b467f5d47f753", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57ecc71f-8e", "ovs_interfaceid": "57ecc71f-8eb7-4129-bed4-3e085ce44291", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:29:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-60bf78a5-8f29-4dec-bb14-18db1454ba42 req-56fe6f21-930a-45c0-95b5-67f7977ba2f4 service nova] Releasing lock "refresh_cache-0169df15-335e-46e6-a5c8-9deb7095bb84" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:29:58 user nova-compute[73391]: DEBUG nova.network.neutron [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Successfully updated port: b6fe7cdf-66e0-40f5-a5df-b99d43175add {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:29:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Acquiring lock "refresh_cache-ee96866e-7ee0-46a1-be1a-60439a52d513" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:29:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Acquired lock "refresh_cache-ee96866e-7ee0-46a1-be1a-60439a52d513" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:29:58 user nova-compute[73391]: DEBUG nova.network.neutron [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:29:58 user nova-compute[73391]: DEBUG nova.network.neutron [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG nova.network.neutron [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Updating instance_info_cache with network_info: [{"id": "b6fe7cdf-66e0-40f5-a5df-b99d43175add", "address": "fa:16:3e:8d:8f:8c", "network": {"id": "d89ed364-c0b3-48b2-a677-2e3010aae495", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1213690697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff822a831e849e69cc772f2ff4b2c20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6fe7cdf-66", "ovs_interfaceid": "b6fe7cdf-66e0-40f5-a5df-b99d43175add", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Releasing lock "refresh_cache-ee96866e-7ee0-46a1-be1a-60439a52d513" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG nova.compute.manager [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Instance network_info: |[{"id": "b6fe7cdf-66e0-40f5-a5df-b99d43175add", "address": "fa:16:3e:8d:8f:8c", "network": {"id": "d89ed364-c0b3-48b2-a677-2e3010aae495", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1213690697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff822a831e849e69cc772f2ff4b2c20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6fe7cdf-66", "ovs_interfaceid": "b6fe7cdf-66e0-40f5-a5df-b99d43175add", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Start _get_guest_xml network_info=[{"id": "b6fe7cdf-66e0-40f5-a5df-b99d43175add", "address": "fa:16:3e:8d:8f:8c", "network": {"id": "d89ed364-c0b3-48b2-a677-2e3010aae495", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1213690697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff822a831e849e69cc772f2ff4b2c20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6fe7cdf-66", "ovs_interfaceid": "b6fe7cdf-66e0-40f5-a5df-b99d43175add", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '191b1dad-305e-4d1c-9b15-515ec59a3278'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:59 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:29:59 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:29:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:29:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1135218455',display_name='tempest-VolumesAssistedSnapshotsTest-server-1135218455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1135218455',id=8,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRy+f7MPRDFS/U6ge+o4VPuiEFdU7mGrHQ/7QrsqnD/O32WSuBs8IIvB8X63CpuMp/gPmQfyxhfZ97C7/qCgpEDZGVwx3+hWZq2I/WGX9pjRfizPn/lWrGKvXDP6LRBbg==',key_name='tempest-keypair-249089032',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ff822a831e849e69cc772f2ff4b2c20',ramdisk_id='',reservation_id='r-l2ztsgo2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1454195170',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1454195170-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:29:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58ec85e797fc4986ab7e771c98a56d67',uuid=ee96866e-7ee0-46a1-be1a-60439a52d513,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6fe7cdf-66e0-40f5-a5df-b99d43175add", "address": "fa:16:3e:8d:8f:8c", "network": {"id": "d89ed364-c0b3-48b2-a677-2e3010aae495", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1213690697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff822a831e849e69cc772f2ff4b2c20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6fe7cdf-66", "ovs_interfaceid": "b6fe7cdf-66e0-40f5-a5df-b99d43175add", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Converting VIF {"id": "b6fe7cdf-66e0-40f5-a5df-b99d43175add", "address": "fa:16:3e:8d:8f:8c", "network": {"id": "d89ed364-c0b3-48b2-a677-2e3010aae495", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1213690697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff822a831e849e69cc772f2ff4b2c20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6fe7cdf-66", "ovs_interfaceid": "b6fe7cdf-66e0-40f5-a5df-b99d43175add", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:8f:8c,bridge_name='br-int',has_traffic_filtering=True,id=b6fe7cdf-66e0-40f5-a5df-b99d43175add,network=Network(d89ed364-c0b3-48b2-a677-2e3010aae495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6fe7cdf-66') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG nova.objects.instance [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Lazy-loading 'pci_devices' on Instance uuid ee96866e-7ee0-46a1-be1a-60439a52d513 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:29:59 user nova-compute[73391]:   <uuid>ee96866e-7ee0-46a1-be1a-60439a52d513</uuid>
Aug 15 05:29:59 user nova-compute[73391]:   <name>instance-00000008</name>
Aug 15 05:29:59 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:29:59 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:29:59 user nova-compute[73391]:   <metadata>
Aug 15 05:29:59 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:29:59 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:29:59 user nova-compute[73391]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1135218455</nova:name>
Aug 15 05:29:59 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:29:59</nova:creationTime>
Aug 15 05:29:59 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:29:59 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:29:59 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:29:59 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:29:59 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:29:59 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:29:59 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:29:59 user nova-compute[73391]:       <nova:owner>
Aug 15 05:29:59 user nova-compute[73391]:         <nova:user uuid="58ec85e797fc4986ab7e771c98a56d67">tempest-VolumesAssistedSnapshotsTest-1454195170-project-member</nova:user>
Aug 15 05:29:59 user nova-compute[73391]:         <nova:project uuid="2ff822a831e849e69cc772f2ff4b2c20">tempest-VolumesAssistedSnapshotsTest-1454195170</nova:project>
Aug 15 05:29:59 user nova-compute[73391]:       </nova:owner>
Aug 15 05:29:59 user nova-compute[73391]:       <nova:root type="image" uuid="191b1dad-305e-4d1c-9b15-515ec59a3278"/>
Aug 15 05:29:59 user nova-compute[73391]:       <nova:ports>
Aug 15 05:29:59 user nova-compute[73391]:         <nova:port uuid="b6fe7cdf-66e0-40f5-a5df-b99d43175add">
Aug 15 05:29:59 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 15 05:29:59 user nova-compute[73391]:         </nova:port>
Aug 15 05:29:59 user nova-compute[73391]:       </nova:ports>
Aug 15 05:29:59 user nova-compute[73391]:     </nova:instance>
Aug 15 05:29:59 user nova-compute[73391]:   </metadata>
Aug 15 05:29:59 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:29:59 user nova-compute[73391]:     <system>
Aug 15 05:29:59 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:29:59 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:29:59 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:29:59 user nova-compute[73391]:       <entry name="serial">ee96866e-7ee0-46a1-be1a-60439a52d513</entry>
Aug 15 05:29:59 user nova-compute[73391]:       <entry name="uuid">ee96866e-7ee0-46a1-be1a-60439a52d513</entry>
Aug 15 05:29:59 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:29:59 user nova-compute[73391]:     </system>
Aug 15 05:29:59 user nova-compute[73391]:   </sysinfo>
Aug 15 05:29:59 user nova-compute[73391]:   <os>
Aug 15 05:29:59 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:29:59 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:29:59 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:29:59 user nova-compute[73391]:   </os>
Aug 15 05:29:59 user nova-compute[73391]:   <features>
Aug 15 05:29:59 user nova-compute[73391]:     <acpi/>
Aug 15 05:29:59 user nova-compute[73391]:     <apic/>
Aug 15 05:29:59 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:29:59 user nova-compute[73391]:   </features>
Aug 15 05:29:59 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:29:59 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:29:59 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:29:59 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:29:59 user nova-compute[73391]:   </clock>
Aug 15 05:29:59 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:29:59 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:29:59 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:29:59 user nova-compute[73391]:   </cpu>
Aug 15 05:29:59 user nova-compute[73391]:   <devices>
Aug 15 05:29:59 user nova-compute[73391]:     <disk type="file" device="disk">
Aug 15 05:29:59 user nova-compute[73391]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 05:29:59 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/ee96866e-7ee0-46a1-be1a-60439a52d513/disk"/>
Aug 15 05:29:59 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:29:59 user nova-compute[73391]:     </disk>
Aug 15 05:29:59 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:29:59 user nova-compute[73391]:       <mac address="fa:16:3e:8d:8f:8c"/>
Aug 15 05:29:59 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:29:59 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:29:59 user nova-compute[73391]:       <target dev="tapb6fe7cdf-66"/>
Aug 15 05:29:59 user nova-compute[73391]:     </interface>
Aug 15 05:29:59 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:29:59 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/ee96866e-7ee0-46a1-be1a-60439a52d513/console.log" append="off"/>
Aug 15 05:29:59 user nova-compute[73391]:     </serial>
Aug 15 05:29:59 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:29:59 user nova-compute[73391]:     <video>
Aug 15 05:29:59 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:29:59 user nova-compute[73391]:     </video>
Aug 15 05:29:59 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:29:59 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:29:59 user nova-compute[73391]:     </rng>
Aug 15 05:29:59 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:29:59 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:29:59 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:29:59 user nova-compute[73391]:     </memballoon>
Aug 15 05:29:59 user nova-compute[73391]:   </devices>
Aug 15 05:29:59 user nova-compute[73391]: </domain>
Aug 15 05:29:59 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:29:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1135218455',display_name='tempest-VolumesAssistedSnapshotsTest-server-1135218455',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1135218455',id=8,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRy+f7MPRDFS/U6ge+o4VPuiEFdU7mGrHQ/7QrsqnD/O32WSuBs8IIvB8X63CpuMp/gPmQfyxhfZ97C7/qCgpEDZGVwx3+hWZq2I/WGX9pjRfizPn/lWrGKvXDP6LRBbg==',key_name='tempest-keypair-249089032',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2ff822a831e849e69cc772f2ff4b2c20',ramdisk_id='',reservation_id='r-l2ztsgo2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1454195170',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1454195170-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:29:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58ec85e797fc4986ab7e771c98a56d67',uuid=ee96866e-7ee0-46a1-be1a-60439a52d513,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6fe7cdf-66e0-40f5-a5df-b99d43175add", "address": "fa:16:3e:8d:8f:8c", "network": {"id": "d89ed364-c0b3-48b2-a677-2e3010aae495", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1213690697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff822a831e849e69cc772f2ff4b2c20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6fe7cdf-66", "ovs_interfaceid": "b6fe7cdf-66e0-40f5-a5df-b99d43175add", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Converting VIF {"id": "b6fe7cdf-66e0-40f5-a5df-b99d43175add", "address": "fa:16:3e:8d:8f:8c", "network": {"id": "d89ed364-c0b3-48b2-a677-2e3010aae495", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1213690697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff822a831e849e69cc772f2ff4b2c20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6fe7cdf-66", "ovs_interfaceid": "b6fe7cdf-66e0-40f5-a5df-b99d43175add", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:8f:8c,bridge_name='br-int',has_traffic_filtering=True,id=b6fe7cdf-66e0-40f5-a5df-b99d43175add,network=Network(d89ed364-c0b3-48b2-a677-2e3010aae495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6fe7cdf-66') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG os_vif [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:8f:8c,bridge_name='br-int',has_traffic_filtering=True,id=b6fe7cdf-66e0-40f5-a5df-b99d43175add,network=Network(d89ed364-c0b3-48b2-a677-2e3010aae495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6fe7cdf-66') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb6fe7cdf-66, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb6fe7cdf-66, col_values=(('external_ids', {'iface-id': 'b6fe7cdf-66e0-40f5-a5df-b99d43175add', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:8f:8c', 'vm-uuid': 'ee96866e-7ee0-46a1-be1a-60439a52d513'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:59 user nova-compute[73391]: INFO os_vif [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:8f:8c,bridge_name='br-int',has_traffic_filtering=True,id=b6fe7cdf-66e0-40f5-a5df-b99d43175add,network=Network(d89ed364-c0b3-48b2-a677-2e3010aae495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6fe7cdf-66')
Aug 15 05:29:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] No VIF found with MAC fa:16:3e:8d:8f:8c, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG nova.compute.manager [req-83e8df1a-3bf9-4ef8-b163-3e963ec6ea56 req-3c3fb840-cdde-4432-9342-adb540f42860 service nova] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Received event network-vif-plugged-57ecc71f-8eb7-4129-bed4-3e085ce44291 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-83e8df1a-3bf9-4ef8-b163-3e963ec6ea56 req-3c3fb840-cdde-4432-9342-adb540f42860 service nova] Acquiring lock "0169df15-335e-46e6-a5c8-9deb7095bb84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-83e8df1a-3bf9-4ef8-b163-3e963ec6ea56 req-3c3fb840-cdde-4432-9342-adb540f42860 service nova] Lock "0169df15-335e-46e6-a5c8-9deb7095bb84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-83e8df1a-3bf9-4ef8-b163-3e963ec6ea56 req-3c3fb840-cdde-4432-9342-adb540f42860 service nova] Lock "0169df15-335e-46e6-a5c8-9deb7095bb84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG nova.compute.manager [req-83e8df1a-3bf9-4ef8-b163-3e963ec6ea56 req-3c3fb840-cdde-4432-9342-adb540f42860 service nova] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] No waiting events found dispatching network-vif-plugged-57ecc71f-8eb7-4129-bed4-3e085ce44291 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:29:59 user nova-compute[73391]: WARNING nova.compute.manager [req-83e8df1a-3bf9-4ef8-b163-3e963ec6ea56 req-3c3fb840-cdde-4432-9342-adb540f42860 service nova] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Received unexpected event network-vif-plugged-57ecc71f-8eb7-4129-bed4-3e085ce44291 for instance with vm_state building and task_state spawning.
Aug 15 05:29:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG nova.compute.manager [req-a61808c8-10fd-4b56-9112-0a8b341f1ae2 req-40e4ba18-3a23-43c2-8d84-c476029d2b69 service nova] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Received event network-vif-plugged-a5f1c5ab-e060-450e-82ee-aa1e4b0ee019 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-a61808c8-10fd-4b56-9112-0a8b341f1ae2 req-40e4ba18-3a23-43c2-8d84-c476029d2b69 service nova] Acquiring lock "4b9f5970-65c5-4eff-a4bf-d18a9c916c90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-a61808c8-10fd-4b56-9112-0a8b341f1ae2 req-40e4ba18-3a23-43c2-8d84-c476029d2b69 service nova] Lock "4b9f5970-65c5-4eff-a4bf-d18a9c916c90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-a61808c8-10fd-4b56-9112-0a8b341f1ae2 req-40e4ba18-3a23-43c2-8d84-c476029d2b69 service nova] Lock "4b9f5970-65c5-4eff-a4bf-d18a9c916c90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG nova.compute.manager [req-a61808c8-10fd-4b56-9112-0a8b341f1ae2 req-40e4ba18-3a23-43c2-8d84-c476029d2b69 service nova] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] No waiting events found dispatching network-vif-plugged-a5f1c5ab-e060-450e-82ee-aa1e4b0ee019 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:29:59 user nova-compute[73391]: WARNING nova.compute.manager [req-a61808c8-10fd-4b56-9112-0a8b341f1ae2 req-40e4ba18-3a23-43c2-8d84-c476029d2b69 service nova] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Received unexpected event network-vif-plugged-a5f1c5ab-e060-450e-82ee-aa1e4b0ee019 for instance with vm_state active and task_state None.
Aug 15 05:29:59 user nova-compute[73391]: DEBUG nova.compute.manager [req-a61808c8-10fd-4b56-9112-0a8b341f1ae2 req-40e4ba18-3a23-43c2-8d84-c476029d2b69 service nova] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Received event network-changed-b6fe7cdf-66e0-40f5-a5df-b99d43175add {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG nova.compute.manager [req-a61808c8-10fd-4b56-9112-0a8b341f1ae2 req-40e4ba18-3a23-43c2-8d84-c476029d2b69 service nova] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Refreshing instance network info cache due to event network-changed-b6fe7cdf-66e0-40f5-a5df-b99d43175add. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-a61808c8-10fd-4b56-9112-0a8b341f1ae2 req-40e4ba18-3a23-43c2-8d84-c476029d2b69 service nova] Acquiring lock "refresh_cache-ee96866e-7ee0-46a1-be1a-60439a52d513" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-a61808c8-10fd-4b56-9112-0a8b341f1ae2 req-40e4ba18-3a23-43c2-8d84-c476029d2b69 service nova] Acquired lock "refresh_cache-ee96866e-7ee0-46a1-be1a-60439a52d513" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:29:59 user nova-compute[73391]: DEBUG nova.network.neutron [req-a61808c8-10fd-4b56-9112-0a8b341f1ae2 req-40e4ba18-3a23-43c2-8d84-c476029d2b69 service nova] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Refreshing network info cache for port b6fe7cdf-66e0-40f5-a5df-b99d43175add {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:30:00 user nova-compute[73391]: DEBUG nova.network.neutron [req-a61808c8-10fd-4b56-9112-0a8b341f1ae2 req-40e4ba18-3a23-43c2-8d84-c476029d2b69 service nova] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Updated VIF entry in instance network info cache for port b6fe7cdf-66e0-40f5-a5df-b99d43175add. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:30:00 user nova-compute[73391]: DEBUG nova.network.neutron [req-a61808c8-10fd-4b56-9112-0a8b341f1ae2 req-40e4ba18-3a23-43c2-8d84-c476029d2b69 service nova] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Updating instance_info_cache with network_info: [{"id": "b6fe7cdf-66e0-40f5-a5df-b99d43175add", "address": "fa:16:3e:8d:8f:8c", "network": {"id": "d89ed364-c0b3-48b2-a677-2e3010aae495", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1213690697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff822a831e849e69cc772f2ff4b2c20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6fe7cdf-66", "ovs_interfaceid": "b6fe7cdf-66e0-40f5-a5df-b99d43175add", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:30:00 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-a61808c8-10fd-4b56-9112-0a8b341f1ae2 req-40e4ba18-3a23-43c2-8d84-c476029d2b69 service nova] Releasing lock "refresh_cache-ee96866e-7ee0-46a1-be1a-60439a52d513" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:30:00 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:30:00 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:30:00 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:30:00 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:30:01 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:30:01 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:30:01 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:30:01 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:30:01 user nova-compute[73391]: DEBUG nova.compute.manager [req-5c0d7498-0aeb-41eb-bebd-6a6372c16edc req-3cec0476-3bb7-4587-bbe0-57d196934ee6 service nova] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Received event network-vif-plugged-57ecc71f-8eb7-4129-bed4-3e085ce44291 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:30:01 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-5c0d7498-0aeb-41eb-bebd-6a6372c16edc req-3cec0476-3bb7-4587-bbe0-57d196934ee6 service nova] Acquiring lock "0169df15-335e-46e6-a5c8-9deb7095bb84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:30:01 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-5c0d7498-0aeb-41eb-bebd-6a6372c16edc req-3cec0476-3bb7-4587-bbe0-57d196934ee6 service nova] Lock "0169df15-335e-46e6-a5c8-9deb7095bb84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:30:01 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-5c0d7498-0aeb-41eb-bebd-6a6372c16edc req-3cec0476-3bb7-4587-bbe0-57d196934ee6 service nova] Lock "0169df15-335e-46e6-a5c8-9deb7095bb84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:30:01 user nova-compute[73391]: DEBUG nova.compute.manager [req-5c0d7498-0aeb-41eb-bebd-6a6372c16edc req-3cec0476-3bb7-4587-bbe0-57d196934ee6 service nova] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] No waiting events found dispatching network-vif-plugged-57ecc71f-8eb7-4129-bed4-3e085ce44291 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:30:01 user nova-compute[73391]: WARNING nova.compute.manager [req-5c0d7498-0aeb-41eb-bebd-6a6372c16edc req-3cec0476-3bb7-4587-bbe0-57d196934ee6 service nova] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Received unexpected event network-vif-plugged-57ecc71f-8eb7-4129-bed4-3e085ce44291 for instance with vm_state building and task_state spawning.
Aug 15 05:30:02 user nova-compute[73391]: DEBUG nova.compute.manager [req-d4185e57-f7b6-4fea-9b3b-013b73b886e5 req-42561a15-c790-492c-8f50-0c6638f55b06 service nova] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Received event network-vif-plugged-b6fe7cdf-66e0-40f5-a5df-b99d43175add {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:30:02 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d4185e57-f7b6-4fea-9b3b-013b73b886e5 req-42561a15-c790-492c-8f50-0c6638f55b06 service nova] Acquiring lock "ee96866e-7ee0-46a1-be1a-60439a52d513-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:30:02 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d4185e57-f7b6-4fea-9b3b-013b73b886e5 req-42561a15-c790-492c-8f50-0c6638f55b06 service nova] Lock "ee96866e-7ee0-46a1-be1a-60439a52d513-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:30:02 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d4185e57-f7b6-4fea-9b3b-013b73b886e5 req-42561a15-c790-492c-8f50-0c6638f55b06 service nova] Lock "ee96866e-7ee0-46a1-be1a-60439a52d513-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:30:02 user nova-compute[73391]: DEBUG nova.compute.manager [req-d4185e57-f7b6-4fea-9b3b-013b73b886e5 req-42561a15-c790-492c-8f50-0c6638f55b06 service nova] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] No waiting events found dispatching network-vif-plugged-b6fe7cdf-66e0-40f5-a5df-b99d43175add {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:30:02 user nova-compute[73391]: WARNING nova.compute.manager [req-d4185e57-f7b6-4fea-9b3b-013b73b886e5 req-42561a15-c790-492c-8f50-0c6638f55b06 service nova] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Received unexpected event network-vif-plugged-b6fe7cdf-66e0-40f5-a5df-b99d43175add for instance with vm_state building and task_state spawning.
Aug 15 05:30:02 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:30:02 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:30:02 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:30:02 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:30:03 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077403.6893556, 0169df15-335e-46e6-a5c8-9deb7095bb84 => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:30:03 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] VM Resumed (Lifecycle Event)
Aug 15 05:30:03 user nova-compute[73391]: DEBUG nova.compute.manager [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:30:03 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Guest created on hypervisor {{(pid=73391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 05:30:03 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Instance spawned successfully.
Aug 15 05:30:03 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 05:30:03 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:30:03 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:30:03 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Found default for hw_cdrom_bus of ide {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:30:03 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Found default for hw_disk_bus of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:30:03 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Found default for hw_input_bus of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:30:03 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Found default for hw_pointer_model of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:30:03 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Found default for hw_video_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:30:03 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Found default for hw_vif_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:30:03 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:30:03 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077403.6913204, 0169df15-335e-46e6-a5c8-9deb7095bb84 => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:30:03 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] VM Started (Lifecycle Event)
Aug 15 05:30:03 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:30:03 user nova-compute[73391]: DEBUG nova.compute.manager [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] [instance: df00c15a-2512-41d0-9857-edb50374897e] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:30:03 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] [instance: df00c15a-2512-41d0-9857-edb50374897e] Guest created on hypervisor {{(pid=73391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 05:30:03 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:30:03 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:30:03 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: df00c15a-2512-41d0-9857-edb50374897e] Instance spawned successfully.
Aug 15 05:30:03 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] [instance: df00c15a-2512-41d0-9857-edb50374897e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 05:30:03 user nova-compute[73391]: INFO nova.compute.manager [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Took 10.38 seconds to spawn the instance on the hypervisor.
Aug 15 05:30:03 user nova-compute[73391]: DEBUG nova.compute.manager [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:30:03 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:30:03 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077403.8195999, df00c15a-2512-41d0-9857-edb50374897e => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:30:03 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: df00c15a-2512-41d0-9857-edb50374897e] VM Resumed (Lifecycle Event)
Aug 15 05:30:03 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] [instance: df00c15a-2512-41d0-9857-edb50374897e] Found default for hw_cdrom_bus of ide {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:30:03 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] [instance: df00c15a-2512-41d0-9857-edb50374897e] Found default for hw_disk_bus of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:30:03 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] [instance: df00c15a-2512-41d0-9857-edb50374897e] Found default for hw_input_bus of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:30:03 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] [instance: df00c15a-2512-41d0-9857-edb50374897e] Found default for hw_pointer_model of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:30:03 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] [instance: df00c15a-2512-41d0-9857-edb50374897e] Found default for hw_video_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:30:03 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] [instance: df00c15a-2512-41d0-9857-edb50374897e] Found default for hw_vif_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:30:03 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: df00c15a-2512-41d0-9857-edb50374897e] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:30:03 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: df00c15a-2512-41d0-9857-edb50374897e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:30:03 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: df00c15a-2512-41d0-9857-edb50374897e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:30:03 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077403.819804, df00c15a-2512-41d0-9857-edb50374897e => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:30:03 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: df00c15a-2512-41d0-9857-edb50374897e] VM Started (Lifecycle Event)
Aug 15 05:30:04 user nova-compute[73391]: INFO nova.compute.manager [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Took 11.84 seconds to build instance.
Aug 15 05:30:04 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: df00c15a-2512-41d0-9857-edb50374897e] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:30:04 user nova-compute[73391]: INFO nova.compute.manager [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] [instance: df00c15a-2512-41d0-9857-edb50374897e] Took 11.21 seconds to spawn the instance on the hypervisor.
Aug 15 05:30:04 user nova-compute[73391]: DEBUG nova.compute.manager [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] [instance: df00c15a-2512-41d0-9857-edb50374897e] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:30:04 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: df00c15a-2512-41d0-9857-edb50374897e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:30:04 user nova-compute[73391]: DEBUG nova.compute.manager [req-65c456e4-1b2b-4052-880f-91e7841b96ff req-be181ea3-b841-4095-b680-3773a8d23be1 service nova] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Received event network-vif-plugged-b6fe7cdf-66e0-40f5-a5df-b99d43175add {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:30:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-65c456e4-1b2b-4052-880f-91e7841b96ff req-be181ea3-b841-4095-b680-3773a8d23be1 service nova] Acquiring lock "ee96866e-7ee0-46a1-be1a-60439a52d513-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:30:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-65c456e4-1b2b-4052-880f-91e7841b96ff req-be181ea3-b841-4095-b680-3773a8d23be1 service nova] Lock "ee96866e-7ee0-46a1-be1a-60439a52d513-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:30:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-65c456e4-1b2b-4052-880f-91e7841b96ff req-be181ea3-b841-4095-b680-3773a8d23be1 service nova] Lock "ee96866e-7ee0-46a1-be1a-60439a52d513-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:30:04 user nova-compute[73391]: DEBUG nova.compute.manager [req-65c456e4-1b2b-4052-880f-91e7841b96ff req-be181ea3-b841-4095-b680-3773a8d23be1 service nova] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] No waiting events found dispatching network-vif-plugged-b6fe7cdf-66e0-40f5-a5df-b99d43175add {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:30:04 user nova-compute[73391]: WARNING nova.compute.manager [req-65c456e4-1b2b-4052-880f-91e7841b96ff req-be181ea3-b841-4095-b680-3773a8d23be1 service nova] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Received unexpected event network-vif-plugged-b6fe7cdf-66e0-40f5-a5df-b99d43175add for instance with vm_state building and task_state spawning.
Aug 15 05:30:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f894182d-c731-4b75-b852-611c752e5019 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Lock "0169df15-335e-46e6-a5c8-9deb7095bb84" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.107s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:30:04 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: df00c15a-2512-41d0-9857-edb50374897e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:30:04 user nova-compute[73391]: INFO nova.compute.manager [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] [instance: df00c15a-2512-41d0-9857-edb50374897e] Took 12.50 seconds to build instance.
Aug 15 05:30:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2c65f4de-1339-4fc2-a6f3-2d34debc81c8 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Lock "df00c15a-2512-41d0-9857-edb50374897e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.672s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:30:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:30:04 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077404.4385197, ee96866e-7ee0-46a1-be1a-60439a52d513 => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:30:04 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] VM Resumed (Lifecycle Event)
Aug 15 05:30:04 user nova-compute[73391]: DEBUG nova.compute.manager [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:30:04 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Guest created on hypervisor {{(pid=73391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 05:30:04 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Instance spawned successfully.
Aug 15 05:30:04 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 05:30:04 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:30:04 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Found default for hw_cdrom_bus of ide {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:30:04 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Found default for hw_disk_bus of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:30:04 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Found default for hw_input_bus of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:30:04 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Found default for hw_pointer_model of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:30:04 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Found default for hw_video_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:30:04 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Found default for hw_vif_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:30:04 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:30:04 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:30:04 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077404.4399223, ee96866e-7ee0-46a1-be1a-60439a52d513 => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:30:04 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] VM Started (Lifecycle Event)
Aug 15 05:30:04 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:30:04 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:30:04 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:30:04 user nova-compute[73391]: INFO nova.compute.manager [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Took 9.96 seconds to spawn the instance on the hypervisor.
Aug 15 05:30:04 user nova-compute[73391]: DEBUG nova.compute.manager [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:30:04 user nova-compute[73391]: INFO nova.compute.manager [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Took 11.48 seconds to build instance.
Aug 15 05:30:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-11e7c004-ea6e-42f0-b20a-60a1120c8b8a tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Lock "ee96866e-7ee0-46a1-be1a-60439a52d513" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.747s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:30:05 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:30:05 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Cleaning up deleted instances {{(pid=73391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 05:30:05 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] There are 0 instances to clean {{(pid=73391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 05:30:05 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:30:05 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73391) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 05:30:05 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:30:06 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:30:06 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:30:07 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:30:08 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:30:08 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:30:08 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:30:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:30:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:30:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:30:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:30:08 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Auditing locally available compute resources for user (node: user) {{(pid=73391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 05:30:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee96866e-7ee0-46a1-be1a-60439a52d513/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:30:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee96866e-7ee0-46a1-be1a-60439a52d513/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:30:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee96866e-7ee0-46a1-be1a-60439a52d513/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:30:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:30:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee96866e-7ee0-46a1-be1a-60439a52d513/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:30:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:30:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:30:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:30:10 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:30:10 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0169df15-335e-46e6-a5c8-9deb7095bb84/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:30:10 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0169df15-335e-46e6-a5c8-9deb7095bb84/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:30:10 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0169df15-335e-46e6-a5c8-9deb7095bb84/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:30:10 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0169df15-335e-46e6-a5c8-9deb7095bb84/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:30:10 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:30:10 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:30:10 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:30:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:30:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c8138a-4efc-403f-8b42-e5080c6a51d3/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:30:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c8138a-4efc-403f-8b42-e5080c6a51d3/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:30:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c8138a-4efc-403f-8b42-e5080c6a51d3/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:30:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c8138a-4efc-403f-8b42-e5080c6a51d3/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:30:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b9f5970-65c5-4eff-a4bf-d18a9c916c90/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:30:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b9f5970-65c5-4eff-a4bf-d18a9c916c90/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:30:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b9f5970-65c5-4eff-a4bf-d18a9c916c90/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:30:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b9f5970-65c5-4eff-a4bf-d18a9c916c90/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:30:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df00c15a-2512-41d0-9857-edb50374897e/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:30:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df00c15a-2512-41d0-9857-edb50374897e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:30:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df00c15a-2512-41d0-9857-edb50374897e/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:30:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df00c15a-2512-41d0-9857-edb50374897e/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:30:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c3d06-ef9e-4ca4-a03b-86f0e6d458a2/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:30:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c3d06-ef9e-4ca4-a03b-86f0e6d458a2/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:30:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c3d06-ef9e-4ca4-a03b-86f0e6d458a2/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:30:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c3d06-ef9e-4ca4-a03b-86f0e6d458a2/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:30:13 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:30:13 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:30:13 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Hypervisor/Node resource view: name=user free_ram=7637MB free_disk=25.7469482421875GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 05:30:13 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:30:13 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:30:13 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 8f08782b-f793-415e-b0d6-5caad1c3d426 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:30:13 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:30:13 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 6ac9d5dc-56be-402f-b9d4-3327bdfd9220 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:30:13 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 18c8138a-4efc-403f-8b42-e5080c6a51d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:30:13 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 4b9f5970-65c5-4eff-a4bf-d18a9c916c90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:30:13 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance df00c15a-2512-41d0-9857-edb50374897e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:30:13 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 0169df15-335e-46e6-a5c8-9deb7095bb84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:30:13 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance ee96866e-7ee0-46a1-be1a-60439a52d513 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:30:13 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 05:30:13 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 05:30:13 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:30:14 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:30:14 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:30:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:30:14 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Compute_service record updated for user:user {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 05:30:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.883s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:30:17 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:30:17 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Starting heal instance info cache {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 05:30:17 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Rebuilding the list of instances to heal {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 05:30:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "refresh_cache-8f08782b-f793-415e-b0d6-5caad1c3d426" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:30:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquired lock "refresh_cache-8f08782b-f793-415e-b0d6-5caad1c3d426" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:30:17 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Forcefully refreshing network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 05:30:17 user nova-compute[73391]: DEBUG nova.objects.instance [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lazy-loading 'info_cache' on Instance uuid 8f08782b-f793-415e-b0d6-5caad1c3d426 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:30:18 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Updating instance_info_cache with network_info: [{"id": "13c5a27d-b6c3-424b-a876-068d047fad28", "address": "fa:16:3e:61:0b:53", "network": {"id": "70d88082-aea7-48bb-abb4-d77d264aaf01", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b9acbe11654053bb905e7c92558a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c5a27d-b6", "ovs_interfaceid": "13c5a27d-b6c3-424b-a876-068d047fad28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:30:18 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Releasing lock "refresh_cache-8f08782b-f793-415e-b0d6-5caad1c3d426" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:30:18 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Updated the network info_cache for instance {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 05:30:18 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:30:18 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:30:18 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 05:30:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:30:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:30:20 user nova-compute[73391]: DEBUG nova.compute.manager [req-2513936b-215a-4468-8051-63aee7ae9049 req-5abe4a40-5dbb-4199-adba-0c78d5310abe service nova] [instance: df00c15a-2512-41d0-9857-edb50374897e] Received event network-vif-plugged-c065ab29-c8d1-463f-bf12-7921829c9ede {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:30:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2513936b-215a-4468-8051-63aee7ae9049 req-5abe4a40-5dbb-4199-adba-0c78d5310abe service nova] Acquiring lock "df00c15a-2512-41d0-9857-edb50374897e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:30:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2513936b-215a-4468-8051-63aee7ae9049 req-5abe4a40-5dbb-4199-adba-0c78d5310abe service nova] Lock "df00c15a-2512-41d0-9857-edb50374897e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:30:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2513936b-215a-4468-8051-63aee7ae9049 req-5abe4a40-5dbb-4199-adba-0c78d5310abe service nova] Lock "df00c15a-2512-41d0-9857-edb50374897e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:30:20 user nova-compute[73391]: DEBUG nova.compute.manager [req-2513936b-215a-4468-8051-63aee7ae9049 req-5abe4a40-5dbb-4199-adba-0c78d5310abe service nova] [instance: df00c15a-2512-41d0-9857-edb50374897e] No waiting events found dispatching network-vif-plugged-c065ab29-c8d1-463f-bf12-7921829c9ede {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:30:20 user nova-compute[73391]: WARNING nova.compute.manager [req-2513936b-215a-4468-8051-63aee7ae9049 req-5abe4a40-5dbb-4199-adba-0c78d5310abe service nova] [instance: df00c15a-2512-41d0-9857-edb50374897e] Received unexpected event network-vif-plugged-c065ab29-c8d1-463f-bf12-7921829c9ede for instance with vm_state active and task_state None.
Aug 15 05:30:22 user nova-compute[73391]: DEBUG nova.compute.manager [req-556c3ffd-b588-46af-aca7-5322b56bb1a0 req-92ace167-9178-4234-8b86-67a2b92b05d1 service nova] [instance: df00c15a-2512-41d0-9857-edb50374897e] Received event network-vif-plugged-c065ab29-c8d1-463f-bf12-7921829c9ede {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:30:22 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-556c3ffd-b588-46af-aca7-5322b56bb1a0 req-92ace167-9178-4234-8b86-67a2b92b05d1 service nova] Acquiring lock "df00c15a-2512-41d0-9857-edb50374897e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:30:22 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-556c3ffd-b588-46af-aca7-5322b56bb1a0 req-92ace167-9178-4234-8b86-67a2b92b05d1 service nova] Lock "df00c15a-2512-41d0-9857-edb50374897e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:30:22 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-556c3ffd-b588-46af-aca7-5322b56bb1a0 req-92ace167-9178-4234-8b86-67a2b92b05d1 service nova] Lock "df00c15a-2512-41d0-9857-edb50374897e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:30:22 user nova-compute[73391]: DEBUG nova.compute.manager [req-556c3ffd-b588-46af-aca7-5322b56bb1a0 req-92ace167-9178-4234-8b86-67a2b92b05d1 service nova] [instance: df00c15a-2512-41d0-9857-edb50374897e] No waiting events found dispatching network-vif-plugged-c065ab29-c8d1-463f-bf12-7921829c9ede {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:30:22 user nova-compute[73391]: WARNING nova.compute.manager [req-556c3ffd-b588-46af-aca7-5322b56bb1a0 req-92ace167-9178-4234-8b86-67a2b92b05d1 service nova] [instance: df00c15a-2512-41d0-9857-edb50374897e] Received unexpected event network-vif-plugged-c065ab29-c8d1-463f-bf12-7921829c9ede for instance with vm_state active and task_state None.
Aug 15 05:30:23 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:30:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:30:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:30:29 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:30:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:30:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:30:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:30:37 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:30:38 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:30:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:30:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Acquiring lock "7b7704e3-f48b-473c-89ae-5437a690f06a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:30:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Lock "7b7704e3-f48b-473c-89ae-5437a690f06a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:30:43 user nova-compute[73391]: DEBUG nova.compute.manager [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Starting instance... {{(pid=73391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 05:30:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:30:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:30:43 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 05:30:43 user nova-compute[73391]: INFO nova.compute.claims [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Claim successful on node user
Aug 15 05:30:43 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Refreshing inventories for resource provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 05:30:43 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Updating ProviderTree inventory for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 05:30:43 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Updating inventory in ProviderTree for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 05:30:43 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Refreshing aggregate associations for resource provider 771708bd-6a2a-4e0c-9869-46d45e6b1896, aggregates: None {{(pid=73391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 05:30:43 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Refreshing trait associations for resource provider 771708bd-6a2a-4e0c-9869-46d45e6b1896, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=73391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 05:30:43 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:30:43 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:30:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.513s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:30:43 user nova-compute[73391]: DEBUG nova.compute.manager [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Start building networks asynchronously for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 05:30:43 user nova-compute[73391]: DEBUG nova.compute.manager [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Allocating IP information in the background. {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 05:30:43 user nova-compute[73391]: DEBUG nova.network.neutron [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] allocate_for_instance() {{(pid=73391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 05:30:43 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 05:30:43 user nova-compute[73391]: DEBUG nova.compute.manager [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Start building block device mappings for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 05:30:43 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:30:43 user nova-compute[73391]: DEBUG nova.policy [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1cf057edc97f43aa9281ecc44885adaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628ed773a4de409084f7b3930d8c4dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73391) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 05:30:43 user nova-compute[73391]: DEBUG nova.compute.manager [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Start spawning the instance on the hypervisor. {{(pid=73391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 05:30:43 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Creating instance directory {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 05:30:43 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Creating image(s)
Aug 15 05:30:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Acquiring lock "/opt/stack/data/nova/instances/7b7704e3-f48b-473c-89ae-5437a690f06a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:30:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Lock "/opt/stack/data/nova/instances/7b7704e3-f48b-473c-89ae-5437a690f06a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:30:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Lock "/opt/stack/data/nova/instances/7b7704e3-f48b-473c-89ae-5437a690f06a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:30:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:30:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.184s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:30:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Acquiring lock "999b315ba87151d8252d543312ae7790e7e1583b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:30:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:30:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:30:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.177s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:30:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/7b7704e3-f48b-473c-89ae-5437a690f06a/disk 1073741824 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:30:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/7b7704e3-f48b-473c-89ae-5437a690f06a/disk 1073741824" returned: 0 in 0.054s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:30:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:30:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:30:44 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:30:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.170s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:30:44 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7b7704e3-f48b-473c-89ae-5437a690f06a/disk. size=1073741824 {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 05:30:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b7704e3-f48b-473c-89ae-5437a690f06a/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:30:44 user nova-compute[73391]: DEBUG nova.network.neutron [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Successfully created port: dcef2b4d-2a9a-4c46-9d5f-a60c4ac7b5de {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 05:30:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b7704e3-f48b-473c-89ae-5437a690f06a/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:30:44 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Cannot resize image /opt/stack/data/nova/instances/7b7704e3-f48b-473c-89ae-5437a690f06a/disk to a smaller size. {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 05:30:44 user nova-compute[73391]: DEBUG nova.objects.instance [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Lazy-loading 'migration_context' on Instance uuid 7b7704e3-f48b-473c-89ae-5437a690f06a {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:30:44 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Created local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 05:30:44 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Ensure instance console log exists: /opt/stack/data/nova/instances/7b7704e3-f48b-473c-89ae-5437a690f06a/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 05:30:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:30:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:30:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:30:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Acquiring lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:30:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:30:45 user nova-compute[73391]: DEBUG nova.compute.manager [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Starting instance... {{(pid=73391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 05:30:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:30:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:30:45 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 05:30:45 user nova-compute[73391]: INFO nova.compute.claims [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Claim successful on node user
Aug 15 05:30:45 user nova-compute[73391]: DEBUG nova.network.neutron [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Successfully updated port: dcef2b4d-2a9a-4c46-9d5f-a60c4ac7b5de {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:30:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Acquiring lock "refresh_cache-7b7704e3-f48b-473c-89ae-5437a690f06a" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:30:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Acquired lock "refresh_cache-7b7704e3-f48b-473c-89ae-5437a690f06a" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:30:45 user nova-compute[73391]: DEBUG nova.network.neutron [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:30:45 user nova-compute[73391]: DEBUG nova.network.neutron [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:30:45 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:30:45 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:30:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.457s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:30:45 user nova-compute[73391]: DEBUG nova.compute.manager [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Start building networks asynchronously for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 05:30:45 user nova-compute[73391]: DEBUG nova.compute.manager [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Allocating IP information in the background. {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 05:30:45 user nova-compute[73391]: DEBUG nova.network.neutron [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] allocate_for_instance() {{(pid=73391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 05:30:45 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 05:30:45 user nova-compute[73391]: DEBUG nova.compute.manager [req-59095d72-7e6a-477f-8abe-7ae09970bca4 req-35f3af96-ac90-4df9-ae6f-d29177982ff9 service nova] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Received event network-changed-dcef2b4d-2a9a-4c46-9d5f-a60c4ac7b5de {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:30:45 user nova-compute[73391]: DEBUG nova.compute.manager [req-59095d72-7e6a-477f-8abe-7ae09970bca4 req-35f3af96-ac90-4df9-ae6f-d29177982ff9 service nova] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Refreshing instance network info cache due to event network-changed-dcef2b4d-2a9a-4c46-9d5f-a60c4ac7b5de. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:30:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-59095d72-7e6a-477f-8abe-7ae09970bca4 req-35f3af96-ac90-4df9-ae6f-d29177982ff9 service nova] Acquiring lock "refresh_cache-7b7704e3-f48b-473c-89ae-5437a690f06a" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:30:45 user nova-compute[73391]: DEBUG nova.compute.manager [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Start building block device mappings for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 05:30:45 user nova-compute[73391]: INFO nova.virt.block_device [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Booting with volume 19a3dc05-2c38-4eea-aab9-23510f1716c7 at /dev/vda
Aug 15 05:30:45 user nova-compute[73391]: DEBUG nova.network.neutron [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Updating instance_info_cache with network_info: [{"id": "dcef2b4d-2a9a-4c46-9d5f-a60c4ac7b5de", "address": "fa:16:3e:bd:31:78", "network": {"id": "2a2a0416-9965-47d3-976b-28e0e0b3340a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-179068040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628ed773a4de409084f7b3930d8c4dce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcef2b4d-2a", "ovs_interfaceid": "dcef2b4d-2a9a-4c46-9d5f-a60c4ac7b5de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:30:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Releasing lock "refresh_cache-7b7704e3-f48b-473c-89ae-5437a690f06a" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:30:45 user nova-compute[73391]: DEBUG nova.compute.manager [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Instance network_info: |[{"id": "dcef2b4d-2a9a-4c46-9d5f-a60c4ac7b5de", "address": "fa:16:3e:bd:31:78", "network": {"id": "2a2a0416-9965-47d3-976b-28e0e0b3340a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-179068040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628ed773a4de409084f7b3930d8c4dce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcef2b4d-2a", "ovs_interfaceid": "dcef2b4d-2a9a-4c46-9d5f-a60c4ac7b5de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 05:30:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-59095d72-7e6a-477f-8abe-7ae09970bca4 req-35f3af96-ac90-4df9-ae6f-d29177982ff9 service nova] Acquired lock "refresh_cache-7b7704e3-f48b-473c-89ae-5437a690f06a" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:30:45 user nova-compute[73391]: DEBUG nova.network.neutron [req-59095d72-7e6a-477f-8abe-7ae09970bca4 req-35f3af96-ac90-4df9-ae6f-d29177982ff9 service nova] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Refreshing network info cache for port dcef2b4d-2a9a-4c46-9d5f-a60c4ac7b5de {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:30:45 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Start _get_guest_xml network_info=[{"id": "dcef2b4d-2a9a-4c46-9d5f-a60c4ac7b5de", "address": "fa:16:3e:bd:31:78", "network": {"id": "2a2a0416-9965-47d3-976b-28e0e0b3340a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-179068040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628ed773a4de409084f7b3930d8c4dce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcef2b4d-2a", "ovs_interfaceid": "dcef2b4d-2a9a-4c46-9d5f-a60c4ac7b5de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '191b1dad-305e-4d1c-9b15-515ec59a3278'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:30:45 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:30:45 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:30:45 user nova-compute[73391]: DEBUG os_brick.utils [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:30:45 user nova-compute[73391]: INFO oslo.privsep.daemon [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp6aump6jv/privsep.sock']
Aug 15 05:30:45 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:30:45 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:30:45 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:30:45 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:30:45 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:30:45 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:30:45 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:30:45 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:30:45 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:30:45 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:30:45 user sudo[84505]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp6aump6jv/privsep.sock
Aug 15 05:30:45 user sudo[84505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Aug 15 05:30:45 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:30:45 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:30:45 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:30:45 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:30:45 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:30:45 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:30:45 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:30:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1562824869',display_name='tempest-VolumesActionsTest-instance-1562824869',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1562824869',id=9,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='628ed773a4de409084f7b3930d8c4dce',ramdisk_id='',reservation_id='r-ksxm0fmy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2132169708',owner_user_name='tempest-VolumesActionsTest-2132169708-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:30:44Z,user_data=None,user_id='1cf057edc97f43aa9281ecc44885adaa',uuid=7b7704e3-f48b-473c-89ae-5437a690f06a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dcef2b4d-2a9a-4c46-9d5f-a60c4ac7b5de", "address": "fa:16:3e:bd:31:78", "network": {"id": "2a2a0416-9965-47d3-976b-28e0e0b3340a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-179068040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628ed773a4de409084f7b3930d8c4dce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcef2b4d-2a", "ovs_interfaceid": "dcef2b4d-2a9a-4c46-9d5f-a60c4ac7b5de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:30:45 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Converting VIF {"id": "dcef2b4d-2a9a-4c46-9d5f-a60c4ac7b5de", "address": "fa:16:3e:bd:31:78", "network": {"id": "2a2a0416-9965-47d3-976b-28e0e0b3340a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-179068040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628ed773a4de409084f7b3930d8c4dce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcef2b4d-2a", "ovs_interfaceid": "dcef2b4d-2a9a-4c46-9d5f-a60c4ac7b5de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:30:45 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:31:78,bridge_name='br-int',has_traffic_filtering=True,id=dcef2b4d-2a9a-4c46-9d5f-a60c4ac7b5de,network=Network(2a2a0416-9965-47d3-976b-28e0e0b3340a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcef2b4d-2a') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:30:45 user nova-compute[73391]: DEBUG nova.objects.instance [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Lazy-loading 'pci_devices' on Instance uuid 7b7704e3-f48b-473c-89ae-5437a690f06a {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:30:45 user nova-compute[73391]: DEBUG nova.policy [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5c3532caac1f479995f501b1345ebcb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49eba1f86e8c412e81feba30657c278a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73391) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 05:30:45 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:30:45 user nova-compute[73391]:   <uuid>7b7704e3-f48b-473c-89ae-5437a690f06a</uuid>
Aug 15 05:30:45 user nova-compute[73391]:   <name>instance-00000009</name>
Aug 15 05:30:45 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:30:45 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:30:45 user nova-compute[73391]:   <metadata>
Aug 15 05:30:45 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:30:45 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:30:45 user nova-compute[73391]:       <nova:name>tempest-VolumesActionsTest-instance-1562824869</nova:name>
Aug 15 05:30:45 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:30:45</nova:creationTime>
Aug 15 05:30:45 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:30:45 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:30:45 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:30:45 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:30:45 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:30:45 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:30:45 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:30:45 user nova-compute[73391]:       <nova:owner>
Aug 15 05:30:45 user nova-compute[73391]:         <nova:user uuid="1cf057edc97f43aa9281ecc44885adaa">tempest-VolumesActionsTest-2132169708-project-member</nova:user>
Aug 15 05:30:45 user nova-compute[73391]:         <nova:project uuid="628ed773a4de409084f7b3930d8c4dce">tempest-VolumesActionsTest-2132169708</nova:project>
Aug 15 05:30:45 user nova-compute[73391]:       </nova:owner>
Aug 15 05:30:45 user nova-compute[73391]:       <nova:root type="image" uuid="191b1dad-305e-4d1c-9b15-515ec59a3278"/>
Aug 15 05:30:45 user nova-compute[73391]:       <nova:ports>
Aug 15 05:30:45 user nova-compute[73391]:         <nova:port uuid="dcef2b4d-2a9a-4c46-9d5f-a60c4ac7b5de">
Aug 15 05:30:45 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 05:30:45 user nova-compute[73391]:         </nova:port>
Aug 15 05:30:45 user nova-compute[73391]:       </nova:ports>
Aug 15 05:30:45 user nova-compute[73391]:     </nova:instance>
Aug 15 05:30:45 user nova-compute[73391]:   </metadata>
Aug 15 05:30:45 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:30:45 user nova-compute[73391]:     <system>
Aug 15 05:30:45 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:30:45 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:30:45 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:30:45 user nova-compute[73391]:       <entry name="serial">7b7704e3-f48b-473c-89ae-5437a690f06a</entry>
Aug 15 05:30:45 user nova-compute[73391]:       <entry name="uuid">7b7704e3-f48b-473c-89ae-5437a690f06a</entry>
Aug 15 05:30:45 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:30:45 user nova-compute[73391]:     </system>
Aug 15 05:30:45 user nova-compute[73391]:   </sysinfo>
Aug 15 05:30:45 user nova-compute[73391]:   <os>
Aug 15 05:30:45 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:30:45 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:30:45 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:30:45 user nova-compute[73391]:   </os>
Aug 15 05:30:45 user nova-compute[73391]:   <features>
Aug 15 05:30:45 user nova-compute[73391]:     <acpi/>
Aug 15 05:30:45 user nova-compute[73391]:     <apic/>
Aug 15 05:30:45 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:30:45 user nova-compute[73391]:   </features>
Aug 15 05:30:45 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:30:45 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:30:45 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:30:45 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:30:45 user nova-compute[73391]:   </clock>
Aug 15 05:30:45 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:30:45 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:30:45 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:30:45 user nova-compute[73391]:   </cpu>
Aug 15 05:30:45 user nova-compute[73391]:   <devices>
Aug 15 05:30:45 user nova-compute[73391]:     <disk type="file" device="disk">
Aug 15 05:30:45 user nova-compute[73391]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 05:30:45 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/7b7704e3-f48b-473c-89ae-5437a690f06a/disk"/>
Aug 15 05:30:45 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:30:45 user nova-compute[73391]:     </disk>
Aug 15 05:30:45 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:30:45 user nova-compute[73391]:       <mac address="fa:16:3e:bd:31:78"/>
Aug 15 05:30:45 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:30:45 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:30:45 user nova-compute[73391]:       <target dev="tapdcef2b4d-2a"/>
Aug 15 05:30:45 user nova-compute[73391]:     </interface>
Aug 15 05:30:45 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:30:45 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/7b7704e3-f48b-473c-89ae-5437a690f06a/console.log" append="off"/>
Aug 15 05:30:45 user nova-compute[73391]:     </serial>
Aug 15 05:30:45 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:30:45 user nova-compute[73391]:     <video>
Aug 15 05:30:45 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:30:45 user nova-compute[73391]:     </video>
Aug 15 05:30:45 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:30:45 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:30:45 user nova-compute[73391]:     </rng>
Aug 15 05:30:45 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:30:45 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:30:45 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:30:45 user nova-compute[73391]:     </memballoon>
Aug 15 05:30:45 user nova-compute[73391]:   </devices>
Aug 15 05:30:45 user nova-compute[73391]: </domain>
Aug 15 05:30:45 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:30:45 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:30:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1562824869',display_name='tempest-VolumesActionsTest-instance-1562824869',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1562824869',id=9,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='628ed773a4de409084f7b3930d8c4dce',ramdisk_id='',reservation_id='r-ksxm0fmy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2132169708',owner_user_name='tempest-VolumesActionsTest-2132169708-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:30:44Z,user_data=None,user_id='1cf057edc97f43aa9281ecc44885adaa',uuid=7b7704e3-f48b-473c-89ae-5437a690f06a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dcef2b4d-2a9a-4c46-9d5f-a60c4ac7b5de", "address": "fa:16:3e:bd:31:78", "network": {"id": "2a2a0416-9965-47d3-976b-28e0e0b3340a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-179068040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628ed773a4de409084f7b3930d8c4dce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcef2b4d-2a", "ovs_interfaceid": "dcef2b4d-2a9a-4c46-9d5f-a60c4ac7b5de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:30:45 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Converting VIF {"id": "dcef2b4d-2a9a-4c46-9d5f-a60c4ac7b5de", "address": "fa:16:3e:bd:31:78", "network": {"id": "2a2a0416-9965-47d3-976b-28e0e0b3340a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-179068040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628ed773a4de409084f7b3930d8c4dce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcef2b4d-2a", "ovs_interfaceid": "dcef2b4d-2a9a-4c46-9d5f-a60c4ac7b5de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:30:45 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:31:78,bridge_name='br-int',has_traffic_filtering=True,id=dcef2b4d-2a9a-4c46-9d5f-a60c4ac7b5de,network=Network(2a2a0416-9965-47d3-976b-28e0e0b3340a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcef2b4d-2a') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:30:45 user nova-compute[73391]: DEBUG os_vif [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:31:78,bridge_name='br-int',has_traffic_filtering=True,id=dcef2b4d-2a9a-4c46-9d5f-a60c4ac7b5de,network=Network(2a2a0416-9965-47d3-976b-28e0e0b3340a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcef2b4d-2a') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:30:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:30:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:30:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:30:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:30:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdcef2b4d-2a, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:30:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdcef2b4d-2a, col_values=(('external_ids', {'iface-id': 'dcef2b4d-2a9a-4c46-9d5f-a60c4ac7b5de', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:31:78', 'vm-uuid': '7b7704e3-f48b-473c-89ae-5437a690f06a'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:30:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:30:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:30:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:30:46 user nova-compute[73391]: INFO os_vif [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:31:78,bridge_name='br-int',has_traffic_filtering=True,id=dcef2b4d-2a9a-4c46-9d5f-a60c4ac7b5de,network=Network(2a2a0416-9965-47d3-976b-28e0e0b3340a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcef2b4d-2a')
Aug 15 05:30:46 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:30:46 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] No VIF found with MAC fa:16:3e:bd:31:78, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:30:46 user nova-compute[73391]: DEBUG nova.network.neutron [req-59095d72-7e6a-477f-8abe-7ae09970bca4 req-35f3af96-ac90-4df9-ae6f-d29177982ff9 service nova] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Updated VIF entry in instance network info cache for port dcef2b4d-2a9a-4c46-9d5f-a60c4ac7b5de. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:30:46 user nova-compute[73391]: DEBUG nova.network.neutron [req-59095d72-7e6a-477f-8abe-7ae09970bca4 req-35f3af96-ac90-4df9-ae6f-d29177982ff9 service nova] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Updating instance_info_cache with network_info: [{"id": "dcef2b4d-2a9a-4c46-9d5f-a60c4ac7b5de", "address": "fa:16:3e:bd:31:78", "network": {"id": "2a2a0416-9965-47d3-976b-28e0e0b3340a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-179068040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628ed773a4de409084f7b3930d8c4dce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcef2b4d-2a", "ovs_interfaceid": "dcef2b4d-2a9a-4c46-9d5f-a60c4ac7b5de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:30:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-59095d72-7e6a-477f-8abe-7ae09970bca4 req-35f3af96-ac90-4df9-ae6f-d29177982ff9 service nova] Releasing lock "refresh_cache-7b7704e3-f48b-473c-89ae-5437a690f06a" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:30:47 user nova-compute[73391]: DEBUG nova.network.neutron [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Successfully created port: 397ea76b-8bbd-4602-b966-cf7331d13e9f {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 05:30:47 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:30:47 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:30:47 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:30:47 user nova-compute[73391]: DEBUG nova.network.neutron [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Successfully created port: 72a3d29f-9af1-4d78-bb33-db5cc02856aa {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 05:30:47 user sudo[84505]: pam_unix(sudo:session): session closed for user root
Aug 15 05:30:47 user nova-compute[73391]: INFO oslo.privsep.daemon [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Spawned new privsep daemon via rootwrap
Aug 15 05:30:47 user nova-compute[73391]: INFO oslo.privsep.daemon [-] privsep daemon starting
Aug 15 05:30:47 user nova-compute[73391]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Aug 15 05:30:47 user nova-compute[73391]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Aug 15 05:30:47 user nova-compute[73391]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84527
Aug 15 05:30:47 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef84571-0361-43a7-b130-ba3c675d833e]: (2,) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:30:47 user nova-compute[73391]: DEBUG nova.compute.manager [req-a077f2d3-4104-4cb3-9f55-d6e84c7e568a req-50b8f6f7-2260-4c21-b6dd-df015c7b0f39 service nova] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Received event network-vif-plugged-dcef2b4d-2a9a-4c46-9d5f-a60c4ac7b5de {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:30:47 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-a077f2d3-4104-4cb3-9f55-d6e84c7e568a req-50b8f6f7-2260-4c21-b6dd-df015c7b0f39 service nova] Acquiring lock "7b7704e3-f48b-473c-89ae-5437a690f06a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:30:47 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-a077f2d3-4104-4cb3-9f55-d6e84c7e568a req-50b8f6f7-2260-4c21-b6dd-df015c7b0f39 service nova] Lock "7b7704e3-f48b-473c-89ae-5437a690f06a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:30:47 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-a077f2d3-4104-4cb3-9f55-d6e84c7e568a req-50b8f6f7-2260-4c21-b6dd-df015c7b0f39 service nova] Lock "7b7704e3-f48b-473c-89ae-5437a690f06a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:30:47 user nova-compute[73391]: DEBUG nova.compute.manager [req-a077f2d3-4104-4cb3-9f55-d6e84c7e568a req-50b8f6f7-2260-4c21-b6dd-df015c7b0f39 service nova] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] No waiting events found dispatching network-vif-plugged-dcef2b4d-2a9a-4c46-9d5f-a60c4ac7b5de {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:30:47 user nova-compute[73391]: WARNING nova.compute.manager [req-a077f2d3-4104-4cb3-9f55-d6e84c7e568a req-50b8f6f7-2260-4c21-b6dd-df015c7b0f39 service nova] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Received unexpected event network-vif-plugged-dcef2b4d-2a9a-4c46-9d5f-a60c4ac7b5de for instance with vm_state building and task_state spawning.
Aug 15 05:30:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:30:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:30:47 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dd0e9fe-b47e-4dcb-8157-693c9d6e812f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:30:47 user nova-compute[73391]: WARNING os_brick.initiator.connectors.nvmeof [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Aug 15 05:30:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:30:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:30:47 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c544b403-f43b-4f9c-b7c5-9887178f42a9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:30:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:30:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:30:47 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c955626e-3317-4eb3-b400-674b9bd2ae74]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:30:48 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[21dffc99-8900-4e95-8b76-e8a94a4f0a0c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:30:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:30:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:30:48 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 05:30:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:30:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:30:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:30:48 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 05:30:48 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4b3d5e-7169-4d3b-97ff-701f4588a794]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:30:48 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 05:30:48 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 05:30:48 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 05:30:48 user nova-compute[73391]: DEBUG os_brick.utils [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] <== get_connector_properties: return (2208ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:30:48 user nova-compute[73391]: DEBUG nova.virt.block_device [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Updating existing volume attachment record: 77783458-377a-4929-9d85-177aa6a38e82 {{(pid=73391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 05:30:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:30:48 user nova-compute[73391]: DEBUG nova.network.neutron [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Successfully created port: 88d012e5-b40e-4398-99a1-14b37a890c47 {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 05:30:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:30:49 user nova-compute[73391]: DEBUG nova.network.neutron [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Successfully created port: 544b22aa-6b69-4b4d-985f-19bdc248d641 {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 05:30:49 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077449.5670497, 7b7704e3-f48b-473c-89ae-5437a690f06a => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:30:49 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] VM Resumed (Lifecycle Event)
Aug 15 05:30:49 user nova-compute[73391]: DEBUG nova.compute.manager [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:30:49 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Guest created on hypervisor {{(pid=73391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 05:30:49 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Instance spawned successfully.
Aug 15 05:30:49 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 05:30:49 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:30:49 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:30:49 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Found default for hw_cdrom_bus of ide {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:30:49 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Found default for hw_disk_bus of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:30:49 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Found default for hw_input_bus of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:30:49 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Found default for hw_pointer_model of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:30:49 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Found default for hw_video_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:30:49 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Found default for hw_vif_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:30:49 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:30:49 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077449.5688589, 7b7704e3-f48b-473c-89ae-5437a690f06a => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:30:49 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] VM Started (Lifecycle Event)
Aug 15 05:30:49 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:30:49 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:30:49 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:30:49 user nova-compute[73391]: DEBUG nova.network.neutron [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Successfully created port: a519d774-56a5-4a6c-9cd3-94e260332725 {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 05:30:49 user nova-compute[73391]: INFO nova.compute.manager [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Took 5.81 seconds to spawn the instance on the hypervisor.
Aug 15 05:30:49 user nova-compute[73391]: DEBUG nova.compute.manager [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:30:49 user nova-compute[73391]: INFO nova.compute.manager [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Took 6.65 seconds to build instance.
Aug 15 05:30:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c39530d7-1557-44af-8a81-8d5749ff5dfd tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Lock "7b7704e3-f48b-473c-89ae-5437a690f06a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.742s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:30:49 user nova-compute[73391]: DEBUG nova.compute.manager [req-da79ce68-ccb5-4661-9733-f235bb7e9f92 req-6b825a83-bef8-490b-8184-d30c88f73087 service nova] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Received event network-vif-plugged-dcef2b4d-2a9a-4c46-9d5f-a60c4ac7b5de {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:30:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-da79ce68-ccb5-4661-9733-f235bb7e9f92 req-6b825a83-bef8-490b-8184-d30c88f73087 service nova] Acquiring lock "7b7704e3-f48b-473c-89ae-5437a690f06a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:30:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-da79ce68-ccb5-4661-9733-f235bb7e9f92 req-6b825a83-bef8-490b-8184-d30c88f73087 service nova] Lock "7b7704e3-f48b-473c-89ae-5437a690f06a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:30:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-da79ce68-ccb5-4661-9733-f235bb7e9f92 req-6b825a83-bef8-490b-8184-d30c88f73087 service nova] Lock "7b7704e3-f48b-473c-89ae-5437a690f06a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:30:49 user nova-compute[73391]: DEBUG nova.compute.manager [req-da79ce68-ccb5-4661-9733-f235bb7e9f92 req-6b825a83-bef8-490b-8184-d30c88f73087 service nova] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] No waiting events found dispatching network-vif-plugged-dcef2b4d-2a9a-4c46-9d5f-a60c4ac7b5de {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:30:49 user nova-compute[73391]: WARNING nova.compute.manager [req-da79ce68-ccb5-4661-9733-f235bb7e9f92 req-6b825a83-bef8-490b-8184-d30c88f73087 service nova] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Received unexpected event network-vif-plugged-dcef2b4d-2a9a-4c46-9d5f-a60c4ac7b5de for instance with vm_state active and task_state None.
Aug 15 05:30:50 user nova-compute[73391]: DEBUG nova.network.neutron [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Successfully updated port: 397ea76b-8bbd-4602-b966-cf7331d13e9f {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:30:50 user nova-compute[73391]: DEBUG nova.compute.manager [req-40994426-3992-4108-b23f-df1264b59ab3 req-de8ef790-0df1-4186-aa70-7c19feabc74a service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received event network-changed-397ea76b-8bbd-4602-b966-cf7331d13e9f {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:30:50 user nova-compute[73391]: DEBUG nova.compute.manager [req-40994426-3992-4108-b23f-df1264b59ab3 req-de8ef790-0df1-4186-aa70-7c19feabc74a service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Refreshing instance network info cache due to event network-changed-397ea76b-8bbd-4602-b966-cf7331d13e9f. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:30:50 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-40994426-3992-4108-b23f-df1264b59ab3 req-de8ef790-0df1-4186-aa70-7c19feabc74a service nova] Acquiring lock "refresh_cache-da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:30:50 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-40994426-3992-4108-b23f-df1264b59ab3 req-de8ef790-0df1-4186-aa70-7c19feabc74a service nova] Acquired lock "refresh_cache-da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:30:50 user nova-compute[73391]: DEBUG nova.network.neutron [req-40994426-3992-4108-b23f-df1264b59ab3 req-de8ef790-0df1-4186-aa70-7c19feabc74a service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Refreshing network info cache for port 397ea76b-8bbd-4602-b966-cf7331d13e9f {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:30:50 user nova-compute[73391]: DEBUG nova.network.neutron [req-40994426-3992-4108-b23f-df1264b59ab3 req-de8ef790-0df1-4186-aa70-7c19feabc74a service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:30:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:30:51 user nova-compute[73391]: DEBUG nova.network.neutron [req-40994426-3992-4108-b23f-df1264b59ab3 req-de8ef790-0df1-4186-aa70-7c19feabc74a service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:30:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-40994426-3992-4108-b23f-df1264b59ab3 req-de8ef790-0df1-4186-aa70-7c19feabc74a service nova] Releasing lock "refresh_cache-da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:30:51 user nova-compute[73391]: DEBUG nova.network.neutron [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Successfully updated port: c165877a-edce-4fec-8aa4-e7708b384676 {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:30:52 user nova-compute[73391]: DEBUG nova.network.neutron [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Successfully updated port: 22ffe1b4-8207-4909-b0ba-0db5dc955912 {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:30:52 user nova-compute[73391]: DEBUG nova.compute.manager [req-b2ea7800-12eb-40bc-ad3e-bb4c2f0632bb req-698e1dfe-2ae3-4a97-8b2c-a24dcc7cf176 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received event network-changed-c165877a-edce-4fec-8aa4-e7708b384676 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:30:52 user nova-compute[73391]: DEBUG nova.compute.manager [req-b2ea7800-12eb-40bc-ad3e-bb4c2f0632bb req-698e1dfe-2ae3-4a97-8b2c-a24dcc7cf176 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Refreshing instance network info cache due to event network-changed-c165877a-edce-4fec-8aa4-e7708b384676. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:30:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-b2ea7800-12eb-40bc-ad3e-bb4c2f0632bb req-698e1dfe-2ae3-4a97-8b2c-a24dcc7cf176 service nova] Acquiring lock "refresh_cache-da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:30:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-b2ea7800-12eb-40bc-ad3e-bb4c2f0632bb req-698e1dfe-2ae3-4a97-8b2c-a24dcc7cf176 service nova] Acquired lock "refresh_cache-da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:30:52 user nova-compute[73391]: DEBUG nova.network.neutron [req-b2ea7800-12eb-40bc-ad3e-bb4c2f0632bb req-698e1dfe-2ae3-4a97-8b2c-a24dcc7cf176 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Refreshing network info cache for port c165877a-edce-4fec-8aa4-e7708b384676 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:30:52 user nova-compute[73391]: DEBUG nova.network.neutron [req-b2ea7800-12eb-40bc-ad3e-bb4c2f0632bb req-698e1dfe-2ae3-4a97-8b2c-a24dcc7cf176 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:30:52 user nova-compute[73391]: DEBUG nova.network.neutron [req-b2ea7800-12eb-40bc-ad3e-bb4c2f0632bb req-698e1dfe-2ae3-4a97-8b2c-a24dcc7cf176 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:30:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-b2ea7800-12eb-40bc-ad3e-bb4c2f0632bb req-698e1dfe-2ae3-4a97-8b2c-a24dcc7cf176 service nova] Releasing lock "refresh_cache-da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:30:53 user nova-compute[73391]: DEBUG nova.network.neutron [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Successfully updated port: 72a3d29f-9af1-4d78-bb33-db5cc02856aa {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:30:53 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:30:54 user nova-compute[73391]: DEBUG nova.network.neutron [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Successfully updated port: 88d012e5-b40e-4398-99a1-14b37a890c47 {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:30:54 user nova-compute[73391]: DEBUG nova.compute.manager [req-2f39dbdd-86b5-4822-b5e9-fe4615286c75 req-2d11cad4-288b-4cbb-8eac-567782860273 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received event network-changed-22ffe1b4-8207-4909-b0ba-0db5dc955912 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:30:54 user nova-compute[73391]: DEBUG nova.compute.manager [req-2f39dbdd-86b5-4822-b5e9-fe4615286c75 req-2d11cad4-288b-4cbb-8eac-567782860273 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Refreshing instance network info cache due to event network-changed-22ffe1b4-8207-4909-b0ba-0db5dc955912. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:30:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2f39dbdd-86b5-4822-b5e9-fe4615286c75 req-2d11cad4-288b-4cbb-8eac-567782860273 service nova] Acquiring lock "refresh_cache-da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:30:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2f39dbdd-86b5-4822-b5e9-fe4615286c75 req-2d11cad4-288b-4cbb-8eac-567782860273 service nova] Acquired lock "refresh_cache-da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:30:54 user nova-compute[73391]: DEBUG nova.network.neutron [req-2f39dbdd-86b5-4822-b5e9-fe4615286c75 req-2d11cad4-288b-4cbb-8eac-567782860273 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Refreshing network info cache for port 22ffe1b4-8207-4909-b0ba-0db5dc955912 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:30:55 user nova-compute[73391]: DEBUG nova.network.neutron [req-2f39dbdd-86b5-4822-b5e9-fe4615286c75 req-2d11cad4-288b-4cbb-8eac-567782860273 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:30:55 user nova-compute[73391]: DEBUG nova.network.neutron [req-2f39dbdd-86b5-4822-b5e9-fe4615286c75 req-2d11cad4-288b-4cbb-8eac-567782860273 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:30:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2f39dbdd-86b5-4822-b5e9-fe4615286c75 req-2d11cad4-288b-4cbb-8eac-567782860273 service nova] Releasing lock "refresh_cache-da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:30:55 user nova-compute[73391]: DEBUG nova.compute.manager [req-2f39dbdd-86b5-4822-b5e9-fe4615286c75 req-2d11cad4-288b-4cbb-8eac-567782860273 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received event network-changed-72a3d29f-9af1-4d78-bb33-db5cc02856aa {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:30:55 user nova-compute[73391]: DEBUG nova.compute.manager [req-2f39dbdd-86b5-4822-b5e9-fe4615286c75 req-2d11cad4-288b-4cbb-8eac-567782860273 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Refreshing instance network info cache due to event network-changed-72a3d29f-9af1-4d78-bb33-db5cc02856aa. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:30:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2f39dbdd-86b5-4822-b5e9-fe4615286c75 req-2d11cad4-288b-4cbb-8eac-567782860273 service nova] Acquiring lock "refresh_cache-da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:30:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2f39dbdd-86b5-4822-b5e9-fe4615286c75 req-2d11cad4-288b-4cbb-8eac-567782860273 service nova] Acquired lock "refresh_cache-da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:30:55 user nova-compute[73391]: DEBUG nova.network.neutron [req-2f39dbdd-86b5-4822-b5e9-fe4615286c75 req-2d11cad4-288b-4cbb-8eac-567782860273 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Refreshing network info cache for port 72a3d29f-9af1-4d78-bb33-db5cc02856aa {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:30:55 user nova-compute[73391]: DEBUG nova.network.neutron [req-2f39dbdd-86b5-4822-b5e9-fe4615286c75 req-2d11cad4-288b-4cbb-8eac-567782860273 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:30:55 user nova-compute[73391]: DEBUG nova.network.neutron [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Successfully updated port: 544b22aa-6b69-4b4d-985f-19bdc248d641 {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:30:55 user nova-compute[73391]: DEBUG nova.network.neutron [req-2f39dbdd-86b5-4822-b5e9-fe4615286c75 req-2d11cad4-288b-4cbb-8eac-567782860273 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:30:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2f39dbdd-86b5-4822-b5e9-fe4615286c75 req-2d11cad4-288b-4cbb-8eac-567782860273 service nova] Releasing lock "refresh_cache-da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:30:55 user nova-compute[73391]: DEBUG nova.compute.manager [req-2f39dbdd-86b5-4822-b5e9-fe4615286c75 req-2d11cad4-288b-4cbb-8eac-567782860273 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received event network-changed-88d012e5-b40e-4398-99a1-14b37a890c47 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:30:55 user nova-compute[73391]: DEBUG nova.compute.manager [req-2f39dbdd-86b5-4822-b5e9-fe4615286c75 req-2d11cad4-288b-4cbb-8eac-567782860273 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Refreshing instance network info cache due to event network-changed-88d012e5-b40e-4398-99a1-14b37a890c47. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:30:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2f39dbdd-86b5-4822-b5e9-fe4615286c75 req-2d11cad4-288b-4cbb-8eac-567782860273 service nova] Acquiring lock "refresh_cache-da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:30:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2f39dbdd-86b5-4822-b5e9-fe4615286c75 req-2d11cad4-288b-4cbb-8eac-567782860273 service nova] Acquired lock "refresh_cache-da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:30:55 user nova-compute[73391]: DEBUG nova.network.neutron [req-2f39dbdd-86b5-4822-b5e9-fe4615286c75 req-2d11cad4-288b-4cbb-8eac-567782860273 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Refreshing network info cache for port 88d012e5-b40e-4398-99a1-14b37a890c47 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:30:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:30:56 user nova-compute[73391]: DEBUG nova.network.neutron [req-2f39dbdd-86b5-4822-b5e9-fe4615286c75 req-2d11cad4-288b-4cbb-8eac-567782860273 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:30:56 user nova-compute[73391]: DEBUG nova.network.neutron [req-2f39dbdd-86b5-4822-b5e9-fe4615286c75 req-2d11cad4-288b-4cbb-8eac-567782860273 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:30:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2f39dbdd-86b5-4822-b5e9-fe4615286c75 req-2d11cad4-288b-4cbb-8eac-567782860273 service nova] Releasing lock "refresh_cache-da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:30:56 user nova-compute[73391]: DEBUG nova.compute.manager [req-ba28054f-be56-4d21-9fda-e0d850b63915 req-b57b2509-85c3-41f7-968b-e858beaec739 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received event network-changed-544b22aa-6b69-4b4d-985f-19bdc248d641 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:30:56 user nova-compute[73391]: DEBUG nova.compute.manager [req-ba28054f-be56-4d21-9fda-e0d850b63915 req-b57b2509-85c3-41f7-968b-e858beaec739 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Refreshing instance network info cache due to event network-changed-544b22aa-6b69-4b4d-985f-19bdc248d641. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:30:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ba28054f-be56-4d21-9fda-e0d850b63915 req-b57b2509-85c3-41f7-968b-e858beaec739 service nova] Acquiring lock "refresh_cache-da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:30:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ba28054f-be56-4d21-9fda-e0d850b63915 req-b57b2509-85c3-41f7-968b-e858beaec739 service nova] Acquired lock "refresh_cache-da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:30:56 user nova-compute[73391]: DEBUG nova.network.neutron [req-ba28054f-be56-4d21-9fda-e0d850b63915 req-b57b2509-85c3-41f7-968b-e858beaec739 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Refreshing network info cache for port 544b22aa-6b69-4b4d-985f-19bdc248d641 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:30:56 user nova-compute[73391]: DEBUG nova.network.neutron [req-ba28054f-be56-4d21-9fda-e0d850b63915 req-b57b2509-85c3-41f7-968b-e858beaec739 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:30:56 user nova-compute[73391]: DEBUG nova.network.neutron [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Successfully updated port: a519d774-56a5-4a6c-9cd3-94e260332725 {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:30:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Acquiring lock "refresh_cache-da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:30:57 user nova-compute[73391]: DEBUG nova.network.neutron [req-ba28054f-be56-4d21-9fda-e0d850b63915 req-b57b2509-85c3-41f7-968b-e858beaec739 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:30:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ba28054f-be56-4d21-9fda-e0d850b63915 req-b57b2509-85c3-41f7-968b-e858beaec739 service nova] Releasing lock "refresh_cache-da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:30:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Acquired lock "refresh_cache-da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:30:57 user nova-compute[73391]: DEBUG nova.network.neutron [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:30:57 user nova-compute[73391]: DEBUG nova.network.neutron [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:30:57 user nova-compute[73391]: INFO nova.virt.block_device [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Booting with volume d16a4c26-9b62-456a-89b5-f6eb00a73d44 at /dev/vdb
Aug 15 05:30:57 user nova-compute[73391]: DEBUG os_brick.utils [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:30:57 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:30:57 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:30:57 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02cc799-1174-4185-9cc0-e26dcd46acb8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:30:57 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:30:57 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:30:57 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[14211131-da36-428a-b579-3243ad98da72]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:30:57 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:30:57 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:30:57 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[373bf702-cc51-48d7-96de-8efd7c234629]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:30:57 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ead972a-6abe-42a3-a147-e93d4846da65]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:30:57 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:30:57 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:30:57 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 05:30:57 user nova-compute[73391]: DEBUG nova.compute.manager [None req-648edc23-2e6b-4b3e-aa47-ba1c115dfe7b tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:30:57 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:30:57 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:30:57 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 05:30:57 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b9efc1-a7f3-4094-930a-74d6a34d3ca4]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:30:57 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 05:30:57 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 05:30:57 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 05:30:57 user nova-compute[73391]: DEBUG os_brick.utils [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:30:57 user nova-compute[73391]: DEBUG nova.virt.block_device [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Updating existing volume attachment record: d966ad41-b546-4ab0-88fa-57b16f6e4637 {{(pid=73391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 05:30:57 user nova-compute[73391]: INFO nova.compute.manager [None req-648edc23-2e6b-4b3e-aa47-ba1c115dfe7b tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] instance snapshotting
Aug 15 05:30:58 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-648edc23-2e6b-4b3e-aa47-ba1c115dfe7b tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Beginning live snapshot process
Aug 15 05:30:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-648edc23-2e6b-4b3e-aa47-ba1c115dfe7b tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json -f qcow2 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:30:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-648edc23-2e6b-4b3e-aa47-ba1c115dfe7b tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json -f qcow2" returned: 0 in 0.195s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:30:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-648edc23-2e6b-4b3e-aa47-ba1c115dfe7b tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json -f qcow2 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:30:58 user nova-compute[73391]: DEBUG nova.compute.manager [req-510d63fa-5a6a-4680-8986-3228f1fa568a req-5b1d5a5f-09e1-4b18-a948-6780050928d1 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received event network-changed-a519d774-56a5-4a6c-9cd3-94e260332725 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:30:58 user nova-compute[73391]: DEBUG nova.compute.manager [req-510d63fa-5a6a-4680-8986-3228f1fa568a req-5b1d5a5f-09e1-4b18-a948-6780050928d1 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Refreshing instance network info cache due to event network-changed-a519d774-56a5-4a6c-9cd3-94e260332725. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:30:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-510d63fa-5a6a-4680-8986-3228f1fa568a req-5b1d5a5f-09e1-4b18-a948-6780050928d1 service nova] Acquiring lock "refresh_cache-da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:30:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-648edc23-2e6b-4b3e-aa47-ba1c115dfe7b tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json -f qcow2" returned: 0 in 0.272s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:30:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-648edc23-2e6b-4b3e-aa47-ba1c115dfe7b tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:30:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-648edc23-2e6b-4b3e-aa47-ba1c115dfe7b tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.225s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:30:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-648edc23-2e6b-4b3e-aa47-ba1c115dfe7b tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpb9zub3xc/2dcabb0157214069b740832a8fd6b603.delta 1073741824 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:30:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-648edc23-2e6b-4b3e-aa47-ba1c115dfe7b tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpb9zub3xc/2dcabb0157214069b740832a8fd6b603.delta 1073741824" returned: 0 in 0.067s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:30:59 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-648edc23-2e6b-4b3e-aa47-ba1c115dfe7b tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 15 05:30:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-648edc23-2e6b-4b3e-aa47-ba1c115dfe7b tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Checking UEFI support for host arch (x86_64) {{(pid=73391) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Aug 15 05:30:59 user nova-compute[73391]: INFO nova.virt.libvirt.host [None req-648edc23-2e6b-4b3e-aa47-ba1c115dfe7b tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] UEFI support detected
Aug 15 05:30:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Acquiring lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:30:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:30:59 user nova-compute[73391]: DEBUG nova.compute.manager [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Starting instance... {{(pid=73391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 05:30:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:30:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:30:59 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 05:30:59 user nova-compute[73391]: INFO nova.compute.claims [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Claim successful on node user
Aug 15 05:30:59 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:30:59 user nova-compute[73391]: DEBUG nova.network.neutron [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Updating instance_info_cache with network_info: [{"id": "397ea76b-8bbd-4602-b966-cf7331d13e9f", "address": "fa:16:3e:61:64:15", "network": {"id": "63ea02b8-a8de-4680-a96b-496a4480c84e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1311691765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap397ea76b-8b", "ovs_interfaceid": "397ea76b-8bbd-4602-b966-cf7331d13e9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c165877a-edce-4fec-8aa4-e7708b384676", "address": "fa:16:3e:fd:7f:88", "network": {"id": "13d2edf3-6d96-4829-8c78-2dee6654aac3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1748402198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc165877a-ed", "ovs_interfaceid": "c165877a-edce-4fec-8aa4-e7708b384676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "22ffe1b4-8207-4909-b0ba-0db5dc955912", "address": "fa:16:3e:40:11:5a", "network": {"id": "13d2edf3-6d96-4829-8c78-2dee6654aac3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1748402198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ffe1b4-82", "ovs_interfaceid": "22ffe1b4-8207-4909-b0ba-0db5dc955912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "72a3d29f-9af1-4d78-bb33-db5cc02856aa", "address": "fa:16:3e:bf:7b:60", "network": {"id": "13d2edf3-6d96-4829-8c78-2dee6654aac3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1748402198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a3d29f-9a", "ovs_interfaceid": "72a3d29f-9af1-4d78-bb33-db5cc02856aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "88d012e5-b40e-4398-99a1-14b37a890c47", "address": "fa:16:3e:ff:a2:52", "network": {"id": "13d2edf3-6d96-4829-8c78-2dee6654aac3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1748402198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88d012e5-b4", "ovs_interfaceid": "88d012e5-b40e-4398-99a1-14b37a890c47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "544b22aa-6b69-4b4d-985f-19bdc248d641", "address": "fa:16:3e:df:ec:65", "network": {"id": "dddb77ca-d38f-4817-bf06-e8dcc8552539", "bridge": "br-int", "label": "tempest-device-tagging-net2-1958061298", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap544b22aa-6b", "ovs_interfaceid": "544b22aa-6b69-4b4d-985f-19bdc248d641", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a519d774-56a5-4a6c-9cd3-94e260332725", "address": "fa:16:3e:d1:a5:ec", "network": {"id": "dddb77ca-d38f-4817-bf06-e8dcc8552539", "bridge": "br-int", "label": "tempest-device-tagging-net2-1958061298", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa519d774-56", "ovs_interfaceid": "a519d774-56a5-4a6c-9cd3-94e260332725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:30:59 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:30:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-648edc23-2e6b-4b3e-aa47-ba1c115dfe7b tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=73391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 05:30:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Releasing lock "refresh_cache-da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:30:59 user nova-compute[73391]: DEBUG nova.compute.manager [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Instance network_info: |[{"id": "397ea76b-8bbd-4602-b966-cf7331d13e9f", "address": "fa:16:3e:61:64:15", "network": {"id": "63ea02b8-a8de-4680-a96b-496a4480c84e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1311691765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap397ea76b-8b", "ovs_interfaceid": "397ea76b-8bbd-4602-b966-cf7331d13e9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c165877a-edce-4fec-8aa4-e7708b384676", "address": "fa:16:3e:fd:7f:88", "network": {"id": "13d2edf3-6d96-4829-8c78-2dee6654aac3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1748402198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc165877a-ed", "ovs_interfaceid": "c165877a-edce-4fec-8aa4-e7708b384676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "22ffe1b4-8207-4909-b0ba-0db5dc955912", "address": "fa:16:3e:40:11:5a", "network": {"id": "13d2edf3-6d96-4829-8c78-2dee6654aac3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1748402198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ffe1b4-82", "ovs_interfaceid": "22ffe1b4-8207-4909-b0ba-0db5dc955912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "72a3d29f-9af1-4d78-bb33-db5cc02856aa", "address": "fa:16:3e:bf:7b:60", "network": {"id": "13d2edf3-6d96-4829-8c78-2dee6654aac3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1748402198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a3d29f-9a", "ovs_interfaceid": "72a3d29f-9af1-4d78-bb33-db5cc02856aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "88d012e5-b40e-4398-99a1-14b37a890c47", "address": "fa:16:3e:ff:a2:52", "network": {"id": "13d2edf3-6d96-4829-8c78-2dee6654aac3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1748402198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88d012e5-b4", "ovs_interfaceid": "88d012e5-b40e-4398-99a1-14b37a890c47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "544b22aa-6b69-4b4d-985f-19bdc248d641", "address": "fa:16:3e:df:ec:65", "network": {"id": "dddb77ca-d38f-4817-bf06-e8dcc8552539", "bridge": "br-int", "label": "tempest-device-tagging-net2-1958061298", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap544b22aa-6b", "ovs_interfaceid": "544b22aa-6b69-4b4d-985f-19bdc248d641", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a519d774-56a5-4a6c-9cd3-94e260332725", "address": "fa:16:3e:d1:a5:ec", "network": {"id": "dddb77ca-d38f-4817-bf06-e8dcc8552539", "bridge": "br-int", "label": "tempest-device-tagging-net2-1958061298", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa519d774-56", "ovs_interfaceid": "a519d774-56a5-4a6c-9cd3-94e260332725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 05:30:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-510d63fa-5a6a-4680-8986-3228f1fa568a req-5b1d5a5f-09e1-4b18-a948-6780050928d1 service nova] Acquired lock "refresh_cache-da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:30:59 user nova-compute[73391]: DEBUG nova.network.neutron [req-510d63fa-5a6a-4680-8986-3228f1fa568a req-5b1d5a5f-09e1-4b18-a948-6780050928d1 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Refreshing network info cache for port a519d774-56a5-4a6c-9cd3-94e260332725 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:30:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.612s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:30:59 user nova-compute[73391]: DEBUG nova.compute.manager [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Start building networks asynchronously for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 05:31:00 user nova-compute[73391]: DEBUG nova.compute.manager [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Allocating IP information in the background. {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 05:31:00 user nova-compute[73391]: DEBUG nova.network.neutron [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] allocate_for_instance() {{(pid=73391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 05:31:00 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 05:31:00 user nova-compute[73391]: DEBUG nova.compute.manager [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Start building block device mappings for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 05:31:00 user nova-compute[73391]: INFO nova.virt.block_device [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Booting with volume 326d5b7a-2a67-4d44-a918-a390fd8d5bb1 at /dev/vda
Aug 15 05:31:00 user nova-compute[73391]: DEBUG os_brick.utils [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:31:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:00 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-648edc23-2e6b-4b3e-aa47-ba1c115dfe7b tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 05:31:00 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-648edc23-2e6b-4b3e-aa47-ba1c115dfe7b tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 15 05:31:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:00 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b6bead-90a7-42e8-aed0-04a03c80db12]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:00 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba4dd67-2795-4de8-babd-b234d9e04fdf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:00 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f08f9487-b74a-43ca-b0ff-0bbb57b8e48a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:00 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bacec69d-dd66-48d3-9c98-45da06118f41]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:31:00 user nova-compute[73391]: DEBUG nova.policy [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7c992a66fd294e5f82aa58e5fa4058af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a32aa9315a244728c4a764d21e1d2c9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73391) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 05:31:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 05:31:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:31:00 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 05:31:00 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9633c6-7b8f-4ac9-9992-96b40a11929f]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 05:31:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 05:31:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 05:31:00 user nova-compute[73391]: DEBUG os_brick.utils [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:31:00 user nova-compute[73391]: DEBUG nova.virt.block_device [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Updating existing volume attachment record: c324fdb5-7ff6-4dc3-87f5-d71647bc5888 {{(pid=73391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 05:31:00 user nova-compute[73391]: DEBUG nova.privsep.utils [None req-648edc23-2e6b-4b3e-aa47-ba1c115dfe7b tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73391) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 05:31:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-648edc23-2e6b-4b3e-aa47-ba1c115dfe7b tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpb9zub3xc/2dcabb0157214069b740832a8fd6b603.delta /opt/stack/data/nova/instances/snapshots/tmpb9zub3xc/2dcabb0157214069b740832a8fd6b603 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:00 user nova-compute[73391]: DEBUG nova.network.neutron [req-510d63fa-5a6a-4680-8986-3228f1fa568a req-5b1d5a5f-09e1-4b18-a948-6780050928d1 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Updated VIF entry in instance network info cache for port a519d774-56a5-4a6c-9cd3-94e260332725. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:31:00 user nova-compute[73391]: DEBUG nova.network.neutron [req-510d63fa-5a6a-4680-8986-3228f1fa568a req-5b1d5a5f-09e1-4b18-a948-6780050928d1 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Updating instance_info_cache with network_info: [{"id": "397ea76b-8bbd-4602-b966-cf7331d13e9f", "address": "fa:16:3e:61:64:15", "network": {"id": "63ea02b8-a8de-4680-a96b-496a4480c84e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1311691765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap397ea76b-8b", "ovs_interfaceid": "397ea76b-8bbd-4602-b966-cf7331d13e9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c165877a-edce-4fec-8aa4-e7708b384676", "address": "fa:16:3e:fd:7f:88", "network": {"id": "13d2edf3-6d96-4829-8c78-2dee6654aac3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1748402198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc165877a-ed", "ovs_interfaceid": "c165877a-edce-4fec-8aa4-e7708b384676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "22ffe1b4-8207-4909-b0ba-0db5dc955912", "address": "fa:16:3e:40:11:5a", "network": {"id": "13d2edf3-6d96-4829-8c78-2dee6654aac3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1748402198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ffe1b4-82", "ovs_interfaceid": "22ffe1b4-8207-4909-b0ba-0db5dc955912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "72a3d29f-9af1-4d78-bb33-db5cc02856aa", "address": "fa:16:3e:bf:7b:60", "network": {"id": "13d2edf3-6d96-4829-8c78-2dee6654aac3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1748402198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a3d29f-9a", "ovs_interfaceid": "72a3d29f-9af1-4d78-bb33-db5cc02856aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "88d012e5-b40e-4398-99a1-14b37a890c47", "address": "fa:16:3e:ff:a2:52", "network": {"id": "13d2edf3-6d96-4829-8c78-2dee6654aac3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1748402198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88d012e5-b4", "ovs_interfaceid": "88d012e5-b40e-4398-99a1-14b37a890c47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "544b22aa-6b69-4b4d-985f-19bdc248d641", "address": "fa:16:3e:df:ec:65", "network": {"id": "dddb77ca-d38f-4817-bf06-e8dcc8552539", "bridge": "br-int", "label": "tempest-device-tagging-net2-1958061298", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap544b22aa-6b", "ovs_interfaceid": "544b22aa-6b69-4b4d-985f-19bdc248d641", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a519d774-56a5-4a6c-9cd3-94e260332725", "address": "fa:16:3e:d1:a5:ec", "network": {"id": "dddb77ca-d38f-4817-bf06-e8dcc8552539", "bridge": "br-int", "label": "tempest-device-tagging-net2-1958061298", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa519d774-56", "ovs_interfaceid": "a519d774-56a5-4a6c-9cd3-94e260332725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:31:01 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-510d63fa-5a6a-4680-8986-3228f1fa568a req-5b1d5a5f-09e1-4b18-a948-6780050928d1 service nova] Releasing lock "refresh_cache-da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:31:01 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:01 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-648edc23-2e6b-4b3e-aa47-ba1c115dfe7b tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpb9zub3xc/2dcabb0157214069b740832a8fd6b603.delta /opt/stack/data/nova/instances/snapshots/tmpb9zub3xc/2dcabb0157214069b740832a8fd6b603" returned: 0 in 0.476s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:01 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-648edc23-2e6b-4b3e-aa47-ba1c115dfe7b tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Snapshot extracted, beginning image upload
Aug 15 05:31:01 user nova-compute[73391]: DEBUG nova.network.neutron [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Successfully created port: 37e2378e-5659-401c-95ce-0424b61e2e1a {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 05:31:01 user nova-compute[73391]: DEBUG nova.network.neutron [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Successfully created port: a09443ce-b3e9-4fe7-b24a-b1c609cb2553 {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 05:31:02 user nova-compute[73391]: DEBUG nova.network.neutron [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Successfully created port: 7adbd6a6-9a65-4e61-9ff2-63351d5dfaad {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 05:31:03 user nova-compute[73391]: DEBUG nova.network.neutron [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Successfully created port: ae52a22f-e13e-4da6-9561-ba679ac242b1 {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 05:31:03 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:03 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-648edc23-2e6b-4b3e-aa47-ba1c115dfe7b tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Snapshot image upload complete
Aug 15 05:31:03 user nova-compute[73391]: INFO nova.compute.manager [None req-648edc23-2e6b-4b3e-aa47-ba1c115dfe7b tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Took 5.93 seconds to snapshot the instance on the hypervisor.
Aug 15 05:31:03 user nova-compute[73391]: DEBUG nova.network.neutron [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Successfully created port: 33d14fed-6340-407f-bdf1-c858e9cf395c {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 05:31:04 user nova-compute[73391]: DEBUG nova.network.neutron [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Successfully updated port: 37e2378e-5659-401c-95ce-0424b61e2e1a {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:31:04 user nova-compute[73391]: DEBUG nova.compute.manager [req-09163a79-670e-4da6-8115-b0e1dc967b86 req-24952317-5d3c-4560-932f-104abd00777d service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received event network-changed-37e2378e-5659-401c-95ce-0424b61e2e1a {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:31:04 user nova-compute[73391]: DEBUG nova.compute.manager [req-09163a79-670e-4da6-8115-b0e1dc967b86 req-24952317-5d3c-4560-932f-104abd00777d service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Refreshing instance network info cache due to event network-changed-37e2378e-5659-401c-95ce-0424b61e2e1a. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:31:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-09163a79-670e-4da6-8115-b0e1dc967b86 req-24952317-5d3c-4560-932f-104abd00777d service nova] Acquiring lock "refresh_cache-96c5782e-9d00-4bb8-8e1d-99416bc7d556" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:31:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-09163a79-670e-4da6-8115-b0e1dc967b86 req-24952317-5d3c-4560-932f-104abd00777d service nova] Acquired lock "refresh_cache-96c5782e-9d00-4bb8-8e1d-99416bc7d556" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:31:04 user nova-compute[73391]: DEBUG nova.network.neutron [req-09163a79-670e-4da6-8115-b0e1dc967b86 req-24952317-5d3c-4560-932f-104abd00777d service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Refreshing network info cache for port 37e2378e-5659-401c-95ce-0424b61e2e1a {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:31:04 user nova-compute[73391]: DEBUG nova.network.neutron [req-09163a79-670e-4da6-8115-b0e1dc967b86 req-24952317-5d3c-4560-932f-104abd00777d service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:31:05 user nova-compute[73391]: DEBUG nova.network.neutron [req-09163a79-670e-4da6-8115-b0e1dc967b86 req-24952317-5d3c-4560-932f-104abd00777d service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:31:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-09163a79-670e-4da6-8115-b0e1dc967b86 req-24952317-5d3c-4560-932f-104abd00777d service nova] Releasing lock "refresh_cache-96c5782e-9d00-4bb8-8e1d-99416bc7d556" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:31:05 user nova-compute[73391]: DEBUG nova.network.neutron [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Successfully updated port: 23d27a9f-a59d-4369-a8c2-0f09564bb78d {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:31:06 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:06 user nova-compute[73391]: DEBUG nova.network.neutron [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Successfully updated port: 879124a9-46cd-45bb-b1a2-34cc8264cf25 {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:31:06 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:31:06 user nova-compute[73391]: DEBUG nova.compute.manager [req-bf71d858-d4d1-4f95-852c-203af347f0f5 req-cd762ceb-a8ff-4dde-afee-13f3a195cb96 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received event network-changed-23d27a9f-a59d-4369-a8c2-0f09564bb78d {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:31:06 user nova-compute[73391]: DEBUG nova.compute.manager [req-bf71d858-d4d1-4f95-852c-203af347f0f5 req-cd762ceb-a8ff-4dde-afee-13f3a195cb96 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Refreshing instance network info cache due to event network-changed-23d27a9f-a59d-4369-a8c2-0f09564bb78d. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:31:06 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-bf71d858-d4d1-4f95-852c-203af347f0f5 req-cd762ceb-a8ff-4dde-afee-13f3a195cb96 service nova] Acquiring lock "refresh_cache-96c5782e-9d00-4bb8-8e1d-99416bc7d556" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:31:06 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-bf71d858-d4d1-4f95-852c-203af347f0f5 req-cd762ceb-a8ff-4dde-afee-13f3a195cb96 service nova] Acquired lock "refresh_cache-96c5782e-9d00-4bb8-8e1d-99416bc7d556" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:31:06 user nova-compute[73391]: DEBUG nova.network.neutron [req-bf71d858-d4d1-4f95-852c-203af347f0f5 req-cd762ceb-a8ff-4dde-afee-13f3a195cb96 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Refreshing network info cache for port 23d27a9f-a59d-4369-a8c2-0f09564bb78d {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:31:06 user nova-compute[73391]: DEBUG nova.network.neutron [req-bf71d858-d4d1-4f95-852c-203af347f0f5 req-cd762ceb-a8ff-4dde-afee-13f3a195cb96 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:31:07 user nova-compute[73391]: DEBUG nova.network.neutron [req-bf71d858-d4d1-4f95-852c-203af347f0f5 req-cd762ceb-a8ff-4dde-afee-13f3a195cb96 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:31:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-bf71d858-d4d1-4f95-852c-203af347f0f5 req-cd762ceb-a8ff-4dde-afee-13f3a195cb96 service nova] Releasing lock "refresh_cache-96c5782e-9d00-4bb8-8e1d-99416bc7d556" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:31:07 user nova-compute[73391]: DEBUG nova.compute.manager [req-bf71d858-d4d1-4f95-852c-203af347f0f5 req-cd762ceb-a8ff-4dde-afee-13f3a195cb96 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received event network-changed-879124a9-46cd-45bb-b1a2-34cc8264cf25 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:31:07 user nova-compute[73391]: DEBUG nova.compute.manager [req-bf71d858-d4d1-4f95-852c-203af347f0f5 req-cd762ceb-a8ff-4dde-afee-13f3a195cb96 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Refreshing instance network info cache due to event network-changed-879124a9-46cd-45bb-b1a2-34cc8264cf25. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:31:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-bf71d858-d4d1-4f95-852c-203af347f0f5 req-cd762ceb-a8ff-4dde-afee-13f3a195cb96 service nova] Acquiring lock "refresh_cache-96c5782e-9d00-4bb8-8e1d-99416bc7d556" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:31:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-bf71d858-d4d1-4f95-852c-203af347f0f5 req-cd762ceb-a8ff-4dde-afee-13f3a195cb96 service nova] Acquired lock "refresh_cache-96c5782e-9d00-4bb8-8e1d-99416bc7d556" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:31:07 user nova-compute[73391]: DEBUG nova.network.neutron [req-bf71d858-d4d1-4f95-852c-203af347f0f5 req-cd762ceb-a8ff-4dde-afee-13f3a195cb96 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Refreshing network info cache for port 879124a9-46cd-45bb-b1a2-34cc8264cf25 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:31:07 user nova-compute[73391]: DEBUG nova.network.neutron [req-bf71d858-d4d1-4f95-852c-203af347f0f5 req-cd762ceb-a8ff-4dde-afee-13f3a195cb96 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:31:07 user nova-compute[73391]: INFO nova.virt.block_device [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Booting with volume 3eec2145-f305-421e-8259-a2b495036296 at /dev/vdc
Aug 15 05:31:07 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:31:07 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:31:07 user nova-compute[73391]: DEBUG os_brick.utils [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:31:07 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:07 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:07 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a77dc536-75d8-4001-a7be-1d150c5c0ff9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:07 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:07 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:07 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3919d86-b1bf-42fc-a6aa-f7ce2346faf0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:07 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:07 user nova-compute[73391]: DEBUG nova.network.neutron [req-bf71d858-d4d1-4f95-852c-203af347f0f5 req-cd762ceb-a8ff-4dde-afee-13f3a195cb96 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:31:07 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:07 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0056d7dd-3235-4e7a-93e0-4e712b9d6a0d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:07 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5244bc16-1b59-4386-a164-3b4d0301b32e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:07 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:07 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:31:07 user nova-compute[73391]: DEBUG nova.network.neutron [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Successfully updated port: a09443ce-b3e9-4fe7-b24a-b1c609cb2553 {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:31:07 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 05:31:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-bf71d858-d4d1-4f95-852c-203af347f0f5 req-cd762ceb-a8ff-4dde-afee-13f3a195cb96 service nova] Releasing lock "refresh_cache-96c5782e-9d00-4bb8-8e1d-99416bc7d556" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:31:07 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:07 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:31:07 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 05:31:07 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[543ca95f-59d0-4538-9737-8cf9ce06eb73]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:07 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 05:31:07 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 05:31:07 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 05:31:07 user nova-compute[73391]: DEBUG os_brick.utils [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:31:07 user nova-compute[73391]: DEBUG nova.virt.block_device [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Updating existing volume attachment record: fab77139-603f-400c-97cb-163f55e20d99 {{(pid=73391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 05:31:08 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:31:08 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:31:08 user nova-compute[73391]: DEBUG nova.compute.manager [req-9c027da2-bdf5-42c7-abe4-0a316690e609 req-d6a7a435-d920-496d-9df0-be4667d3e01d service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received event network-changed-a09443ce-b3e9-4fe7-b24a-b1c609cb2553 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:31:08 user nova-compute[73391]: DEBUG nova.compute.manager [req-9c027da2-bdf5-42c7-abe4-0a316690e609 req-d6a7a435-d920-496d-9df0-be4667d3e01d service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Refreshing instance network info cache due to event network-changed-a09443ce-b3e9-4fe7-b24a-b1c609cb2553. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:31:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-9c027da2-bdf5-42c7-abe4-0a316690e609 req-d6a7a435-d920-496d-9df0-be4667d3e01d service nova] Acquiring lock "refresh_cache-96c5782e-9d00-4bb8-8e1d-99416bc7d556" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:31:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-9c027da2-bdf5-42c7-abe4-0a316690e609 req-d6a7a435-d920-496d-9df0-be4667d3e01d service nova] Acquired lock "refresh_cache-96c5782e-9d00-4bb8-8e1d-99416bc7d556" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:31:08 user nova-compute[73391]: DEBUG nova.network.neutron [req-9c027da2-bdf5-42c7-abe4-0a316690e609 req-d6a7a435-d920-496d-9df0-be4667d3e01d service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Refreshing network info cache for port a09443ce-b3e9-4fe7-b24a-b1c609cb2553 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:31:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:08 user nova-compute[73391]: DEBUG nova.network.neutron [req-9c027da2-bdf5-42c7-abe4-0a316690e609 req-d6a7a435-d920-496d-9df0-be4667d3e01d service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:31:09 user nova-compute[73391]: DEBUG nova.network.neutron [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Successfully updated port: 7adbd6a6-9a65-4e61-9ff2-63351d5dfaad {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:31:09 user nova-compute[73391]: DEBUG nova.network.neutron [req-9c027da2-bdf5-42c7-abe4-0a316690e609 req-d6a7a435-d920-496d-9df0-be4667d3e01d service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:31:09 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-9c027da2-bdf5-42c7-abe4-0a316690e609 req-d6a7a435-d920-496d-9df0-be4667d3e01d service nova] Releasing lock "refresh_cache-96c5782e-9d00-4bb8-8e1d-99416bc7d556" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:31:10 user nova-compute[73391]: DEBUG nova.network.neutron [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Successfully updated port: ae52a22f-e13e-4da6-9561-ba679ac242b1 {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:31:10 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:31:10 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:31:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:31:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:31:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:31:10 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Auditing locally available compute resources for user (node: user) {{(pid=73391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 05:31:10 user nova-compute[73391]: DEBUG nova.compute.manager [req-940dd41d-661d-4be1-9907-98ad95ce547d req-4f0277a3-3b06-40ac-8dd6-d3b7d3ca939f service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received event network-changed-7adbd6a6-9a65-4e61-9ff2-63351d5dfaad {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:31:10 user nova-compute[73391]: DEBUG nova.compute.manager [req-940dd41d-661d-4be1-9907-98ad95ce547d req-4f0277a3-3b06-40ac-8dd6-d3b7d3ca939f service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Refreshing instance network info cache due to event network-changed-7adbd6a6-9a65-4e61-9ff2-63351d5dfaad. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:31:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-940dd41d-661d-4be1-9907-98ad95ce547d req-4f0277a3-3b06-40ac-8dd6-d3b7d3ca939f service nova] Acquiring lock "refresh_cache-96c5782e-9d00-4bb8-8e1d-99416bc7d556" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:31:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-940dd41d-661d-4be1-9907-98ad95ce547d req-4f0277a3-3b06-40ac-8dd6-d3b7d3ca939f service nova] Acquired lock "refresh_cache-96c5782e-9d00-4bb8-8e1d-99416bc7d556" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:31:10 user nova-compute[73391]: DEBUG nova.network.neutron [req-940dd41d-661d-4be1-9907-98ad95ce547d req-4f0277a3-3b06-40ac-8dd6-d3b7d3ca939f service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Refreshing network info cache for port 7adbd6a6-9a65-4e61-9ff2-63351d5dfaad {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:31:10 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee96866e-7ee0-46a1-be1a-60439a52d513/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:10 user nova-compute[73391]: DEBUG nova.network.neutron [req-940dd41d-661d-4be1-9907-98ad95ce547d req-4f0277a3-3b06-40ac-8dd6-d3b7d3ca939f service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:31:11 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee96866e-7ee0-46a1-be1a-60439a52d513/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee96866e-7ee0-46a1-be1a-60439a52d513/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee96866e-7ee0-46a1-be1a-60439a52d513/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:11 user nova-compute[73391]: DEBUG nova.network.neutron [req-940dd41d-661d-4be1-9907-98ad95ce547d req-4f0277a3-3b06-40ac-8dd6-d3b7d3ca939f service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:31:11 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-940dd41d-661d-4be1-9907-98ad95ce547d req-4f0277a3-3b06-40ac-8dd6-d3b7d3ca939f service nova] Releasing lock "refresh_cache-96c5782e-9d00-4bb8-8e1d-99416bc7d556" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:31:11 user nova-compute[73391]: DEBUG nova.compute.manager [req-940dd41d-661d-4be1-9907-98ad95ce547d req-4f0277a3-3b06-40ac-8dd6-d3b7d3ca939f service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received event network-changed-ae52a22f-e13e-4da6-9561-ba679ac242b1 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:31:11 user nova-compute[73391]: DEBUG nova.compute.manager [req-940dd41d-661d-4be1-9907-98ad95ce547d req-4f0277a3-3b06-40ac-8dd6-d3b7d3ca939f service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Refreshing instance network info cache due to event network-changed-ae52a22f-e13e-4da6-9561-ba679ac242b1. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:31:11 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-940dd41d-661d-4be1-9907-98ad95ce547d req-4f0277a3-3b06-40ac-8dd6-d3b7d3ca939f service nova] Acquiring lock "refresh_cache-96c5782e-9d00-4bb8-8e1d-99416bc7d556" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:31:11 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-940dd41d-661d-4be1-9907-98ad95ce547d req-4f0277a3-3b06-40ac-8dd6-d3b7d3ca939f service nova] Acquired lock "refresh_cache-96c5782e-9d00-4bb8-8e1d-99416bc7d556" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:31:11 user nova-compute[73391]: DEBUG nova.network.neutron [req-940dd41d-661d-4be1-9907-98ad95ce547d req-4f0277a3-3b06-40ac-8dd6-d3b7d3ca939f service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Refreshing network info cache for port ae52a22f-e13e-4da6-9561-ba679ac242b1 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:31:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:11 user nova-compute[73391]: DEBUG nova.network.neutron [req-940dd41d-661d-4be1-9907-98ad95ce547d req-4f0277a3-3b06-40ac-8dd6-d3b7d3ca939f service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:31:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b7704e3-f48b-473c-89ae-5437a690f06a/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:11 user nova-compute[73391]: DEBUG nova.network.neutron [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Successfully updated port: 33d14fed-6340-407f-bdf1-c858e9cf395c {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:31:11 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Acquiring lock "refresh_cache-96c5782e-9d00-4bb8-8e1d-99416bc7d556" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:31:11 user nova-compute[73391]: DEBUG nova.network.neutron [req-940dd41d-661d-4be1-9907-98ad95ce547d req-4f0277a3-3b06-40ac-8dd6-d3b7d3ca939f service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:31:11 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-940dd41d-661d-4be1-9907-98ad95ce547d req-4f0277a3-3b06-40ac-8dd6-d3b7d3ca939f service nova] Releasing lock "refresh_cache-96c5782e-9d00-4bb8-8e1d-99416bc7d556" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:31:11 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Acquired lock "refresh_cache-96c5782e-9d00-4bb8-8e1d-99416bc7d556" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:31:11 user nova-compute[73391]: DEBUG nova.network.neutron [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:31:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b7704e3-f48b-473c-89ae-5437a690f06a/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b7704e3-f48b-473c-89ae-5437a690f06a/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:11 user nova-compute[73391]: DEBUG nova.network.neutron [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:31:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b7704e3-f48b-473c-89ae-5437a690f06a/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0169df15-335e-46e6-a5c8-9deb7095bb84/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6cc1e3ce-1cbd-41c9-8dd3-d0dfeb17c1df tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Acquiring lock "782c3d06-ef9e-4ca4-a03b-86f0e6d458a2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:31:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6cc1e3ce-1cbd-41c9-8dd3-d0dfeb17c1df tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Lock "782c3d06-ef9e-4ca4-a03b-86f0e6d458a2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:31:12 user nova-compute[73391]: DEBUG nova.objects.instance [None req-6cc1e3ce-1cbd-41c9-8dd3-d0dfeb17c1df tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Lazy-loading 'flavor' on Instance uuid 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:31:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0169df15-335e-46e6-a5c8-9deb7095bb84/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0169df15-335e-46e6-a5c8-9deb7095bb84/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6cc1e3ce-1cbd-41c9-8dd3-d0dfeb17c1df tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Lock "782c3d06-ef9e-4ca4-a03b-86f0e6d458a2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.093s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:31:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0169df15-335e-46e6-a5c8-9deb7095bb84/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6cc1e3ce-1cbd-41c9-8dd3-d0dfeb17c1df tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Acquiring lock "782c3d06-ef9e-4ca4-a03b-86f0e6d458a2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:31:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6cc1e3ce-1cbd-41c9-8dd3-d0dfeb17c1df tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Lock "782c3d06-ef9e-4ca4-a03b-86f0e6d458a2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:31:12 user nova-compute[73391]: INFO nova.compute.manager [None req-6cc1e3ce-1cbd-41c9-8dd3-d0dfeb17c1df tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Attaching volume dee27f26-c48e-4de8-8b6f-38c300512f77 to /dev/vdb
Aug 15 05:31:12 user nova-compute[73391]: DEBUG os_brick.utils [None req-6cc1e3ce-1cbd-41c9-8dd3-d0dfeb17c1df tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:31:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:12 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e25098-662d-428e-960d-63b5ef0e24a2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:12 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb618a04-95bb-454e-8e01-e5e41ab63235]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:12 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e633813-2f73-46cc-9d43-28bb06472cde]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:12 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bf8e6db-215d-4349-8d17-3d0eb1cd706a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-6cc1e3ce-1cbd-41c9-8dd3-d0dfeb17c1df tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-6cc1e3ce-1cbd-41c9-8dd3-d0dfeb17c1df tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:31:12 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6cc1e3ce-1cbd-41c9-8dd3-d0dfeb17c1df tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 05:31:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:31:12 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 05:31:12 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd853e0c-5c9b-46f3-946f-6b2c169fad1d]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:12 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-6cc1e3ce-1cbd-41c9-8dd3-d0dfeb17c1df tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 05:31:12 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-6cc1e3ce-1cbd-41c9-8dd3-d0dfeb17c1df tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 05:31:12 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-6cc1e3ce-1cbd-41c9-8dd3-d0dfeb17c1df tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 05:31:12 user nova-compute[73391]: DEBUG os_brick.utils [None req-6cc1e3ce-1cbd-41c9-8dd3-d0dfeb17c1df tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] <== get_connector_properties: return (161ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:31:12 user nova-compute[73391]: DEBUG nova.virt.block_device [None req-6cc1e3ce-1cbd-41c9-8dd3-d0dfeb17c1df tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Updating existing volume attachment record: f0fc1f7a-2c35-4ff7-bbdd-cf0f62af9064 {{(pid=73391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 05:31:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c8138a-4efc-403f-8b42-e5080c6a51d3/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:12 user nova-compute[73391]: DEBUG nova.compute.manager [req-07900219-49e1-4054-a1b4-48d197039480 req-fee93feb-908e-4bed-b76e-d2adb7eacb5a service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received event network-changed-33d14fed-6340-407f-bdf1-c858e9cf395c {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:31:12 user nova-compute[73391]: DEBUG nova.compute.manager [req-07900219-49e1-4054-a1b4-48d197039480 req-fee93feb-908e-4bed-b76e-d2adb7eacb5a service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Refreshing instance network info cache due to event network-changed-33d14fed-6340-407f-bdf1-c858e9cf395c. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:31:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-07900219-49e1-4054-a1b4-48d197039480 req-fee93feb-908e-4bed-b76e-d2adb7eacb5a service nova] Acquiring lock "refresh_cache-96c5782e-9d00-4bb8-8e1d-99416bc7d556" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:31:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c8138a-4efc-403f-8b42-e5080c6a51d3/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c8138a-4efc-403f-8b42-e5080c6a51d3/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c8138a-4efc-403f-8b42-e5080c6a51d3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b9f5970-65c5-4eff-a4bf-d18a9c916c90/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b9f5970-65c5-4eff-a4bf-d18a9c916c90/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b9f5970-65c5-4eff-a4bf-d18a9c916c90/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b9f5970-65c5-4eff-a4bf-d18a9c916c90/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df00c15a-2512-41d0-9857-edb50374897e/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df00c15a-2512-41d0-9857-edb50374897e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df00c15a-2512-41d0-9857-edb50374897e/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:13 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df00c15a-2512-41d0-9857-edb50374897e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c3d06-ef9e-4ca4-a03b-86f0e6d458a2/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:14 user nova-compute[73391]: DEBUG nova.network.neutron [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Updating instance_info_cache with network_info: [{"id": "37e2378e-5659-401c-95ce-0424b61e2e1a", "address": "fa:16:3e:7b:4f:9c", "network": {"id": "1fb1af76-f96a-4640-a09d-1bdb13e93bd6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-505156524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e2378e-56", "ovs_interfaceid": "37e2378e-5659-401c-95ce-0424b61e2e1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23d27a9f-a59d-4369-a8c2-0f09564bb78d", "address": "fa:16:3e:4a:c7:00", "network": {"id": "38d7d183-2f35-4f50-bd69-614eaf1952ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-82531103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23d27a9f-a5", "ovs_interfaceid": "23d27a9f-a59d-4369-a8c2-0f09564bb78d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "879124a9-46cd-45bb-b1a2-34cc8264cf25", "address": "fa:16:3e:4a:68:3f", "network": {"id": "38d7d183-2f35-4f50-bd69-614eaf1952ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-82531103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap879124a9-46", "ovs_interfaceid": "879124a9-46cd-45bb-b1a2-34cc8264cf25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a09443ce-b3e9-4fe7-b24a-b1c609cb2553", "address": "fa:16:3e:6a:6d:c5", "network": {"id": "38d7d183-2f35-4f50-bd69-614eaf1952ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-82531103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa09443ce-b3", "ovs_interfaceid": "a09443ce-b3e9-4fe7-b24a-b1c609cb2553", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7adbd6a6-9a65-4e61-9ff2-63351d5dfaad", "address": "fa:16:3e:b7:e9:02", "network": {"id": "38d7d183-2f35-4f50-bd69-614eaf1952ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-82531103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7adbd6a6-9a", "ovs_interfaceid": "7adbd6a6-9a65-4e61-9ff2-63351d5dfaad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ae52a22f-e13e-4da6-9561-ba679ac242b1", "address": "fa:16:3e:df:63:15", "network": {"id": "0376a3e8-17aa-47e4-afdb-fb7ba9174147", "bridge": "br-int", "label": "tempest-device-tagging-net2-1320047162", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae52a22f-e1", "ovs_interfaceid": "ae52a22f-e13e-4da6-9561-ba679ac242b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "33d14fed-6340-407f-bdf1-c858e9cf395c", "address": "fa:16:3e:f1:52:78", "network": {"id": "0376a3e8-17aa-47e4-afdb-fb7ba9174147", "bridge": "br-int", "label": "tempest-device-tagging-net2-1320047162", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33d14fed-63", "ovs_interfaceid": "33d14fed-6340-407f-bdf1-c858e9cf395c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:31:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Releasing lock "refresh_cache-96c5782e-9d00-4bb8-8e1d-99416bc7d556" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:31:14 user nova-compute[73391]: DEBUG nova.compute.manager [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Instance network_info: |[{"id": "37e2378e-5659-401c-95ce-0424b61e2e1a", "address": "fa:16:3e:7b:4f:9c", "network": {"id": "1fb1af76-f96a-4640-a09d-1bdb13e93bd6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-505156524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e2378e-56", "ovs_interfaceid": "37e2378e-5659-401c-95ce-0424b61e2e1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23d27a9f-a59d-4369-a8c2-0f09564bb78d", "address": "fa:16:3e:4a:c7:00", "network": {"id": "38d7d183-2f35-4f50-bd69-614eaf1952ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-82531103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23d27a9f-a5", "ovs_interfaceid": "23d27a9f-a59d-4369-a8c2-0f09564bb78d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "879124a9-46cd-45bb-b1a2-34cc8264cf25", "address": "fa:16:3e:4a:68:3f", "network": {"id": "38d7d183-2f35-4f50-bd69-614eaf1952ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-82531103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap879124a9-46", "ovs_interfaceid": "879124a9-46cd-45bb-b1a2-34cc8264cf25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a09443ce-b3e9-4fe7-b24a-b1c609cb2553", "address": "fa:16:3e:6a:6d:c5", "network": {"id": "38d7d183-2f35-4f50-bd69-614eaf1952ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-82531103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa09443ce-b3", "ovs_interfaceid": "a09443ce-b3e9-4fe7-b24a-b1c609cb2553", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7adbd6a6-9a65-4e61-9ff2-63351d5dfaad", "address": "fa:16:3e:b7:e9:02", "network": {"id": "38d7d183-2f35-4f50-bd69-614eaf1952ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-82531103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7adbd6a6-9a", "ovs_interfaceid": "7adbd6a6-9a65-4e61-9ff2-63351d5dfaad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ae52a22f-e13e-4da6-9561-ba679ac242b1", "address": "fa:16:3e:df:63:15", "network": {"id": "0376a3e8-17aa-47e4-afdb-fb7ba9174147", "bridge": "br-int", "label": "tempest-device-tagging-net2-1320047162", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae52a22f-e1", "ovs_interfaceid": "ae52a22f-e13e-4da6-9561-ba679ac242b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "33d14fed-6340-407f-bdf1-c858e9cf395c", "address": "fa:16:3e:f1:52:78", "network": {"id": "0376a3e8-17aa-47e4-afdb-fb7ba9174147", "bridge": "br-int", "label": "tempest-device-tagging-net2-1320047162", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33d14fed-63", "ovs_interfaceid": "33d14fed-6340-407f-bdf1-c858e9cf395c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 05:31:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-07900219-49e1-4054-a1b4-48d197039480 req-fee93feb-908e-4bed-b76e-d2adb7eacb5a service nova] Acquired lock "refresh_cache-96c5782e-9d00-4bb8-8e1d-99416bc7d556" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:31:14 user nova-compute[73391]: DEBUG nova.network.neutron [req-07900219-49e1-4054-a1b4-48d197039480 req-fee93feb-908e-4bed-b76e-d2adb7eacb5a service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Refreshing network info cache for port 33d14fed-6340-407f-bdf1-c858e9cf395c {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:31:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c3d06-ef9e-4ca4-a03b-86f0e6d458a2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c3d06-ef9e-4ca4-a03b-86f0e6d458a2/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/782c3d06-ef9e-4ca4-a03b-86f0e6d458a2/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:14 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:31:14 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:31:14 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Hypervisor/Node resource view: name=user free_ram=7095MB free_disk=25.56976318359375GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 05:31:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:31:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:31:14 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 8f08782b-f793-415e-b0d6-5caad1c3d426 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:31:14 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:31:14 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 6ac9d5dc-56be-402f-b9d4-3327bdfd9220 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:31:14 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 18c8138a-4efc-403f-8b42-e5080c6a51d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:31:14 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 4b9f5970-65c5-4eff-a4bf-d18a9c916c90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:31:14 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance df00c15a-2512-41d0-9857-edb50374897e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:31:14 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 0169df15-335e-46e6-a5c8-9deb7095bb84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:31:14 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance ee96866e-7ee0-46a1-be1a-60439a52d513 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:31:14 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 7b7704e3-f48b-473c-89ae-5437a690f06a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:31:14 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:31:14 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 96c5782e-9d00-4bb8-8e1d-99416bc7d556 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:31:14 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 05:31:14 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 05:31:14 user nova-compute[73391]: DEBUG nova.network.neutron [req-07900219-49e1-4054-a1b4-48d197039480 req-fee93feb-908e-4bed-b76e-d2adb7eacb5a service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Updated VIF entry in instance network info cache for port 33d14fed-6340-407f-bdf1-c858e9cf395c. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:31:14 user nova-compute[73391]: DEBUG nova.network.neutron [req-07900219-49e1-4054-a1b4-48d197039480 req-fee93feb-908e-4bed-b76e-d2adb7eacb5a service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Updating instance_info_cache with network_info: [{"id": "37e2378e-5659-401c-95ce-0424b61e2e1a", "address": "fa:16:3e:7b:4f:9c", "network": {"id": "1fb1af76-f96a-4640-a09d-1bdb13e93bd6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-505156524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e2378e-56", "ovs_interfaceid": "37e2378e-5659-401c-95ce-0424b61e2e1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23d27a9f-a59d-4369-a8c2-0f09564bb78d", "address": "fa:16:3e:4a:c7:00", "network": {"id": "38d7d183-2f35-4f50-bd69-614eaf1952ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-82531103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23d27a9f-a5", "ovs_interfaceid": "23d27a9f-a59d-4369-a8c2-0f09564bb78d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "879124a9-46cd-45bb-b1a2-34cc8264cf25", "address": "fa:16:3e:4a:68:3f", "network": {"id": "38d7d183-2f35-4f50-bd69-614eaf1952ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-82531103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap879124a9-46", "ovs_interfaceid": "879124a9-46cd-45bb-b1a2-34cc8264cf25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a09443ce-b3e9-4fe7-b24a-b1c609cb2553", "address": "fa:16:3e:6a:6d:c5", "network": {"id": "38d7d183-2f35-4f50-bd69-614eaf1952ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-82531103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa09443ce-b3", "ovs_interfaceid": "a09443ce-b3e9-4fe7-b24a-b1c609cb2553", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7adbd6a6-9a65-4e61-9ff2-63351d5dfaad", "address": "fa:16:3e:b7:e9:02", "network": {"id": "38d7d183-2f35-4f50-bd69-614eaf1952ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-82531103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7adbd6a6-9a", "ovs_interfaceid": "7adbd6a6-9a65-4e61-9ff2-63351d5dfaad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ae52a22f-e13e-4da6-9561-ba679ac242b1", "address": "fa:16:3e:df:63:15", "network": {"id": "0376a3e8-17aa-47e4-afdb-fb7ba9174147", "bridge": "br-int", "label": "tempest-device-tagging-net2-1320047162", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae52a22f-e1", "ovs_interfaceid": "ae52a22f-e13e-4da6-9561-ba679ac242b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "33d14fed-6340-407f-bdf1-c858e9cf395c", "address": "fa:16:3e:f1:52:78", "network": {"id": "0376a3e8-17aa-47e4-afdb-fb7ba9174147", "bridge": "br-int", "label": "tempest-device-tagging-net2-1320047162", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33d14fed-63", "ovs_interfaceid": "33d14fed-6340-407f-bdf1-c858e9cf395c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:31:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-07900219-49e1-4054-a1b4-48d197039480 req-fee93feb-908e-4bed-b76e-d2adb7eacb5a service nova] Releasing lock "refresh_cache-96c5782e-9d00-4bb8-8e1d-99416bc7d556" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:31:15 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:31:15 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:31:15 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Compute_service record updated for user:user {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 05:31:15 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.482s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:31:16 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:16 user nova-compute[73391]: DEBUG nova.compute.manager [req-b0ec35a1-e351-4701-bec6-a241a32ffa8d req-69466995-a0f8-4e0b-a7b7-21739c420295 service nova] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Received event network-changed-9cde10e9-3186-4680-8e4d-a3bb0d8600d0 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:31:16 user nova-compute[73391]: DEBUG nova.compute.manager [req-b0ec35a1-e351-4701-bec6-a241a32ffa8d req-69466995-a0f8-4e0b-a7b7-21739c420295 service nova] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Refreshing instance network info cache due to event network-changed-9cde10e9-3186-4680-8e4d-a3bb0d8600d0. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:31:16 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-b0ec35a1-e351-4701-bec6-a241a32ffa8d req-69466995-a0f8-4e0b-a7b7-21739c420295 service nova] Acquiring lock "refresh_cache-6ac9d5dc-56be-402f-b9d4-3327bdfd9220" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:31:16 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-b0ec35a1-e351-4701-bec6-a241a32ffa8d req-69466995-a0f8-4e0b-a7b7-21739c420295 service nova] Acquired lock "refresh_cache-6ac9d5dc-56be-402f-b9d4-3327bdfd9220" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:31:16 user nova-compute[73391]: DEBUG nova.network.neutron [req-b0ec35a1-e351-4701-bec6-a241a32ffa8d req-69466995-a0f8-4e0b-a7b7-21739c420295 service nova] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Refreshing network info cache for port 9cde10e9-3186-4680-8e4d-a3bb0d8600d0 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:31:16 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:31:16 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Starting heal instance info cache {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 05:31:16 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "refresh_cache-782c3d06-ef9e-4ca4-a03b-86f0e6d458a2" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:31:16 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquired lock "refresh_cache-782c3d06-ef9e-4ca4-a03b-86f0e6d458a2" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:31:16 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Forcefully refreshing network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 05:31:17 user nova-compute[73391]: DEBUG nova.network.neutron [req-b0ec35a1-e351-4701-bec6-a241a32ffa8d req-69466995-a0f8-4e0b-a7b7-21739c420295 service nova] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Updated VIF entry in instance network info cache for port 9cde10e9-3186-4680-8e4d-a3bb0d8600d0. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:31:17 user nova-compute[73391]: DEBUG nova.network.neutron [req-b0ec35a1-e351-4701-bec6-a241a32ffa8d req-69466995-a0f8-4e0b-a7b7-21739c420295 service nova] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Updating instance_info_cache with network_info: [{"id": "9cde10e9-3186-4680-8e4d-a3bb0d8600d0", "address": "fa:16:3e:50:39:e0", "network": {"id": "610f78de-5741-4743-815d-d12ba05f8000", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1518164868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b01853a82243369bd71dc0dbedb5d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cde10e9-31", "ovs_interfaceid": "9cde10e9-3186-4680-8e4d-a3bb0d8600d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:31:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-b0ec35a1-e351-4701-bec6-a241a32ffa8d req-69466995-a0f8-4e0b-a7b7-21739c420295 service nova] Releasing lock "refresh_cache-6ac9d5dc-56be-402f-b9d4-3327bdfd9220" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:31:17 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Updating instance_info_cache with network_info: [{"id": "39b441c5-fe40-4e06-9dcc-b11135805efe", "address": "fa:16:3e:0c:87:08", "network": {"id": "7b58b377-f2fd-4b5c-9bb3-4e7fa4c10faf", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1135444746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76918aa37f848008c8466a38bac1908", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b441c5-fe", "ovs_interfaceid": "39b441c5-fe40-4e06-9dcc-b11135805efe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:31:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Releasing lock "refresh_cache-782c3d06-ef9e-4ca4-a03b-86f0e6d458a2" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:31:17 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Updated the network info_cache for instance {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 05:31:17 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:31:17 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:31:17 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 05:31:17 user nova-compute[73391]: INFO nova.virt.block_device [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Booting with volume 162fea74-b991-40c2-acce-b2c6fcd5c2f1 at /dev/vdb
Aug 15 05:31:17 user nova-compute[73391]: DEBUG os_brick.utils [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:31:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:17 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac37f811-771b-4de7-9304-8cfebe56c5bf]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.014s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:17 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf6060f-35cc-4a60-988a-195a12ac9e0b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:17 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[09cea4b0-3576-4cb0-a84b-4a34fcb32d88]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:17 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb81a1a8-51bf-4c03-ae7d-95961af463ee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:31:17 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 05:31:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:31:17 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 05:31:17 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40a977f-0f4a-4fd1-a4ab-a68528653ac2]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:17 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 05:31:17 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 05:31:17 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 05:31:17 user nova-compute[73391]: DEBUG os_brick.utils [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:31:17 user nova-compute[73391]: DEBUG nova.virt.block_device [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Updating existing volume attachment record: 7ce01946-dc0f-42d9-9bcf-f65b18305a4e {{(pid=73391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG nova.compute.manager [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Start spawning the instance on the hypervisor. {{(pid=73391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Creating instance directory {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 05:31:18 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Creating image(s)
Aug 15 05:31:18 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Did not create local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Ensure instance console log exists: /opt/stack/data/nova/instances/da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Start _get_guest_xml network_info=[{"id": "397ea76b-8bbd-4602-b966-cf7331d13e9f", "address": "fa:16:3e:61:64:15", "network": {"id": "63ea02b8-a8de-4680-a96b-496a4480c84e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1311691765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap397ea76b-8b", "ovs_interfaceid": "397ea76b-8bbd-4602-b966-cf7331d13e9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c165877a-edce-4fec-8aa4-e7708b384676", "address": "fa:16:3e:fd:7f:88", "network": {"id": "13d2edf3-6d96-4829-8c78-2dee6654aac3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1748402198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc165877a-ed", "ovs_interfaceid": "c165877a-edce-4fec-8aa4-e7708b384676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "22ffe1b4-8207-4909-b0ba-0db5dc955912", "address": "fa:16:3e:40:11:5a", "network": {"id": "13d2edf3-6d96-4829-8c78-2dee6654aac3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1748402198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ffe1b4-82", "ovs_interfaceid": "22ffe1b4-8207-4909-b0ba-0db5dc955912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "72a3d29f-9af1-4d78-bb33-db5cc02856aa", "address": "fa:16:3e:bf:7b:60", "network": {"id": "13d2edf3-6d96-4829-8c78-2dee6654aac3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1748402198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a3d29f-9a", "ovs_interfaceid": "72a3d29f-9af1-4d78-bb33-db5cc02856aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "88d012e5-b40e-4398-99a1-14b37a890c47", "address": "fa:16:3e:ff:a2:52", "network": {"id": "13d2edf3-6d96-4829-8c78-2dee6654aac3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1748402198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88d012e5-b4", "ovs_interfaceid": "88d012e5-b40e-4398-99a1-14b37a890c47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "544b22aa-6b69-4b4d-985f-19bdc248d641", "address": "fa:16:3e:df:ec:65", "network": {"id": "dddb77ca-d38f-4817-bf06-e8dcc8552539", "bridge": "br-int", "label": "tempest-device-tagging-net2-1958061298", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap544b22aa-6b", "ovs_interfaceid": "544b22aa-6b69-4b4d-985f-19bdc248d641", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a519d774-56a5-4a6c-9cd3-94e260332725", "address": "fa:16:3e:d1:a5:ec", "network": {"id": "dddb77ca-d38f-4817-bf06-e8dcc8552539", "bridge": "br-int", "label": "tempest-device-tagging-net2-1958061298", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa519d774-56", "ovs_interfaceid": "a519d774-56a5-4a6c-9cd3-94e260332725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jMNqLDeK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb', 'attached_at': '', 'detached_at': '', 'volume_id': '19a3dc05-2c38-4eea-aab9-23510f1716c7', 'serial': '19a3dc05-2c38-4eea-aab9-23510f1716c7'}, 'attachment_id': '77783458-377a-4929-9d85-177aa6a38e82', 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'volume_type': None}, {'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XezUgYOQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb', 'attached_at': '', 'detached_at': '', 'volume_id': 'd16a4c26-9b62-456a-89b5-f6eb00a73d44', 'serial': 'd16a4c26-9b62-456a-89b5-f6eb00a73d44'}, 'attachment_id': 'd966ad41-b546-4ab0-88fa-57b16f6e4637', 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 1, 'guest_format': None, 'delete_on_termination': False, 'volume_type': None}, {'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WPoDVQFw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb', 'attached_at': '', 'detached_at': '', 'volume_id': '3eec2145-f305-421e-8259-a2b495036296', 'serial': '3eec2145-f305-421e-8259-a2b495036296'}, 'attachment_id': 'fab77139-603f-400c-97cb-163f55e20d99', 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 2, 'guest_format': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:31:18 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:31:18 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:31:18 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG os_brick.initiator.connector [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Factory for ISCSI on None {{(pid=73391) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jMNqLDeK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:31:18 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:31:18 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:31:18 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:31:18 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:31:18 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 05:31:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cffb322b-6634-4f7b-a150-2d4b9f8bb972]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 05:31:18 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc88178f-8a24-4273-acda-c60eaeb91e39]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7] added
Aug 15 05:31:18 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb864607-9e0c-4cef-be70-438a54b0f8b7]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e462858c-ce1d-47d8-9e64-14398c9cb6a6]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jMNqLDeK {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jMNqLDeK" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a5b202-3638-4359-aac6-63f533c5a459]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jMNqLDeK'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9170cd4f-08ec-4e7b-82cc-9a4fdb0399f3]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9082b719-1c78-48e8-a0c8-ba38fd8d7441]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 05:31:18 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 05:31:18 user nova-compute[73391]:  {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:31:18 user nova-compute[73391]: WARNING os_brick.initiator.connectors.iscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 05:31:18 user nova-compute[73391]: 
Aug 15 05:31:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6adf287-f106-46bd-b895-203b5d595fce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7, portal: 172.16.0.220,3260]
Aug 15 05:31:18 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7, portal: 172.16.0.220,3260] successful.
Aug 15 05:31:18 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff48b01-6e4c-4c88-9ba2-8e469a99ebe7]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[199ed375-d7f8-4cae-b4b8-0faf1d5a7417]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:31:18 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:31:18 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b6f56f-704c-4307-99e0-c66d035cac17]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jMNqLDeK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 05:31:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG nova.compute.manager [req-265e6631-0b67-4449-8fdc-11a4301f59d0 req-06a129aa-5b36-4892-9eb1-534684b39329 service nova] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Received event network-changed-bf92cfab-6648-42bd-b9f0-2a6f38562165 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG nova.compute.manager [req-265e6631-0b67-4449-8fdc-11a4301f59d0 req-06a129aa-5b36-4892-9eb1-534684b39329 service nova] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Refreshing instance network info cache due to event network-changed-bf92cfab-6648-42bd-b9f0-2a6f38562165. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-265e6631-0b67-4449-8fdc-11a4301f59d0 req-06a129aa-5b36-4892-9eb1-534684b39329 service nova] Acquiring lock "refresh_cache-18c8138a-4efc-403f-8b42-e5080c6a51d3" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-265e6631-0b67-4449-8fdc-11a4301f59d0 req-06a129aa-5b36-4892-9eb1-534684b39329 service nova] Acquired lock "refresh_cache-18c8138a-4efc-403f-8b42-e5080c6a51d3" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG nova.network.neutron [req-265e6631-0b67-4449-8fdc-11a4301f59d0 req-06a129aa-5b36-4892-9eb1-534684b39329 service nova] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Refreshing network info cache for port bf92cfab-6648-42bd-b9f0-2a6f38562165 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23336313734393562', 'path': '/dev/sdb'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336313734393562', 'path': '/dev/sdb'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XezUgYOQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:31:19 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:31:19 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:31:19 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:31:19 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:31:19 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 05:31:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[17be5e5e-41d8-474c-9205-da5f096c4349]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 05:31:19 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6e8400-a946-49b7-8f41-69ca6a449519]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44] added
Aug 15 05:31:19 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cf5a73a-517e-4906-aa29-22bde33fa2a3]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d1a3e0c-c24e-41f7-a624-d0e4a69792a9]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XezUgYOQ {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XezUgYOQ" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e44a93-947d-4a4c-a4a5-c2edf8d42e51]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XezUgYOQ'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c59d27-8e6c-4824-92be-a8f779f34fd4]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6caef317-6416-42ca-ada2-9de0ff344295]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:31:19 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:31:19 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e33907-e99d-4ae5-9471-408b49094036]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44, portal: 172.16.0.220,3260]
Aug 15 05:31:19 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44, portal: 172.16.0.220,3260] successful.
Aug 15 05:31:19 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG nova.network.neutron [req-265e6631-0b67-4449-8fdc-11a4301f59d0 req-06a129aa-5b36-4892-9eb1-534684b39329 service nova] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Updated VIF entry in instance network info cache for port bf92cfab-6648-42bd-b9f0-2a6f38562165. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG nova.network.neutron [req-265e6631-0b67-4449-8fdc-11a4301f59d0 req-06a129aa-5b36-4892-9eb1-534684b39329 service nova] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Updating instance_info_cache with network_info: [{"id": "bf92cfab-6648-42bd-b9f0-2a6f38562165", "address": "fa:16:3e:ba:49:5f", "network": {"id": "f67152a9-4f18-4d7f-9d3e-5e517bd46813", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-731866550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88871d09f7e347a4b9104a558604f2f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf92cfab-66", "ovs_interfaceid": "bf92cfab-6648-42bd-b9f0-2a6f38562165", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e42e418-5a83-4a0b-aa8a-2a44f74045cf]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-265e6631-0b67-4449-8fdc-11a4301f59d0 req-06a129aa-5b36-4892-9eb1-534684b39329 service nova] Releasing lock "refresh_cache-18c8138a-4efc-403f-8b42-e5080c6a51d3" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c917800-4355-4e4a-abd3-36e3cb951d46]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:31:19 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:31:19 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:31:19 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:31:19 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[be208fb4-8be5-4b55-9d3a-2643fdd39415]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:31:19 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XezUgYOQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 05:31:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:31:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '26665313565613962', 'path': '/dev/sdc'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:31:20 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665313565613962', 'path': '/dev/sdc'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 05:31:20 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 05:31:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WPoDVQFw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:31:20 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:31:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:31:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:31:20 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:31:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:31:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:31:20 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 05:31:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:20 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84ae332-e27e-4822-9936-43933a028715]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 05:31:20 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:21 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d944733b-4a7d-4439-9123-d6f8988322c2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296] added
Aug 15 05:31:21 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:21 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:21 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8261c153-24f2-4946-a4de-38673ead3cae]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:21 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ff05be-e6ee-4602-875a-65058d7d42e1]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WPoDVQFw {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WPoDVQFw" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:21 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d930c1d-0fd4-4028-81a4-382194aaca23]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WPoDVQFw'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:21 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d8e39b-181a-43e8-be32-7673b9a9090e]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:21 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[535f4c26-179d-4d00-8957-2431a9754d85]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:31:21 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:31:21 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:31:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:31:21 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:31:21 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:31:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:21 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16ebf87-5e8a-4cce-a271-852dbd987315]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296, portal: 172.16.0.220,3260]
Aug 15 05:31:21 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296, portal: 172.16.0.220,3260] successful.
Aug 15 05:31:21 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:21 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[78999cfb-198c-47ba-b3dd-fb3f48fec6cb]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:21 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f2eda42-7943-4b11-a1c4-99efec854f0b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:31:21 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:31:21 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:31:21 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:31:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:31:21 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:31:21 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:31:21 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:31:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:31:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 05:31:21 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 05:31:21 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 05:31:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:21 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f6deda-ade5-42cf-8e55-a431fb122b4b]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:21 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:31:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WPoDVQFw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23265353436626565', 'path': '/dev/sdd'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23265353436626565', 'path': '/dev/sdd'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T05:30:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-118546539',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-118546539',id=10,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVdOrqYNwV4MLMHxNmTDhEmFPOR9rOnQPmrNIXpeoWg1qLlFK+xdylhYEL2zGy51LkM6RTKBrNl9yWnnwsJkCQ0pK6QVUH89mFZcZYjyoFgJpATZPF1Wux6OL5jmVUb9Q==',key_name='tempest-keypair-2147219675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49eba1f86e8c412e81feba30657c278a',ramdisk_id='',reservation_id='r-a6usm2mn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2085483445',owner_user_name='tempest-TaggedBootDevicesTest-2085483445-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:30:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c3532caac1f479995f501b1345ebcb2',uuid=da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "397ea76b-8bbd-4602-b966-cf7331d13e9f", "address": "fa:16:3e:61:64:15", "network": {"id": "63ea02b8-a8de-4680-a96b-496a4480c84e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1311691765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap397ea76b-8b", "ovs_interfaceid": "397ea76b-8bbd-4602-b966-cf7331d13e9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Converting VIF {"id": "397ea76b-8bbd-4602-b966-cf7331d13e9f", "address": "fa:16:3e:61:64:15", "network": {"id": "63ea02b8-a8de-4680-a96b-496a4480c84e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1311691765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap397ea76b-8b", "ovs_interfaceid": "397ea76b-8bbd-4602-b966-cf7331d13e9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:64:15,bridge_name='br-int',has_traffic_filtering=True,id=397ea76b-8bbd-4602-b966-cf7331d13e9f,network=Network(63ea02b8-a8de-4680-a96b-496a4480c84e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap397ea76b-8b') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T05:30:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-118546539',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-118546539',id=10,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVdOrqYNwV4MLMHxNmTDhEmFPOR9rOnQPmrNIXpeoWg1qLlFK+xdylhYEL2zGy51LkM6RTKBrNl9yWnnwsJkCQ0pK6QVUH89mFZcZYjyoFgJpATZPF1Wux6OL5jmVUb9Q==',key_name='tempest-keypair-2147219675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49eba1f86e8c412e81feba30657c278a',ramdisk_id='',reservation_id='r-a6usm2mn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2085483445',owner_user_name='tempest-TaggedBootDevicesTest-2085483445-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:30:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c3532caac1f479995f501b1345ebcb2',uuid=da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c165877a-edce-4fec-8aa4-e7708b384676", "address": "fa:16:3e:fd:7f:88", "network": {"id": "13d2edf3-6d96-4829-8c78-2dee6654aac3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1748402198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc165877a-ed", "ovs_interfaceid": "c165877a-edce-4fec-8aa4-e7708b384676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Converting VIF {"id": "c165877a-edce-4fec-8aa4-e7708b384676", "address": "fa:16:3e:fd:7f:88", "network": {"id": "13d2edf3-6d96-4829-8c78-2dee6654aac3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1748402198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc165877a-ed", "ovs_interfaceid": "c165877a-edce-4fec-8aa4-e7708b384676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:7f:88,bridge_name='br-int',has_traffic_filtering=True,id=c165877a-edce-4fec-8aa4-e7708b384676,network=Network(13d2edf3-6d96-4829-8c78-2dee6654aac3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc165877a-ed') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T05:30:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-118546539',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-118546539',id=10,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVdOrqYNwV4MLMHxNmTDhEmFPOR9rOnQPmrNIXpeoWg1qLlFK+xdylhYEL2zGy51LkM6RTKBrNl9yWnnwsJkCQ0pK6QVUH89mFZcZYjyoFgJpATZPF1Wux6OL5jmVUb9Q==',key_name='tempest-keypair-2147219675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49eba1f86e8c412e81feba30657c278a',ramdisk_id='',reservation_id='r-a6usm2mn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2085483445',owner_user_name='tempest-TaggedBootDevicesTest-2085483445-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:30:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c3532caac1f479995f501b1345ebcb2',uuid=da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22ffe1b4-8207-4909-b0ba-0db5dc955912", "address": "fa:16:3e:40:11:5a", "network": {"id": "13d2edf3-6d96-4829-8c78-2dee6654aac3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1748402198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ffe1b4-82", "ovs_interfaceid": "22ffe1b4-8207-4909-b0ba-0db5dc955912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Converting VIF {"id": "22ffe1b4-8207-4909-b0ba-0db5dc955912", "address": "fa:16:3e:40:11:5a", "network": {"id": "13d2edf3-6d96-4829-8c78-2dee6654aac3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1748402198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ffe1b4-82", "ovs_interfaceid": "22ffe1b4-8207-4909-b0ba-0db5dc955912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:11:5a,bridge_name='br-int',has_traffic_filtering=True,id=22ffe1b4-8207-4909-b0ba-0db5dc955912,network=Network(13d2edf3-6d96-4829-8c78-2dee6654aac3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap22ffe1b4-82') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T05:30:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-118546539',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-118546539',id=10,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVdOrqYNwV4MLMHxNmTDhEmFPOR9rOnQPmrNIXpeoWg1qLlFK+xdylhYEL2zGy51LkM6RTKBrNl9yWnnwsJkCQ0pK6QVUH89mFZcZYjyoFgJpATZPF1Wux6OL5jmVUb9Q==',key_name='tempest-keypair-2147219675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49eba1f86e8c412e81feba30657c278a',ramdisk_id='',reservation_id='r-a6usm2mn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2085483445',owner_user_name='tempest-TaggedBootDevicesTest-2085483445-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:30:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c3532caac1f479995f501b1345ebcb2',uuid=da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72a3d29f-9af1-4d78-bb33-db5cc02856aa", "address": "fa:16:3e:bf:7b:60", "network": {"id": "13d2edf3-6d96-4829-8c78-2dee6654aac3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1748402198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a3d29f-9a", "ovs_interfaceid": "72a3d29f-9af1-4d78-bb33-db5cc02856aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Converting VIF {"id": "72a3d29f-9af1-4d78-bb33-db5cc02856aa", "address": "fa:16:3e:bf:7b:60", "network": {"id": "13d2edf3-6d96-4829-8c78-2dee6654aac3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1748402198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a3d29f-9a", "ovs_interfaceid": "72a3d29f-9af1-4d78-bb33-db5cc02856aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:7b:60,bridge_name='br-int',has_traffic_filtering=True,id=72a3d29f-9af1-4d78-bb33-db5cc02856aa,network=Network(13d2edf3-6d96-4829-8c78-2dee6654aac3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72a3d29f-9a') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T05:30:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-118546539',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-118546539',id=10,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVdOrqYNwV4MLMHxNmTDhEmFPOR9rOnQPmrNIXpeoWg1qLlFK+xdylhYEL2zGy51LkM6RTKBrNl9yWnnwsJkCQ0pK6QVUH89mFZcZYjyoFgJpATZPF1Wux6OL5jmVUb9Q==',key_name='tempest-keypair-2147219675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49eba1f86e8c412e81feba30657c278a',ramdisk_id='',reservation_id='r-a6usm2mn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2085483445',owner_user_name='tempest-TaggedBootDevicesTest-2085483445-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:30:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c3532caac1f479995f501b1345ebcb2',uuid=da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88d012e5-b40e-4398-99a1-14b37a890c47", "address": "fa:16:3e:ff:a2:52", "network": {"id": "13d2edf3-6d96-4829-8c78-2dee6654aac3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1748402198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88d012e5-b4", "ovs_interfaceid": "88d012e5-b40e-4398-99a1-14b37a890c47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Converting VIF {"id": "88d012e5-b40e-4398-99a1-14b37a890c47", "address": "fa:16:3e:ff:a2:52", "network": {"id": "13d2edf3-6d96-4829-8c78-2dee6654aac3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1748402198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88d012e5-b4", "ovs_interfaceid": "88d012e5-b40e-4398-99a1-14b37a890c47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:a2:52,bridge_name='br-int',has_traffic_filtering=True,id=88d012e5-b40e-4398-99a1-14b37a890c47,network=Network(13d2edf3-6d96-4829-8c78-2dee6654aac3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88d012e5-b4') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T05:30:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-118546539',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-118546539',id=10,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVdOrqYNwV4MLMHxNmTDhEmFPOR9rOnQPmrNIXpeoWg1qLlFK+xdylhYEL2zGy51LkM6RTKBrNl9yWnnwsJkCQ0pK6QVUH89mFZcZYjyoFgJpATZPF1Wux6OL5jmVUb9Q==',key_name='tempest-keypair-2147219675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49eba1f86e8c412e81feba30657c278a',ramdisk_id='',reservation_id='r-a6usm2mn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2085483445',owner_user_name='tempest-TaggedBootDevicesTest-2085483445-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:30:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c3532caac1f479995f501b1345ebcb2',uuid=da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "544b22aa-6b69-4b4d-985f-19bdc248d641", "address": "fa:16:3e:df:ec:65", "network": {"id": "dddb77ca-d38f-4817-bf06-e8dcc8552539", "bridge": "br-int", "label": "tempest-device-tagging-net2-1958061298", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap544b22aa-6b", "ovs_interfaceid": "544b22aa-6b69-4b4d-985f-19bdc248d641", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Converting VIF {"id": "544b22aa-6b69-4b4d-985f-19bdc248d641", "address": "fa:16:3e:df:ec:65", "network": {"id": "dddb77ca-d38f-4817-bf06-e8dcc8552539", "bridge": "br-int", "label": "tempest-device-tagging-net2-1958061298", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap544b22aa-6b", "ovs_interfaceid": "544b22aa-6b69-4b4d-985f-19bdc248d641", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:ec:65,bridge_name='br-int',has_traffic_filtering=True,id=544b22aa-6b69-4b4d-985f-19bdc248d641,network=Network(dddb77ca-d38f-4817-bf06-e8dcc8552539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap544b22aa-6b') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T05:30:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-118546539',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-118546539',id=10,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVdOrqYNwV4MLMHxNmTDhEmFPOR9rOnQPmrNIXpeoWg1qLlFK+xdylhYEL2zGy51LkM6RTKBrNl9yWnnwsJkCQ0pK6QVUH89mFZcZYjyoFgJpATZPF1Wux6OL5jmVUb9Q==',key_name='tempest-keypair-2147219675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49eba1f86e8c412e81feba30657c278a',ramdisk_id='',reservation_id='r-a6usm2mn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2085483445',owner_user_name='tempest-TaggedBootDevicesTest-2085483445-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:30:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c3532caac1f479995f501b1345ebcb2',uuid=da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a519d774-56a5-4a6c-9cd3-94e260332725", "address": "fa:16:3e:d1:a5:ec", "network": {"id": "dddb77ca-d38f-4817-bf06-e8dcc8552539", "bridge": "br-int", "label": "tempest-device-tagging-net2-1958061298", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa519d774-56", "ovs_interfaceid": "a519d774-56a5-4a6c-9cd3-94e260332725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Converting VIF {"id": "a519d774-56a5-4a6c-9cd3-94e260332725", "address": "fa:16:3e:d1:a5:ec", "network": {"id": "dddb77ca-d38f-4817-bf06-e8dcc8552539", "bridge": "br-int", "label": "tempest-device-tagging-net2-1958061298", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa519d774-56", "ovs_interfaceid": "a519d774-56a5-4a6c-9cd3-94e260332725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:a5:ec,bridge_name='br-int',has_traffic_filtering=True,id=a519d774-56a5-4a6c-9cd3-94e260332725,network=Network(dddb77ca-d38f-4817-bf06-e8dcc8552539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa519d774-56') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG nova.objects.instance [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Lazy-loading 'pci_devices' on Instance uuid da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:31:22 user nova-compute[73391]:   <uuid>da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb</uuid>
Aug 15 05:31:22 user nova-compute[73391]:   <name>instance-0000000a</name>
Aug 15 05:31:22 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:31:22 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:31:22 user nova-compute[73391]:   <metadata>
Aug 15 05:31:22 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:31:22 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:31:22 user nova-compute[73391]:       <nova:name>tempest-device-tagging-server-118546539</nova:name>
Aug 15 05:31:22 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:31:18</nova:creationTime>
Aug 15 05:31:22 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:31:22 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:31:22 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:31:22 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:31:22 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:31:22 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:31:22 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:31:22 user nova-compute[73391]:       <nova:owner>
Aug 15 05:31:22 user nova-compute[73391]:         <nova:user uuid="5c3532caac1f479995f501b1345ebcb2">tempest-TaggedBootDevicesTest-2085483445-project-member</nova:user>
Aug 15 05:31:22 user nova-compute[73391]:         <nova:project uuid="49eba1f86e8c412e81feba30657c278a">tempest-TaggedBootDevicesTest-2085483445</nova:project>
Aug 15 05:31:22 user nova-compute[73391]:       </nova:owner>
Aug 15 05:31:22 user nova-compute[73391]:       <nova:root type="image" uuid="191b1dad-305e-4d1c-9b15-515ec59a3278"/>
Aug 15 05:31:22 user nova-compute[73391]:       <nova:ports>
Aug 15 05:31:22 user nova-compute[73391]:         <nova:port uuid="397ea76b-8bbd-4602-b966-cf7331d13e9f">
Aug 15 05:31:22 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 15 05:31:22 user nova-compute[73391]:         </nova:port>
Aug 15 05:31:22 user nova-compute[73391]:         <nova:port uuid="c165877a-edce-4fec-8aa4-e7708b384676">
Aug 15 05:31:22 user nova-compute[73391]:           <nova:ip type="fixed" address="10.1.1.109" ipVersion="4"/>
Aug 15 05:31:22 user nova-compute[73391]:         </nova:port>
Aug 15 05:31:22 user nova-compute[73391]:         <nova:port uuid="22ffe1b4-8207-4909-b0ba-0db5dc955912">
Aug 15 05:31:22 user nova-compute[73391]:           <nova:ip type="fixed" address="10.1.1.191" ipVersion="4"/>
Aug 15 05:31:22 user nova-compute[73391]:         </nova:port>
Aug 15 05:31:22 user nova-compute[73391]:         <nova:port uuid="72a3d29f-9af1-4d78-bb33-db5cc02856aa">
Aug 15 05:31:22 user nova-compute[73391]:           <nova:ip type="fixed" address="10.1.1.158" ipVersion="4"/>
Aug 15 05:31:22 user nova-compute[73391]:         </nova:port>
Aug 15 05:31:22 user nova-compute[73391]:         <nova:port uuid="88d012e5-b40e-4398-99a1-14b37a890c47">
Aug 15 05:31:22 user nova-compute[73391]:           <nova:ip type="fixed" address="10.1.1.52" ipVersion="4"/>
Aug 15 05:31:22 user nova-compute[73391]:         </nova:port>
Aug 15 05:31:22 user nova-compute[73391]:         <nova:port uuid="544b22aa-6b69-4b4d-985f-19bdc248d641">
Aug 15 05:31:22 user nova-compute[73391]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 15 05:31:22 user nova-compute[73391]:         </nova:port>
Aug 15 05:31:22 user nova-compute[73391]:         <nova:port uuid="a519d774-56a5-4a6c-9cd3-94e260332725">
Aug 15 05:31:22 user nova-compute[73391]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 15 05:31:22 user nova-compute[73391]:         </nova:port>
Aug 15 05:31:22 user nova-compute[73391]:       </nova:ports>
Aug 15 05:31:22 user nova-compute[73391]:     </nova:instance>
Aug 15 05:31:22 user nova-compute[73391]:   </metadata>
Aug 15 05:31:22 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:31:22 user nova-compute[73391]:     <system>
Aug 15 05:31:22 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:31:22 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:31:22 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:31:22 user nova-compute[73391]:       <entry name="serial">da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb</entry>
Aug 15 05:31:22 user nova-compute[73391]:       <entry name="uuid">da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb</entry>
Aug 15 05:31:22 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:31:22 user nova-compute[73391]:     </system>
Aug 15 05:31:22 user nova-compute[73391]:   </sysinfo>
Aug 15 05:31:22 user nova-compute[73391]:   <os>
Aug 15 05:31:22 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:31:22 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:31:22 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:31:22 user nova-compute[73391]:   </os>
Aug 15 05:31:22 user nova-compute[73391]:   <features>
Aug 15 05:31:22 user nova-compute[73391]:     <acpi/>
Aug 15 05:31:22 user nova-compute[73391]:     <apic/>
Aug 15 05:31:22 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:31:22 user nova-compute[73391]:   </features>
Aug 15 05:31:22 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:31:22 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:31:22 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:31:22 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:31:22 user nova-compute[73391]:   </clock>
Aug 15 05:31:22 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:31:22 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:31:22 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:31:22 user nova-compute[73391]:   </cpu>
Aug 15 05:31:22 user nova-compute[73391]:   <devices>
Aug 15 05:31:22 user nova-compute[73391]:     <disk type="file" device="cdrom">
Aug 15 05:31:22 user nova-compute[73391]:       <driver name="qemu" type="raw" cache="none"/>
Aug 15 05:31:22 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb/disk.config"/>
Aug 15 05:31:22 user nova-compute[73391]:       <target dev="hda" bus="ide"/>
Aug 15 05:31:22 user nova-compute[73391]:     </disk>
Aug 15 05:31:22 user nova-compute[73391]:     <disk type="block" device="disk">
Aug 15 05:31:22 user nova-compute[73391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:31:22 user nova-compute[73391]:       <source dev="/dev/sdb"/>
Aug 15 05:31:22 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:31:22 user nova-compute[73391]:       <serial>19a3dc05-2c38-4eea-aab9-23510f1716c7</serial>
Aug 15 05:31:22 user nova-compute[73391]:     </disk>
Aug 15 05:31:22 user nova-compute[73391]:     <disk type="block" device="disk">
Aug 15 05:31:22 user nova-compute[73391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:31:22 user nova-compute[73391]:       <source dev="/dev/sdc"/>
Aug 15 05:31:22 user nova-compute[73391]:       <target dev="vdb" bus="virtio"/>
Aug 15 05:31:22 user nova-compute[73391]:       <serial>d16a4c26-9b62-456a-89b5-f6eb00a73d44</serial>
Aug 15 05:31:22 user nova-compute[73391]:     </disk>
Aug 15 05:31:22 user nova-compute[73391]:     <disk type="block" device="disk">
Aug 15 05:31:22 user nova-compute[73391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:31:22 user nova-compute[73391]:       <source dev="/dev/sdd"/>
Aug 15 05:31:22 user nova-compute[73391]:       <target dev="vdc" bus="virtio"/>
Aug 15 05:31:22 user nova-compute[73391]:       <serial>3eec2145-f305-421e-8259-a2b495036296</serial>
Aug 15 05:31:22 user nova-compute[73391]:     </disk>
Aug 15 05:31:22 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:31:22 user nova-compute[73391]:       <mac address="fa:16:3e:61:64:15"/>
Aug 15 05:31:22 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:31:22 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:31:22 user nova-compute[73391]:       <target dev="tap397ea76b-8b"/>
Aug 15 05:31:22 user nova-compute[73391]:     </interface>
Aug 15 05:31:22 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:31:22 user nova-compute[73391]:       <mac address="fa:16:3e:fd:7f:88"/>
Aug 15 05:31:22 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:31:22 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:31:22 user nova-compute[73391]:       <target dev="tapc165877a-ed"/>
Aug 15 05:31:22 user nova-compute[73391]:     </interface>
Aug 15 05:31:22 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:31:22 user nova-compute[73391]:       <mac address="fa:16:3e:40:11:5a"/>
Aug 15 05:31:22 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:31:22 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:31:22 user nova-compute[73391]:       <target dev="tap22ffe1b4-82"/>
Aug 15 05:31:22 user nova-compute[73391]:     </interface>
Aug 15 05:31:22 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:31:22 user nova-compute[73391]:       <mac address="fa:16:3e:bf:7b:60"/>
Aug 15 05:31:22 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:31:22 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:31:22 user nova-compute[73391]:       <target dev="tap72a3d29f-9a"/>
Aug 15 05:31:22 user nova-compute[73391]:     </interface>
Aug 15 05:31:22 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:31:22 user nova-compute[73391]:       <mac address="fa:16:3e:ff:a2:52"/>
Aug 15 05:31:22 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:31:22 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:31:22 user nova-compute[73391]:       <target dev="tap88d012e5-b4"/>
Aug 15 05:31:22 user nova-compute[73391]:     </interface>
Aug 15 05:31:22 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:31:22 user nova-compute[73391]:       <mac address="fa:16:3e:df:ec:65"/>
Aug 15 05:31:22 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:31:22 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:31:22 user nova-compute[73391]:       <target dev="tap544b22aa-6b"/>
Aug 15 05:31:22 user nova-compute[73391]:     </interface>
Aug 15 05:31:22 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:31:22 user nova-compute[73391]:       <mac address="fa:16:3e:d1:a5:ec"/>
Aug 15 05:31:22 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:31:22 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:31:22 user nova-compute[73391]:       <target dev="tapa519d774-56"/>
Aug 15 05:31:22 user nova-compute[73391]:     </interface>
Aug 15 05:31:22 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:31:22 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb/console.log" append="off"/>
Aug 15 05:31:22 user nova-compute[73391]:     </serial>
Aug 15 05:31:22 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:31:22 user nova-compute[73391]:     <video>
Aug 15 05:31:22 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:31:22 user nova-compute[73391]:     </video>
Aug 15 05:31:22 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:31:22 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:31:22 user nova-compute[73391]:     </rng>
Aug 15 05:31:22 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:31:22 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:31:22 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:31:22 user nova-compute[73391]:     </memballoon>
Aug 15 05:31:22 user nova-compute[73391]:   </devices>
Aug 15 05:31:22 user nova-compute[73391]: </domain>
Aug 15 05:31:22 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T05:30:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-118546539',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-118546539',id=10,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVdOrqYNwV4MLMHxNmTDhEmFPOR9rOnQPmrNIXpeoWg1qLlFK+xdylhYEL2zGy51LkM6RTKBrNl9yWnnwsJkCQ0pK6QVUH89mFZcZYjyoFgJpATZPF1Wux6OL5jmVUb9Q==',key_name='tempest-keypair-2147219675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49eba1f86e8c412e81feba30657c278a',ramdisk_id='',reservation_id='r-a6usm2mn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2085483445',owner_user_name='tempest-TaggedBootDevicesTest-2085483445-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:30:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c3532caac1f479995f501b1345ebcb2',uuid=da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "397ea76b-8bbd-4602-b966-cf7331d13e9f", "address": "fa:16:3e:61:64:15", "network": {"id": "63ea02b8-a8de-4680-a96b-496a4480c84e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1311691765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap397ea76b-8b", "ovs_interfaceid": "397ea76b-8bbd-4602-b966-cf7331d13e9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Converting VIF {"id": "397ea76b-8bbd-4602-b966-cf7331d13e9f", "address": "fa:16:3e:61:64:15", "network": {"id": "63ea02b8-a8de-4680-a96b-496a4480c84e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1311691765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap397ea76b-8b", "ovs_interfaceid": "397ea76b-8bbd-4602-b966-cf7331d13e9f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:64:15,bridge_name='br-int',has_traffic_filtering=True,id=397ea76b-8bbd-4602-b966-cf7331d13e9f,network=Network(63ea02b8-a8de-4680-a96b-496a4480c84e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap397ea76b-8b') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG os_vif [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:64:15,bridge_name='br-int',has_traffic_filtering=True,id=397ea76b-8bbd-4602-b966-cf7331d13e9f,network=Network(63ea02b8-a8de-4680-a96b-496a4480c84e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap397ea76b-8b') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap397ea76b-8b, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap397ea76b-8b, col_values=(('external_ids', {'iface-id': '397ea76b-8bbd-4602-b966-cf7331d13e9f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:64:15', 'vm-uuid': 'da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:22 user nova-compute[73391]: INFO os_vif [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:64:15,bridge_name='br-int',has_traffic_filtering=True,id=397ea76b-8bbd-4602-b966-cf7331d13e9f,network=Network(63ea02b8-a8de-4680-a96b-496a4480c84e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap397ea76b-8b')
Aug 15 05:31:22 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T05:30:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-118546539',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-118546539',id=10,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVdOrqYNwV4MLMHxNmTDhEmFPOR9rOnQPmrNIXpeoWg1qLlFK+xdylhYEL2zGy51LkM6RTKBrNl9yWnnwsJkCQ0pK6QVUH89mFZcZYjyoFgJpATZPF1Wux6OL5jmVUb9Q==',key_name='tempest-keypair-2147219675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49eba1f86e8c412e81feba30657c278a',ramdisk_id='',reservation_id='r-a6usm2mn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2085483445',owner_user_name='tempest-TaggedBootDevicesTest-2085483445-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:30:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c3532caac1f479995f501b1345ebcb2',uuid=da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c165877a-edce-4fec-8aa4-e7708b384676", "address": "fa:16:3e:fd:7f:88", "network": {"id": "13d2edf3-6d96-4829-8c78-2dee6654aac3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1748402198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc165877a-ed", "ovs_interfaceid": "c165877a-edce-4fec-8aa4-e7708b384676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Converting VIF {"id": "c165877a-edce-4fec-8aa4-e7708b384676", "address": "fa:16:3e:fd:7f:88", "network": {"id": "13d2edf3-6d96-4829-8c78-2dee6654aac3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1748402198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc165877a-ed", "ovs_interfaceid": "c165877a-edce-4fec-8aa4-e7708b384676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:7f:88,bridge_name='br-int',has_traffic_filtering=True,id=c165877a-edce-4fec-8aa4-e7708b384676,network=Network(13d2edf3-6d96-4829-8c78-2dee6654aac3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc165877a-ed') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG os_vif [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:7f:88,bridge_name='br-int',has_traffic_filtering=True,id=c165877a-edce-4fec-8aa4-e7708b384676,network=Network(13d2edf3-6d96-4829-8c78-2dee6654aac3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc165877a-ed') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc165877a-ed, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc165877a-ed, col_values=(('external_ids', {'iface-id': 'c165877a-edce-4fec-8aa4-e7708b384676', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:7f:88', 'vm-uuid': 'da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:22 user nova-compute[73391]: INFO os_vif [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:7f:88,bridge_name='br-int',has_traffic_filtering=True,id=c165877a-edce-4fec-8aa4-e7708b384676,network=Network(13d2edf3-6d96-4829-8c78-2dee6654aac3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc165877a-ed')
Aug 15 05:31:22 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T05:30:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-118546539',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-118546539',id=10,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVdOrqYNwV4MLMHxNmTDhEmFPOR9rOnQPmrNIXpeoWg1qLlFK+xdylhYEL2zGy51LkM6RTKBrNl9yWnnwsJkCQ0pK6QVUH89mFZcZYjyoFgJpATZPF1Wux6OL5jmVUb9Q==',key_name='tempest-keypair-2147219675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49eba1f86e8c412e81feba30657c278a',ramdisk_id='',reservation_id='r-a6usm2mn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2085483445',owner_user_name='tempest-TaggedBootDevicesTest-2085483445-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:30:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c3532caac1f479995f501b1345ebcb2',uuid=da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "22ffe1b4-8207-4909-b0ba-0db5dc955912", "address": "fa:16:3e:40:11:5a", "network": {"id": "13d2edf3-6d96-4829-8c78-2dee6654aac3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1748402198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ffe1b4-82", "ovs_interfaceid": "22ffe1b4-8207-4909-b0ba-0db5dc955912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Converting VIF {"id": "22ffe1b4-8207-4909-b0ba-0db5dc955912", "address": "fa:16:3e:40:11:5a", "network": {"id": "13d2edf3-6d96-4829-8c78-2dee6654aac3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1748402198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ffe1b4-82", "ovs_interfaceid": "22ffe1b4-8207-4909-b0ba-0db5dc955912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:11:5a,bridge_name='br-int',has_traffic_filtering=True,id=22ffe1b4-8207-4909-b0ba-0db5dc955912,network=Network(13d2edf3-6d96-4829-8c78-2dee6654aac3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap22ffe1b4-82') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG os_vif [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:11:5a,bridge_name='br-int',has_traffic_filtering=True,id=22ffe1b4-8207-4909-b0ba-0db5dc955912,network=Network(13d2edf3-6d96-4829-8c78-2dee6654aac3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap22ffe1b4-82') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap22ffe1b4-82, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap22ffe1b4-82, col_values=(('external_ids', {'iface-id': '22ffe1b4-8207-4909-b0ba-0db5dc955912', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:40:11:5a', 'vm-uuid': 'da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:22 user nova-compute[73391]: INFO os_vif [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:11:5a,bridge_name='br-int',has_traffic_filtering=True,id=22ffe1b4-8207-4909-b0ba-0db5dc955912,network=Network(13d2edf3-6d96-4829-8c78-2dee6654aac3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap22ffe1b4-82')
Aug 15 05:31:22 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T05:30:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-118546539',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-118546539',id=10,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVdOrqYNwV4MLMHxNmTDhEmFPOR9rOnQPmrNIXpeoWg1qLlFK+xdylhYEL2zGy51LkM6RTKBrNl9yWnnwsJkCQ0pK6QVUH89mFZcZYjyoFgJpATZPF1Wux6OL5jmVUb9Q==',key_name='tempest-keypair-2147219675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49eba1f86e8c412e81feba30657c278a',ramdisk_id='',reservation_id='r-a6usm2mn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2085483445',owner_user_name='tempest-TaggedBootDevicesTest-2085483445-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:30:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c3532caac1f479995f501b1345ebcb2',uuid=da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "72a3d29f-9af1-4d78-bb33-db5cc02856aa", "address": "fa:16:3e:bf:7b:60", "network": {"id": "13d2edf3-6d96-4829-8c78-2dee6654aac3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1748402198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a3d29f-9a", "ovs_interfaceid": "72a3d29f-9af1-4d78-bb33-db5cc02856aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Converting VIF {"id": "72a3d29f-9af1-4d78-bb33-db5cc02856aa", "address": "fa:16:3e:bf:7b:60", "network": {"id": "13d2edf3-6d96-4829-8c78-2dee6654aac3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1748402198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a3d29f-9a", "ovs_interfaceid": "72a3d29f-9af1-4d78-bb33-db5cc02856aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:7b:60,bridge_name='br-int',has_traffic_filtering=True,id=72a3d29f-9af1-4d78-bb33-db5cc02856aa,network=Network(13d2edf3-6d96-4829-8c78-2dee6654aac3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72a3d29f-9a') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG os_vif [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:7b:60,bridge_name='br-int',has_traffic_filtering=True,id=72a3d29f-9af1-4d78-bb33-db5cc02856aa,network=Network(13d2edf3-6d96-4829-8c78-2dee6654aac3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72a3d29f-9a') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap72a3d29f-9a, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap72a3d29f-9a, col_values=(('external_ids', {'iface-id': '72a3d29f-9af1-4d78-bb33-db5cc02856aa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:7b:60', 'vm-uuid': 'da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:22 user nova-compute[73391]: INFO os_vif [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:7b:60,bridge_name='br-int',has_traffic_filtering=True,id=72a3d29f-9af1-4d78-bb33-db5cc02856aa,network=Network(13d2edf3-6d96-4829-8c78-2dee6654aac3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72a3d29f-9a')
Aug 15 05:31:22 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T05:30:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-118546539',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-118546539',id=10,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVdOrqYNwV4MLMHxNmTDhEmFPOR9rOnQPmrNIXpeoWg1qLlFK+xdylhYEL2zGy51LkM6RTKBrNl9yWnnwsJkCQ0pK6QVUH89mFZcZYjyoFgJpATZPF1Wux6OL5jmVUb9Q==',key_name='tempest-keypair-2147219675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49eba1f86e8c412e81feba30657c278a',ramdisk_id='',reservation_id='r-a6usm2mn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2085483445',owner_user_name='tempest-TaggedBootDevicesTest-2085483445-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:30:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c3532caac1f479995f501b1345ebcb2',uuid=da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88d012e5-b40e-4398-99a1-14b37a890c47", "address": "fa:16:3e:ff:a2:52", "network": {"id": "13d2edf3-6d96-4829-8c78-2dee6654aac3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1748402198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88d012e5-b4", "ovs_interfaceid": "88d012e5-b40e-4398-99a1-14b37a890c47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Converting VIF {"id": "88d012e5-b40e-4398-99a1-14b37a890c47", "address": "fa:16:3e:ff:a2:52", "network": {"id": "13d2edf3-6d96-4829-8c78-2dee6654aac3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1748402198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88d012e5-b4", "ovs_interfaceid": "88d012e5-b40e-4398-99a1-14b37a890c47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:a2:52,bridge_name='br-int',has_traffic_filtering=True,id=88d012e5-b40e-4398-99a1-14b37a890c47,network=Network(13d2edf3-6d96-4829-8c78-2dee6654aac3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88d012e5-b4') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG os_vif [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:a2:52,bridge_name='br-int',has_traffic_filtering=True,id=88d012e5-b40e-4398-99a1-14b37a890c47,network=Network(13d2edf3-6d96-4829-8c78-2dee6654aac3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88d012e5-b4') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap88d012e5-b4, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap88d012e5-b4, col_values=(('external_ids', {'iface-id': '88d012e5-b40e-4398-99a1-14b37a890c47', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:a2:52', 'vm-uuid': 'da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:22 user nova-compute[73391]: INFO os_vif [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:a2:52,bridge_name='br-int',has_traffic_filtering=True,id=88d012e5-b40e-4398-99a1-14b37a890c47,network=Network(13d2edf3-6d96-4829-8c78-2dee6654aac3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88d012e5-b4')
Aug 15 05:31:22 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T05:30:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-118546539',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-118546539',id=10,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVdOrqYNwV4MLMHxNmTDhEmFPOR9rOnQPmrNIXpeoWg1qLlFK+xdylhYEL2zGy51LkM6RTKBrNl9yWnnwsJkCQ0pK6QVUH89mFZcZYjyoFgJpATZPF1Wux6OL5jmVUb9Q==',key_name='tempest-keypair-2147219675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49eba1f86e8c412e81feba30657c278a',ramdisk_id='',reservation_id='r-a6usm2mn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2085483445',owner_user_name='tempest-TaggedBootDevicesTest-2085483445-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:30:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c3532caac1f479995f501b1345ebcb2',uuid=da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "544b22aa-6b69-4b4d-985f-19bdc248d641", "address": "fa:16:3e:df:ec:65", "network": {"id": "dddb77ca-d38f-4817-bf06-e8dcc8552539", "bridge": "br-int", "label": "tempest-device-tagging-net2-1958061298", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap544b22aa-6b", "ovs_interfaceid": "544b22aa-6b69-4b4d-985f-19bdc248d641", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Converting VIF {"id": "544b22aa-6b69-4b4d-985f-19bdc248d641", "address": "fa:16:3e:df:ec:65", "network": {"id": "dddb77ca-d38f-4817-bf06-e8dcc8552539", "bridge": "br-int", "label": "tempest-device-tagging-net2-1958061298", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap544b22aa-6b", "ovs_interfaceid": "544b22aa-6b69-4b4d-985f-19bdc248d641", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:ec:65,bridge_name='br-int',has_traffic_filtering=True,id=544b22aa-6b69-4b4d-985f-19bdc248d641,network=Network(dddb77ca-d38f-4817-bf06-e8dcc8552539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap544b22aa-6b') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG os_vif [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:ec:65,bridge_name='br-int',has_traffic_filtering=True,id=544b22aa-6b69-4b4d-985f-19bdc248d641,network=Network(dddb77ca-d38f-4817-bf06-e8dcc8552539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap544b22aa-6b') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap544b22aa-6b, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap544b22aa-6b, col_values=(('external_ids', {'iface-id': '544b22aa-6b69-4b4d-985f-19bdc248d641', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:ec:65', 'vm-uuid': 'da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:22 user nova-compute[73391]: INFO os_vif [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:ec:65,bridge_name='br-int',has_traffic_filtering=True,id=544b22aa-6b69-4b4d-985f-19bdc248d641,network=Network(dddb77ca-d38f-4817-bf06-e8dcc8552539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap544b22aa-6b')
Aug 15 05:31:22 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T05:30:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-118546539',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-118546539',id=10,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVdOrqYNwV4MLMHxNmTDhEmFPOR9rOnQPmrNIXpeoWg1qLlFK+xdylhYEL2zGy51LkM6RTKBrNl9yWnnwsJkCQ0pK6QVUH89mFZcZYjyoFgJpATZPF1Wux6OL5jmVUb9Q==',key_name='tempest-keypair-2147219675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49eba1f86e8c412e81feba30657c278a',ramdisk_id='',reservation_id='r-a6usm2mn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2085483445',owner_user_name='tempest-TaggedBootDevicesTest-2085483445-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:30:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c3532caac1f479995f501b1345ebcb2',uuid=da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a519d774-56a5-4a6c-9cd3-94e260332725", "address": "fa:16:3e:d1:a5:ec", "network": {"id": "dddb77ca-d38f-4817-bf06-e8dcc8552539", "bridge": "br-int", "label": "tempest-device-tagging-net2-1958061298", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa519d774-56", "ovs_interfaceid": "a519d774-56a5-4a6c-9cd3-94e260332725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Converting VIF {"id": "a519d774-56a5-4a6c-9cd3-94e260332725", "address": "fa:16:3e:d1:a5:ec", "network": {"id": "dddb77ca-d38f-4817-bf06-e8dcc8552539", "bridge": "br-int", "label": "tempest-device-tagging-net2-1958061298", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa519d774-56", "ovs_interfaceid": "a519d774-56a5-4a6c-9cd3-94e260332725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:a5:ec,bridge_name='br-int',has_traffic_filtering=True,id=a519d774-56a5-4a6c-9cd3-94e260332725,network=Network(dddb77ca-d38f-4817-bf06-e8dcc8552539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa519d774-56') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG os_vif [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:a5:ec,bridge_name='br-int',has_traffic_filtering=True,id=a519d774-56a5-4a6c-9cd3-94e260332725,network=Network(dddb77ca-d38f-4817-bf06-e8dcc8552539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa519d774-56') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa519d774-56, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa519d774-56, col_values=(('external_ids', {'iface-id': 'a519d774-56a5-4a6c-9cd3-94e260332725', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:a5:ec', 'vm-uuid': 'da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:22 user nova-compute[73391]: INFO os_vif [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:a5:ec,bridge_name='br-int',has_traffic_filtering=True,id=a519d774-56a5-4a6c-9cd3-94e260332725,network=Network(dddb77ca-d38f-4817-bf06-e8dcc8552539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa519d774-56')
Aug 15 05:31:22 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] No BDM found with device name hda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] No VIF found with MAC fa:16:3e:61:64:15, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] No VIF found with MAC fa:16:3e:ff:a2:52, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:31:22 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Using config drive
Aug 15 05:31:22 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Creating config drive at /opt/stack/data/nova/instances/da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb/disk.config
Aug 15 05:31:22 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp8hymblty {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:22 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp8hymblty" returned: 0 in 0.052s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:23 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:24 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2891f6fd-f998-4fcb-a215-caa23f22ba2e tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Acquiring lock "18c8138a-4efc-403f-8b42-e5080c6a51d3" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:31:24 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2891f6fd-f998-4fcb-a215-caa23f22ba2e tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "18c8138a-4efc-403f-8b42-e5080c6a51d3" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:31:24 user nova-compute[73391]: INFO nova.compute.manager [None req-2891f6fd-f998-4fcb-a215-caa23f22ba2e tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Shelving
Aug 15 05:31:24 user nova-compute[73391]: DEBUG nova.compute.manager [req-d833276f-314c-4bf4-afe7-8a90885a69fb req-e579b2cb-88f0-48f7-8e28-c83f1b2343b2 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received event network-vif-plugged-397ea76b-8bbd-4602-b966-cf7331d13e9f {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:31:24 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d833276f-314c-4bf4-afe7-8a90885a69fb req-e579b2cb-88f0-48f7-8e28-c83f1b2343b2 service nova] Acquiring lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:31:24 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d833276f-314c-4bf4-afe7-8a90885a69fb req-e579b2cb-88f0-48f7-8e28-c83f1b2343b2 service nova] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:31:24 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d833276f-314c-4bf4-afe7-8a90885a69fb req-e579b2cb-88f0-48f7-8e28-c83f1b2343b2 service nova] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:31:24 user nova-compute[73391]: DEBUG nova.compute.manager [req-d833276f-314c-4bf4-afe7-8a90885a69fb req-e579b2cb-88f0-48f7-8e28-c83f1b2343b2 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] No waiting events found dispatching network-vif-plugged-397ea76b-8bbd-4602-b966-cf7331d13e9f {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:31:24 user nova-compute[73391]: WARNING nova.compute.manager [req-d833276f-314c-4bf4-afe7-8a90885a69fb req-e579b2cb-88f0-48f7-8e28-c83f1b2343b2 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received unexpected event network-vif-plugged-397ea76b-8bbd-4602-b966-cf7331d13e9f for instance with vm_state building and task_state spawning.
Aug 15 05:31:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:24 user nova-compute[73391]: DEBUG nova.compute.manager [req-ddff025a-d170-4b97-bca0-24c41d0909e2 req-382776db-77be-4ac9-a2fe-6ef89a7cd3e8 service nova] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Received event network-vif-unplugged-bf92cfab-6648-42bd-b9f0-2a6f38562165 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:31:24 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ddff025a-d170-4b97-bca0-24c41d0909e2 req-382776db-77be-4ac9-a2fe-6ef89a7cd3e8 service nova] Acquiring lock "18c8138a-4efc-403f-8b42-e5080c6a51d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:31:24 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ddff025a-d170-4b97-bca0-24c41d0909e2 req-382776db-77be-4ac9-a2fe-6ef89a7cd3e8 service nova] Lock "18c8138a-4efc-403f-8b42-e5080c6a51d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:31:24 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ddff025a-d170-4b97-bca0-24c41d0909e2 req-382776db-77be-4ac9-a2fe-6ef89a7cd3e8 service nova] Lock "18c8138a-4efc-403f-8b42-e5080c6a51d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:31:24 user nova-compute[73391]: DEBUG nova.compute.manager [req-ddff025a-d170-4b97-bca0-24c41d0909e2 req-382776db-77be-4ac9-a2fe-6ef89a7cd3e8 service nova] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] No waiting events found dispatching network-vif-unplugged-bf92cfab-6648-42bd-b9f0-2a6f38562165 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:31:24 user nova-compute[73391]: WARNING nova.compute.manager [req-ddff025a-d170-4b97-bca0-24c41d0909e2 req-382776db-77be-4ac9-a2fe-6ef89a7cd3e8 service nova] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Received unexpected event network-vif-unplugged-bf92cfab-6648-42bd-b9f0-2a6f38562165 for instance with vm_state active and task_state shelving.
Aug 15 05:31:25 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:25 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:25 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:25 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:25 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:25 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:25 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:25 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:25 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Instance destroyed successfully.
Aug 15 05:31:25 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:25 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:25 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-2891f6fd-f998-4fcb-a215-caa23f22ba2e tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Beginning cold snapshot process
Aug 15 05:31:25 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:25 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:25 user nova-compute[73391]: DEBUG nova.privsep.utils [None req-2891f6fd-f998-4fcb-a215-caa23f22ba2e tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73391) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 05:31:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-2891f6fd-f998-4fcb-a215-caa23f22ba2e tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/18c8138a-4efc-403f-8b42-e5080c6a51d3/disk /opt/stack/data/nova/instances/snapshots/tmpkc7epiy7/8ab4d1c459404af59c93052d969c3e41 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:26 user nova-compute[73391]: DEBUG nova.compute.manager [req-3d2be381-48e1-4266-9ff9-f6e1763d32cd req-ee929559-2ce3-4222-a933-8ef758b91630 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received event network-vif-plugged-72a3d29f-9af1-4d78-bb33-db5cc02856aa {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:31:26 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-3d2be381-48e1-4266-9ff9-f6e1763d32cd req-ee929559-2ce3-4222-a933-8ef758b91630 service nova] Acquiring lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:31:26 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-3d2be381-48e1-4266-9ff9-f6e1763d32cd req-ee929559-2ce3-4222-a933-8ef758b91630 service nova] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:31:26 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-3d2be381-48e1-4266-9ff9-f6e1763d32cd req-ee929559-2ce3-4222-a933-8ef758b91630 service nova] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:31:26 user nova-compute[73391]: DEBUG nova.compute.manager [req-3d2be381-48e1-4266-9ff9-f6e1763d32cd req-ee929559-2ce3-4222-a933-8ef758b91630 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] No waiting events found dispatching network-vif-plugged-72a3d29f-9af1-4d78-bb33-db5cc02856aa {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:31:26 user nova-compute[73391]: WARNING nova.compute.manager [req-3d2be381-48e1-4266-9ff9-f6e1763d32cd req-ee929559-2ce3-4222-a933-8ef758b91630 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received unexpected event network-vif-plugged-72a3d29f-9af1-4d78-bb33-db5cc02856aa for instance with vm_state building and task_state spawning.
Aug 15 05:31:26 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:26 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:26 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:26 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:26 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:26 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:26 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:26 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:26 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:26 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:26 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:26 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:26 user nova-compute[73391]: DEBUG nova.compute.manager [req-66b9275e-ad0e-4b01-aded-b0df98df4208 req-5b255f45-7b60-4a8e-8cdd-a540796cbd18 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received event network-vif-plugged-397ea76b-8bbd-4602-b966-cf7331d13e9f {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:31:26 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-66b9275e-ad0e-4b01-aded-b0df98df4208 req-5b255f45-7b60-4a8e-8cdd-a540796cbd18 service nova] Acquiring lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:31:26 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-66b9275e-ad0e-4b01-aded-b0df98df4208 req-5b255f45-7b60-4a8e-8cdd-a540796cbd18 service nova] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:31:26 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-66b9275e-ad0e-4b01-aded-b0df98df4208 req-5b255f45-7b60-4a8e-8cdd-a540796cbd18 service nova] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:31:26 user nova-compute[73391]: DEBUG nova.compute.manager [req-66b9275e-ad0e-4b01-aded-b0df98df4208 req-5b255f45-7b60-4a8e-8cdd-a540796cbd18 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] No waiting events found dispatching network-vif-plugged-397ea76b-8bbd-4602-b966-cf7331d13e9f {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:31:26 user nova-compute[73391]: WARNING nova.compute.manager [req-66b9275e-ad0e-4b01-aded-b0df98df4208 req-5b255f45-7b60-4a8e-8cdd-a540796cbd18 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received unexpected event network-vif-plugged-397ea76b-8bbd-4602-b966-cf7331d13e9f for instance with vm_state building and task_state spawning.
Aug 15 05:31:26 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:26 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:26 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:26 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-2891f6fd-f998-4fcb-a215-caa23f22ba2e tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/18c8138a-4efc-403f-8b42-e5080c6a51d3/disk /opt/stack/data/nova/instances/snapshots/tmpkc7epiy7/8ab4d1c459404af59c93052d969c3e41" returned: 0 in 0.824s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:26 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-2891f6fd-f998-4fcb-a215-caa23f22ba2e tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Snapshot extracted, beginning image upload
Aug 15 05:31:27 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:27 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:27 user nova-compute[73391]: DEBUG nova.compute.manager [req-98d24adf-c9aa-4f4d-a99c-2821ae1cc346 req-a63a04ef-af70-482a-b1cb-48ca18f27fb1 service nova] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Received event network-vif-plugged-bf92cfab-6648-42bd-b9f0-2a6f38562165 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:31:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-98d24adf-c9aa-4f4d-a99c-2821ae1cc346 req-a63a04ef-af70-482a-b1cb-48ca18f27fb1 service nova] Acquiring lock "18c8138a-4efc-403f-8b42-e5080c6a51d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:31:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-98d24adf-c9aa-4f4d-a99c-2821ae1cc346 req-a63a04ef-af70-482a-b1cb-48ca18f27fb1 service nova] Lock "18c8138a-4efc-403f-8b42-e5080c6a51d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:31:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-98d24adf-c9aa-4f4d-a99c-2821ae1cc346 req-a63a04ef-af70-482a-b1cb-48ca18f27fb1 service nova] Lock "18c8138a-4efc-403f-8b42-e5080c6a51d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:31:27 user nova-compute[73391]: DEBUG nova.compute.manager [req-98d24adf-c9aa-4f4d-a99c-2821ae1cc346 req-a63a04ef-af70-482a-b1cb-48ca18f27fb1 service nova] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] No waiting events found dispatching network-vif-plugged-bf92cfab-6648-42bd-b9f0-2a6f38562165 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:31:27 user nova-compute[73391]: WARNING nova.compute.manager [req-98d24adf-c9aa-4f4d-a99c-2821ae1cc346 req-a63a04ef-af70-482a-b1cb-48ca18f27fb1 service nova] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Received unexpected event network-vif-plugged-bf92cfab-6648-42bd-b9f0-2a6f38562165 for instance with vm_state active and task_state shelving_image_uploading.
Aug 15 05:31:27 user nova-compute[73391]: DEBUG nova.compute.manager [req-98d24adf-c9aa-4f4d-a99c-2821ae1cc346 req-a63a04ef-af70-482a-b1cb-48ca18f27fb1 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received event network-vif-plugged-c165877a-edce-4fec-8aa4-e7708b384676 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:31:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-98d24adf-c9aa-4f4d-a99c-2821ae1cc346 req-a63a04ef-af70-482a-b1cb-48ca18f27fb1 service nova] Acquiring lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:31:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-98d24adf-c9aa-4f4d-a99c-2821ae1cc346 req-a63a04ef-af70-482a-b1cb-48ca18f27fb1 service nova] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:31:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-98d24adf-c9aa-4f4d-a99c-2821ae1cc346 req-a63a04ef-af70-482a-b1cb-48ca18f27fb1 service nova] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:31:27 user nova-compute[73391]: DEBUG nova.compute.manager [req-98d24adf-c9aa-4f4d-a99c-2821ae1cc346 req-a63a04ef-af70-482a-b1cb-48ca18f27fb1 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] No waiting events found dispatching network-vif-plugged-c165877a-edce-4fec-8aa4-e7708b384676 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:31:27 user nova-compute[73391]: WARNING nova.compute.manager [req-98d24adf-c9aa-4f4d-a99c-2821ae1cc346 req-a63a04ef-af70-482a-b1cb-48ca18f27fb1 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received unexpected event network-vif-plugged-c165877a-edce-4fec-8aa4-e7708b384676 for instance with vm_state building and task_state spawning.
Aug 15 05:31:27 user nova-compute[73391]: DEBUG nova.compute.manager [req-98d24adf-c9aa-4f4d-a99c-2821ae1cc346 req-a63a04ef-af70-482a-b1cb-48ca18f27fb1 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received event network-vif-plugged-c165877a-edce-4fec-8aa4-e7708b384676 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:31:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-98d24adf-c9aa-4f4d-a99c-2821ae1cc346 req-a63a04ef-af70-482a-b1cb-48ca18f27fb1 service nova] Acquiring lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:31:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-98d24adf-c9aa-4f4d-a99c-2821ae1cc346 req-a63a04ef-af70-482a-b1cb-48ca18f27fb1 service nova] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:31:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-98d24adf-c9aa-4f4d-a99c-2821ae1cc346 req-a63a04ef-af70-482a-b1cb-48ca18f27fb1 service nova] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:31:27 user nova-compute[73391]: DEBUG nova.compute.manager [req-98d24adf-c9aa-4f4d-a99c-2821ae1cc346 req-a63a04ef-af70-482a-b1cb-48ca18f27fb1 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] No waiting events found dispatching network-vif-plugged-c165877a-edce-4fec-8aa4-e7708b384676 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:31:27 user nova-compute[73391]: WARNING nova.compute.manager [req-98d24adf-c9aa-4f4d-a99c-2821ae1cc346 req-a63a04ef-af70-482a-b1cb-48ca18f27fb1 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received unexpected event network-vif-plugged-c165877a-edce-4fec-8aa4-e7708b384676 for instance with vm_state building and task_state spawning.
Aug 15 05:31:27 user nova-compute[73391]: DEBUG nova.compute.manager [req-98d24adf-c9aa-4f4d-a99c-2821ae1cc346 req-a63a04ef-af70-482a-b1cb-48ca18f27fb1 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received event network-vif-plugged-22ffe1b4-8207-4909-b0ba-0db5dc955912 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:31:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-98d24adf-c9aa-4f4d-a99c-2821ae1cc346 req-a63a04ef-af70-482a-b1cb-48ca18f27fb1 service nova] Acquiring lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:31:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-98d24adf-c9aa-4f4d-a99c-2821ae1cc346 req-a63a04ef-af70-482a-b1cb-48ca18f27fb1 service nova] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:31:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-98d24adf-c9aa-4f4d-a99c-2821ae1cc346 req-a63a04ef-af70-482a-b1cb-48ca18f27fb1 service nova] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:31:27 user nova-compute[73391]: DEBUG nova.compute.manager [req-98d24adf-c9aa-4f4d-a99c-2821ae1cc346 req-a63a04ef-af70-482a-b1cb-48ca18f27fb1 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] No waiting events found dispatching network-vif-plugged-22ffe1b4-8207-4909-b0ba-0db5dc955912 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:31:27 user nova-compute[73391]: WARNING nova.compute.manager [req-98d24adf-c9aa-4f4d-a99c-2821ae1cc346 req-a63a04ef-af70-482a-b1cb-48ca18f27fb1 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received unexpected event network-vif-plugged-22ffe1b4-8207-4909-b0ba-0db5dc955912 for instance with vm_state building and task_state spawning.
Aug 15 05:31:27 user nova-compute[73391]: DEBUG nova.compute.manager [req-98d24adf-c9aa-4f4d-a99c-2821ae1cc346 req-a63a04ef-af70-482a-b1cb-48ca18f27fb1 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received event network-vif-plugged-22ffe1b4-8207-4909-b0ba-0db5dc955912 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:31:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-98d24adf-c9aa-4f4d-a99c-2821ae1cc346 req-a63a04ef-af70-482a-b1cb-48ca18f27fb1 service nova] Acquiring lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:31:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-98d24adf-c9aa-4f4d-a99c-2821ae1cc346 req-a63a04ef-af70-482a-b1cb-48ca18f27fb1 service nova] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:31:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-98d24adf-c9aa-4f4d-a99c-2821ae1cc346 req-a63a04ef-af70-482a-b1cb-48ca18f27fb1 service nova] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:31:27 user nova-compute[73391]: DEBUG nova.compute.manager [req-98d24adf-c9aa-4f4d-a99c-2821ae1cc346 req-a63a04ef-af70-482a-b1cb-48ca18f27fb1 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] No waiting events found dispatching network-vif-plugged-22ffe1b4-8207-4909-b0ba-0db5dc955912 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:31:27 user nova-compute[73391]: WARNING nova.compute.manager [req-98d24adf-c9aa-4f4d-a99c-2821ae1cc346 req-a63a04ef-af70-482a-b1cb-48ca18f27fb1 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received unexpected event network-vif-plugged-22ffe1b4-8207-4909-b0ba-0db5dc955912 for instance with vm_state building and task_state spawning.
Aug 15 05:31:27 user nova-compute[73391]: DEBUG nova.compute.manager [req-98d24adf-c9aa-4f4d-a99c-2821ae1cc346 req-a63a04ef-af70-482a-b1cb-48ca18f27fb1 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received event network-vif-plugged-a519d774-56a5-4a6c-9cd3-94e260332725 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:31:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-98d24adf-c9aa-4f4d-a99c-2821ae1cc346 req-a63a04ef-af70-482a-b1cb-48ca18f27fb1 service nova] Acquiring lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:31:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-98d24adf-c9aa-4f4d-a99c-2821ae1cc346 req-a63a04ef-af70-482a-b1cb-48ca18f27fb1 service nova] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:31:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-98d24adf-c9aa-4f4d-a99c-2821ae1cc346 req-a63a04ef-af70-482a-b1cb-48ca18f27fb1 service nova] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:31:27 user nova-compute[73391]: DEBUG nova.compute.manager [req-98d24adf-c9aa-4f4d-a99c-2821ae1cc346 req-a63a04ef-af70-482a-b1cb-48ca18f27fb1 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] No waiting events found dispatching network-vif-plugged-a519d774-56a5-4a6c-9cd3-94e260332725 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:31:27 user nova-compute[73391]: WARNING nova.compute.manager [req-98d24adf-c9aa-4f4d-a99c-2821ae1cc346 req-a63a04ef-af70-482a-b1cb-48ca18f27fb1 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received unexpected event network-vif-plugged-a519d774-56a5-4a6c-9cd3-94e260332725 for instance with vm_state building and task_state spawning.
Aug 15 05:31:27 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:27 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:27 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:27 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:27 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:27 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG nova.compute.manager [req-d89e5e1b-b39f-47be-9eed-f6fd767f7038 req-73252680-62df-4606-b268-c6d308473641 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received event network-vif-plugged-72a3d29f-9af1-4d78-bb33-db5cc02856aa {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d89e5e1b-b39f-47be-9eed-f6fd767f7038 req-73252680-62df-4606-b268-c6d308473641 service nova] Acquiring lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d89e5e1b-b39f-47be-9eed-f6fd767f7038 req-73252680-62df-4606-b268-c6d308473641 service nova] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d89e5e1b-b39f-47be-9eed-f6fd767f7038 req-73252680-62df-4606-b268-c6d308473641 service nova] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG nova.compute.manager [req-d89e5e1b-b39f-47be-9eed-f6fd767f7038 req-73252680-62df-4606-b268-c6d308473641 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] No waiting events found dispatching network-vif-plugged-72a3d29f-9af1-4d78-bb33-db5cc02856aa {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:31:28 user nova-compute[73391]: WARNING nova.compute.manager [req-d89e5e1b-b39f-47be-9eed-f6fd767f7038 req-73252680-62df-4606-b268-c6d308473641 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received unexpected event network-vif-plugged-72a3d29f-9af1-4d78-bb33-db5cc02856aa for instance with vm_state building and task_state spawning.
Aug 15 05:31:28 user nova-compute[73391]: DEBUG nova.compute.manager [req-d89e5e1b-b39f-47be-9eed-f6fd767f7038 req-73252680-62df-4606-b268-c6d308473641 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received event network-vif-plugged-88d012e5-b40e-4398-99a1-14b37a890c47 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d89e5e1b-b39f-47be-9eed-f6fd767f7038 req-73252680-62df-4606-b268-c6d308473641 service nova] Acquiring lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d89e5e1b-b39f-47be-9eed-f6fd767f7038 req-73252680-62df-4606-b268-c6d308473641 service nova] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d89e5e1b-b39f-47be-9eed-f6fd767f7038 req-73252680-62df-4606-b268-c6d308473641 service nova] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG nova.compute.manager [req-d89e5e1b-b39f-47be-9eed-f6fd767f7038 req-73252680-62df-4606-b268-c6d308473641 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] No waiting events found dispatching network-vif-plugged-88d012e5-b40e-4398-99a1-14b37a890c47 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:31:28 user nova-compute[73391]: WARNING nova.compute.manager [req-d89e5e1b-b39f-47be-9eed-f6fd767f7038 req-73252680-62df-4606-b268-c6d308473641 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received unexpected event network-vif-plugged-88d012e5-b40e-4398-99a1-14b37a890c47 for instance with vm_state building and task_state spawning.
Aug 15 05:31:28 user nova-compute[73391]: DEBUG nova.compute.manager [req-d89e5e1b-b39f-47be-9eed-f6fd767f7038 req-73252680-62df-4606-b268-c6d308473641 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received event network-vif-plugged-88d012e5-b40e-4398-99a1-14b37a890c47 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d89e5e1b-b39f-47be-9eed-f6fd767f7038 req-73252680-62df-4606-b268-c6d308473641 service nova] Acquiring lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d89e5e1b-b39f-47be-9eed-f6fd767f7038 req-73252680-62df-4606-b268-c6d308473641 service nova] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d89e5e1b-b39f-47be-9eed-f6fd767f7038 req-73252680-62df-4606-b268-c6d308473641 service nova] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG nova.compute.manager [req-d89e5e1b-b39f-47be-9eed-f6fd767f7038 req-73252680-62df-4606-b268-c6d308473641 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] No waiting events found dispatching network-vif-plugged-88d012e5-b40e-4398-99a1-14b37a890c47 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:31:28 user nova-compute[73391]: WARNING nova.compute.manager [req-d89e5e1b-b39f-47be-9eed-f6fd767f7038 req-73252680-62df-4606-b268-c6d308473641 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received unexpected event network-vif-plugged-88d012e5-b40e-4398-99a1-14b37a890c47 for instance with vm_state building and task_state spawning.
Aug 15 05:31:28 user nova-compute[73391]: DEBUG nova.compute.manager [req-d89e5e1b-b39f-47be-9eed-f6fd767f7038 req-73252680-62df-4606-b268-c6d308473641 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received event network-vif-plugged-544b22aa-6b69-4b4d-985f-19bdc248d641 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d89e5e1b-b39f-47be-9eed-f6fd767f7038 req-73252680-62df-4606-b268-c6d308473641 service nova] Acquiring lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d89e5e1b-b39f-47be-9eed-f6fd767f7038 req-73252680-62df-4606-b268-c6d308473641 service nova] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d89e5e1b-b39f-47be-9eed-f6fd767f7038 req-73252680-62df-4606-b268-c6d308473641 service nova] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG nova.compute.manager [req-d89e5e1b-b39f-47be-9eed-f6fd767f7038 req-73252680-62df-4606-b268-c6d308473641 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] No waiting events found dispatching network-vif-plugged-544b22aa-6b69-4b4d-985f-19bdc248d641 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:31:28 user nova-compute[73391]: WARNING nova.compute.manager [req-d89e5e1b-b39f-47be-9eed-f6fd767f7038 req-73252680-62df-4606-b268-c6d308473641 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received unexpected event network-vif-plugged-544b22aa-6b69-4b4d-985f-19bdc248d641 for instance with vm_state building and task_state spawning.
Aug 15 05:31:28 user nova-compute[73391]: DEBUG nova.compute.manager [req-d89e5e1b-b39f-47be-9eed-f6fd767f7038 req-73252680-62df-4606-b268-c6d308473641 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received event network-vif-plugged-544b22aa-6b69-4b4d-985f-19bdc248d641 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d89e5e1b-b39f-47be-9eed-f6fd767f7038 req-73252680-62df-4606-b268-c6d308473641 service nova] Acquiring lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d89e5e1b-b39f-47be-9eed-f6fd767f7038 req-73252680-62df-4606-b268-c6d308473641 service nova] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d89e5e1b-b39f-47be-9eed-f6fd767f7038 req-73252680-62df-4606-b268-c6d308473641 service nova] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG nova.compute.manager [req-d89e5e1b-b39f-47be-9eed-f6fd767f7038 req-73252680-62df-4606-b268-c6d308473641 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] No waiting events found dispatching network-vif-plugged-544b22aa-6b69-4b4d-985f-19bdc248d641 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:31:28 user nova-compute[73391]: WARNING nova.compute.manager [req-d89e5e1b-b39f-47be-9eed-f6fd767f7038 req-73252680-62df-4606-b268-c6d308473641 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received unexpected event network-vif-plugged-544b22aa-6b69-4b4d-985f-19bdc248d641 for instance with vm_state building and task_state spawning.
Aug 15 05:31:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cc1e3ce-1cbd-41c9-8dd3-d0dfeb17c1df tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc1e3ce-1cbd-41c9-8dd3-d0dfeb17c1df tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:dee27f26-c48e-4de8-8b6f-38c300512f77'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cFhGEiJZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:31:28 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-6cc1e3ce-1cbd-41c9-8dd3-d0dfeb17c1df tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:31:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-6cc1e3ce-1cbd-41c9-8dd3-d0dfeb17c1df tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-6cc1e3ce-1cbd-41c9-8dd3-d0dfeb17c1df tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:31:28 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-6cc1e3ce-1cbd-41c9-8dd3-d0dfeb17c1df tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:31:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-6cc1e3ce-1cbd-41c9-8dd3-d0dfeb17c1df tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dee27f26-c48e-4de8-8b6f-38c300512f77" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-6cc1e3ce-1cbd-41c9-8dd3-d0dfeb17c1df tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dee27f26-c48e-4de8-8b6f-38c300512f77" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:31:28 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-6cc1e3ce-1cbd-41c9-8dd3-d0dfeb17c1df tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 05:31:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dee27f26-c48e-4de8-8b6f-38c300512f77 -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dee27f26-c48e-4de8-8b6f-38c300512f77 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0172d4a-bb17-46b2-bff5-1ad987aff706]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc1e3ce-1cbd-41c9-8dd3-d0dfeb17c1df tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 05:31:28 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dee27f26-c48e-4de8-8b6f-38c300512f77 -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dee27f26-c48e-4de8-8b6f-38c300512f77 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[60258a21-704e-46fc-8a55-118bf8829954]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dee27f26-c48e-4de8-8b6f-38c300512f77] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc1e3ce-1cbd-41c9-8dd3-d0dfeb17c1df tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dee27f26-c48e-4de8-8b6f-38c300512f77] added
Aug 15 05:31:28 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dee27f26-c48e-4de8-8b6f-38c300512f77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dee27f26-c48e-4de8-8b6f-38c300512f77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[722b5b31-d4a0-44aa-a8e7-e9d3dda3d2de]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc1e3ce-1cbd-41c9-8dd3-d0dfeb17c1df tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dee27f26-c48e-4de8-8b6f-38c300512f77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dee27f26-c48e-4de8-8b6f-38c300512f77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af39e20-1e13-44cc-ad16-dc148baf20df]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc1e3ce-1cbd-41c9-8dd3-d0dfeb17c1df tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dee27f26-c48e-4de8-8b6f-38c300512f77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cFhGEiJZ {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dee27f26-c48e-4de8-8b6f-38c300512f77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cFhGEiJZ" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc774e26-2e56-4f2f-8a21-c3334e9da249]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc1e3ce-1cbd-41c9-8dd3-d0dfeb17c1df tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cFhGEiJZ'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dee27f26-c48e-4de8-8b6f-38c300512f77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dee27f26-c48e-4de8-8b6f-38c300512f77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a496d647-a89c-4eca-93ee-39a6a9596383]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc1e3ce-1cbd-41c9-8dd3-d0dfeb17c1df tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7048bf8-68d4-4ab5-bee8-abda186379b9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc1e3ce-1cbd-41c9-8dd3-d0dfeb17c1df tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:31:28 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:31:28 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:31:28 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc1e3ce-1cbd-41c9-8dd3-d0dfeb17c1df tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:31:28 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:31:28 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:31:28 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dee27f26-c48e-4de8-8b6f-38c300512f77 -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dee27f26-c48e-4de8-8b6f-38c300512f77 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f00de142-3798-475e-9b2a-1a61a899179a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dee27f26-c48e-4de8-8b6f-38c300512f77, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dee27f26-c48e-4de8-8b6f-38c300512f77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc1e3ce-1cbd-41c9-8dd3-d0dfeb17c1df tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dee27f26-c48e-4de8-8b6f-38c300512f77, portal: 172.16.0.220,3260]
Aug 15 05:31:28 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:dee27f26-c48e-4de8-8b6f-38c300512f77, portal: 172.16.0.220,3260] successful.
Aug 15 05:31:28 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dee27f26-c48e-4de8-8b6f-38c300512f77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dee27f26-c48e-4de8-8b6f-38c300512f77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9568e5c-b7bc-4e72-8fcf-d8f3a70526a0]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc1e3ce-1cbd-41c9-8dd3-d0dfeb17c1df tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87e82b8-3af9-40f4-be96-b45966b648b7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee27f26-c48e-4de8-8b6f-38c300512f77 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc1e3ce-1cbd-41c9-8dd3-d0dfeb17c1df tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:31:28 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:31:28 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:31:28 user nova-compute[73391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee27f26-c48e-4de8-8b6f-38c300512f77 (non-flash)
Aug 15 05:31:28 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc1e3ce-1cbd-41c9-8dd3-d0dfeb17c1df tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:31:28 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:31:28 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:31:28 user nova-compute[73391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee27f26-c48e-4de8-8b6f-38c300512f77 (non-flash)
Aug 15 05:31:28 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-6cc1e3ce-1cbd-41c9-8dd3-d0dfeb17c1df tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dee27f26-c48e-4de8-8b6f-38c300512f77" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc1e3ce-1cbd-41c9-8dd3-d0dfeb17c1df tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-6cc1e3ce-1cbd-41c9-8dd3-d0dfeb17c1df tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-6cc1e3ce-1cbd-41c9-8dd3-d0dfeb17c1df tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[363a7914-57b6-4899-b07d-e083697664e0]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-6cc1e3ce-1cbd-41c9-8dd3-d0dfeb17c1df tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc1e3ce-1cbd-41c9-8dd3-d0dfeb17c1df tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cFhGEiJZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 05:31:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:29 user nova-compute[73391]: DEBUG nova.compute.manager [req-dc1d04d8-cac3-4718-8c59-b0b480f78388 req-91962544-8466-4565-9324-207005febebe service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received event network-vif-plugged-a519d774-56a5-4a6c-9cd3-94e260332725 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:31:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-dc1d04d8-cac3-4718-8c59-b0b480f78388 req-91962544-8466-4565-9324-207005febebe service nova] Acquiring lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:31:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-dc1d04d8-cac3-4718-8c59-b0b480f78388 req-91962544-8466-4565-9324-207005febebe service nova] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:31:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-dc1d04d8-cac3-4718-8c59-b0b480f78388 req-91962544-8466-4565-9324-207005febebe service nova] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:31:29 user nova-compute[73391]: DEBUG nova.compute.manager [req-dc1d04d8-cac3-4718-8c59-b0b480f78388 req-91962544-8466-4565-9324-207005febebe service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] No waiting events found dispatching network-vif-plugged-a519d774-56a5-4a6c-9cd3-94e260332725 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:31:29 user nova-compute[73391]: WARNING nova.compute.manager [req-dc1d04d8-cac3-4718-8c59-b0b480f78388 req-91962544-8466-4565-9324-207005febebe service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received unexpected event network-vif-plugged-a519d774-56a5-4a6c-9cd3-94e260332725 for instance with vm_state building and task_state spawning.
Aug 15 05:31:29 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077489.1822858, da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:31:29 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] VM Resumed (Lifecycle Event)
Aug 15 05:31:29 user nova-compute[73391]: DEBUG nova.compute.manager [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:31:29 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Guest created on hypervisor {{(pid=73391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 05:31:29 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Instance spawned successfully.
Aug 15 05:31:29 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 05:31:29 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:31:29 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:31:29 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Found default for hw_cdrom_bus of ide {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:31:29 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Found default for hw_disk_bus of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:31:29 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Found default for hw_input_bus of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:31:29 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Found default for hw_pointer_model of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:31:29 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Found default for hw_video_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:31:29 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Found default for hw_vif_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:31:29 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:31:29 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077489.1933453, da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:31:29 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] VM Started (Lifecycle Event)
Aug 15 05:31:29 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:31:29 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:31:29 user nova-compute[73391]: INFO nova.compute.manager [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Took 11.21 seconds to spawn the instance on the hypervisor.
Aug 15 05:31:29 user nova-compute[73391]: DEBUG nova.compute.manager [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:31:29 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:31:29 user nova-compute[73391]: INFO nova.compute.manager [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Took 44.45 seconds to build instance.
Aug 15 05:31:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-750a0304-81be-4ac6-bda8-e3d6999fa914 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 44.553s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:31:29 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-6cc1e3ce-1cbd-41c9-8dd3-d0dfeb17c1df tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:31:29 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6cc1e3ce-1cbd-41c9-8dd3-d0dfeb17c1df tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23965666362303861', 'path': '/dev/sde'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:31:29 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6cc1e3ce-1cbd-41c9-8dd3-d0dfeb17c1df tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965666362303861', 'path': '/dev/sde'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 05:31:29 user nova-compute[73391]: DEBUG nova.objects.instance [None req-6cc1e3ce-1cbd-41c9-8dd3-d0dfeb17c1df tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Lazy-loading 'flavor' on Instance uuid 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:31:29 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-6cc1e3ce-1cbd-41c9-8dd3-d0dfeb17c1df tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 05:31:29 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:31:29 user nova-compute[73391]:   <source dev="/dev/sde"/>
Aug 15 05:31:29 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:31:29 user nova-compute[73391]:   <serial>dee27f26-c48e-4de8-8b6f-38c300512f77</serial>
Aug 15 05:31:29 user nova-compute[73391]: </disk>
Aug 15 05:31:29 user nova-compute[73391]:  {{(pid=73391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 05:31:29 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-2891f6fd-f998-4fcb-a215-caa23f22ba2e tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Snapshot image upload complete
Aug 15 05:31:29 user nova-compute[73391]: DEBUG nova.compute.manager [None req-2891f6fd-f998-4fcb-a215-caa23f22ba2e tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:31:30 user nova-compute[73391]: INFO nova.compute.manager [None req-2891f6fd-f998-4fcb-a215-caa23f22ba2e tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Shelve offloading
Aug 15 05:31:30 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Instance destroyed successfully.
Aug 15 05:31:30 user nova-compute[73391]: DEBUG nova.compute.manager [None req-2891f6fd-f998-4fcb-a215-caa23f22ba2e tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:31:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2891f6fd-f998-4fcb-a215-caa23f22ba2e tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Acquiring lock "refresh_cache-18c8138a-4efc-403f-8b42-e5080c6a51d3" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:31:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2891f6fd-f998-4fcb-a215-caa23f22ba2e tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Acquired lock "refresh_cache-18c8138a-4efc-403f-8b42-e5080c6a51d3" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:31:30 user nova-compute[73391]: DEBUG nova.network.neutron [None req-2891f6fd-f998-4fcb-a215-caa23f22ba2e tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:31:30 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-6cc1e3ce-1cbd-41c9-8dd3-d0dfeb17c1df tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:31:30 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-6cc1e3ce-1cbd-41c9-8dd3-d0dfeb17c1df tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:31:30 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-6cc1e3ce-1cbd-41c9-8dd3-d0dfeb17c1df tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] No VIF found with MAC fa:16:3e:0c:87:08, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:31:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6cc1e3ce-1cbd-41c9-8dd3-d0dfeb17c1df tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Lock "782c3d06-ef9e-4ca4-a03b-86f0e6d458a2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.913s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:31:30 user nova-compute[73391]: DEBUG nova.network.neutron [None req-2891f6fd-f998-4fcb-a215-caa23f22ba2e tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Updating instance_info_cache with network_info: [{"id": "bf92cfab-6648-42bd-b9f0-2a6f38562165", "address": "fa:16:3e:ba:49:5f", "network": {"id": "f67152a9-4f18-4d7f-9d3e-5e517bd46813", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-731866550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88871d09f7e347a4b9104a558604f2f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf92cfab-66", "ovs_interfaceid": "bf92cfab-6648-42bd-b9f0-2a6f38562165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:31:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2891f6fd-f998-4fcb-a215-caa23f22ba2e tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Releasing lock "refresh_cache-18c8138a-4efc-403f-8b42-e5080c6a51d3" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:31:31 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Instance destroyed successfully.
Aug 15 05:31:31 user nova-compute[73391]: DEBUG nova.objects.instance [None req-2891f6fd-f998-4fcb-a215-caa23f22ba2e tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lazy-loading 'resources' on Instance uuid 18c8138a-4efc-403f-8b42-e5080c6a51d3 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:31:31 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-2891f6fd-f998-4fcb-a215-caa23f22ba2e tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:29:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1277477436',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1277477436',id=4,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+vdfT2KUhLvPzx3dX+PrdTohkqxawdWMutgX8a450R3MvuBVzacV3c2EJESUdzVmjzs1fL7ALVh4jlwXHV/wX8tRMRsuEAx2ENCOBZxjSP5MZ2JRhfupI25RQTizDxiw==',key_name='tempest-keypair-700723771',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:29:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='88871d09f7e347a4b9104a558604f2f6',ramdisk_id='',reservation_id='r-j1g463qr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1774553789',owner_user_name='tempest-AttachVolumeShelveTestJSON-1774553789-project-member',shelved_at='2023-08-15T05:31:29.971597',shelved_host='user',shelved_image_id='7a7ff1bb-1715-4ce4-afca-751bea2e698b'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:31:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c932032fc884b14b9268d5df91d45ea',uuid=18c8138a-4efc-403f-8b42-e5080c6a51d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "bf92cfab-6648-42bd-b9f0-2a6f38562165", "address": "fa:16:3e:ba:49:5f", "network": {"id": "f67152a9-4f18-4d7f-9d3e-5e517bd46813", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-731866550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88871d09f7e347a4b9104a558604f2f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf92cfab-66", "ovs_interfaceid": "bf92cfab-6648-42bd-b9f0-2a6f38562165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:31:31 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-2891f6fd-f998-4fcb-a215-caa23f22ba2e tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Converting VIF {"id": "bf92cfab-6648-42bd-b9f0-2a6f38562165", "address": "fa:16:3e:ba:49:5f", "network": {"id": "f67152a9-4f18-4d7f-9d3e-5e517bd46813", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-731866550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88871d09f7e347a4b9104a558604f2f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf92cfab-66", "ovs_interfaceid": "bf92cfab-6648-42bd-b9f0-2a6f38562165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:31:31 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-2891f6fd-f998-4fcb-a215-caa23f22ba2e tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:49:5f,bridge_name='br-int',has_traffic_filtering=True,id=bf92cfab-6648-42bd-b9f0-2a6f38562165,network=Network(f67152a9-4f18-4d7f-9d3e-5e517bd46813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf92cfab-66') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:31:31 user nova-compute[73391]: DEBUG os_vif [None req-2891f6fd-f998-4fcb-a215-caa23f22ba2e tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:49:5f,bridge_name='br-int',has_traffic_filtering=True,id=bf92cfab-6648-42bd-b9f0-2a6f38562165,network=Network(f67152a9-4f18-4d7f-9d3e-5e517bd46813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf92cfab-66') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:31:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf92cfab-66, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:31:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:31 user nova-compute[73391]: INFO os_vif [None req-2891f6fd-f998-4fcb-a215-caa23f22ba2e tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:49:5f,bridge_name='br-int',has_traffic_filtering=True,id=bf92cfab-6648-42bd-b9f0-2a6f38562165,network=Network(f67152a9-4f18-4d7f-9d3e-5e517bd46813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf92cfab-66')
Aug 15 05:31:31 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-2891f6fd-f998-4fcb-a215-caa23f22ba2e tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Deleting instance files /opt/stack/data/nova/instances/18c8138a-4efc-403f-8b42-e5080c6a51d3_del
Aug 15 05:31:31 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-2891f6fd-f998-4fcb-a215-caa23f22ba2e tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Deletion of /opt/stack/data/nova/instances/18c8138a-4efc-403f-8b42-e5080c6a51d3_del complete
Aug 15 05:31:31 user nova-compute[73391]: DEBUG nova.compute.manager [req-024ca50d-9139-4d1a-ac14-1f854b740f06 req-fc566152-a76d-4eaa-8ceb-c123daddd786 service nova] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Received event network-changed-bf92cfab-6648-42bd-b9f0-2a6f38562165 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:31:31 user nova-compute[73391]: DEBUG nova.compute.manager [req-024ca50d-9139-4d1a-ac14-1f854b740f06 req-fc566152-a76d-4eaa-8ceb-c123daddd786 service nova] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Refreshing instance network info cache due to event network-changed-bf92cfab-6648-42bd-b9f0-2a6f38562165. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:31:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-024ca50d-9139-4d1a-ac14-1f854b740f06 req-fc566152-a76d-4eaa-8ceb-c123daddd786 service nova] Acquiring lock "refresh_cache-18c8138a-4efc-403f-8b42-e5080c6a51d3" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:31:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-024ca50d-9139-4d1a-ac14-1f854b740f06 req-fc566152-a76d-4eaa-8ceb-c123daddd786 service nova] Acquired lock "refresh_cache-18c8138a-4efc-403f-8b42-e5080c6a51d3" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:31:31 user nova-compute[73391]: DEBUG nova.network.neutron [req-024ca50d-9139-4d1a-ac14-1f854b740f06 req-fc566152-a76d-4eaa-8ceb-c123daddd786 service nova] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Refreshing network info cache for port bf92cfab-6648-42bd-b9f0-2a6f38562165 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:31:31 user nova-compute[73391]: INFO nova.scheduler.client.report [None req-2891f6fd-f998-4fcb-a215-caa23f22ba2e tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Deleted allocations for instance 18c8138a-4efc-403f-8b42-e5080c6a51d3
Aug 15 05:31:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-5b1c3bb0-ad2a-4f10-a930-8e46def116fb tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Acquiring lock "782c3d06-ef9e-4ca4-a03b-86f0e6d458a2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:31:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-5b1c3bb0-ad2a-4f10-a930-8e46def116fb tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Lock "782c3d06-ef9e-4ca4-a03b-86f0e6d458a2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:31:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-5b1c3bb0-ad2a-4f10-a930-8e46def116fb tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Acquiring lock "782c3d06-ef9e-4ca4-a03b-86f0e6d458a2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:31:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-5b1c3bb0-ad2a-4f10-a930-8e46def116fb tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Lock "782c3d06-ef9e-4ca4-a03b-86f0e6d458a2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:31:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-5b1c3bb0-ad2a-4f10-a930-8e46def116fb tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Lock "782c3d06-ef9e-4ca4-a03b-86f0e6d458a2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:31:31 user nova-compute[73391]: INFO nova.compute.manager [None req-5b1c3bb0-ad2a-4f10-a930-8e46def116fb tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Terminating instance
Aug 15 05:31:31 user nova-compute[73391]: DEBUG nova.compute.manager [None req-5b1c3bb0-ad2a-4f10-a930-8e46def116fb tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Start destroying the instance on the hypervisor. {{(pid=73391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 05:31:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2891f6fd-f998-4fcb-a215-caa23f22ba2e tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:31:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2891f6fd-f998-4fcb-a215-caa23f22ba2e tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:31:31 user nova-compute[73391]: DEBUG nova.objects.instance [None req-2891f6fd-f998-4fcb-a215-caa23f22ba2e tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lazy-loading 'numa_topology' on Instance uuid 18c8138a-4efc-403f-8b42-e5080c6a51d3 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:31:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG nova.compute.manager [req-e2c95554-e489-4f1d-bf83-62b59bbdfd47 req-77eb1832-7ee2-461e-99a0-0e87b5f50f13 service nova] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Received event network-vif-unplugged-39b441c5-fe40-4e06-9dcc-b11135805efe {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e2c95554-e489-4f1d-bf83-62b59bbdfd47 req-77eb1832-7ee2-461e-99a0-0e87b5f50f13 service nova] Acquiring lock "782c3d06-ef9e-4ca4-a03b-86f0e6d458a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e2c95554-e489-4f1d-bf83-62b59bbdfd47 req-77eb1832-7ee2-461e-99a0-0e87b5f50f13 service nova] Lock "782c3d06-ef9e-4ca4-a03b-86f0e6d458a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e2c95554-e489-4f1d-bf83-62b59bbdfd47 req-77eb1832-7ee2-461e-99a0-0e87b5f50f13 service nova] Lock "782c3d06-ef9e-4ca4-a03b-86f0e6d458a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG nova.compute.manager [req-e2c95554-e489-4f1d-bf83-62b59bbdfd47 req-77eb1832-7ee2-461e-99a0-0e87b5f50f13 service nova] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] No waiting events found dispatching network-vif-unplugged-39b441c5-fe40-4e06-9dcc-b11135805efe {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG nova.compute.manager [req-e2c95554-e489-4f1d-bf83-62b59bbdfd47 req-77eb1832-7ee2-461e-99a0-0e87b5f50f13 service nova] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Received event network-vif-unplugged-39b441c5-fe40-4e06-9dcc-b11135805efe for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-2891f6fd-f998-4fcb-a215-caa23f22ba2e tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-2891f6fd-f998-4fcb-a215-caa23f22ba2e tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2891f6fd-f998-4fcb-a215-caa23f22ba2e tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.548s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2891f6fd-f998-4fcb-a215-caa23f22ba2e tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "18c8138a-4efc-403f-8b42-e5080c6a51d3" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.942s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:31:32 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Instance destroyed successfully.
Aug 15 05:31:32 user nova-compute[73391]: DEBUG nova.objects.instance [None req-5b1c3bb0-ad2a-4f10-a930-8e46def116fb tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Lazy-loading 'resources' on Instance uuid 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-5b1c3bb0-ad2a-4f10-a930-8e46def116fb tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:29:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1595978663',display_name='tempest-DeleteServersTestJSON-server-1595978663',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1595978663',id=2,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:29:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f76918aa37f848008c8466a38bac1908',ramdisk_id='',reservation_id='r-p7z2rvlx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1058379781',owner_user_name='tempest-DeleteServersTestJSON-1058379781-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:29:31Z,user_data=None,user_id='983afbd9c0fe421db4cfe0dd75d45b1b',uuid=782c3d06-ef9e-4ca4-a03b-86f0e6d458a2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "39b441c5-fe40-4e06-9dcc-b11135805efe", "address": "fa:16:3e:0c:87:08", "network": {"id": "7b58b377-f2fd-4b5c-9bb3-4e7fa4c10faf", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1135444746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76918aa37f848008c8466a38bac1908", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b441c5-fe", "ovs_interfaceid": "39b441c5-fe40-4e06-9dcc-b11135805efe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-5b1c3bb0-ad2a-4f10-a930-8e46def116fb tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Converting VIF {"id": "39b441c5-fe40-4e06-9dcc-b11135805efe", "address": "fa:16:3e:0c:87:08", "network": {"id": "7b58b377-f2fd-4b5c-9bb3-4e7fa4c10faf", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1135444746-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f76918aa37f848008c8466a38bac1908", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39b441c5-fe", "ovs_interfaceid": "39b441c5-fe40-4e06-9dcc-b11135805efe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-5b1c3bb0-ad2a-4f10-a930-8e46def116fb tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:87:08,bridge_name='br-int',has_traffic_filtering=True,id=39b441c5-fe40-4e06-9dcc-b11135805efe,network=Network(7b58b377-f2fd-4b5c-9bb3-4e7fa4c10faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39b441c5-fe') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG os_vif [None req-5b1c3bb0-ad2a-4f10-a930-8e46def116fb tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:87:08,bridge_name='br-int',has_traffic_filtering=True,id=39b441c5-fe40-4e06-9dcc-b11135805efe,network=Network(7b58b377-f2fd-4b5c-9bb3-4e7fa4c10faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39b441c5-fe') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap39b441c5-fe, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:31:32 user nova-compute[73391]: INFO os_vif [None req-5b1c3bb0-ad2a-4f10-a930-8e46def116fb tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:87:08,bridge_name='br-int',has_traffic_filtering=True,id=39b441c5-fe40-4e06-9dcc-b11135805efe,network=Network(7b58b377-f2fd-4b5c-9bb3-4e7fa4c10faf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39b441c5-fe')
Aug 15 05:31:32 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b1c3bb0-ad2a-4f10-a930-8e46def116fb tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1c3bb0-ad2a-4f10-a930-8e46def116fb tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:dee27f26-c48e-4de8-8b6f-38c300512f77'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cFhGEiJZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:31:32 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-5b1c3bb0-ad2a-4f10-a930-8e46def116fb tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:31:32 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-5b1c3bb0-ad2a-4f10-a930-8e46def116fb tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-5b1c3bb0-ad2a-4f10-a930-8e46def116fb tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1c3bb0-ad2a-4f10-a930-8e46def116fb tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dee27f26-c48e-4de8-8b6f-38c300512f77', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb7fa30-7809-43eb-a4e5-0e302b33dcf8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dee27f26-c48e-4de8-8b6f-38c300512f77\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9496daf4-33ba-42a7-b3d4-eff3edd92f94]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee27f26-c48e-4de8-8b6f-38c300512f77 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1c3bb0-ad2a-4f10-a930-8e46def116fb tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:31:32 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:31:32 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:31:32 user nova-compute[73391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee27f26-c48e-4de8-8b6f-38c300512f77 (non-flash)
Aug 15 05:31:32 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1c3bb0-ad2a-4f10-a930-8e46def116fb tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:31:32 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:31:32 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:31:32 user nova-compute[73391]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dee27f26-c48e-4de8-8b6f-38c300512f77 (non-flash)
Aug 15 05:31:32 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1c3bb0-ad2a-4f10-a930-8e46def116fb tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7748100790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dee27f26-c48e-4de8-8b6f-38c300512f77'): ({'sde'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-5b1c3bb0-ad2a-4f10-a930-8e46def116fb tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Removing single pathed devices sde {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG nova.network.neutron [req-024ca50d-9139-4d1a-ac14-1f854b740f06 req-fc566152-a76d-4eaa-8ceb-c123daddd786 service nova] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Updated VIF entry in instance network info cache for port bf92cfab-6648-42bd-b9f0-2a6f38562165. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG nova.network.neutron [req-024ca50d-9139-4d1a-ac14-1f854b740f06 req-fc566152-a76d-4eaa-8ceb-c123daddd786 service nova] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Updating instance_info_cache with network_info: [{"id": "bf92cfab-6648-42bd-b9f0-2a6f38562165", "address": "fa:16:3e:ba:49:5f", "network": {"id": "f67152a9-4f18-4d7f-9d3e-5e517bd46813", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-731866550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88871d09f7e347a4b9104a558604f2f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapbf92cfab-66", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ef074d-856c-412b-b36b-8ea8e5584465]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa3342e-9c8a-4c6e-bbcd-6bc9fbe049f1]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-5b1c3bb0-ad2a-4f10-a930-8e46def116fb tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Flushing IO for device /dev/sde {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-024ca50d-9139-4d1a-ac14-1f854b740f06 req-fc566152-a76d-4eaa-8ceb-c123daddd786 service nova] Releasing lock "refresh_cache-18c8138a-4efc-403f-8b42-e5080c6a51d3" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4366ac-1336-4a74-bcdc-ad2738def81f]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-5b1c3bb0-ad2a-4f10-a930-8e46def116fb tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.057s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[519dd834-ffe0-4b1c-9c87-b5bb3d9e9992]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-5b1c3bb0-ad2a-4f10-a930-8e46def116fb tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-5b1c3bb0-ad2a-4f10-a930-8e46def116fb tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] SCSI volumes sde have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1c3bb0-ad2a-4f10-a930-8e46def116fb tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dee27f26-c48e-4de8-8b6f-38c300512f77')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dee27f26-c48e-4de8-8b6f-38c300512f77 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dee27f26-c48e-4de8-8b6f-38c300512f77 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05756c4-6ed2-4a8f-8a47-924831bfcffe]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1c3bb0-ad2a-4f10-a930-8e46def116fb tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dee27f26-c48e-4de8-8b6f-38c300512f77 -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dee27f26-c48e-4de8-8b6f-38c300512f77 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de186b8-3d32-4438-aedb-a2020bdbe2e6]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:dee27f26-c48e-4de8-8b6f-38c300512f77, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:dee27f26-c48e-4de8-8b6f-38c300512f77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1c3bb0-ad2a-4f10-a930-8e46def116fb tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:dee27f26-c48e-4de8-8b6f-38c300512f77, portal: 172.16.0.220,3260]
Aug 15 05:31:32 user nova-compute[73391]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:dee27f26-c48e-4de8-8b6f-38c300512f77, portal: 172.16.0.220,3260] successful.
Aug 15 05:31:32 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dee27f26-c48e-4de8-8b6f-38c300512f77 -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dee27f26-c48e-4de8-8b6f-38c300512f77 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aefef31-1561-4a9b-aabb-2ba6910a52ed]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1c3bb0-ad2a-4f10-a930-8e46def116fb tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-5b1c3bb0-ad2a-4f10-a930-8e46def116fb tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b1c3bb0-ad2a-4f10-a930-8e46def116fb tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] <== disconnect_volume: return (365ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:31:32 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b1c3bb0-ad2a-4f10-a930-8e46def116fb tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 05:31:32 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-5b1c3bb0-ad2a-4f10-a930-8e46def116fb tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Deleting instance files /opt/stack/data/nova/instances/782c3d06-ef9e-4ca4-a03b-86f0e6d458a2_del
Aug 15 05:31:32 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-5b1c3bb0-ad2a-4f10-a930-8e46def116fb tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Deletion of /opt/stack/data/nova/instances/782c3d06-ef9e-4ca4-a03b-86f0e6d458a2_del complete
Aug 15 05:31:33 user nova-compute[73391]: INFO nova.compute.manager [None req-5b1c3bb0-ad2a-4f10-a930-8e46def116fb tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Took 1.39 seconds to destroy the instance on the hypervisor.
Aug 15 05:31:33 user nova-compute[73391]: DEBUG oslo.service.loopingcall [None req-5b1c3bb0-ad2a-4f10-a930-8e46def116fb tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 05:31:33 user nova-compute[73391]: DEBUG nova.compute.manager [-] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Deallocating network for instance {{(pid=73391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 05:31:33 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] deallocate_for_instance() {{(pid=73391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 05:31:33 user nova-compute[73391]: DEBUG nova.compute.manager [req-0396fef5-6afd-4d9c-91f6-9ac5ec4f00e1 req-356c71e4-3403-432c-a22d-42a458026ac3 service nova] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Received event network-changed-a5f1c5ab-e060-450e-82ee-aa1e4b0ee019 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:31:33 user nova-compute[73391]: DEBUG nova.compute.manager [req-0396fef5-6afd-4d9c-91f6-9ac5ec4f00e1 req-356c71e4-3403-432c-a22d-42a458026ac3 service nova] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Refreshing instance network info cache due to event network-changed-a5f1c5ab-e060-450e-82ee-aa1e4b0ee019. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:31:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-0396fef5-6afd-4d9c-91f6-9ac5ec4f00e1 req-356c71e4-3403-432c-a22d-42a458026ac3 service nova] Acquiring lock "refresh_cache-4b9f5970-65c5-4eff-a4bf-d18a9c916c90" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:31:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-0396fef5-6afd-4d9c-91f6-9ac5ec4f00e1 req-356c71e4-3403-432c-a22d-42a458026ac3 service nova] Acquired lock "refresh_cache-4b9f5970-65c5-4eff-a4bf-d18a9c916c90" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:31:33 user nova-compute[73391]: DEBUG nova.network.neutron [req-0396fef5-6afd-4d9c-91f6-9ac5ec4f00e1 req-356c71e4-3403-432c-a22d-42a458026ac3 service nova] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Refreshing network info cache for port a5f1c5ab-e060-450e-82ee-aa1e4b0ee019 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:31:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:33 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:31:34 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Took 0.94 seconds to deallocate network for instance.
Aug 15 05:31:34 user nova-compute[73391]: DEBUG nova.compute.manager [req-640b3e62-d2c9-484c-9bd2-a128c929a9cc req-ae70e418-385b-4a6d-999a-d21959d972d2 service nova] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Received event network-vif-deleted-39b441c5-fe40-4e06-9dcc-b11135805efe {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:31:34 user nova-compute[73391]: INFO nova.compute.manager [req-640b3e62-d2c9-484c-9bd2-a128c929a9cc req-ae70e418-385b-4a6d-999a-d21959d972d2 service nova] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Neutron deleted interface 39b441c5-fe40-4e06-9dcc-b11135805efe; detaching it from the instance and deleting it from the info cache
Aug 15 05:31:34 user nova-compute[73391]: DEBUG nova.network.neutron [req-640b3e62-d2c9-484c-9bd2-a128c929a9cc req-ae70e418-385b-4a6d-999a-d21959d972d2 service nova] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:31:34 user nova-compute[73391]: DEBUG nova.compute.manager [req-640b3e62-d2c9-484c-9bd2-a128c929a9cc req-ae70e418-385b-4a6d-999a-d21959d972d2 service nova] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Detach interface failed, port_id=39b441c5-fe40-4e06-9dcc-b11135805efe, reason: Instance 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2 could not be found. {{(pid=73391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 05:31:34 user nova-compute[73391]: DEBUG nova.compute.manager [req-2446c5f8-2d78-4ff7-bbfe-6b1320d0a005 req-4484110d-9a4b-48bc-9b4f-de6186bacbf7 service nova] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Received event network-vif-plugged-39b441c5-fe40-4e06-9dcc-b11135805efe {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:31:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2446c5f8-2d78-4ff7-bbfe-6b1320d0a005 req-4484110d-9a4b-48bc-9b4f-de6186bacbf7 service nova] Acquiring lock "782c3d06-ef9e-4ca4-a03b-86f0e6d458a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:31:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2446c5f8-2d78-4ff7-bbfe-6b1320d0a005 req-4484110d-9a4b-48bc-9b4f-de6186bacbf7 service nova] Lock "782c3d06-ef9e-4ca4-a03b-86f0e6d458a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:31:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2446c5f8-2d78-4ff7-bbfe-6b1320d0a005 req-4484110d-9a4b-48bc-9b4f-de6186bacbf7 service nova] Lock "782c3d06-ef9e-4ca4-a03b-86f0e6d458a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:31:34 user nova-compute[73391]: DEBUG nova.compute.manager [req-2446c5f8-2d78-4ff7-bbfe-6b1320d0a005 req-4484110d-9a4b-48bc-9b4f-de6186bacbf7 service nova] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] No waiting events found dispatching network-vif-plugged-39b441c5-fe40-4e06-9dcc-b11135805efe {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:31:34 user nova-compute[73391]: WARNING nova.compute.manager [req-2446c5f8-2d78-4ff7-bbfe-6b1320d0a005 req-4484110d-9a4b-48bc-9b4f-de6186bacbf7 service nova] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Received unexpected event network-vif-plugged-39b441c5-fe40-4e06-9dcc-b11135805efe for instance with vm_state active and task_state deleting.
Aug 15 05:31:34 user nova-compute[73391]: DEBUG nova.network.neutron [req-0396fef5-6afd-4d9c-91f6-9ac5ec4f00e1 req-356c71e4-3403-432c-a22d-42a458026ac3 service nova] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Updated VIF entry in instance network info cache for port a5f1c5ab-e060-450e-82ee-aa1e4b0ee019. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:31:34 user nova-compute[73391]: DEBUG nova.network.neutron [req-0396fef5-6afd-4d9c-91f6-9ac5ec4f00e1 req-356c71e4-3403-432c-a22d-42a458026ac3 service nova] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Updating instance_info_cache with network_info: [{"id": "a5f1c5ab-e060-450e-82ee-aa1e4b0ee019", "address": "fa:16:3e:11:2e:cb", "network": {"id": "f69631d8-9da0-4c6d-8530-e8c455942703", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-108520740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d2058584e624e869bf316e4cee4d669", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f1c5ab-e0", "ovs_interfaceid": "a5f1c5ab-e060-450e-82ee-aa1e4b0ee019", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:31:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-0396fef5-6afd-4d9c-91f6-9ac5ec4f00e1 req-356c71e4-3403-432c-a22d-42a458026ac3 service nova] Releasing lock "refresh_cache-4b9f5970-65c5-4eff-a4bf-d18a9c916c90" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:31:34 user nova-compute[73391]: INFO nova.compute.manager [None req-5b1c3bb0-ad2a-4f10-a930-8e46def116fb tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Took 0.93 seconds to detach 1 volumes for instance.
Aug 15 05:31:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-5b1c3bb0-ad2a-4f10-a930-8e46def116fb tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:31:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-5b1c3bb0-ad2a-4f10-a930-8e46def116fb tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:31:35 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-5b1c3bb0-ad2a-4f10-a930-8e46def116fb tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:31:35 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-5b1c3bb0-ad2a-4f10-a930-8e46def116fb tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:31:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-5b1c3bb0-ad2a-4f10-a930-8e46def116fb tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.436s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:31:35 user nova-compute[73391]: INFO nova.scheduler.client.report [None req-5b1c3bb0-ad2a-4f10-a930-8e46def116fb tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Deleted allocations for instance 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2
Aug 15 05:31:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-5b1c3bb0-ad2a-4f10-a930-8e46def116fb tempest-DeleteServersTestJSON-1058379781 tempest-DeleteServersTestJSON-1058379781-project-member] Lock "782c3d06-ef9e-4ca4-a03b-86f0e6d458a2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.937s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:31:37 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-263b7877-22e4-4438-8155-c3e7a3123033 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Acquiring lock "4b9f5970-65c5-4eff-a4bf-d18a9c916c90" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:31:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-263b7877-22e4-4438-8155-c3e7a3123033 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Lock "4b9f5970-65c5-4eff-a4bf-d18a9c916c90" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:31:38 user nova-compute[73391]: DEBUG nova.objects.instance [None req-263b7877-22e4-4438-8155-c3e7a3123033 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Lazy-loading 'flavor' on Instance uuid 4b9f5970-65c5-4eff-a4bf-d18a9c916c90 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:31:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-263b7877-22e4-4438-8155-c3e7a3123033 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Lock "4b9f5970-65c5-4eff-a4bf-d18a9c916c90" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.095s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:31:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-263b7877-22e4-4438-8155-c3e7a3123033 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Acquiring lock "4b9f5970-65c5-4eff-a4bf-d18a9c916c90" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:31:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-263b7877-22e4-4438-8155-c3e7a3123033 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Lock "4b9f5970-65c5-4eff-a4bf-d18a9c916c90" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:31:38 user nova-compute[73391]: INFO nova.compute.manager [None req-263b7877-22e4-4438-8155-c3e7a3123033 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Attaching volume 7c0f5093-cc00-451f-bf62-335df5a87a26 to /dev/vdb
Aug 15 05:31:38 user nova-compute[73391]: DEBUG os_brick.utils [None req-263b7877-22e4-4438-8155-c3e7a3123033 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:31:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:38 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[46fc5b32-c095-41b6-badc-8c357f2a2b77]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:38 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a87e045-8e8c-49df-bd1e-99c254fde3b9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:38 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6d1147-d936-41c0-bec0-750e4e7d89df]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:38 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5accc885-57e9-445e-ade2-f7c19adf7895]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-263b7877-22e4-4438-8155-c3e7a3123033 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-263b7877-22e4-4438-8155-c3e7a3123033 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:31:38 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-263b7877-22e4-4438-8155-c3e7a3123033 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 05:31:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:31:38 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 05:31:38 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f005313a-595e-4d27-9147-732c8887710c]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:38 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-263b7877-22e4-4438-8155-c3e7a3123033 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 05:31:38 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-263b7877-22e4-4438-8155-c3e7a3123033 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 05:31:38 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-263b7877-22e4-4438-8155-c3e7a3123033 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 05:31:38 user nova-compute[73391]: DEBUG os_brick.utils [None req-263b7877-22e4-4438-8155-c3e7a3123033 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:31:38 user nova-compute[73391]: DEBUG nova.virt.block_device [None req-263b7877-22e4-4438-8155-c3e7a3123033 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Updating existing volume attachment record: 7562b293-61fd-473d-9f34-636d38446065 {{(pid=73391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 05:31:38 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:40 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692077485.6587195, 18c8138a-4efc-403f-8b42-e5080c6a51d3 => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:31:40 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] VM Stopped (Lifecycle Event)
Aug 15 05:31:40 user nova-compute[73391]: DEBUG nova.compute.manager [None req-a017c633-8a12-49d3-8058-802160b4f8f7 None None] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:31:40 user nova-compute[73391]: INFO nova.virt.block_device [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Booting with volume 644f40f9-9fcf-4fa6-908e-d1c315ad9518 at /dev/vdc
Aug 15 05:31:40 user nova-compute[73391]: DEBUG os_brick.utils [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:31:40 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:40 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:40 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef0fd1f-8202-4a0a-9c28-0933d591777d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:40 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:41 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8535e8c2-75ab-4882-8f84-91566d00a557]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:41 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c1d460-301b-427a-97f2-470901331391]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:41 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6061aa-ec09-4e21-b6fe-3f37329ef0b8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:31:41 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 05:31:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:31:41 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 05:31:41 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a460608-e6d4-4bc2-a346-c1ff055dfcc2]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:41 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 05:31:41 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 05:31:41 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 05:31:41 user nova-compute[73391]: DEBUG os_brick.utils [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:31:41 user nova-compute[73391]: DEBUG nova.virt.block_device [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Updating existing volume attachment record: 94855c9a-0f21-432e-aea3-c18fc66c74a4 {{(pid=73391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 05:31:42 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:43 user nova-compute[73391]: DEBUG nova.compute.manager [req-f69b744f-4c6d-4907-adbb-08fbbe0c1173 req-efbee99c-1bd2-48e4-9ca9-71e8c4e3a661 service nova] [instance: df00c15a-2512-41d0-9857-edb50374897e] Received event network-changed-c065ab29-c8d1-463f-bf12-7921829c9ede {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:31:43 user nova-compute[73391]: DEBUG nova.compute.manager [req-f69b744f-4c6d-4907-adbb-08fbbe0c1173 req-efbee99c-1bd2-48e4-9ca9-71e8c4e3a661 service nova] [instance: df00c15a-2512-41d0-9857-edb50374897e] Refreshing instance network info cache due to event network-changed-c065ab29-c8d1-463f-bf12-7921829c9ede. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:31:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f69b744f-4c6d-4907-adbb-08fbbe0c1173 req-efbee99c-1bd2-48e4-9ca9-71e8c4e3a661 service nova] Acquiring lock "refresh_cache-df00c15a-2512-41d0-9857-edb50374897e" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:31:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f69b744f-4c6d-4907-adbb-08fbbe0c1173 req-efbee99c-1bd2-48e4-9ca9-71e8c4e3a661 service nova] Acquired lock "refresh_cache-df00c15a-2512-41d0-9857-edb50374897e" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:31:43 user nova-compute[73391]: DEBUG nova.network.neutron [req-f69b744f-4c6d-4907-adbb-08fbbe0c1173 req-efbee99c-1bd2-48e4-9ca9-71e8c4e3a661 service nova] [instance: df00c15a-2512-41d0-9857-edb50374897e] Refreshing network info cache for port c065ab29-c8d1-463f-bf12-7921829c9ede {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:31:43 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-21176e08-244c-430a-938f-39349c8fa67c tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Acquiring lock "interface-df00c15a-2512-41d0-9857-edb50374897e-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:31:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-21176e08-244c-430a-938f-39349c8fa67c tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Lock "interface-df00c15a-2512-41d0-9857-edb50374897e-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:31:44 user nova-compute[73391]: DEBUG nova.objects.instance [None req-21176e08-244c-430a-938f-39349c8fa67c tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Lazy-loading 'flavor' on Instance uuid df00c15a-2512-41d0-9857-edb50374897e {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:31:44 user nova-compute[73391]: DEBUG nova.objects.instance [None req-21176e08-244c-430a-938f-39349c8fa67c tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Lazy-loading 'pci_requests' on Instance uuid df00c15a-2512-41d0-9857-edb50374897e {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:31:44 user nova-compute[73391]: DEBUG nova.network.neutron [None req-21176e08-244c-430a-938f-39349c8fa67c tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] [instance: df00c15a-2512-41d0-9857-edb50374897e] allocate_for_instance() {{(pid=73391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 05:31:45 user nova-compute[73391]: DEBUG nova.policy [None req-21176e08-244c-430a-938f-39349c8fa67c tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '42f8f8600f9a4d81a72afbaf2bbd53a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1d2905fedccc4085a38a905192ba079b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73391) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 05:31:45 user nova-compute[73391]: DEBUG nova.network.neutron [req-f69b744f-4c6d-4907-adbb-08fbbe0c1173 req-efbee99c-1bd2-48e4-9ca9-71e8c4e3a661 service nova] [instance: df00c15a-2512-41d0-9857-edb50374897e] Updated VIF entry in instance network info cache for port c065ab29-c8d1-463f-bf12-7921829c9ede. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:31:45 user nova-compute[73391]: DEBUG nova.network.neutron [req-f69b744f-4c6d-4907-adbb-08fbbe0c1173 req-efbee99c-1bd2-48e4-9ca9-71e8c4e3a661 service nova] [instance: df00c15a-2512-41d0-9857-edb50374897e] Updating instance_info_cache with network_info: [{"id": "c065ab29-c8d1-463f-bf12-7921829c9ede", "address": "fa:16:3e:92:27:fb", "network": {"id": "6605a4f0-a8e4-4044-a7d3-36dd84d3870c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-694227201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d2905fedccc4085a38a905192ba079b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc065ab29-c8", "ovs_interfaceid": "c065ab29-c8d1-463f-bf12-7921829c9ede", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:31:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f69b744f-4c6d-4907-adbb-08fbbe0c1173 req-efbee99c-1bd2-48e4-9ca9-71e8c4e3a661 service nova] Releasing lock "refresh_cache-df00c15a-2512-41d0-9857-edb50374897e" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:31:46 user nova-compute[73391]: DEBUG nova.compute.manager [req-e22396a3-37a1-49b7-a9dd-86191683bcf6 req-6e96cc4f-60e3-4291-92df-14c1ba6aaafb service nova] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Received event network-changed-57ecc71f-8eb7-4129-bed4-3e085ce44291 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:31:46 user nova-compute[73391]: DEBUG nova.compute.manager [req-e22396a3-37a1-49b7-a9dd-86191683bcf6 req-6e96cc4f-60e3-4291-92df-14c1ba6aaafb service nova] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Refreshing instance network info cache due to event network-changed-57ecc71f-8eb7-4129-bed4-3e085ce44291. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:31:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e22396a3-37a1-49b7-a9dd-86191683bcf6 req-6e96cc4f-60e3-4291-92df-14c1ba6aaafb service nova] Acquiring lock "refresh_cache-0169df15-335e-46e6-a5c8-9deb7095bb84" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:31:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e22396a3-37a1-49b7-a9dd-86191683bcf6 req-6e96cc4f-60e3-4291-92df-14c1ba6aaafb service nova] Acquired lock "refresh_cache-0169df15-335e-46e6-a5c8-9deb7095bb84" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:31:46 user nova-compute[73391]: DEBUG nova.network.neutron [req-e22396a3-37a1-49b7-a9dd-86191683bcf6 req-6e96cc4f-60e3-4291-92df-14c1ba6aaafb service nova] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Refreshing network info cache for port 57ecc71f-8eb7-4129-bed4-3e085ce44291 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:31:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-882c0ff1-a747-4c70-917d-6f8cebc35d20 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Acquiring lock "0169df15-335e-46e6-a5c8-9deb7095bb84" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:31:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-882c0ff1-a747-4c70-917d-6f8cebc35d20 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Lock "0169df15-335e-46e6-a5c8-9deb7095bb84" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:31:46 user nova-compute[73391]: DEBUG nova.objects.instance [None req-882c0ff1-a747-4c70-917d-6f8cebc35d20 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Lazy-loading 'flavor' on Instance uuid 0169df15-335e-46e6-a5c8-9deb7095bb84 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:31:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-882c0ff1-a747-4c70-917d-6f8cebc35d20 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Lock "0169df15-335e-46e6-a5c8-9deb7095bb84" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:31:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e77ca1fe-67c6-4c14-97e3-952a122e5023 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] Acquiring lock "ee96866e-7ee0-46a1-be1a-60439a52d513" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:31:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e77ca1fe-67c6-4c14-97e3-952a122e5023 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] Lock "ee96866e-7ee0-46a1-be1a-60439a52d513" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:31:46 user nova-compute[73391]: DEBUG nova.objects.instance [None req-e77ca1fe-67c6-4c14-97e3-952a122e5023 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] Lazy-loading 'flavor' on Instance uuid ee96866e-7ee0-46a1-be1a-60439a52d513 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:31:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e77ca1fe-67c6-4c14-97e3-952a122e5023 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] Lock "ee96866e-7ee0-46a1-be1a-60439a52d513" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.089s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:31:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-882c0ff1-a747-4c70-917d-6f8cebc35d20 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Acquiring lock "0169df15-335e-46e6-a5c8-9deb7095bb84" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:31:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-882c0ff1-a747-4c70-917d-6f8cebc35d20 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Lock "0169df15-335e-46e6-a5c8-9deb7095bb84" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:31:46 user nova-compute[73391]: INFO nova.compute.manager [None req-882c0ff1-a747-4c70-917d-6f8cebc35d20 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Attaching volume fb592ee0-ed3e-427a-8cc4-05091385a40a to /dev/vdb
Aug 15 05:31:46 user nova-compute[73391]: DEBUG os_brick.utils [None req-882c0ff1-a747-4c70-917d-6f8cebc35d20 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:31:46 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:46 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:46 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7415ff81-f16a-46f0-9d79-6e345c5f3ea3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:46 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:46 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:46 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[75078fcd-91ff-43a5-b2cc-df417168ff24]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:46 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:46 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:46 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[dba60389-c52f-4f22-924d-6e2660787cbe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:46 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d590a3-4ae1-4ca1-b91d-9b94671df077]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:46 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-882c0ff1-a747-4c70-917d-6f8cebc35d20 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:46 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-882c0ff1-a747-4c70-917d-6f8cebc35d20 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:31:46 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-882c0ff1-a747-4c70-917d-6f8cebc35d20 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 05:31:46 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:46 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:31:46 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 05:31:46 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a646b1fc-59cf-4c94-9043-6ca292be1f8c]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:46 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-882c0ff1-a747-4c70-917d-6f8cebc35d20 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 05:31:46 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-882c0ff1-a747-4c70-917d-6f8cebc35d20 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 05:31:46 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-882c0ff1-a747-4c70-917d-6f8cebc35d20 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 05:31:46 user nova-compute[73391]: DEBUG os_brick.utils [None req-882c0ff1-a747-4c70-917d-6f8cebc35d20 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:31:46 user nova-compute[73391]: DEBUG nova.virt.block_device [None req-882c0ff1-a747-4c70-917d-6f8cebc35d20 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Updating existing volume attachment record: c99f2752-5b1a-4977-b22d-5406cd47a03c {{(pid=73391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 05:31:46 user nova-compute[73391]: DEBUG nova.network.neutron [None req-21176e08-244c-430a-938f-39349c8fa67c tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] [instance: df00c15a-2512-41d0-9857-edb50374897e] Successfully created port: f2700be5-db51-43e4-bfaa-aa91b76489af {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 05:31:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e77ca1fe-67c6-4c14-97e3-952a122e5023 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] Acquiring lock "ee96866e-7ee0-46a1-be1a-60439a52d513" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:31:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e77ca1fe-67c6-4c14-97e3-952a122e5023 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] Lock "ee96866e-7ee0-46a1-be1a-60439a52d513" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:31:46 user nova-compute[73391]: INFO nova.compute.manager [None req-e77ca1fe-67c6-4c14-97e3-952a122e5023 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Attaching volume 84e2f66b-ecf5-4e00-a17a-6fc6c67929e1 to /dev/vdb
Aug 15 05:31:46 user nova-compute[73391]: DEBUG nova.network.neutron [req-e22396a3-37a1-49b7-a9dd-86191683bcf6 req-6e96cc4f-60e3-4291-92df-14c1ba6aaafb service nova] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Updated VIF entry in instance network info cache for port 57ecc71f-8eb7-4129-bed4-3e085ce44291. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:31:46 user nova-compute[73391]: DEBUG nova.network.neutron [req-e22396a3-37a1-49b7-a9dd-86191683bcf6 req-6e96cc4f-60e3-4291-92df-14c1ba6aaafb service nova] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Updating instance_info_cache with network_info: [{"id": "57ecc71f-8eb7-4129-bed4-3e085ce44291", "address": "fa:16:3e:09:d0:87", "network": {"id": "5cff12e9-5977-4f76-b8c9-f166bdb40ffe", "bridge": "br-int", "label": "tempest-TestVolumeSwap-440667944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a845478f29ec418db07b467f5d47f753", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57ecc71f-8e", "ovs_interfaceid": "57ecc71f-8eb7-4129-bed4-3e085ce44291", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:31:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e22396a3-37a1-49b7-a9dd-86191683bcf6 req-6e96cc4f-60e3-4291-92df-14c1ba6aaafb service nova] Releasing lock "refresh_cache-0169df15-335e-46e6-a5c8-9deb7095bb84" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:31:47 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692077492.5416172, 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2 => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:31:47 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] VM Stopped (Lifecycle Event)
Aug 15 05:31:47 user nova-compute[73391]: DEBUG nova.compute.manager [None req-a6f66703-f8f5-4a22-bc6a-91ed5a6dac74 None None] [instance: 782c3d06-ef9e-4ca4-a03b-86f0e6d458a2] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:31:47 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:47 user nova-compute[73391]: DEBUG nova.network.neutron [None req-21176e08-244c-430a-938f-39349c8fa67c tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] [instance: df00c15a-2512-41d0-9857-edb50374897e] Successfully updated port: f2700be5-db51-43e4-bfaa-aa91b76489af {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:31:47 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-21176e08-244c-430a-938f-39349c8fa67c tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Acquiring lock "refresh_cache-df00c15a-2512-41d0-9857-edb50374897e" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:31:47 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-21176e08-244c-430a-938f-39349c8fa67c tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Acquired lock "refresh_cache-df00c15a-2512-41d0-9857-edb50374897e" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:31:47 user nova-compute[73391]: DEBUG nova.network.neutron [None req-21176e08-244c-430a-938f-39349c8fa67c tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] [instance: df00c15a-2512-41d0-9857-edb50374897e] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:31:48 user nova-compute[73391]: DEBUG nova.compute.manager [req-5a9fdffb-b5f4-46ab-9fbc-74fab0c452b0 req-3cd2f7f1-c10d-42ed-bef6-95bdf945ce0f service nova] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Received event network-changed-b6fe7cdf-66e0-40f5-a5df-b99d43175add {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:31:48 user nova-compute[73391]: DEBUG nova.compute.manager [req-5a9fdffb-b5f4-46ab-9fbc-74fab0c452b0 req-3cd2f7f1-c10d-42ed-bef6-95bdf945ce0f service nova] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Refreshing instance network info cache due to event network-changed-b6fe7cdf-66e0-40f5-a5df-b99d43175add. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:31:48 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-5a9fdffb-b5f4-46ab-9fbc-74fab0c452b0 req-3cd2f7f1-c10d-42ed-bef6-95bdf945ce0f service nova] Acquiring lock "refresh_cache-ee96866e-7ee0-46a1-be1a-60439a52d513" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:31:48 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-5a9fdffb-b5f4-46ab-9fbc-74fab0c452b0 req-3cd2f7f1-c10d-42ed-bef6-95bdf945ce0f service nova] Acquired lock "refresh_cache-ee96866e-7ee0-46a1-be1a-60439a52d513" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:31:48 user nova-compute[73391]: DEBUG nova.network.neutron [req-5a9fdffb-b5f4-46ab-9fbc-74fab0c452b0 req-3cd2f7f1-c10d-42ed-bef6-95bdf945ce0f service nova] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Refreshing network info cache for port b6fe7cdf-66e0-40f5-a5df-b99d43175add {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:31:48 user nova-compute[73391]: DEBUG nova.network.neutron [None req-21176e08-244c-430a-938f-39349c8fa67c tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] [instance: df00c15a-2512-41d0-9857-edb50374897e] Updating instance_info_cache with network_info: [{"id": "c065ab29-c8d1-463f-bf12-7921829c9ede", "address": "fa:16:3e:92:27:fb", "network": {"id": "6605a4f0-a8e4-4044-a7d3-36dd84d3870c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-694227201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d2905fedccc4085a38a905192ba079b", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc065ab29-c8", "ovs_interfaceid": "c065ab29-c8d1-463f-bf12-7921829c9ede", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f2700be5-db51-43e4-bfaa-aa91b76489af", "address": "fa:16:3e:ac:36:4b", "network": {"id": "a0603438-6866-4c65-af22-30fac1b66aaa", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-963064482", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1d2905fedccc4085a38a905192ba079b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2700be5-db", "ovs_interfaceid": "f2700be5-db51-43e4-bfaa-aa91b76489af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:31:48 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-21176e08-244c-430a-938f-39349c8fa67c tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Releasing lock "refresh_cache-df00c15a-2512-41d0-9857-edb50374897e" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:31:48 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-21176e08-244c-430a-938f-39349c8fa67c tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T05:29:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1483983120',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1483983120',id=6,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2gCgxFYyHMvanjOmlhgs+PtTOvShgOshpOoTRWbXBVti5EI5YAHx014n7qsJi2J2bJRkI0PBGeXP5u90VAUBx25BB0y6ovoKoEveKinIqcQDUv9GNl+Dqk3GoYb9mVVg==',key_name='tempest-keypair-1486183318',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:30:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1d2905fedccc4085a38a905192ba079b',ramdisk_id='',reservation_id='r-j2lev19d',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1390153553',owner_user_name='tempest-TaggedAttachmentsTest-1390153553-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:30:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='42f8f8600f9a4d81a72afbaf2bbd53a5',uuid=df00c15a-2512-41d0-9857-edb50374897e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f2700be5-db51-43e4-bfaa-aa91b76489af", "address": "fa:16:3e:ac:36:4b", "network": {"id": "a0603438-6866-4c65-af22-30fac1b66aaa", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-963064482", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1d2905fedccc4085a38a905192ba079b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2700be5-db", "ovs_interfaceid": "f2700be5-db51-43e4-bfaa-aa91b76489af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:31:48 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-21176e08-244c-430a-938f-39349c8fa67c tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Converting VIF {"id": "f2700be5-db51-43e4-bfaa-aa91b76489af", "address": "fa:16:3e:ac:36:4b", "network": {"id": "a0603438-6866-4c65-af22-30fac1b66aaa", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-963064482", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1d2905fedccc4085a38a905192ba079b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2700be5-db", "ovs_interfaceid": "f2700be5-db51-43e4-bfaa-aa91b76489af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:31:48 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-21176e08-244c-430a-938f-39349c8fa67c tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:36:4b,bridge_name='br-int',has_traffic_filtering=True,id=f2700be5-db51-43e4-bfaa-aa91b76489af,network=Network(a0603438-6866-4c65-af22-30fac1b66aaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2700be5-db') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:31:48 user nova-compute[73391]: DEBUG os_vif [None req-21176e08-244c-430a-938f-39349c8fa67c tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:36:4b,bridge_name='br-int',has_traffic_filtering=True,id=f2700be5-db51-43e4-bfaa-aa91b76489af,network=Network(a0603438-6866-4c65-af22-30fac1b66aaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2700be5-db') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:31:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:31:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:31:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf2700be5-db, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:31:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf2700be5-db, col_values=(('external_ids', {'iface-id': 'f2700be5-db51-43e4-bfaa-aa91b76489af', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:36:4b', 'vm-uuid': 'df00c15a-2512-41d0-9857-edb50374897e'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:31:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:31:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:48 user nova-compute[73391]: INFO os_vif [None req-21176e08-244c-430a-938f-39349c8fa67c tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:36:4b,bridge_name='br-int',has_traffic_filtering=True,id=f2700be5-db51-43e4-bfaa-aa91b76489af,network=Network(a0603438-6866-4c65-af22-30fac1b66aaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2700be5-db')
Aug 15 05:31:48 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-21176e08-244c-430a-938f-39349c8fa67c tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T05:29:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1483983120',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1483983120',id=6,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2gCgxFYyHMvanjOmlhgs+PtTOvShgOshpOoTRWbXBVti5EI5YAHx014n7qsJi2J2bJRkI0PBGeXP5u90VAUBx25BB0y6ovoKoEveKinIqcQDUv9GNl+Dqk3GoYb9mVVg==',key_name='tempest-keypair-1486183318',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:30:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='1d2905fedccc4085a38a905192ba079b',ramdisk_id='',reservation_id='r-j2lev19d',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1390153553',owner_user_name='tempest-TaggedAttachmentsTest-1390153553-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:30:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='42f8f8600f9a4d81a72afbaf2bbd53a5',uuid=df00c15a-2512-41d0-9857-edb50374897e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f2700be5-db51-43e4-bfaa-aa91b76489af", "address": "fa:16:3e:ac:36:4b", "network": {"id": "a0603438-6866-4c65-af22-30fac1b66aaa", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-963064482", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1d2905fedccc4085a38a905192ba079b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2700be5-db", "ovs_interfaceid": "f2700be5-db51-43e4-bfaa-aa91b76489af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:31:48 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-21176e08-244c-430a-938f-39349c8fa67c tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Converting VIF {"id": "f2700be5-db51-43e4-bfaa-aa91b76489af", "address": "fa:16:3e:ac:36:4b", "network": {"id": "a0603438-6866-4c65-af22-30fac1b66aaa", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-963064482", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1d2905fedccc4085a38a905192ba079b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2700be5-db", "ovs_interfaceid": "f2700be5-db51-43e4-bfaa-aa91b76489af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:31:48 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-21176e08-244c-430a-938f-39349c8fa67c tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:36:4b,bridge_name='br-int',has_traffic_filtering=True,id=f2700be5-db51-43e4-bfaa-aa91b76489af,network=Network(a0603438-6866-4c65-af22-30fac1b66aaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2700be5-db') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:31:48 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-21176e08-244c-430a-938f-39349c8fa67c tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] attach device xml: <interface type="ethernet">
Aug 15 05:31:48 user nova-compute[73391]:   <mac address="fa:16:3e:ac:36:4b"/>
Aug 15 05:31:48 user nova-compute[73391]:   <model type="virtio"/>
Aug 15 05:31:48 user nova-compute[73391]:   <mtu size="1442"/>
Aug 15 05:31:48 user nova-compute[73391]:   <target dev="tapf2700be5-db"/>
Aug 15 05:31:48 user nova-compute[73391]: </interface>
Aug 15 05:31:48 user nova-compute[73391]:  {{(pid=73391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 05:31:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:48 user nova-compute[73391]: DEBUG nova.network.neutron [req-5a9fdffb-b5f4-46ab-9fbc-74fab0c452b0 req-3cd2f7f1-c10d-42ed-bef6-95bdf945ce0f service nova] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Updated VIF entry in instance network info cache for port b6fe7cdf-66e0-40f5-a5df-b99d43175add. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:31:48 user nova-compute[73391]: DEBUG nova.network.neutron [req-5a9fdffb-b5f4-46ab-9fbc-74fab0c452b0 req-3cd2f7f1-c10d-42ed-bef6-95bdf945ce0f service nova] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Updating instance_info_cache with network_info: [{"id": "b6fe7cdf-66e0-40f5-a5df-b99d43175add", "address": "fa:16:3e:8d:8f:8c", "network": {"id": "d89ed364-c0b3-48b2-a677-2e3010aae495", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1213690697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff822a831e849e69cc772f2ff4b2c20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6fe7cdf-66", "ovs_interfaceid": "b6fe7cdf-66e0-40f5-a5df-b99d43175add", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:31:48 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-5a9fdffb-b5f4-46ab-9fbc-74fab0c452b0 req-3cd2f7f1-c10d-42ed-bef6-95bdf945ce0f service nova] Releasing lock "refresh_cache-ee96866e-7ee0-46a1-be1a-60439a52d513" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:31:48 user nova-compute[73391]: DEBUG nova.compute.manager [req-5a9fdffb-b5f4-46ab-9fbc-74fab0c452b0 req-3cd2f7f1-c10d-42ed-bef6-95bdf945ce0f service nova] [instance: df00c15a-2512-41d0-9857-edb50374897e] Received event network-changed-f2700be5-db51-43e4-bfaa-aa91b76489af {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:31:48 user nova-compute[73391]: DEBUG nova.compute.manager [req-5a9fdffb-b5f4-46ab-9fbc-74fab0c452b0 req-3cd2f7f1-c10d-42ed-bef6-95bdf945ce0f service nova] [instance: df00c15a-2512-41d0-9857-edb50374897e] Refreshing instance network info cache due to event network-changed-f2700be5-db51-43e4-bfaa-aa91b76489af. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:31:48 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-5a9fdffb-b5f4-46ab-9fbc-74fab0c452b0 req-3cd2f7f1-c10d-42ed-bef6-95bdf945ce0f service nova] Acquiring lock "refresh_cache-df00c15a-2512-41d0-9857-edb50374897e" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:31:48 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-5a9fdffb-b5f4-46ab-9fbc-74fab0c452b0 req-3cd2f7f1-c10d-42ed-bef6-95bdf945ce0f service nova] Acquired lock "refresh_cache-df00c15a-2512-41d0-9857-edb50374897e" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:31:48 user nova-compute[73391]: DEBUG nova.network.neutron [req-5a9fdffb-b5f4-46ab-9fbc-74fab0c452b0 req-3cd2f7f1-c10d-42ed-bef6-95bdf945ce0f service nova] [instance: df00c15a-2512-41d0-9857-edb50374897e] Refreshing network info cache for port f2700be5-db51-43e4-bfaa-aa91b76489af {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:31:49 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-21176e08-244c-430a-938f-39349c8fa67c tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:31:49 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-21176e08-244c-430a-938f-39349c8fa67c tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] No BDM found with device name hda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:31:49 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-21176e08-244c-430a-938f-39349c8fa67c tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] No VIF found with MAC fa:16:3e:92:27:fb, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:31:49 user nova-compute[73391]: DEBUG nova.compute.manager [req-3056b813-ba88-4185-8dc7-61d4c7f26937 req-ab2bb59f-cba3-4e16-811a-e920c0407cf8 service nova] [instance: df00c15a-2512-41d0-9857-edb50374897e] Received event network-vif-plugged-f2700be5-db51-43e4-bfaa-aa91b76489af {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:31:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-3056b813-ba88-4185-8dc7-61d4c7f26937 req-ab2bb59f-cba3-4e16-811a-e920c0407cf8 service nova] Acquiring lock "df00c15a-2512-41d0-9857-edb50374897e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:31:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-3056b813-ba88-4185-8dc7-61d4c7f26937 req-ab2bb59f-cba3-4e16-811a-e920c0407cf8 service nova] Lock "df00c15a-2512-41d0-9857-edb50374897e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:31:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-3056b813-ba88-4185-8dc7-61d4c7f26937 req-ab2bb59f-cba3-4e16-811a-e920c0407cf8 service nova] Lock "df00c15a-2512-41d0-9857-edb50374897e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:31:49 user nova-compute[73391]: DEBUG nova.compute.manager [req-3056b813-ba88-4185-8dc7-61d4c7f26937 req-ab2bb59f-cba3-4e16-811a-e920c0407cf8 service nova] [instance: df00c15a-2512-41d0-9857-edb50374897e] No waiting events found dispatching network-vif-plugged-f2700be5-db51-43e4-bfaa-aa91b76489af {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:31:49 user nova-compute[73391]: WARNING nova.compute.manager [req-3056b813-ba88-4185-8dc7-61d4c7f26937 req-ab2bb59f-cba3-4e16-811a-e920c0407cf8 service nova] [instance: df00c15a-2512-41d0-9857-edb50374897e] Received unexpected event network-vif-plugged-f2700be5-db51-43e4-bfaa-aa91b76489af for instance with vm_state active and task_state None.
Aug 15 05:31:49 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-21176e08-244c-430a-938f-39349c8fa67c tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:31:49 user nova-compute[73391]:   <nova:package version="0.0.0"/>
Aug 15 05:31:49 user nova-compute[73391]:   <nova:name>tempest-device-tagging-server-1483983120</nova:name>
Aug 15 05:31:49 user nova-compute[73391]:   <nova:creationTime>2023-08-15 05:31:49</nova:creationTime>
Aug 15 05:31:49 user nova-compute[73391]:   <nova:flavor name="m1.tiny">
Aug 15 05:31:49 user nova-compute[73391]:     <nova:memory>512</nova:memory>
Aug 15 05:31:49 user nova-compute[73391]:     <nova:disk>1</nova:disk>
Aug 15 05:31:49 user nova-compute[73391]:     <nova:swap>0</nova:swap>
Aug 15 05:31:49 user nova-compute[73391]:     <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:31:49 user nova-compute[73391]:     <nova:vcpus>1</nova:vcpus>
Aug 15 05:31:49 user nova-compute[73391]:   </nova:flavor>
Aug 15 05:31:49 user nova-compute[73391]:   <nova:owner>
Aug 15 05:31:49 user nova-compute[73391]:     <nova:user uuid="42f8f8600f9a4d81a72afbaf2bbd53a5">tempest-TaggedAttachmentsTest-1390153553-project-member</nova:user>
Aug 15 05:31:49 user nova-compute[73391]:     <nova:project uuid="1d2905fedccc4085a38a905192ba079b">tempest-TaggedAttachmentsTest-1390153553</nova:project>
Aug 15 05:31:49 user nova-compute[73391]:   </nova:owner>
Aug 15 05:31:49 user nova-compute[73391]:   <nova:root type="image" uuid="191b1dad-305e-4d1c-9b15-515ec59a3278"/>
Aug 15 05:31:49 user nova-compute[73391]:   <nova:ports>
Aug 15 05:31:49 user nova-compute[73391]:     <nova:port uuid="c065ab29-c8d1-463f-bf12-7921829c9ede">
Aug 15 05:31:49 user nova-compute[73391]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 05:31:49 user nova-compute[73391]:     </nova:port>
Aug 15 05:31:49 user nova-compute[73391]:     <nova:port uuid="f2700be5-db51-43e4-bfaa-aa91b76489af">
Aug 15 05:31:49 user nova-compute[73391]:       <nova:ip type="fixed" address="10.10.10.247" ipVersion="4"/>
Aug 15 05:31:49 user nova-compute[73391]:     </nova:port>
Aug 15 05:31:49 user nova-compute[73391]:   </nova:ports>
Aug 15 05:31:49 user nova-compute[73391]: </nova:instance>
Aug 15 05:31:49 user nova-compute[73391]:  {{(pid=73391) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 15 05:31:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-21176e08-244c-430a-938f-39349c8fa67c tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Lock "interface-df00c15a-2512-41d0-9857-edb50374897e-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 5.146s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:31:49 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:49 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:49 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:49 user nova-compute[73391]: DEBUG nova.network.neutron [req-5a9fdffb-b5f4-46ab-9fbc-74fab0c452b0 req-3cd2f7f1-c10d-42ed-bef6-95bdf945ce0f service nova] [instance: df00c15a-2512-41d0-9857-edb50374897e] Updated VIF entry in instance network info cache for port f2700be5-db51-43e4-bfaa-aa91b76489af. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:31:49 user nova-compute[73391]: DEBUG nova.network.neutron [req-5a9fdffb-b5f4-46ab-9fbc-74fab0c452b0 req-3cd2f7f1-c10d-42ed-bef6-95bdf945ce0f service nova] [instance: df00c15a-2512-41d0-9857-edb50374897e] Updating instance_info_cache with network_info: [{"id": "c065ab29-c8d1-463f-bf12-7921829c9ede", "address": "fa:16:3e:92:27:fb", "network": {"id": "6605a4f0-a8e4-4044-a7d3-36dd84d3870c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-694227201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d2905fedccc4085a38a905192ba079b", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc065ab29-c8", "ovs_interfaceid": "c065ab29-c8d1-463f-bf12-7921829c9ede", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f2700be5-db51-43e4-bfaa-aa91b76489af", "address": "fa:16:3e:ac:36:4b", "network": {"id": "a0603438-6866-4c65-af22-30fac1b66aaa", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-963064482", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1d2905fedccc4085a38a905192ba079b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2700be5-db", "ovs_interfaceid": "f2700be5-db51-43e4-bfaa-aa91b76489af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:31:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-5a9fdffb-b5f4-46ab-9fbc-74fab0c452b0 req-3cd2f7f1-c10d-42ed-bef6-95bdf945ce0f service nova] Releasing lock "refresh_cache-df00c15a-2512-41d0-9857-edb50374897e" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:31:49 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-263b7877-22e4-4438-8155-c3e7a3123033 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 05:31:49 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-263b7877-22e4-4438-8155-c3e7a3123033 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vnwNjczG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:31:49 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-263b7877-22e4-4438-8155-c3e7a3123033 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:31:49 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-263b7877-22e4-4438-8155-c3e7a3123033 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:31:49 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-263b7877-22e4-4438-8155-c3e7a3123033 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:31:49 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-263b7877-22e4-4438-8155-c3e7a3123033 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:31:49 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-263b7877-22e4-4438-8155-c3e7a3123033 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:31:49 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-263b7877-22e4-4438-8155-c3e7a3123033 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:31:49 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-263b7877-22e4-4438-8155-c3e7a3123033 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 05:31:49 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26 -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:49 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:49 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bebee252-db62-43a1-b2db-28d55f2b1314]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:49 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-263b7877-22e4-4438-8155-c3e7a3123033 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 05:31:49 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:49 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26 -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:49 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.029s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:49 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0175f072-d977-464f-8b9b-79a73cbf0c75]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:49 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-263b7877-22e4-4438-8155-c3e7a3123033 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26] added
Aug 15 05:31:49 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:49 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:49 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:49 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d67fd8e-2f57-4b8b-a00b-7ff884b66ea7]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:49 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-263b7877-22e4-4438-8155-c3e7a3123033 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:49 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:49 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:49 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb89bdc4-613e-4ba3-a697-02a83583a444]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:49 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-263b7877-22e4-4438-8155-c3e7a3123033 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:49 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vnwNjczG {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:49 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vnwNjczG" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:49 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f41646-90e3-4ed6-bbcb-6300c74316a7]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:49 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-263b7877-22e4-4438-8155-c3e7a3123033 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vnwNjczG'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:49 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:49 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:49 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[96fe1fe0-1471-4ad9-a167-458217d91648]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:49 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-263b7877-22e4-4438-8155-c3e7a3123033 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:49 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:50 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:50 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc07cd3-ff92-475b-8c12-887012dc376b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:50 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-263b7877-22e4-4438-8155-c3e7a3123033 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:31:50 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:31:50 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:31:50 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:31:50 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-263b7877-22e4-4438-8155-c3e7a3123033 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:31:50 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:31:50 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:31:50 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:31:50 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26 -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:50 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-50abbc6c-79d3-47ee-b9e3-e2e5344e5787 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Acquiring lock "df00c15a-2512-41d0-9857-edb50374897e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:31:50 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-50abbc6c-79d3-47ee-b9e3-e2e5344e5787 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Lock "df00c15a-2512-41d0-9857-edb50374897e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:31:50 user nova-compute[73391]: DEBUG nova.objects.instance [None req-50abbc6c-79d3-47ee-b9e3-e2e5344e5787 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Lazy-loading 'flavor' on Instance uuid df00c15a-2512-41d0-9857-edb50374897e {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:31:50 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:50 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[138531de-b1b3-4f49-9ece-0d27718e4f1d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:50 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-263b7877-22e4-4438-8155-c3e7a3123033 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26, portal: 172.16.0.220,3260]
Aug 15 05:31:50 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26, portal: 172.16.0.220,3260] successful.
Aug 15 05:31:50 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:50 user nova-compute[73391]: DEBUG os_brick.utils [None req-e77ca1fe-67c6-4c14-97e3-952a122e5023 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:31:50 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:50 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:50 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:50 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb91a1a-177e-4cd7-aafd-5c538fd71a84]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:50 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:50 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8a0d4a-d42f-4e1d-9e4f-5350874a24c7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:50 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-263b7877-22e4-4438-8155-c3e7a3123033 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:50 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:50 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:50 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-50abbc6c-79d3-47ee-b9e3-e2e5344e5787 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Lock "df00c15a-2512-41d0-9857-edb50374897e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:31:50 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:50 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd79c342-4f2b-4a99-bd6a-9f233533f239]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:50 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:50 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:50 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e159a39b-0347-4a86-8b15-9a051e289ad3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:50 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-263b7877-22e4-4438-8155-c3e7a3123033 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:31:50 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:31:50 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:31:50 user nova-compute[73391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26 (non-flash)
Aug 15 05:31:50 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:31:50 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-263b7877-22e4-4438-8155-c3e7a3123033 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:31:50 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:31:50 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:31:50 user nova-compute[73391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26 (non-flash)
Aug 15 05:31:50 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:31:50 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-263b7877-22e4-4438-8155-c3e7a3123033 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:31:50 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-263b7877-22e4-4438-8155-c3e7a3123033 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 05:31:50 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-263b7877-22e4-4438-8155-c3e7a3123033 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 05:31:50 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-263b7877-22e4-4438-8155-c3e7a3123033 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 05:31:50 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:50 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:50 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[59350380-cd75-4478-b1c0-6192d5c47951]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:50 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49891f3-195a-465c-8321-e4fd9121f127]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:50 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-e77ca1fe-67c6-4c14-97e3-952a122e5023 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:50 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-e77ca1fe-67c6-4c14-97e3-952a122e5023 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:31:50 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.024s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:50 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5805d128-6708-47ce-87a8-a4f055f17ef0]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:50 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e77ca1fe-67c6-4c14-97e3-952a122e5023 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 05:31:50 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-263b7877-22e4-4438-8155-c3e7a3123033 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:31:50 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-263b7877-22e4-4438-8155-c3e7a3123033 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vnwNjczG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 05:31:50 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:50 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:31:50 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 05:31:50 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[94598f02-ba4d-465c-865f-567d495cebc0]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:50 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-e77ca1fe-67c6-4c14-97e3-952a122e5023 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 05:31:50 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-e77ca1fe-67c6-4c14-97e3-952a122e5023 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 05:31:50 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-e77ca1fe-67c6-4c14-97e3-952a122e5023 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 05:31:50 user nova-compute[73391]: DEBUG os_brick.utils [None req-e77ca1fe-67c6-4c14-97e3-952a122e5023 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:31:50 user nova-compute[73391]: DEBUG nova.virt.block_device [None req-e77ca1fe-67c6-4c14-97e3-952a122e5023 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Updating existing volume attachment record: 1ae20ca4-99da-4e06-bac8-1c91f4515259 {{(pid=73391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 05:31:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-263b7877-22e4-4438-8155-c3e7a3123033 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:31:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-263b7877-22e4-4438-8155-c3e7a3123033 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] <== connect_volume: return (1385ms) {'type': 'block', 'scsi_wwn': '23734336561386363', 'path': '/dev/sde'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:31:51 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-263b7877-22e4-4438-8155-c3e7a3123033 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23734336561386363', 'path': '/dev/sde'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 05:31:51 user nova-compute[73391]: DEBUG nova.objects.instance [None req-263b7877-22e4-4438-8155-c3e7a3123033 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Lazy-loading 'flavor' on Instance uuid 4b9f5970-65c5-4eff-a4bf-d18a9c916c90 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:31:51 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-263b7877-22e4-4438-8155-c3e7a3123033 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 05:31:51 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:31:51 user nova-compute[73391]:   <source dev="/dev/sde"/>
Aug 15 05:31:51 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:31:51 user nova-compute[73391]:   <serial>7c0f5093-cc00-451f-bf62-335df5a87a26</serial>
Aug 15 05:31:51 user nova-compute[73391]: </disk>
Aug 15 05:31:51 user nova-compute[73391]:  {{(pid=73391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 05:31:51 user nova-compute[73391]: DEBUG nova.compute.manager [req-45907331-30b9-4532-a482-a5ea59333b7b req-6942f9ed-ca82-477a-b8b2-478dfcf5f655 service nova] [instance: df00c15a-2512-41d0-9857-edb50374897e] Received event network-vif-plugged-f2700be5-db51-43e4-bfaa-aa91b76489af {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:31:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-45907331-30b9-4532-a482-a5ea59333b7b req-6942f9ed-ca82-477a-b8b2-478dfcf5f655 service nova] Acquiring lock "df00c15a-2512-41d0-9857-edb50374897e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:31:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-45907331-30b9-4532-a482-a5ea59333b7b req-6942f9ed-ca82-477a-b8b2-478dfcf5f655 service nova] Lock "df00c15a-2512-41d0-9857-edb50374897e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:31:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-45907331-30b9-4532-a482-a5ea59333b7b req-6942f9ed-ca82-477a-b8b2-478dfcf5f655 service nova] Lock "df00c15a-2512-41d0-9857-edb50374897e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:31:51 user nova-compute[73391]: DEBUG nova.compute.manager [req-45907331-30b9-4532-a482-a5ea59333b7b req-6942f9ed-ca82-477a-b8b2-478dfcf5f655 service nova] [instance: df00c15a-2512-41d0-9857-edb50374897e] No waiting events found dispatching network-vif-plugged-f2700be5-db51-43e4-bfaa-aa91b76489af {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:31:51 user nova-compute[73391]: WARNING nova.compute.manager [req-45907331-30b9-4532-a482-a5ea59333b7b req-6942f9ed-ca82-477a-b8b2-478dfcf5f655 service nova] [instance: df00c15a-2512-41d0-9857-edb50374897e] Received unexpected event network-vif-plugged-f2700be5-db51-43e4-bfaa-aa91b76489af for instance with vm_state active and task_state None.
Aug 15 05:31:51 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-263b7877-22e4-4438-8155-c3e7a3123033 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:31:51 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-263b7877-22e4-4438-8155-c3e7a3123033 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:31:51 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-263b7877-22e4-4438-8155-c3e7a3123033 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] No VIF found with MAC fa:16:3e:11:2e:cb, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:31:53 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:53 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-882c0ff1-a747-4c70-917d-6f8cebc35d20 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-882c0ff1-a747-4c70-917d-6f8cebc35d20 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XYflAmQI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:31:57 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-882c0ff1-a747-4c70-917d-6f8cebc35d20 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:31:57 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-882c0ff1-a747-4c70-917d-6f8cebc35d20 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-882c0ff1-a747-4c70-917d-6f8cebc35d20 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:31:57 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-882c0ff1-a747-4c70-917d-6f8cebc35d20 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:31:57 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-882c0ff1-a747-4c70-917d-6f8cebc35d20 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-882c0ff1-a747-4c70-917d-6f8cebc35d20 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:31:57 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-882c0ff1-a747-4c70-917d-6f8cebc35d20 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 05:31:57 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3e0aba-75da-4305-9b3b-18066e030ab6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-882c0ff1-a747-4c70-917d-6f8cebc35d20 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 05:31:57 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b49a35-de38-4070-a340-0b0e73bbf4e5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-882c0ff1-a747-4c70-917d-6f8cebc35d20 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a] added
Aug 15 05:31:57 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f13e9a-ae2c-4a5f-96c7-8949c92e64a8]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-882c0ff1-a747-4c70-917d-6f8cebc35d20 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c66d69f-574f-4945-8045-83ff7094fe5c]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-882c0ff1-a747-4c70-917d-6f8cebc35d20 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XYflAmQI {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-50abbc6c-79d3-47ee-b9e3-e2e5344e5787 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Acquiring lock "df00c15a-2512-41d0-9857-edb50374897e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-50abbc6c-79d3-47ee-b9e3-e2e5344e5787 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Lock "df00c15a-2512-41d0-9857-edb50374897e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:31:57 user nova-compute[73391]: INFO nova.compute.manager [None req-50abbc6c-79d3-47ee-b9e3-e2e5344e5787 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] [instance: df00c15a-2512-41d0-9857-edb50374897e] Attaching volume 10c42aea-dda6-436d-9698-7fde946ef419 to /dev/vdb
Aug 15 05:31:57 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XYflAmQI" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c37df08-c644-40a1-a62b-53fabdc81a70]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-882c0ff1-a747-4c70-917d-6f8cebc35d20 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XYflAmQI'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[996132d3-c8f9-4015-b49c-16a2b8f96cfe]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-882c0ff1-a747-4c70-917d-6f8cebc35d20 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[23852d55-3f8b-4d2d-91d3-622e3e90c6ba]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-882c0ff1-a747-4c70-917d-6f8cebc35d20 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:31:57 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:31:57 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:31:57 user nova-compute[73391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26 (non-flash)
Aug 15 05:31:57 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-882c0ff1-a747-4c70-917d-6f8cebc35d20 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:31:57 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:31:57 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:31:57 user nova-compute[73391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26 (non-flash)
Aug 15 05:31:57 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced7296f-cb9e-4edf-b1fd-b2867c87a95a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-882c0ff1-a747-4c70-917d-6f8cebc35d20 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a, portal: 172.16.0.220,3260]
Aug 15 05:31:57 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a, portal: 172.16.0.220,3260] successful.
Aug 15 05:31:57 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ea6e7a-3131-4be9-805a-2cef7b963c3b]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-882c0ff1-a747-4c70-917d-6f8cebc35d20 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b43c2c-16bc-43dc-8a64-6252ccf95c84]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-882c0ff1-a747-4c70-917d-6f8cebc35d20 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:31:57 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:31:57 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:31:57 user nova-compute[73391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26 (non-flash)
Aug 15 05:31:57 user nova-compute[73391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)
Aug 15 05:31:57 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-882c0ff1-a747-4c70-917d-6f8cebc35d20 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:31:57 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:31:57 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:31:57 user nova-compute[73391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26 (non-flash)
Aug 15 05:31:57 user nova-compute[73391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)
Aug 15 05:31:57 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-882c0ff1-a747-4c70-917d-6f8cebc35d20 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-882c0ff1-a747-4c70-917d-6f8cebc35d20 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-882c0ff1-a747-4c70-917d-6f8cebc35d20 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] HCTL ('37', '-', '-', 0) found on session 7 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-882c0ff1-a747-4c70-917d-6f8cebc35d20 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f41953-8c8e-45a1-90b2-2272ff79301a]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-882c0ff1-a747-4c70-917d-6f8cebc35d20 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Searching for a device in session 7 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-882c0ff1-a747-4c70-917d-6f8cebc35d20 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XYflAmQI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-263b7877-22e4-4438-8155-c3e7a3123033 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Lock "4b9f5970-65c5-4eff-a4bf-d18a9c916c90" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.828s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG os_brick.utils [None req-50abbc6c-79d3-47ee-b9e3-e2e5344e5787 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[80bdfa13-9f88-4c60-bbea-f59d1a532381]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[16669890-7c98-4706-9c8c-8e246b66245f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de8c8d6-d83e-499a-a01e-4f5121eb18d9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f08209-34b3-4f32-b002-70c6fc134274]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-50abbc6c-79d3-47ee-b9e3-e2e5344e5787 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-50abbc6c-79d3-47ee-b9e3-e2e5344e5787 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-50abbc6c-79d3-47ee-b9e3-e2e5344e5787 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:31:57 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 05:31:57 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9caecaa-e065-4989-a632-0606ce32ad11]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-50abbc6c-79d3-47ee-b9e3-e2e5344e5787 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-50abbc6c-79d3-47ee-b9e3-e2e5344e5787 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-50abbc6c-79d3-47ee-b9e3-e2e5344e5787 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG os_brick.utils [None req-50abbc6c-79d3-47ee-b9e3-e2e5344e5787 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:31:57 user nova-compute[73391]: DEBUG nova.virt.block_device [None req-50abbc6c-79d3-47ee-b9e3-e2e5344e5787 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] [instance: df00c15a-2512-41d0-9857-edb50374897e] Updating existing volume attachment record: 0f898e1d-12ee-4a0f-bc37-08e6689cad5a {{(pid=73391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 05:31:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-882c0ff1-a747-4c70-917d-6f8cebc35d20 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:31:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-882c0ff1-a747-4c70-917d-6f8cebc35d20 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23534633138326161', 'path': '/dev/sdf'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:31:58 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-882c0ff1-a747-4c70-917d-6f8cebc35d20 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23534633138326161', 'path': '/dev/sdf'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 05:31:58 user nova-compute[73391]: DEBUG nova.objects.instance [None req-882c0ff1-a747-4c70-917d-6f8cebc35d20 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Lazy-loading 'flavor' on Instance uuid 0169df15-335e-46e6-a5c8-9deb7095bb84 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:31:58 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-882c0ff1-a747-4c70-917d-6f8cebc35d20 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 05:31:58 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:31:58 user nova-compute[73391]:   <source dev="/dev/sdf"/>
Aug 15 05:31:58 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:31:58 user nova-compute[73391]:   <serial>fb592ee0-ed3e-427a-8cc4-05091385a40a</serial>
Aug 15 05:31:58 user nova-compute[73391]: </disk>
Aug 15 05:31:58 user nova-compute[73391]:  {{(pid=73391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 05:31:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-882c0ff1-a747-4c70-917d-6f8cebc35d20 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-882c0ff1-a747-4c70-917d-6f8cebc35d20 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-882c0ff1-a747-4c70-917d-6f8cebc35d20 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] No VIF found with MAC fa:16:3e:09:d0:87, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG nova.compute.manager [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Start spawning the instance on the hypervisor. {{(pid=73391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Creating instance directory {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 05:31:59 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Creating image(s)
Aug 15 05:31:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Did not create local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Ensure instance console log exists: /opt/stack/data/nova/instances/96c5782e-9d00-4bb8-8e1d-99416bc7d556/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Start _get_guest_xml network_info=[{"id": "37e2378e-5659-401c-95ce-0424b61e2e1a", "address": "fa:16:3e:7b:4f:9c", "network": {"id": "1fb1af76-f96a-4640-a09d-1bdb13e93bd6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-505156524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e2378e-56", "ovs_interfaceid": "37e2378e-5659-401c-95ce-0424b61e2e1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23d27a9f-a59d-4369-a8c2-0f09564bb78d", "address": "fa:16:3e:4a:c7:00", "network": {"id": "38d7d183-2f35-4f50-bd69-614eaf1952ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-82531103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23d27a9f-a5", "ovs_interfaceid": "23d27a9f-a59d-4369-a8c2-0f09564bb78d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "879124a9-46cd-45bb-b1a2-34cc8264cf25", "address": "fa:16:3e:4a:68:3f", "network": {"id": "38d7d183-2f35-4f50-bd69-614eaf1952ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-82531103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap879124a9-46", "ovs_interfaceid": "879124a9-46cd-45bb-b1a2-34cc8264cf25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a09443ce-b3e9-4fe7-b24a-b1c609cb2553", "address": "fa:16:3e:6a:6d:c5", "network": {"id": "38d7d183-2f35-4f50-bd69-614eaf1952ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-82531103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa09443ce-b3", "ovs_interfaceid": "a09443ce-b3e9-4fe7-b24a-b1c609cb2553", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7adbd6a6-9a65-4e61-9ff2-63351d5dfaad", "address": "fa:16:3e:b7:e9:02", "network": {"id": "38d7d183-2f35-4f50-bd69-614eaf1952ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-82531103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7adbd6a6-9a", "ovs_interfaceid": "7adbd6a6-9a65-4e61-9ff2-63351d5dfaad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ae52a22f-e13e-4da6-9561-ba679ac242b1", "address": "fa:16:3e:df:63:15", "network": {"id": "0376a3e8-17aa-47e4-afdb-fb7ba9174147", "bridge": "br-int", "label": "tempest-device-tagging-net2-1320047162", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae52a22f-e1", "ovs_interfaceid": "ae52a22f-e13e-4da6-9561-ba679ac242b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "33d14fed-6340-407f-bdf1-c858e9cf395c", "address": "fa:16:3e:f1:52:78", "network": {"id": "0376a3e8-17aa-47e4-afdb-fb7ba9174147", "bridge": "br-int", "label": "tempest-device-tagging-net2-1320047162", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33d14fed-63", "ovs_interfaceid": "33d14fed-6340-407f-bdf1-c858e9cf395c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BMuDhPfR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '96c5782e-9d00-4bb8-8e1d-99416bc7d556', 'attached_at': '', 'detached_at': '', 'volume_id': '326d5b7a-2a67-4d44-a918-a390fd8d5bb1', 'serial': '326d5b7a-2a67-4d44-a918-a390fd8d5bb1'}, 'attachment_id': 'c324fdb5-7ff6-4dc3-87f5-d71647bc5888', 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'volume_type': None}, {'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'awBbNDlJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '96c5782e-9d00-4bb8-8e1d-99416bc7d556', 'attached_at': '', 'detached_at': '', 'volume_id': '162fea74-b991-40c2-acce-b2c6fcd5c2f1', 'serial': '162fea74-b991-40c2-acce-b2c6fcd5c2f1'}, 'attachment_id': '7ce01946-dc0f-42d9-9bcf-f65b18305a4e', 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 1, 'guest_format': None, 'delete_on_termination': False, 'volume_type': None}, {'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wydCbFrj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '96c5782e-9d00-4bb8-8e1d-99416bc7d556', 'attached_at': '', 'detached_at': '', 'volume_id': '644f40f9-9fcf-4fa6-908e-d1c315ad9518', 'serial': '644f40f9-9fcf-4fa6-908e-d1c315ad9518'}, 'attachment_id': '94855c9a-0f21-432e-aea3-c18fc66c74a4', 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 2, 'guest_format': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:31:59 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:31:59 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:31:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BMuDhPfR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:31:59 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:31:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:31:59 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:31:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:31:59 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 05:31:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-882c0ff1-a747-4c70-917d-6f8cebc35d20 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Lock "0169df15-335e-46e6-a5c8-9deb7095bb84" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.591s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f5c84a-90cf-4f09-89e3-97f5b8ef9074]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 05:31:59 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[238e454f-523c-467f-a482-74a27fd2ba59]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1] added
Aug 15 05:31:59 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7412a15d-50dc-49df-8081-6a30abe64e0d]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[581c2e3f-38f9-4112-a1fe-b43a8655f5f9]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BMuDhPfR {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BMuDhPfR" returned: 0 in 0.026s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e9903b5-53c3-46f2-a82a-0fc25990efee]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BMuDhPfR'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c069c8b-84df-4eef-8691-6a4ac79903ea]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5153ba33-5ffe-4f07-835c-9afed094ed87]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:31:59 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:31:59 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:31:59 user nova-compute[73391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26 (non-flash)
Aug 15 05:31:59 user nova-compute[73391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)
Aug 15 05:31:59 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:31:59 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:31:59 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:31:59 user nova-compute[73391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26 (non-flash)
Aug 15 05:31:59 user nova-compute[73391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)
Aug 15 05:31:59 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a700db34-7d86-417c-9cb0-a57154c69a6c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1, portal: 172.16.0.220,3260]
Aug 15 05:31:59 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1, portal: 172.16.0.220,3260] successful.
Aug 15 05:31:59 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[405b74eb-609e-4cdc-a0d5-555147010b2c]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[69f41440-0103-4f38-982f-2a1bb549f293]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:31:59 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:31:59 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:31:59 user nova-compute[73391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26 (non-flash)
Aug 15 05:31:59 user nova-compute[73391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)
Aug 15 05:31:59 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:31:59 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:31:59 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:31:59 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:31:59 user nova-compute[73391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26 (non-flash)
Aug 15 05:31:59 user nova-compute[73391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)
Aug 15 05:31:59 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:31:59 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ebba2c9-00ee-46cb-8011-1f822b07a91d]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BMuDhPfR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8340b21a-f39a-4696-88c7-638bd58c1553 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Acquiring lock "4b9f5970-65c5-4eff-a4bf-d18a9c916c90" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8340b21a-f39a-4696-88c7-638bd58c1553 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Lock "4b9f5970-65c5-4eff-a4bf-d18a9c916c90" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:31:59 user nova-compute[73391]: INFO nova.compute.manager [None req-8340b21a-f39a-4696-88c7-638bd58c1553 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Detaching volume 7c0f5093-cc00-451f-bf62-335df5a87a26
Aug 15 05:31:59 user nova-compute[73391]: INFO nova.virt.block_device [None req-8340b21a-f39a-4696-88c7-638bd58c1553 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Attempting to driver detach volume 7c0f5093-cc00-451f-bf62-335df5a87a26 from mountpoint /dev/vdb
Aug 15 05:31:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-8340b21a-f39a-4696-88c7-638bd58c1553 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Attempting to detach device vdb from instance 4b9f5970-65c5-4eff-a4bf-d18a9c916c90 from the persistent domain config. {{(pid=73391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-8340b21a-f39a-4696-88c7-638bd58c1553 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 05:31:59 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:31:59 user nova-compute[73391]:   <source dev="/dev/sde"/>
Aug 15 05:31:59 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:31:59 user nova-compute[73391]:   <serial>7c0f5093-cc00-451f-bf62-335df5a87a26</serial>
Aug 15 05:31:59 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 05:31:59 user nova-compute[73391]: </disk>
Aug 15 05:31:59 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 05:31:59 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-8340b21a-f39a-4696-88c7-638bd58c1553 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Successfully detached device vdb from instance 4b9f5970-65c5-4eff-a4bf-d18a9c916c90 from the persistent domain config.
Aug 15 05:31:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-8340b21a-f39a-4696-88c7-638bd58c1553 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4b9f5970-65c5-4eff-a4bf-d18a9c916c90 from the live domain config. {{(pid=73391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 05:31:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-8340b21a-f39a-4696-88c7-638bd58c1553 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 05:31:59 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:31:59 user nova-compute[73391]:   <source dev="/dev/sde"/>
Aug 15 05:31:59 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:31:59 user nova-compute[73391]:   <serial>7c0f5093-cc00-451f-bf62-335df5a87a26</serial>
Aug 15 05:31:59 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 05:31:59 user nova-compute[73391]: </disk>
Aug 15 05:31:59 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Received event <DeviceRemovedEvent: 1692077520.4954336, 4b9f5970-65c5-4eff-a4bf-d18a9c916c90 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73391) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-8340b21a-f39a-4696-88c7-638bd58c1553 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4b9f5970-65c5-4eff-a4bf-d18a9c916c90 {{(pid=73391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 05:32:00 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-8340b21a-f39a-4696-88c7-638bd58c1553 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Successfully detached device vdb from instance 4b9f5970-65c5-4eff-a4bf-d18a9c916c90 from the live domain config.
Aug 15 05:32:00 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8340b21a-f39a-4696-88c7-638bd58c1553 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8340b21a-f39a-4696-88c7-638bd58c1553 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vnwNjczG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:32:00 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-8340b21a-f39a-4696-88c7-638bd58c1553 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:32:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-8340b21a-f39a-4696-88c7-638bd58c1553 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] <== connect_volume: return (1384ms) {'type': 'block', 'scsi_wwn': '26239616465663636', 'path': '/dev/sdg'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26239616465663636', 'path': '/dev/sdg'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-8340b21a-f39a-4696-88c7-638bd58c1553 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.099s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8340b21a-f39a-4696-88c7-638bd58c1553 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e77ca1fe-67c6-4c14-97e3-952a122e5023 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e77ca1fe-67c6-4c14-97e3-952a122e5023 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mHYsiaTX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:32:00 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-e77ca1fe-67c6-4c14-97e3-952a122e5023 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:32:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-e77ca1fe-67c6-4c14-97e3-952a122e5023 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86ee20f-f82d-4088-8d02-e6098ad19b8e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'awBbNDlJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:32:00 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:32:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] Acquiring lock "0169df15-335e-46e6-a5c8-9deb7095bb84" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] Lock "0169df15-335e-46e6-a5c8-9deb7095bb84" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG os_brick.utils [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d590aee-fe7a-490d-bd9c-d37520516821]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8340b21a-f39a-4696-88c7-638bd58c1553 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:32:00 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:32:00 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:32:00 user nova-compute[73391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26 (non-flash)
Aug 15 05:32:00 user nova-compute[73391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)
Aug 15 05:32:00 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:32:00 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8340b21a-f39a-4696-88c7-638bd58c1553 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:32:00 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:32:00 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:32:00 user nova-compute[73391]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26 (non-flash)
Aug 15 05:32:00 user nova-compute[73391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)
Aug 15 05:32:00 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:32:00 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8340b21a-f39a-4696-88c7-638bd58c1553 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7755907880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26'): ({'sde'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-8340b21a-f39a-4696-88c7-638bd58c1553 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Removing single pathed devices sde {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7dc7f7c-e3cd-4ece-af21-e5104324c207]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1580ceb7-da28-4164-aced-b0afd854a083]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[458f6c32-efd3-4cdc-a932-bfa95b79dc3e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b297908f-e70e-4441-b4e8-422c387611d2]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-8340b21a-f39a-4696-88c7-638bd58c1553 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Flushing IO for device /dev/sde {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[750dc9bf-6f4e-4212-9292-ca1d72b2e57d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[92159699-1974-480a-ae70-d33b8ca9f65b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d5af7d-1d81-414f-9c73-d63c3fef20df]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-8340b21a-f39a-4696-88c7-638bd58c1553 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:32:00 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 05:32:00 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db398ae-7ec9-4767-997c-34eabe3ae256]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG os_brick.utils [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.052s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2ad972-5c76-474b-818c-76d85f9bab89]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-8340b21a-f39a-4696-88c7-638bd58c1553 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-8340b21a-f39a-4696-88c7-638bd58c1553 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] SCSI volumes sde have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8340b21a-f39a-4696-88c7-638bd58c1553 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[10766667-eb9c-482d-9bc6-2680cae1346f]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8340b21a-f39a-4696-88c7-638bd58c1553 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26 -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:00 user nova-compute[73391]: INFO nova.compute.manager [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Swapping volume fb592ee0-ed3e-427a-8cc4-05091385a40a for 4003a351-ce41-40db-8e1f-95bd0985e3e9
Aug 15 05:32:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[887959d3-59f9-4e1b-b10b-469034733b34]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8340b21a-f39a-4696-88c7-638bd58c1553 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26, portal: 172.16.0.220,3260]
Aug 15 05:32:00 user nova-compute[73391]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26, portal: 172.16.0.220,3260] successful.
Aug 15 05:32:00 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26 -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7c0f5093-cc00-451f-bf62-335df5a87a26 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3a07d3-6303-4cd7-a17f-1c884aef96de]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8340b21a-f39a-4696-88c7-638bd58c1553 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-8340b21a-f39a-4696-88c7-638bd58c1553 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.383s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8340b21a-f39a-4696-88c7-638bd58c1553 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] <== disconnect_volume: return (483ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8340b21a-f39a-4696-88c7-638bd58c1553 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 05:32:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-e77ca1fe-67c6-4c14-97e3-952a122e5023 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.380s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:32:01 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-e77ca1fe-67c6-4c14-97e3-952a122e5023 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:32:01 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-e77ca1fe-67c6-4c14-97e3-952a122e5023 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:32:01 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-e77ca1fe-67c6-4c14-97e3-952a122e5023 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:32:01 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-e77ca1fe-67c6-4c14-97e3-952a122e5023 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 05:32:01 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1 -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:01 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:01 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b0abd1-2674-4a3e-8b62-13fb7dcb02d2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:01 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e77ca1fe-67c6-4c14-97e3-952a122e5023 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 05:32:01 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:01 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:01 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:01 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19bf342-af7d-459f-b033-91f1cbe002f3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:01 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e77ca1fe-67c6-4c14-97e3-952a122e5023 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1] added
Aug 15 05:32:01 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:01 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:01 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:01 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a732eb7-53aa-4254-bc73-248dd8bb5311]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:01 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e77ca1fe-67c6-4c14-97e3-952a122e5023 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:01 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:01 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:01 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca15019-24f5-4f81-8eda-45696bc9117c]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:01 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e77ca1fe-67c6-4c14-97e3-952a122e5023 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:01 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mHYsiaTX {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:01 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mHYsiaTX" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:01 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[87263562-74cc-4946-8e6e-a3102b5375bf]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:01 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e77ca1fe-67c6-4c14-97e3-952a122e5023 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mHYsiaTX'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:01 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:01 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:01 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f5f8f7-8109-475c-b5ab-a9f686bbe006]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:01 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e77ca1fe-67c6-4c14-97e3-952a122e5023 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:01 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:01 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:01 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7063884-f413-4a4b-8fce-80cb4f30ec79]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:01 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e77ca1fe-67c6-4c14-97e3-952a122e5023 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:32:01 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:32:01 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:32:01 user nova-compute[73391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)
Aug 15 05:32:01 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:32:01 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:32:01 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e77ca1fe-67c6-4c14-97e3-952a122e5023 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:32:01 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:32:01 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:32:01 user nova-compute[73391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)
Aug 15 05:32:01 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:32:01 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:32:01 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1 -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:01 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:01 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9883ee-c25e-4acc-9c7e-74a31c7a25f2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:01 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e77ca1fe-67c6-4c14-97e3-952a122e5023 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1, portal: 172.16.0.220,3260]
Aug 15 05:32:01 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1, portal: 172.16.0.220,3260] successful.
Aug 15 05:32:01 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:01 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:01 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:01 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[843d6de0-dece-44ab-84b7-b40f8ffa29cb]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:01 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e77ca1fe-67c6-4c14-97e3-952a122e5023 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:01 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:01 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:01 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[aebb1fbe-41f7-4237-9d02-dc16e5a70b0e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:01 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e77ca1fe-67c6-4c14-97e3-952a122e5023 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:32:01 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:32:01 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:32:01 user nova-compute[73391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)
Aug 15 05:32:01 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:32:01 user nova-compute[73391]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1 (non-flash)
Aug 15 05:32:01 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:32:01 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e77ca1fe-67c6-4c14-97e3-952a122e5023 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:32:01 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:32:01 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:32:01 user nova-compute[73391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)
Aug 15 05:32:01 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:32:01 user nova-compute[73391]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1 (non-flash)
Aug 15 05:32:01 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:32:01 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-e77ca1fe-67c6-4c14-97e3-952a122e5023 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:32:01 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e77ca1fe-67c6-4c14-97e3-952a122e5023 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 05:32:01 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-e77ca1fe-67c6-4c14-97e3-952a122e5023 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] HCTL ('36', '-', '-', 0) found on session 9 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 05:32:01 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-e77ca1fe-67c6-4c14-97e3-952a122e5023 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 05:32:01 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:01 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:01 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8183bc3d-4436-48a1-91bb-1d0b1398dd83]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:01 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-e77ca1fe-67c6-4c14-97e3-952a122e5023 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] Searching for a device in session 9 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:32:01 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e77ca1fe-67c6-4c14-97e3-952a122e5023 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mHYsiaTX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 05:32:01 user nova-compute[73391]: DEBUG nova.objects.instance [None req-8340b21a-f39a-4696-88c7-638bd58c1553 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Lazy-loading 'flavor' on Instance uuid 4b9f5970-65c5-4eff-a4bf-d18a9c916c90 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:32:01 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8340b21a-f39a-4696-88c7-638bd58c1553 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Lock "4b9f5970-65c5-4eff-a4bf-d18a9c916c90" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.096s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-e77ca1fe-67c6-4c14-97e3-952a122e5023 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.352s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e77ca1fe-67c6-4c14-97e3-952a122e5023 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] <== connect_volume: return (1732ms) {'type': 'block', 'scsi_wwn': '26539383333643864', 'path': '/dev/sde'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e77ca1fe-67c6-4c14-97e3-952a122e5023 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26539383333643864', 'path': '/dev/sde'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.701s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:32:02 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:32:02 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:32:02 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 05:32:02 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG nova.objects.instance [None req-e77ca1fe-67c6-4c14-97e3-952a122e5023 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] Lazy-loading 'flavor' on Instance uuid ee96866e-7ee0-46a1-be1a-60439a52d513 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc1e359-9bdd-4f1a-97a1-4d1091663b1a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 05:32:02 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[01babaaa-b1b9-41f7-8843-0a861e141f56]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1] added
Aug 15 05:32:02 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-e77ca1fe-67c6-4c14-97e3-952a122e5023 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] attach device xml: <disk type="block" device="disk">
Aug 15 05:32:02 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:32:02 user nova-compute[73391]:   <source dev="/dev/sde"/>
Aug 15 05:32:02 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:32:02 user nova-compute[73391]:   <serial>84e2f66b-ecf5-4e00-a17a-6fc6c67929e1</serial>
Aug 15 05:32:02 user nova-compute[73391]: </disk>
Aug 15 05:32:02 user nova-compute[73391]:  {{(pid=73391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[132a0aaf-e247-4109-8d27-2caecb719385]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[edaa4951-e8ff-40a2-ae31-3240ffa8a279]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v awBbNDlJ {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v awBbNDlJ" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2acd36b-2e1f-49e7-bd40-3969806dba6b]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'awBbNDlJ'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4f23f2-4ad4-4342-876a-6aad14ad2a13]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[19759632-b1cd-4e78-9768-83b7a3728fb7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:32:02 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:32:02 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:32:02 user nova-compute[73391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)
Aug 15 05:32:02 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:32:02 user nova-compute[73391]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1 (non-flash)
Aug 15 05:32:02 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:32:02 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:32:02 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:32:02 user nova-compute[73391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)
Aug 15 05:32:02 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:32:02 user nova-compute[73391]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1 (non-flash)
Aug 15 05:32:02 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1770230f-21ac-44fe-b8ad-ee6f57017306]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1, portal: 172.16.0.220,3260]
Aug 15 05:32:02 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1, portal: 172.16.0.220,3260] successful.
Aug 15 05:32:02 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae10bcb9-28d6-4a03-81cc-d9a68f8d8d4d]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b540b272-6818-4b18-a7c1-8f78226ee7fa]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)
Aug 15 05:32:02 user nova-compute[73391]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:32:02 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:32:02 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:32:02 user nova-compute[73391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)
Aug 15 05:32:02 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:32:02 user nova-compute[73391]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1 (non-flash)
Aug 15 05:32:02 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)
Aug 15 05:32:02 user nova-compute[73391]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:32:02 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:32:02 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:32:02 user nova-compute[73391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)
Aug 15 05:32:02 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:32:02 user nova-compute[73391]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1 (non-flash)
Aug 15 05:32:02 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] HCTL ('39', '-', '-', 0) found on session 10 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2803f1-917e-495d-9621-d16a953b0b6f]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Searching for a device in session 10 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Connected to sdh using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'awBbNDlJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e77ca1fe-67c6-4c14-97e3-952a122e5023 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e77ca1fe-67c6-4c14-97e3-952a122e5023 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:32:02 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e77ca1fe-67c6-4c14-97e3-952a122e5023 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] No VIF found with MAC fa:16:3e:8d:8f:8c, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:32:03 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e77ca1fe-67c6-4c14-97e3-952a122e5023 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] Lock "ee96866e-7ee0-46a1-be1a-60439a52d513" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.065s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:03 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-30f09214-94b6-43a6-835c-16e40c7dea43 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] volume_snapshot_create: create_info: {'snapshot_id': '89238db4-e278-4d27-a4c3-2adef4621d24', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=73391) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3566}}
Aug 15 05:32:03 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-30f09214-94b6-43a6-835c-16e40c7dea43 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] snap xml: <domainsnapshot>
Aug 15 05:32:03 user nova-compute[73391]:   <disks>
Aug 15 05:32:03 user nova-compute[73391]:     <disk name="/dev/sde" snapshot="external" type="file">
Aug 15 05:32:03 user nova-compute[73391]:       <source file="/dev/new_file"/>
Aug 15 05:32:03 user nova-compute[73391]:     </disk>
Aug 15 05:32:03 user nova-compute[73391]:     <disk name="vda" snapshot="no"/>
Aug 15 05:32:03 user nova-compute[73391]:   </disks>
Aug 15 05:32:03 user nova-compute[73391]: </domainsnapshot>
Aug 15 05:32:03 user nova-compute[73391]:  {{(pid=73391) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3507}}
Aug 15 05:32:03 user nova-compute[73391]: DEBUG nova.objects.instance [None req-30f09214-94b6-43a6-835c-16e40c7dea43 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] Lazy-loading 'system_metadata' on Instance uuid ee96866e-7ee0-46a1-be1a-60439a52d513 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:32:03 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-30f09214-94b6-43a6-835c-16e40c7dea43 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver [None req-30f09214-94b6-43a6-835c-16e40c7dea43 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Traceback (most recent call last):
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver [instance: ee96866e-7ee0-46a1-be1a-60439a52d513]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver [instance: ee96866e-7ee0-46a1-be1a-60439a52d513]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver [instance: ee96866e-7ee0-46a1-be1a-60439a52d513]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver [instance: ee96866e-7ee0-46a1-be1a-60439a52d513]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver [instance: ee96866e-7ee0-46a1-be1a-60439a52d513]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver [instance: ee96866e-7ee0-46a1-be1a-60439a52d513]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver [instance: ee96866e-7ee0-46a1-be1a-60439a52d513]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver [instance: ee96866e-7ee0-46a1-be1a-60439a52d513]     rv = execute(f, *args, **kwargs)
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver [instance: ee96866e-7ee0-46a1-be1a-60439a52d513]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver [instance: ee96866e-7ee0-46a1-be1a-60439a52d513]     six.reraise(c, e, tb)
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver [instance: ee96866e-7ee0-46a1-be1a-60439a52d513]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver [instance: ee96866e-7ee0-46a1-be1a-60439a52d513]     raise value
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver [instance: ee96866e-7ee0-46a1-be1a-60439a52d513]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver [instance: ee96866e-7ee0-46a1-be1a-60439a52d513]     rv = meth(*args, **kwargs)
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver [instance: ee96866e-7ee0-46a1-be1a-60439a52d513]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver [instance: ee96866e-7ee0-46a1-be1a-60439a52d513]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] 
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver [None req-30f09214-94b6-43a6-835c-16e40c7dea43 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Traceback (most recent call last):
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver [instance: ee96866e-7ee0-46a1-be1a-60439a52d513]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver [instance: ee96866e-7ee0-46a1-be1a-60439a52d513]     self._volume_snapshot_create(context, instance, guest,
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver [instance: ee96866e-7ee0-46a1-be1a-60439a52d513]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver [instance: ee96866e-7ee0-46a1-be1a-60439a52d513]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver [instance: ee96866e-7ee0-46a1-be1a-60439a52d513]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver [instance: ee96866e-7ee0-46a1-be1a-60439a52d513]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver [instance: ee96866e-7ee0-46a1-be1a-60439a52d513]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver [instance: ee96866e-7ee0-46a1-be1a-60439a52d513]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver [instance: ee96866e-7ee0-46a1-be1a-60439a52d513]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver [instance: ee96866e-7ee0-46a1-be1a-60439a52d513]     rv = execute(f, *args, **kwargs)
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver [instance: ee96866e-7ee0-46a1-be1a-60439a52d513]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver [instance: ee96866e-7ee0-46a1-be1a-60439a52d513]     six.reraise(c, e, tb)
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver [instance: ee96866e-7ee0-46a1-be1a-60439a52d513]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver [instance: ee96866e-7ee0-46a1-be1a-60439a52d513]     raise value
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver [instance: ee96866e-7ee0-46a1-be1a-60439a52d513]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver [instance: ee96866e-7ee0-46a1-be1a-60439a52d513]     rv = meth(*args, **kwargs)
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver [instance: ee96866e-7ee0-46a1-be1a-60439a52d513]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver [instance: ee96866e-7ee0-46a1-be1a-60439a52d513]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] 
Aug 15 05:32:03 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-b768f023-10cc-42e3-8d68-7112c0265910 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] volume_snapshot_delete: delete_info: {'volume_id': '84e2f66b-ecf5-4e00-a17a-6fc6c67929e1'} {{(pid=73391) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3667}}
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver [None req-b768f023-10cc-42e3-8d68-7112c0265910 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Traceback (most recent call last):
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver [instance: ee96866e-7ee0-46a1-be1a-60439a52d513]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver [instance: ee96866e-7ee0-46a1-be1a-60439a52d513]     self._volume_snapshot_delete(context, instance, volume_id,
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver [instance: ee96866e-7ee0-46a1-be1a-60439a52d513]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver [instance: ee96866e-7ee0-46a1-be1a-60439a52d513]     if delete_info['type'] != 'qcow2':
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] KeyError: 'type'
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] 
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver [None req-30f09214-94b6-43a6-835c-16e40c7dea43 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 89238db4-e278-4d27-a4c3-2adef4621d24 could not be found.
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver     raise value
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver 
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver 
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 89238db4-e278-4d27-a4c3-2adef4621d24 could not be found. (HTTP 404) (Request-ID: req-0cd4e41b-aa7b-4f9f-b457-6ed0f0fa9619)
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver 
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver 
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 89238db4-e278-4d27-a4c3-2adef4621d24 could not be found.
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver 
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver [None req-b768f023-10cc-42e3-8d68-7112c0265910 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver 
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver 
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-05230975-2f29-4315-9de2-83af2b5adaec)
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver 
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver 
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3406, in _volume_snapshot_update_status
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Aug 15 05:32:03 user nova-compute[73391]: ERROR nova.virt.libvirt.driver 
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server [None req-30f09214-94b6-43a6-835c-16e40c7dea43 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4425, in volume_snapshot_create
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3587, in volume_snapshot_create
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3584, in volume_snapshot_create
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3534, in _volume_snapshot_create
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server     raise value
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server 
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server [None req-b768f023-10cc-42e3-8d68-7112c0265910 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] Exception during message handling: KeyError: 'type'
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4437, in volume_snapshot_delete
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3843, in volume_snapshot_delete
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server     raise self.value
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3840, in volume_snapshot_delete
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3670, in _volume_snapshot_delete
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Aug 15 05:32:03 user nova-compute[73391]: ERROR oslo_messaging.rpc.server 
Aug 15 05:32:03 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:03 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:32:03 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] <== connect_volume: return (3042ms) {'type': 'block', 'scsi_wwn': '26561646330633164', 'path': '/dev/sdh'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:32:03 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561646330633164', 'path': '/dev/sdh'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 05:32:03 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-a1812145-31cc-458c-b4b3-225c662d9181 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] Acquiring lock "ee96866e-7ee0-46a1-be1a-60439a52d513" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:03 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-a1812145-31cc-458c-b4b3-225c662d9181 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] Lock "ee96866e-7ee0-46a1-be1a-60439a52d513" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:03 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 05:32:03 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wydCbFrj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:32:03 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:32:03 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:32:03 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:32:03 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:32:03 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:32:03 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:32:03 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 05:32:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:03 user nova-compute[73391]: INFO nova.compute.manager [None req-a1812145-31cc-458c-b4b3-225c662d9181 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Detaching volume 84e2f66b-ecf5-4e00-a17a-6fc6c67929e1
Aug 15 05:32:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:03 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a81dfd8-139e-4943-a483-6c7807f1f0b6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:03 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 05:32:03 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:03 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[856585c2-69ab-4326-a4f9-71c13adb4711]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:03 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518] added
Aug 15 05:32:03 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:03 user nova-compute[73391]: INFO nova.virt.block_device [None req-a1812145-31cc-458c-b4b3-225c662d9181 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Attempting to driver detach volume 84e2f66b-ecf5-4e00-a17a-6fc6c67929e1 from mountpoint /dev/vdb
Aug 15 05:32:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:03 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e29b8b-9917-43a4-8434-5d112797f941]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:03 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:03 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-a1812145-31cc-458c-b4b3-225c662d9181 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] Attempting to detach device vdb from instance ee96866e-7ee0-46a1-be1a-60439a52d513 from the persistent domain config. {{(pid=73391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 05:32:03 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-a1812145-31cc-458c-b4b3-225c662d9181 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] detach device xml: <disk type="block" device="disk">
Aug 15 05:32:03 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:32:03 user nova-compute[73391]:   <source dev="/dev/sde"/>
Aug 15 05:32:03 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:32:03 user nova-compute[73391]:   <serial>84e2f66b-ecf5-4e00-a17a-6fc6c67929e1</serial>
Aug 15 05:32:03 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 05:32:03 user nova-compute[73391]: </disk>
Aug 15 05:32:03 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 05:32:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:03 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-a1812145-31cc-458c-b4b3-225c662d9181 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] Successfully detached device vdb from instance ee96866e-7ee0-46a1-be1a-60439a52d513 from the persistent domain config.
Aug 15 05:32:03 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-a1812145-31cc-458c-b4b3-225c662d9181 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ee96866e-7ee0-46a1-be1a-60439a52d513 from the live domain config. {{(pid=73391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 05:32:03 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-a1812145-31cc-458c-b4b3-225c662d9181 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] detach device xml: <disk type="block" device="disk">
Aug 15 05:32:03 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:32:03 user nova-compute[73391]:   <source dev="/dev/sde"/>
Aug 15 05:32:03 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:32:03 user nova-compute[73391]:   <serial>84e2f66b-ecf5-4e00-a17a-6fc6c67929e1</serial>
Aug 15 05:32:03 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 05:32:03 user nova-compute[73391]: </disk>
Aug 15 05:32:03 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 05:32:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:03 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fabe31cc-6c8b-4db2-b260-fa15136232a8]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:03 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wydCbFrj {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wydCbFrj" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:03 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dcfa87c-a3cb-44ed-807b-0adff779fcd3]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:03 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wydCbFrj'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:03 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[061e1f41-f7bc-477b-be6a-cf4c073eaebb]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:03 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:03 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:03 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2665ed-a1b6-4564-afc1-69113f51e61b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:03 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)
Aug 15 05:32:03 user nova-compute[73391]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:32:03 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:32:03 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:32:03 user nova-compute[73391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)
Aug 15 05:32:03 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:32:03 user nova-compute[73391]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1 (non-flash)
Aug 15 05:32:03 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:32:03 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)
Aug 15 05:32:03 user nova-compute[73391]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:32:03 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:32:03 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:32:03 user nova-compute[73391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)
Aug 15 05:32:03 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:32:03 user nova-compute[73391]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1 (non-flash)
Aug 15 05:32:03 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:32:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:04 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:04 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ffefa1e-37d3-4aab-888a-8c5f5ecf56dd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:04 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518, portal: 172.16.0.220,3260]
Aug 15 05:32:04 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518, portal: 172.16.0.220,3260] successful.
Aug 15 05:32:04 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:04 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:04 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:04 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[394fec33-4421-41c1-a774-ef387637ca0a]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:04 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:04 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:04 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:04 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d17e204-501e-4954-a7ea-234e8f3e8154]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:04 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)
Aug 15 05:32:04 user nova-compute[73391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)
Aug 15 05:32:04 user nova-compute[73391]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:32:04 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:32:04 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:32:04 user nova-compute[73391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)
Aug 15 05:32:04 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:32:04 user nova-compute[73391]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1 (non-flash)
Aug 15 05:32:04 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:32:04 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)
Aug 15 05:32:04 user nova-compute[73391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)
Aug 15 05:32:04 user nova-compute[73391]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:32:04 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:32:04 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:32:04 user nova-compute[73391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)
Aug 15 05:32:04 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:32:04 user nova-compute[73391]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1 (non-flash)
Aug 15 05:32:04 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:32:04 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:32:04 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 05:32:04 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] HCTL ('40', '-', '-', 0) found on session 11 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 05:32:04 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 05:32:04 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:04 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:04 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[94cd31a7-d20b-46da-a282-699e83fdbf6d]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:04 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Searching for a device in session 11 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:32:04 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Connected to sdi using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wydCbFrj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 05:32:04 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Received event <DeviceRemovedEvent: 1692077524.283965, ee96866e-7ee0-46a1-be1a-60439a52d513 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73391) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 05:32:04 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-a1812145-31cc-458c-b4b3-225c662d9181 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ee96866e-7ee0-46a1-be1a-60439a52d513 {{(pid=73391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 05:32:04 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-a1812145-31cc-458c-b4b3-225c662d9181 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] Successfully detached device vdb from instance ee96866e-7ee0-46a1-be1a-60439a52d513 from the live domain config.
Aug 15 05:32:04 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1812145-31cc-458c-b4b3-225c662d9181 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 05:32:04 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1812145-31cc-458c-b4b3-225c662d9181 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mHYsiaTX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:32:04 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-a1812145-31cc-458c-b4b3-225c662d9181 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:32:04 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-a1812145-31cc-458c-b4b3-225c662d9181 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '23733613232373263', 'path': '/dev/sdi'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733613232373263', 'path': '/dev/sdi'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-a1812145-31cc-458c-b4b3-225c662d9181 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.811s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1812145-31cc-458c-b4b3-225c662d9181 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[11295f88-7342-4ef3-ac7e-6cb6e2188045]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T05:30:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-350405470',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-350405470',id=11,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8kTpqAr2hLgWgcWYp4BVd/dgkLt1zBjg5KiL/KMWsa8lWthPbN0pIZvu1z1F8qRVBT5oG0yoSkSyH6fSrOKFgLogLPWFv1SqT9saqO+ApvBDi+D4+ywqDg/jbYLc8kJg==',key_name='tempest-keypair-129548124',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a32aa9315a244728c4a764d21e1d2c9',ramdisk_id='',reservation_id='r-8ixr7r7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-133221342',owner_user_name='tempest-TaggedBootDevicesTest_v242-133221342-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:31:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c992a66fd294e5f82aa58e5fa4058af',uuid=96c5782e-9d00-4bb8-8e1d-99416bc7d556,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37e2378e-5659-401c-95ce-0424b61e2e1a", "address": "fa:16:3e:7b:4f:9c", "network": {"id": "1fb1af76-f96a-4640-a09d-1bdb13e93bd6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-505156524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e2378e-56", "ovs_interfaceid": "37e2378e-5659-401c-95ce-0424b61e2e1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Converting VIF {"id": "37e2378e-5659-401c-95ce-0424b61e2e1a", "address": "fa:16:3e:7b:4f:9c", "network": {"id": "1fb1af76-f96a-4640-a09d-1bdb13e93bd6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-505156524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e2378e-56", "ovs_interfaceid": "37e2378e-5659-401c-95ce-0424b61e2e1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:4f:9c,bridge_name='br-int',has_traffic_filtering=True,id=37e2378e-5659-401c-95ce-0424b61e2e1a,network=Network(1fb1af76-f96a-4640-a09d-1bdb13e93bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37e2378e-56') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T05:30:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-350405470',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-350405470',id=11,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8kTpqAr2hLgWgcWYp4BVd/dgkLt1zBjg5KiL/KMWsa8lWthPbN0pIZvu1z1F8qRVBT5oG0yoSkSyH6fSrOKFgLogLPWFv1SqT9saqO+ApvBDi+D4+ywqDg/jbYLc8kJg==',key_name='tempest-keypair-129548124',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a32aa9315a244728c4a764d21e1d2c9',ramdisk_id='',reservation_id='r-8ixr7r7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-133221342',owner_user_name='tempest-TaggedBootDevicesTest_v242-133221342-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:31:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c992a66fd294e5f82aa58e5fa4058af',uuid=96c5782e-9d00-4bb8-8e1d-99416bc7d556,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23d27a9f-a59d-4369-a8c2-0f09564bb78d", "address": "fa:16:3e:4a:c7:00", "network": {"id": "38d7d183-2f35-4f50-bd69-614eaf1952ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-82531103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23d27a9f-a5", "ovs_interfaceid": "23d27a9f-a59d-4369-a8c2-0f09564bb78d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Converting VIF {"id": "23d27a9f-a59d-4369-a8c2-0f09564bb78d", "address": "fa:16:3e:4a:c7:00", "network": {"id": "38d7d183-2f35-4f50-bd69-614eaf1952ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-82531103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23d27a9f-a5", "ovs_interfaceid": "23d27a9f-a59d-4369-a8c2-0f09564bb78d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:c7:00,bridge_name='br-int',has_traffic_filtering=True,id=23d27a9f-a59d-4369-a8c2-0f09564bb78d,network=Network(38d7d183-2f35-4f50-bd69-614eaf1952ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap23d27a9f-a5') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T05:30:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-350405470',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-350405470',id=11,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8kTpqAr2hLgWgcWYp4BVd/dgkLt1zBjg5KiL/KMWsa8lWthPbN0pIZvu1z1F8qRVBT5oG0yoSkSyH6fSrOKFgLogLPWFv1SqT9saqO+ApvBDi+D4+ywqDg/jbYLc8kJg==',key_name='tempest-keypair-129548124',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a32aa9315a244728c4a764d21e1d2c9',ramdisk_id='',reservation_id='r-8ixr7r7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-133221342',owner_user_name='tempest-TaggedBootDevicesTest_v242-133221342-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:31:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c992a66fd294e5f82aa58e5fa4058af',uuid=96c5782e-9d00-4bb8-8e1d-99416bc7d556,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "879124a9-46cd-45bb-b1a2-34cc8264cf25", "address": "fa:16:3e:4a:68:3f", "network": {"id": "38d7d183-2f35-4f50-bd69-614eaf1952ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-82531103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap879124a9-46", "ovs_interfaceid": "879124a9-46cd-45bb-b1a2-34cc8264cf25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Converting VIF {"id": "879124a9-46cd-45bb-b1a2-34cc8264cf25", "address": "fa:16:3e:4a:68:3f", "network": {"id": "38d7d183-2f35-4f50-bd69-614eaf1952ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-82531103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap879124a9-46", "ovs_interfaceid": "879124a9-46cd-45bb-b1a2-34cc8264cf25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:68:3f,bridge_name='br-int',has_traffic_filtering=True,id=879124a9-46cd-45bb-b1a2-34cc8264cf25,network=Network(38d7d183-2f35-4f50-bd69-614eaf1952ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap879124a9-46') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T05:30:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-350405470',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-350405470',id=11,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8kTpqAr2hLgWgcWYp4BVd/dgkLt1zBjg5KiL/KMWsa8lWthPbN0pIZvu1z1F8qRVBT5oG0yoSkSyH6fSrOKFgLogLPWFv1SqT9saqO+ApvBDi+D4+ywqDg/jbYLc8kJg==',key_name='tempest-keypair-129548124',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a32aa9315a244728c4a764d21e1d2c9',ramdisk_id='',reservation_id='r-8ixr7r7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-133221342',owner_user_name='tempest-TaggedBootDevicesTest_v242-133221342-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:31:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c992a66fd294e5f82aa58e5fa4058af',uuid=96c5782e-9d00-4bb8-8e1d-99416bc7d556,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a09443ce-b3e9-4fe7-b24a-b1c609cb2553", "address": "fa:16:3e:6a:6d:c5", "network": {"id": "38d7d183-2f35-4f50-bd69-614eaf1952ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-82531103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa09443ce-b3", "ovs_interfaceid": "a09443ce-b3e9-4fe7-b24a-b1c609cb2553", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Converting VIF {"id": "a09443ce-b3e9-4fe7-b24a-b1c609cb2553", "address": "fa:16:3e:6a:6d:c5", "network": {"id": "38d7d183-2f35-4f50-bd69-614eaf1952ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-82531103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa09443ce-b3", "ovs_interfaceid": "a09443ce-b3e9-4fe7-b24a-b1c609cb2553", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:6d:c5,bridge_name='br-int',has_traffic_filtering=True,id=a09443ce-b3e9-4fe7-b24a-b1c609cb2553,network=Network(38d7d183-2f35-4f50-bd69-614eaf1952ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa09443ce-b3') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T05:30:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-350405470',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-350405470',id=11,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8kTpqAr2hLgWgcWYp4BVd/dgkLt1zBjg5KiL/KMWsa8lWthPbN0pIZvu1z1F8qRVBT5oG0yoSkSyH6fSrOKFgLogLPWFv1SqT9saqO+ApvBDi+D4+ywqDg/jbYLc8kJg==',key_name='tempest-keypair-129548124',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a32aa9315a244728c4a764d21e1d2c9',ramdisk_id='',reservation_id='r-8ixr7r7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-133221342',owner_user_name='tempest-TaggedBootDevicesTest_v242-133221342-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:31:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c992a66fd294e5f82aa58e5fa4058af',uuid=96c5782e-9d00-4bb8-8e1d-99416bc7d556,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7adbd6a6-9a65-4e61-9ff2-63351d5dfaad", "address": "fa:16:3e:b7:e9:02", "network": {"id": "38d7d183-2f35-4f50-bd69-614eaf1952ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-82531103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7adbd6a6-9a", "ovs_interfaceid": "7adbd6a6-9a65-4e61-9ff2-63351d5dfaad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Converting VIF {"id": "7adbd6a6-9a65-4e61-9ff2-63351d5dfaad", "address": "fa:16:3e:b7:e9:02", "network": {"id": "38d7d183-2f35-4f50-bd69-614eaf1952ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-82531103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7adbd6a6-9a", "ovs_interfaceid": "7adbd6a6-9a65-4e61-9ff2-63351d5dfaad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:e9:02,bridge_name='br-int',has_traffic_filtering=True,id=7adbd6a6-9a65-4e61-9ff2-63351d5dfaad,network=Network(38d7d183-2f35-4f50-bd69-614eaf1952ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7adbd6a6-9a') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T05:30:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-350405470',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-350405470',id=11,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8kTpqAr2hLgWgcWYp4BVd/dgkLt1zBjg5KiL/KMWsa8lWthPbN0pIZvu1z1F8qRVBT5oG0yoSkSyH6fSrOKFgLogLPWFv1SqT9saqO+ApvBDi+D4+ywqDg/jbYLc8kJg==',key_name='tempest-keypair-129548124',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a32aa9315a244728c4a764d21e1d2c9',ramdisk_id='',reservation_id='r-8ixr7r7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-133221342',owner_user_name='tempest-TaggedBootDevicesTest_v242-133221342-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:31:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c992a66fd294e5f82aa58e5fa4058af',uuid=96c5782e-9d00-4bb8-8e1d-99416bc7d556,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae52a22f-e13e-4da6-9561-ba679ac242b1", "address": "fa:16:3e:df:63:15", "network": {"id": "0376a3e8-17aa-47e4-afdb-fb7ba9174147", "bridge": "br-int", "label": "tempest-device-tagging-net2-1320047162", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae52a22f-e1", "ovs_interfaceid": "ae52a22f-e13e-4da6-9561-ba679ac242b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Converting VIF {"id": "ae52a22f-e13e-4da6-9561-ba679ac242b1", "address": "fa:16:3e:df:63:15", "network": {"id": "0376a3e8-17aa-47e4-afdb-fb7ba9174147", "bridge": "br-int", "label": "tempest-device-tagging-net2-1320047162", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae52a22f-e1", "ovs_interfaceid": "ae52a22f-e13e-4da6-9561-ba679ac242b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:63:15,bridge_name='br-int',has_traffic_filtering=True,id=ae52a22f-e13e-4da6-9561-ba679ac242b1,network=Network(0376a3e8-17aa-47e4-afdb-fb7ba9174147),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae52a22f-e1') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T05:30:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-350405470',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-350405470',id=11,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8kTpqAr2hLgWgcWYp4BVd/dgkLt1zBjg5KiL/KMWsa8lWthPbN0pIZvu1z1F8qRVBT5oG0yoSkSyH6fSrOKFgLogLPWFv1SqT9saqO+ApvBDi+D4+ywqDg/jbYLc8kJg==',key_name='tempest-keypair-129548124',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a32aa9315a244728c4a764d21e1d2c9',ramdisk_id='',reservation_id='r-8ixr7r7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-133221342',owner_user_name='tempest-TaggedBootDevicesTest_v242-133221342-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:31:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c992a66fd294e5f82aa58e5fa4058af',uuid=96c5782e-9d00-4bb8-8e1d-99416bc7d556,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33d14fed-6340-407f-bdf1-c858e9cf395c", "address": "fa:16:3e:f1:52:78", "network": {"id": "0376a3e8-17aa-47e4-afdb-fb7ba9174147", "bridge": "br-int", "label": "tempest-device-tagging-net2-1320047162", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33d14fed-63", "ovs_interfaceid": "33d14fed-6340-407f-bdf1-c858e9cf395c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Converting VIF {"id": "33d14fed-6340-407f-bdf1-c858e9cf395c", "address": "fa:16:3e:f1:52:78", "network": {"id": "0376a3e8-17aa-47e4-afdb-fb7ba9174147", "bridge": "br-int", "label": "tempest-device-tagging-net2-1320047162", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33d14fed-63", "ovs_interfaceid": "33d14fed-6340-407f-bdf1-c858e9cf395c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:52:78,bridge_name='br-int',has_traffic_filtering=True,id=33d14fed-6340-407f-bdf1-c858e9cf395c,network=Network(0376a3e8-17aa-47e4-afdb-fb7ba9174147),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33d14fed-63') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG nova.objects.instance [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Lazy-loading 'pci_devices' on Instance uuid 96c5782e-9d00-4bb8-8e1d-99416bc7d556 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:32:05 user nova-compute[73391]:   <uuid>96c5782e-9d00-4bb8-8e1d-99416bc7d556</uuid>
Aug 15 05:32:05 user nova-compute[73391]:   <name>instance-0000000b</name>
Aug 15 05:32:05 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:32:05 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:32:05 user nova-compute[73391]:   <metadata>
Aug 15 05:32:05 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:32:05 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:32:05 user nova-compute[73391]:       <nova:name>tempest-device-tagging-server-350405470</nova:name>
Aug 15 05:32:05 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:31:59</nova:creationTime>
Aug 15 05:32:05 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:32:05 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:32:05 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:32:05 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:32:05 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:32:05 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:32:05 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:32:05 user nova-compute[73391]:       <nova:owner>
Aug 15 05:32:05 user nova-compute[73391]:         <nova:user uuid="7c992a66fd294e5f82aa58e5fa4058af">tempest-TaggedBootDevicesTest_v242-133221342-project-member</nova:user>
Aug 15 05:32:05 user nova-compute[73391]:         <nova:project uuid="2a32aa9315a244728c4a764d21e1d2c9">tempest-TaggedBootDevicesTest_v242-133221342</nova:project>
Aug 15 05:32:05 user nova-compute[73391]:       </nova:owner>
Aug 15 05:32:05 user nova-compute[73391]:       <nova:root type="image" uuid="191b1dad-305e-4d1c-9b15-515ec59a3278"/>
Aug 15 05:32:05 user nova-compute[73391]:       <nova:ports>
Aug 15 05:32:05 user nova-compute[73391]:         <nova:port uuid="37e2378e-5659-401c-95ce-0424b61e2e1a">
Aug 15 05:32:05 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 15 05:32:05 user nova-compute[73391]:         </nova:port>
Aug 15 05:32:05 user nova-compute[73391]:         <nova:port uuid="23d27a9f-a59d-4369-a8c2-0f09564bb78d">
Aug 15 05:32:05 user nova-compute[73391]:           <nova:ip type="fixed" address="10.1.1.154" ipVersion="4"/>
Aug 15 05:32:05 user nova-compute[73391]:         </nova:port>
Aug 15 05:32:05 user nova-compute[73391]:         <nova:port uuid="879124a9-46cd-45bb-b1a2-34cc8264cf25">
Aug 15 05:32:05 user nova-compute[73391]:           <nova:ip type="fixed" address="10.1.1.27" ipVersion="4"/>
Aug 15 05:32:05 user nova-compute[73391]:         </nova:port>
Aug 15 05:32:05 user nova-compute[73391]:         <nova:port uuid="a09443ce-b3e9-4fe7-b24a-b1c609cb2553">
Aug 15 05:32:05 user nova-compute[73391]:           <nova:ip type="fixed" address="10.1.1.62" ipVersion="4"/>
Aug 15 05:32:05 user nova-compute[73391]:         </nova:port>
Aug 15 05:32:05 user nova-compute[73391]:         <nova:port uuid="7adbd6a6-9a65-4e61-9ff2-63351d5dfaad">
Aug 15 05:32:05 user nova-compute[73391]:           <nova:ip type="fixed" address="10.1.1.247" ipVersion="4"/>
Aug 15 05:32:05 user nova-compute[73391]:         </nova:port>
Aug 15 05:32:05 user nova-compute[73391]:         <nova:port uuid="ae52a22f-e13e-4da6-9561-ba679ac242b1">
Aug 15 05:32:05 user nova-compute[73391]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Aug 15 05:32:05 user nova-compute[73391]:         </nova:port>
Aug 15 05:32:05 user nova-compute[73391]:         <nova:port uuid="33d14fed-6340-407f-bdf1-c858e9cf395c">
Aug 15 05:32:05 user nova-compute[73391]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Aug 15 05:32:05 user nova-compute[73391]:         </nova:port>
Aug 15 05:32:05 user nova-compute[73391]:       </nova:ports>
Aug 15 05:32:05 user nova-compute[73391]:     </nova:instance>
Aug 15 05:32:05 user nova-compute[73391]:   </metadata>
Aug 15 05:32:05 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:32:05 user nova-compute[73391]:     <system>
Aug 15 05:32:05 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:32:05 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:32:05 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:32:05 user nova-compute[73391]:       <entry name="serial">96c5782e-9d00-4bb8-8e1d-99416bc7d556</entry>
Aug 15 05:32:05 user nova-compute[73391]:       <entry name="uuid">96c5782e-9d00-4bb8-8e1d-99416bc7d556</entry>
Aug 15 05:32:05 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:32:05 user nova-compute[73391]:     </system>
Aug 15 05:32:05 user nova-compute[73391]:   </sysinfo>
Aug 15 05:32:05 user nova-compute[73391]:   <os>
Aug 15 05:32:05 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:32:05 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:32:05 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:32:05 user nova-compute[73391]:   </os>
Aug 15 05:32:05 user nova-compute[73391]:   <features>
Aug 15 05:32:05 user nova-compute[73391]:     <acpi/>
Aug 15 05:32:05 user nova-compute[73391]:     <apic/>
Aug 15 05:32:05 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:32:05 user nova-compute[73391]:   </features>
Aug 15 05:32:05 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:32:05 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:32:05 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:32:05 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:32:05 user nova-compute[73391]:   </clock>
Aug 15 05:32:05 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:32:05 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:32:05 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:32:05 user nova-compute[73391]:   </cpu>
Aug 15 05:32:05 user nova-compute[73391]:   <devices>
Aug 15 05:32:05 user nova-compute[73391]:     <disk type="file" device="cdrom">
Aug 15 05:32:05 user nova-compute[73391]:       <driver name="qemu" type="raw" cache="none"/>
Aug 15 05:32:05 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/96c5782e-9d00-4bb8-8e1d-99416bc7d556/disk.config"/>
Aug 15 05:32:05 user nova-compute[73391]:       <target dev="hda" bus="ide"/>
Aug 15 05:32:05 user nova-compute[73391]:     </disk>
Aug 15 05:32:05 user nova-compute[73391]:     <disk type="block" device="disk">
Aug 15 05:32:05 user nova-compute[73391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:32:05 user nova-compute[73391]:       <source dev="/dev/sdg"/>
Aug 15 05:32:05 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:32:05 user nova-compute[73391]:       <serial>326d5b7a-2a67-4d44-a918-a390fd8d5bb1</serial>
Aug 15 05:32:05 user nova-compute[73391]:     </disk>
Aug 15 05:32:05 user nova-compute[73391]:     <disk type="block" device="disk">
Aug 15 05:32:05 user nova-compute[73391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:32:05 user nova-compute[73391]:       <source dev="/dev/sdh"/>
Aug 15 05:32:05 user nova-compute[73391]:       <target dev="vdb" bus="virtio"/>
Aug 15 05:32:05 user nova-compute[73391]:       <serial>162fea74-b991-40c2-acce-b2c6fcd5c2f1</serial>
Aug 15 05:32:05 user nova-compute[73391]:     </disk>
Aug 15 05:32:05 user nova-compute[73391]:     <disk type="block" device="disk">
Aug 15 05:32:05 user nova-compute[73391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:32:05 user nova-compute[73391]:       <source dev="/dev/sdi"/>
Aug 15 05:32:05 user nova-compute[73391]:       <target dev="vdc" bus="virtio"/>
Aug 15 05:32:05 user nova-compute[73391]:       <serial>644f40f9-9fcf-4fa6-908e-d1c315ad9518</serial>
Aug 15 05:32:05 user nova-compute[73391]:     </disk>
Aug 15 05:32:05 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:32:05 user nova-compute[73391]:       <mac address="fa:16:3e:7b:4f:9c"/>
Aug 15 05:32:05 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:32:05 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:32:05 user nova-compute[73391]:       <target dev="tap37e2378e-56"/>
Aug 15 05:32:05 user nova-compute[73391]:     </interface>
Aug 15 05:32:05 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:32:05 user nova-compute[73391]:       <mac address="fa:16:3e:4a:c7:00"/>
Aug 15 05:32:05 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:32:05 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:32:05 user nova-compute[73391]:       <target dev="tap23d27a9f-a5"/>
Aug 15 05:32:05 user nova-compute[73391]:     </interface>
Aug 15 05:32:05 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:32:05 user nova-compute[73391]:       <mac address="fa:16:3e:4a:68:3f"/>
Aug 15 05:32:05 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:32:05 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:32:05 user nova-compute[73391]:       <target dev="tap879124a9-46"/>
Aug 15 05:32:05 user nova-compute[73391]:     </interface>
Aug 15 05:32:05 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:32:05 user nova-compute[73391]:       <mac address="fa:16:3e:6a:6d:c5"/>
Aug 15 05:32:05 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:32:05 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:32:05 user nova-compute[73391]:       <target dev="tapa09443ce-b3"/>
Aug 15 05:32:05 user nova-compute[73391]:     </interface>
Aug 15 05:32:05 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:32:05 user nova-compute[73391]:       <mac address="fa:16:3e:b7:e9:02"/>
Aug 15 05:32:05 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:32:05 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:32:05 user nova-compute[73391]:       <target dev="tap7adbd6a6-9a"/>
Aug 15 05:32:05 user nova-compute[73391]:     </interface>
Aug 15 05:32:05 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:32:05 user nova-compute[73391]:       <mac address="fa:16:3e:df:63:15"/>
Aug 15 05:32:05 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:32:05 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:32:05 user nova-compute[73391]:       <target dev="tapae52a22f-e1"/>
Aug 15 05:32:05 user nova-compute[73391]:     </interface>
Aug 15 05:32:05 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:32:05 user nova-compute[73391]:       <mac address="fa:16:3e:f1:52:78"/>
Aug 15 05:32:05 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:32:05 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:32:05 user nova-compute[73391]:       <target dev="tap33d14fed-63"/>
Aug 15 05:32:05 user nova-compute[73391]:     </interface>
Aug 15 05:32:05 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:32:05 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/96c5782e-9d00-4bb8-8e1d-99416bc7d556/console.log" append="off"/>
Aug 15 05:32:05 user nova-compute[73391]:     </serial>
Aug 15 05:32:05 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:32:05 user nova-compute[73391]:     <video>
Aug 15 05:32:05 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:32:05 user nova-compute[73391]:     </video>
Aug 15 05:32:05 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:32:05 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:32:05 user nova-compute[73391]:     </rng>
Aug 15 05:32:05 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:32:05 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:32:05 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:32:05 user nova-compute[73391]:     </memballoon>
Aug 15 05:32:05 user nova-compute[73391]:   </devices>
Aug 15 05:32:05 user nova-compute[73391]: </domain>
Aug 15 05:32:05 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T05:30:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-350405470',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-350405470',id=11,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8kTpqAr2hLgWgcWYp4BVd/dgkLt1zBjg5KiL/KMWsa8lWthPbN0pIZvu1z1F8qRVBT5oG0yoSkSyH6fSrOKFgLogLPWFv1SqT9saqO+ApvBDi+D4+ywqDg/jbYLc8kJg==',key_name='tempest-keypair-129548124',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a32aa9315a244728c4a764d21e1d2c9',ramdisk_id='',reservation_id='r-8ixr7r7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-133221342',owner_user_name='tempest-TaggedBootDevicesTest_v242-133221342-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:31:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c992a66fd294e5f82aa58e5fa4058af',uuid=96c5782e-9d00-4bb8-8e1d-99416bc7d556,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "37e2378e-5659-401c-95ce-0424b61e2e1a", "address": "fa:16:3e:7b:4f:9c", "network": {"id": "1fb1af76-f96a-4640-a09d-1bdb13e93bd6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-505156524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e2378e-56", "ovs_interfaceid": "37e2378e-5659-401c-95ce-0424b61e2e1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Converting VIF {"id": "37e2378e-5659-401c-95ce-0424b61e2e1a", "address": "fa:16:3e:7b:4f:9c", "network": {"id": "1fb1af76-f96a-4640-a09d-1bdb13e93bd6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-505156524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e2378e-56", "ovs_interfaceid": "37e2378e-5659-401c-95ce-0424b61e2e1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7b:4f:9c,bridge_name='br-int',has_traffic_filtering=True,id=37e2378e-5659-401c-95ce-0424b61e2e1a,network=Network(1fb1af76-f96a-4640-a09d-1bdb13e93bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37e2378e-56') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG os_vif [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:4f:9c,bridge_name='br-int',has_traffic_filtering=True,id=37e2378e-5659-401c-95ce-0424b61e2e1a,network=Network(1fb1af76-f96a-4640-a09d-1bdb13e93bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37e2378e-56') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[49cd43ee-7f10-436f-84fe-ed2c138d5340]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1812145-31cc-458c-b4b3-225c662d9181 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)
Aug 15 05:32:05 user nova-compute[73391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)
Aug 15 05:32:05 user nova-compute[73391]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:32:05 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:32:05 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:32:05 user nova-compute[73391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)
Aug 15 05:32:05 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:32:05 user nova-compute[73391]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1 (non-flash)
Aug 15 05:32:05 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1812145-31cc-458c-b4b3-225c662d9181 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)
Aug 15 05:32:05 user nova-compute[73391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)
Aug 15 05:32:05 user nova-compute[73391]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:32:05 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:32:05 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:32:05 user nova-compute[73391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)
Aug 15 05:32:05 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:32:05 user nova-compute[73391]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1 (non-flash)
Aug 15 05:32:05 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1812145-31cc-458c-b4b3-225c662d9181 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7757fd1000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1'): ({'sde'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-a1812145-31cc-458c-b4b3-225c662d9181 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] Removing single pathed devices sde {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap37e2378e-56, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap37e2378e-56, col_values=(('external_ids', {'iface-id': '37e2378e-5659-401c-95ce-0424b61e2e1a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7b:4f:9c', 'vm-uuid': '96c5782e-9d00-4bb8-8e1d-99416bc7d556'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef48b323-f6e6-4973-a51c-0d338d89474a]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:05 user nova-compute[73391]: INFO os_vif [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7b:4f:9c,bridge_name='br-int',has_traffic_filtering=True,id=37e2378e-5659-401c-95ce-0424b61e2e1a,network=Network(1fb1af76-f96a-4640-a09d-1bdb13e93bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37e2378e-56')
Aug 15 05:32:05 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T05:30:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-350405470',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-350405470',id=11,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8kTpqAr2hLgWgcWYp4BVd/dgkLt1zBjg5KiL/KMWsa8lWthPbN0pIZvu1z1F8qRVBT5oG0yoSkSyH6fSrOKFgLogLPWFv1SqT9saqO+ApvBDi+D4+ywqDg/jbYLc8kJg==',key_name='tempest-keypair-129548124',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a32aa9315a244728c4a764d21e1d2c9',ramdisk_id='',reservation_id='r-8ixr7r7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-133221342',owner_user_name='tempest-TaggedBootDevicesTest_v242-133221342-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:31:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c992a66fd294e5f82aa58e5fa4058af',uuid=96c5782e-9d00-4bb8-8e1d-99416bc7d556,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23d27a9f-a59d-4369-a8c2-0f09564bb78d", "address": "fa:16:3e:4a:c7:00", "network": {"id": "38d7d183-2f35-4f50-bd69-614eaf1952ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-82531103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23d27a9f-a5", "ovs_interfaceid": "23d27a9f-a59d-4369-a8c2-0f09564bb78d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Converting VIF {"id": "23d27a9f-a59d-4369-a8c2-0f09564bb78d", "address": "fa:16:3e:4a:c7:00", "network": {"id": "38d7d183-2f35-4f50-bd69-614eaf1952ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-82531103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23d27a9f-a5", "ovs_interfaceid": "23d27a9f-a59d-4369-a8c2-0f09564bb78d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:c7:00,bridge_name='br-int',has_traffic_filtering=True,id=23d27a9f-a59d-4369-a8c2-0f09564bb78d,network=Network(38d7d183-2f35-4f50-bd69-614eaf1952ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap23d27a9f-a5') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG os_vif [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:c7:00,bridge_name='br-int',has_traffic_filtering=True,id=23d27a9f-a59d-4369-a8c2-0f09564bb78d,network=Network(38d7d183-2f35-4f50-bd69-614eaf1952ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap23d27a9f-a5') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap23d27a9f-a5, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap23d27a9f-a5, col_values=(('external_ids', {'iface-id': '23d27a9f-a59d-4369-a8c2-0f09564bb78d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:c7:00', 'vm-uuid': '96c5782e-9d00-4bb8-8e1d-99416bc7d556'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e8de1b-143a-471c-a2cf-22feb5e2ae3a]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-a1812145-31cc-458c-b4b3-225c662d9181 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] Flushing IO for device /dev/sde {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:05 user nova-compute[73391]: INFO os_vif [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:c7:00,bridge_name='br-int',has_traffic_filtering=True,id=23d27a9f-a59d-4369-a8c2-0f09564bb78d,network=Network(38d7d183-2f35-4f50-bd69-614eaf1952ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap23d27a9f-a5')
Aug 15 05:32:05 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T05:30:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-350405470',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-350405470',id=11,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8kTpqAr2hLgWgcWYp4BVd/dgkLt1zBjg5KiL/KMWsa8lWthPbN0pIZvu1z1F8qRVBT5oG0yoSkSyH6fSrOKFgLogLPWFv1SqT9saqO+ApvBDi+D4+ywqDg/jbYLc8kJg==',key_name='tempest-keypair-129548124',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a32aa9315a244728c4a764d21e1d2c9',ramdisk_id='',reservation_id='r-8ixr7r7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-133221342',owner_user_name='tempest-TaggedBootDevicesTest_v242-133221342-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:31:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c992a66fd294e5f82aa58e5fa4058af',uuid=96c5782e-9d00-4bb8-8e1d-99416bc7d556,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "879124a9-46cd-45bb-b1a2-34cc8264cf25", "address": "fa:16:3e:4a:68:3f", "network": {"id": "38d7d183-2f35-4f50-bd69-614eaf1952ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-82531103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap879124a9-46", "ovs_interfaceid": "879124a9-46cd-45bb-b1a2-34cc8264cf25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Converting VIF {"id": "879124a9-46cd-45bb-b1a2-34cc8264cf25", "address": "fa:16:3e:4a:68:3f", "network": {"id": "38d7d183-2f35-4f50-bd69-614eaf1952ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-82531103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap879124a9-46", "ovs_interfaceid": "879124a9-46cd-45bb-b1a2-34cc8264cf25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:68:3f,bridge_name='br-int',has_traffic_filtering=True,id=879124a9-46cd-45bb-b1a2-34cc8264cf25,network=Network(38d7d183-2f35-4f50-bd69-614eaf1952ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap879124a9-46') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG os_vif [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:68:3f,bridge_name='br-int',has_traffic_filtering=True,id=879124a9-46cd-45bb-b1a2-34cc8264cf25,network=Network(38d7d183-2f35-4f50-bd69-614eaf1952ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap879124a9-46') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap879124a9-46, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap879124a9-46, col_values=(('external_ids', {'iface-id': '879124a9-46cd-45bb-b1a2-34cc8264cf25', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:68:3f', 'vm-uuid': '96c5782e-9d00-4bb8-8e1d-99416bc7d556'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69a8014-d5d8-4afe-83b9-5eb2b56beee5]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-a1812145-31cc-458c-b4b3-225c662d9181 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:05 user nova-compute[73391]: INFO os_vif [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:68:3f,bridge_name='br-int',has_traffic_filtering=True,id=879124a9-46cd-45bb-b1a2-34cc8264cf25,network=Network(38d7d183-2f35-4f50-bd69-614eaf1952ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap879124a9-46')
Aug 15 05:32:05 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T05:30:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-350405470',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-350405470',id=11,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8kTpqAr2hLgWgcWYp4BVd/dgkLt1zBjg5KiL/KMWsa8lWthPbN0pIZvu1z1F8qRVBT5oG0yoSkSyH6fSrOKFgLogLPWFv1SqT9saqO+ApvBDi+D4+ywqDg/jbYLc8kJg==',key_name='tempest-keypair-129548124',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a32aa9315a244728c4a764d21e1d2c9',ramdisk_id='',reservation_id='r-8ixr7r7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-133221342',owner_user_name='tempest-TaggedBootDevicesTest_v242-133221342-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:31:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c992a66fd294e5f82aa58e5fa4058af',uuid=96c5782e-9d00-4bb8-8e1d-99416bc7d556,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a09443ce-b3e9-4fe7-b24a-b1c609cb2553", "address": "fa:16:3e:6a:6d:c5", "network": {"id": "38d7d183-2f35-4f50-bd69-614eaf1952ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-82531103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa09443ce-b3", "ovs_interfaceid": "a09443ce-b3e9-4fe7-b24a-b1c609cb2553", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Converting VIF {"id": "a09443ce-b3e9-4fe7-b24a-b1c609cb2553", "address": "fa:16:3e:6a:6d:c5", "network": {"id": "38d7d183-2f35-4f50-bd69-614eaf1952ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-82531103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa09443ce-b3", "ovs_interfaceid": "a09443ce-b3e9-4fe7-b24a-b1c609cb2553", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:6d:c5,bridge_name='br-int',has_traffic_filtering=True,id=a09443ce-b3e9-4fe7-b24a-b1c609cb2553,network=Network(38d7d183-2f35-4f50-bd69-614eaf1952ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa09443ce-b3') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG os_vif [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:6d:c5,bridge_name='br-int',has_traffic_filtering=True,id=a09443ce-b3e9-4fe7-b24a-b1c609cb2553,network=Network(38d7d183-2f35-4f50-bd69-614eaf1952ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa09443ce-b3') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa09443ce-b3, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa09443ce-b3, col_values=(('external_ids', {'iface-id': 'a09443ce-b3e9-4fe7-b24a-b1c609cb2553', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:6d:c5', 'vm-uuid': '96c5782e-9d00-4bb8-8e1d-99416bc7d556'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.054s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f97d32-672c-450c-8707-b19cecb614e5]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-a1812145-31cc-458c-b4b3-225c662d9181 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-a1812145-31cc-458c-b4b3-225c662d9181 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] SCSI volumes sde have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1812145-31cc-458c-b4b3-225c662d9181 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:05 user nova-compute[73391]: INFO os_vif [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:6d:c5,bridge_name='br-int',has_traffic_filtering=True,id=a09443ce-b3e9-4fe7-b24a-b1c609cb2553,network=Network(38d7d183-2f35-4f50-bd69-614eaf1952ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa09443ce-b3')
Aug 15 05:32:05 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T05:30:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-350405470',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-350405470',id=11,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8kTpqAr2hLgWgcWYp4BVd/dgkLt1zBjg5KiL/KMWsa8lWthPbN0pIZvu1z1F8qRVBT5oG0yoSkSyH6fSrOKFgLogLPWFv1SqT9saqO+ApvBDi+D4+ywqDg/jbYLc8kJg==',key_name='tempest-keypair-129548124',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a32aa9315a244728c4a764d21e1d2c9',ramdisk_id='',reservation_id='r-8ixr7r7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-133221342',owner_user_name='tempest-TaggedBootDevicesTest_v242-133221342-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:31:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c992a66fd294e5f82aa58e5fa4058af',uuid=96c5782e-9d00-4bb8-8e1d-99416bc7d556,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7adbd6a6-9a65-4e61-9ff2-63351d5dfaad", "address": "fa:16:3e:b7:e9:02", "network": {"id": "38d7d183-2f35-4f50-bd69-614eaf1952ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-82531103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7adbd6a6-9a", "ovs_interfaceid": "7adbd6a6-9a65-4e61-9ff2-63351d5dfaad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Converting VIF {"id": "7adbd6a6-9a65-4e61-9ff2-63351d5dfaad", "address": "fa:16:3e:b7:e9:02", "network": {"id": "38d7d183-2f35-4f50-bd69-614eaf1952ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-82531103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7adbd6a6-9a", "ovs_interfaceid": "7adbd6a6-9a65-4e61-9ff2-63351d5dfaad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:e9:02,bridge_name='br-int',has_traffic_filtering=True,id=7adbd6a6-9a65-4e61-9ff2-63351d5dfaad,network=Network(38d7d183-2f35-4f50-bd69-614eaf1952ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7adbd6a6-9a') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG os_vif [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:e9:02,bridge_name='br-int',has_traffic_filtering=True,id=7adbd6a6-9a65-4e61-9ff2-63351d5dfaad,network=Network(38d7d183-2f35-4f50-bd69-614eaf1952ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7adbd6a6-9a') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7adbd6a6-9a, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7adbd6a6-9a, col_values=(('external_ids', {'iface-id': '7adbd6a6-9a65-4e61-9ff2-63351d5dfaad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:e9:02', 'vm-uuid': '96c5782e-9d00-4bb8-8e1d-99416bc7d556'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[785ce8e1-fe13-44d4-81fb-883104ec57ef]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1812145-31cc-458c-b4b3-225c662d9181 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1 -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:05 user nova-compute[73391]: INFO os_vif [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:e9:02,bridge_name='br-int',has_traffic_filtering=True,id=7adbd6a6-9a65-4e61-9ff2-63351d5dfaad,network=Network(38d7d183-2f35-4f50-bd69-614eaf1952ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7adbd6a6-9a')
Aug 15 05:32:05 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T05:30:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-350405470',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-350405470',id=11,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8kTpqAr2hLgWgcWYp4BVd/dgkLt1zBjg5KiL/KMWsa8lWthPbN0pIZvu1z1F8qRVBT5oG0yoSkSyH6fSrOKFgLogLPWFv1SqT9saqO+ApvBDi+D4+ywqDg/jbYLc8kJg==',key_name='tempest-keypair-129548124',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a32aa9315a244728c4a764d21e1d2c9',ramdisk_id='',reservation_id='r-8ixr7r7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-133221342',owner_user_name='tempest-TaggedBootDevicesTest_v242-133221342-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:31:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c992a66fd294e5f82aa58e5fa4058af',uuid=96c5782e-9d00-4bb8-8e1d-99416bc7d556,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ae52a22f-e13e-4da6-9561-ba679ac242b1", "address": "fa:16:3e:df:63:15", "network": {"id": "0376a3e8-17aa-47e4-afdb-fb7ba9174147", "bridge": "br-int", "label": "tempest-device-tagging-net2-1320047162", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae52a22f-e1", "ovs_interfaceid": "ae52a22f-e13e-4da6-9561-ba679ac242b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Converting VIF {"id": "ae52a22f-e13e-4da6-9561-ba679ac242b1", "address": "fa:16:3e:df:63:15", "network": {"id": "0376a3e8-17aa-47e4-afdb-fb7ba9174147", "bridge": "br-int", "label": "tempest-device-tagging-net2-1320047162", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae52a22f-e1", "ovs_interfaceid": "ae52a22f-e13e-4da6-9561-ba679ac242b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:63:15,bridge_name='br-int',has_traffic_filtering=True,id=ae52a22f-e13e-4da6-9561-ba679ac242b1,network=Network(0376a3e8-17aa-47e4-afdb-fb7ba9174147),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae52a22f-e1') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG os_vif [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:63:15,bridge_name='br-int',has_traffic_filtering=True,id=ae52a22f-e13e-4da6-9561-ba679ac242b1,network=Network(0376a3e8-17aa-47e4-afdb-fb7ba9174147),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae52a22f-e1') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapae52a22f-e1, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapae52a22f-e1, col_values=(('external_ids', {'iface-id': 'ae52a22f-e13e-4da6-9561-ba679ac242b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:63:15', 'vm-uuid': '96c5782e-9d00-4bb8-8e1d-99416bc7d556'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[efcd0915-e57e-4fc7-b118-6a23e46c72b0]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1812145-31cc-458c-b4b3-225c662d9181 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1, portal: 172.16.0.220,3260]
Aug 15 05:32:05 user nova-compute[73391]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1, portal: 172.16.0.220,3260] successful.
Aug 15 05:32:05 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1 -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquiring lock "6358e825-5705-45d6-86b6-3aacfa5a9bbb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "6358e825-5705-45d6-86b6-3aacfa5a9bbb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG nova.compute.manager [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Starting instance... {{(pid=73391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84e2f66b-ecf5-4e00-a17a-6fc6c67929e1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c35ca7f-f481-429f-894e-8dac4830049a]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1812145-31cc-458c-b4b3-225c662d9181 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-a1812145-31cc-458c-b4b3-225c662d9181 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.396s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1812145-31cc-458c-b4b3-225c662d9181 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] <== disconnect_volume: return (1208ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1812145-31cc-458c-b4b3-225c662d9181 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 05:32:05 user nova-compute[73391]: INFO os_vif [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:63:15,bridge_name='br-int',has_traffic_filtering=True,id=ae52a22f-e13e-4da6-9561-ba679ac242b1,network=Network(0376a3e8-17aa-47e4-afdb-fb7ba9174147),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae52a22f-e1')
Aug 15 05:32:05 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T05:30:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-350405470',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-350405470',id=11,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8kTpqAr2hLgWgcWYp4BVd/dgkLt1zBjg5KiL/KMWsa8lWthPbN0pIZvu1z1F8qRVBT5oG0yoSkSyH6fSrOKFgLogLPWFv1SqT9saqO+ApvBDi+D4+ywqDg/jbYLc8kJg==',key_name='tempest-keypair-129548124',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2a32aa9315a244728c4a764d21e1d2c9',ramdisk_id='',reservation_id='r-8ixr7r7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-133221342',owner_user_name='tempest-TaggedBootDevicesTest_v242-133221342-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:31:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c992a66fd294e5f82aa58e5fa4058af',uuid=96c5782e-9d00-4bb8-8e1d-99416bc7d556,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "33d14fed-6340-407f-bdf1-c858e9cf395c", "address": "fa:16:3e:f1:52:78", "network": {"id": "0376a3e8-17aa-47e4-afdb-fb7ba9174147", "bridge": "br-int", "label": "tempest-device-tagging-net2-1320047162", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33d14fed-63", "ovs_interfaceid": "33d14fed-6340-407f-bdf1-c858e9cf395c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Converting VIF {"id": "33d14fed-6340-407f-bdf1-c858e9cf395c", "address": "fa:16:3e:f1:52:78", "network": {"id": "0376a3e8-17aa-47e4-afdb-fb7ba9174147", "bridge": "br-int", "label": "tempest-device-tagging-net2-1320047162", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33d14fed-63", "ovs_interfaceid": "33d14fed-6340-407f-bdf1-c858e9cf395c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:52:78,bridge_name='br-int',has_traffic_filtering=True,id=33d14fed-6340-407f-bdf1-c858e9cf395c,network=Network(0376a3e8-17aa-47e4-afdb-fb7ba9174147),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33d14fed-63') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG os_vif [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:52:78,bridge_name='br-int',has_traffic_filtering=True,id=33d14fed-6340-407f-bdf1-c858e9cf395c,network=Network(0376a3e8-17aa-47e4-afdb-fb7ba9174147),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33d14fed-63') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap33d14fed-63, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap33d14fed-63, col_values=(('external_ids', {'iface-id': '33d14fed-6340-407f-bdf1-c858e9cf395c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f1:52:78', 'vm-uuid': '96c5782e-9d00-4bb8-8e1d-99416bc7d556'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:05 user nova-compute[73391]: INFO os_vif [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:52:78,bridge_name='br-int',has_traffic_filtering=True,id=33d14fed-6340-407f-bdf1-c858e9cf395c,network=Network(0376a3e8-17aa-47e4-afdb-fb7ba9174147),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33d14fed-63')
Aug 15 05:32:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 05:32:05 user nova-compute[73391]: INFO nova.compute.claims [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Claim successful on node user
Aug 15 05:32:05 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] No BDM found with device name hda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] No VIF found with MAC fa:16:3e:7b:4f:9c, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] No VIF found with MAC fa:16:3e:b7:e9:02, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:32:05 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Using config drive
Aug 15 05:32:05 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Creating config drive at /opt/stack/data/nova/instances/96c5782e-9d00-4bb8-8e1d-99416bc7d556/disk.config
Aug 15 05:32:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/96c5782e-9d00-4bb8-8e1d-99416bc7d556/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpfafi2dno {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/96c5782e-9d00-4bb8-8e1d-99416bc7d556/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpfafi2dno" returned: 0 in 0.055s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:06 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:32:06 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:32:06 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.496s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:06 user nova-compute[73391]: DEBUG nova.compute.manager [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Start building networks asynchronously for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 05:32:06 user nova-compute[73391]: DEBUG nova.compute.manager [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Allocating IP information in the background. {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 05:32:06 user nova-compute[73391]: DEBUG nova.network.neutron [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] allocate_for_instance() {{(pid=73391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 05:32:06 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 05:32:06 user nova-compute[73391]: DEBUG nova.compute.manager [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Start building block device mappings for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 05:32:06 user nova-compute[73391]: INFO nova.virt.block_device [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Booting with blank volume at /dev/vda
Aug 15 05:32:06 user nova-compute[73391]: DEBUG nova.policy [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '887f0846cf554e12acf92a663f5ab266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b9acbe11654053bb905e7c92558a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73391) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 05:32:06 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:32:07 user nova-compute[73391]: DEBUG nova.network.neutron [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Successfully created port: 3b77e3e1-84f9-470a-b684-e8bdc4996c68 {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 05:32:07 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:07 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:07 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:07 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:07 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:08 user nova-compute[73391]: DEBUG nova.compute.manager [req-434c6c6f-eff2-4796-8f1d-5db06619aede req-02e312a1-82d0-4a99-b63b-2c2701bac148 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received event network-vif-plugged-37e2378e-5659-401c-95ce-0424b61e2e1a {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:32:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-434c6c6f-eff2-4796-8f1d-5db06619aede req-02e312a1-82d0-4a99-b63b-2c2701bac148 service nova] Acquiring lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-434c6c6f-eff2-4796-8f1d-5db06619aede req-02e312a1-82d0-4a99-b63b-2c2701bac148 service nova] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-434c6c6f-eff2-4796-8f1d-5db06619aede req-02e312a1-82d0-4a99-b63b-2c2701bac148 service nova] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:08 user nova-compute[73391]: DEBUG nova.compute.manager [req-434c6c6f-eff2-4796-8f1d-5db06619aede req-02e312a1-82d0-4a99-b63b-2c2701bac148 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] No waiting events found dispatching network-vif-plugged-37e2378e-5659-401c-95ce-0424b61e2e1a {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:32:08 user nova-compute[73391]: WARNING nova.compute.manager [req-434c6c6f-eff2-4796-8f1d-5db06619aede req-02e312a1-82d0-4a99-b63b-2c2701bac148 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received unexpected event network-vif-plugged-37e2378e-5659-401c-95ce-0424b61e2e1a for instance with vm_state building and task_state spawning.
Aug 15 05:32:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:08 user nova-compute[73391]: DEBUG nova.compute.manager [req-d136a952-96cb-4fd1-9fc0-61535fe33641 req-0d8f4e32-01de-4919-91d5-4f36a4d00184 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received event network-vif-plugged-879124a9-46cd-45bb-b1a2-34cc8264cf25 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:32:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d136a952-96cb-4fd1-9fc0-61535fe33641 req-0d8f4e32-01de-4919-91d5-4f36a4d00184 service nova] Acquiring lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d136a952-96cb-4fd1-9fc0-61535fe33641 req-0d8f4e32-01de-4919-91d5-4f36a4d00184 service nova] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d136a952-96cb-4fd1-9fc0-61535fe33641 req-0d8f4e32-01de-4919-91d5-4f36a4d00184 service nova] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:08 user nova-compute[73391]: DEBUG nova.compute.manager [req-d136a952-96cb-4fd1-9fc0-61535fe33641 req-0d8f4e32-01de-4919-91d5-4f36a4d00184 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] No waiting events found dispatching network-vif-plugged-879124a9-46cd-45bb-b1a2-34cc8264cf25 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:32:08 user nova-compute[73391]: WARNING nova.compute.manager [req-d136a952-96cb-4fd1-9fc0-61535fe33641 req-0d8f4e32-01de-4919-91d5-4f36a4d00184 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received unexpected event network-vif-plugged-879124a9-46cd-45bb-b1a2-34cc8264cf25 for instance with vm_state building and task_state spawning.
Aug 15 05:32:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:08 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:32:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50abbc6c-79d3-47ee-b9e3-e2e5344e5787 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] [instance: df00c15a-2512-41d0-9857-edb50374897e] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 05:32:08 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-50abbc6c-79d3-47ee-b9e3-e2e5344e5787 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:10c42aea-dda6-436d-9698-7fde946ef419'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wgqiPeTv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:32:08 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-50abbc6c-79d3-47ee-b9e3-e2e5344e5787 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:32:08 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-50abbc6c-79d3-47ee-b9e3-e2e5344e5787 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:32:08 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-50abbc6c-79d3-47ee-b9e3-e2e5344e5787 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:32:08 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-50abbc6c-79d3-47ee-b9e3-e2e5344e5787 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:32:08 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-50abbc6c-79d3-47ee-b9e3-e2e5344e5787 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10c42aea-dda6-436d-9698-7fde946ef419" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:32:08 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-50abbc6c-79d3-47ee-b9e3-e2e5344e5787 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10c42aea-dda6-436d-9698-7fde946ef419" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:32:08 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-50abbc6c-79d3-47ee-b9e3-e2e5344e5787 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 05:32:08 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10c42aea-dda6-436d-9698-7fde946ef419 -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:08 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10c42aea-dda6-436d-9698-7fde946ef419 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:08 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8081b84b-9a78-4a61-8d47-68d7fb503705]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:08 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-50abbc6c-79d3-47ee-b9e3-e2e5344e5787 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 05:32:08 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:08 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10c42aea-dda6-436d-9698-7fde946ef419 -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:08 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10c42aea-dda6-436d-9698-7fde946ef419 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:08 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffec86a-0a20-438f-86e8-7ff94008620d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:10c42aea-dda6-436d-9698-7fde946ef419] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:08 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-50abbc6c-79d3-47ee-b9e3-e2e5344e5787 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:10c42aea-dda6-436d-9698-7fde946ef419] added
Aug 15 05:32:08 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:08 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10c42aea-dda6-436d-9698-7fde946ef419 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:08 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10c42aea-dda6-436d-9698-7fde946ef419 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:08 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bfce8e4-0f9d-4823-ab0e-86331a0f4b55]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:08 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-50abbc6c-79d3-47ee-b9e3-e2e5344e5787 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:08 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10c42aea-dda6-436d-9698-7fde946ef419 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:08 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10c42aea-dda6-436d-9698-7fde946ef419 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:08 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[553f1bd1-3864-4c65-9b1e-6671bdeb14e7]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:08 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-50abbc6c-79d3-47ee-b9e3-e2e5344e5787 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:08 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10c42aea-dda6-436d-9698-7fde946ef419 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wgqiPeTv {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:08 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10c42aea-dda6-436d-9698-7fde946ef419 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wgqiPeTv" returned: 0 in 0.024s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:08 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[211fc709-3267-4c8d-a369-cde1b8e8b382]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:08 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-50abbc6c-79d3-47ee-b9e3-e2e5344e5787 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wgqiPeTv'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10c42aea-dda6-436d-9698-7fde946ef419 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10c42aea-dda6-436d-9698-7fde946ef419 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8494790c-bdaf-4904-93d7-73df11915a4c]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-50abbc6c-79d3-47ee-b9e3-e2e5344e5787 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ef0783b-fba5-4036-99c8-83a341ed1400]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-50abbc6c-79d3-47ee-b9e3-e2e5344e5787 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)
Aug 15 05:32:09 user nova-compute[73391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)
Aug 15 05:32:09 user nova-compute[73391]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:32:09 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:32:09 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:32:09 user nova-compute[73391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)
Aug 15 05:32:09 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:32:09 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-50abbc6c-79d3-47ee-b9e3-e2e5344e5787 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)
Aug 15 05:32:09 user nova-compute[73391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)
Aug 15 05:32:09 user nova-compute[73391]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:32:09 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:32:09 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:32:09 user nova-compute[73391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)
Aug 15 05:32:09 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:32:09 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10c42aea-dda6-436d-9698-7fde946ef419 -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10c42aea-dda6-436d-9698-7fde946ef419 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[837118e7-1248-4e80-8dee-8f5c6a0b65ac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:10c42aea-dda6-436d-9698-7fde946ef419, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:10c42aea-dda6-436d-9698-7fde946ef419, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-50abbc6c-79d3-47ee-b9e3-e2e5344e5787 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:10c42aea-dda6-436d-9698-7fde946ef419, portal: 172.16.0.220,3260]
Aug 15 05:32:09 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:10c42aea-dda6-436d-9698-7fde946ef419, portal: 172.16.0.220,3260] successful.
Aug 15 05:32:09 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10c42aea-dda6-436d-9698-7fde946ef419 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10c42aea-dda6-436d-9698-7fde946ef419 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[90fb105e-d951-4f94-b881-b7ab51a0d821]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-50abbc6c-79d3-47ee-b9e3-e2e5344e5787 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG nova.network.neutron [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Successfully updated port: 3b77e3e1-84f9-470a-b684-e8bdc4996c68 {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[244cbad6-7862-46fb-80c6-03f73ce0fad1]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10c42aea-dda6-436d-9698-7fde946ef419 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquiring lock "refresh_cache-6358e825-5705-45d6-86b6-3aacfa5a9bbb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquired lock "refresh_cache-6358e825-5705-45d6-86b6-3aacfa5a9bbb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG nova.network.neutron [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-50abbc6c-79d3-47ee-b9e3-e2e5344e5787 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)
Aug 15 05:32:09 user nova-compute[73391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)
Aug 15 05:32:09 user nova-compute[73391]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10c42aea-dda6-436d-9698-7fde946ef419 (non-flash)
Aug 15 05:32:09 user nova-compute[73391]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:32:09 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:32:09 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:32:09 user nova-compute[73391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)
Aug 15 05:32:09 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:32:09 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-50abbc6c-79d3-47ee-b9e3-e2e5344e5787 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)
Aug 15 05:32:09 user nova-compute[73391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)
Aug 15 05:32:09 user nova-compute[73391]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10c42aea-dda6-436d-9698-7fde946ef419 (non-flash)
Aug 15 05:32:09 user nova-compute[73391]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:32:09 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:32:09 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:32:09 user nova-compute[73391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)
Aug 15 05:32:09 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:32:09 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-50abbc6c-79d3-47ee-b9e3-e2e5344e5787 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10c42aea-dda6-436d-9698-7fde946ef419" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.406s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-50abbc6c-79d3-47ee-b9e3-e2e5344e5787 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-50abbc6c-79d3-47ee-b9e3-e2e5344e5787 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] HCTL ('36', '-', '-', 0) found on session 12 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-50abbc6c-79d3-47ee-b9e3-e2e5344e5787 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.041s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[974dbe1e-9798-4239-b419-2dd2adfcf2b9]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-50abbc6c-79d3-47ee-b9e3-e2e5344e5787 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Searching for a device in session 12 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-50abbc6c-79d3-47ee-b9e3-e2e5344e5787 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wgqiPeTv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG nova.compute.manager [req-37551f94-9cde-4fff-a666-994f665e59be req-15f25d43-e129-46a4-bc26-e246a024bf4b service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received event network-vif-plugged-7adbd6a6-9a65-4e61-9ff2-63351d5dfaad {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-37551f94-9cde-4fff-a666-994f665e59be req-15f25d43-e129-46a4-bc26-e246a024bf4b service nova] Acquiring lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-37551f94-9cde-4fff-a666-994f665e59be req-15f25d43-e129-46a4-bc26-e246a024bf4b service nova] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-37551f94-9cde-4fff-a666-994f665e59be req-15f25d43-e129-46a4-bc26-e246a024bf4b service nova] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG nova.compute.manager [req-37551f94-9cde-4fff-a666-994f665e59be req-15f25d43-e129-46a4-bc26-e246a024bf4b service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] No waiting events found dispatching network-vif-plugged-7adbd6a6-9a65-4e61-9ff2-63351d5dfaad {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:32:09 user nova-compute[73391]: WARNING nova.compute.manager [req-37551f94-9cde-4fff-a666-994f665e59be req-15f25d43-e129-46a4-bc26-e246a024bf4b service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received unexpected event network-vif-plugged-7adbd6a6-9a65-4e61-9ff2-63351d5dfaad for instance with vm_state building and task_state spawning.
Aug 15 05:32:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG nova.network.neutron [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:09 user nova-compute[73391]: DEBUG nova.network.neutron [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Updating instance_info_cache with network_info: [{"id": "3b77e3e1-84f9-470a-b684-e8bdc4996c68", "address": "fa:16:3e:68:b6:f9", "network": {"id": "70d88082-aea7-48bb-abb4-d77d264aaf01", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b9acbe11654053bb905e7c92558a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b77e3e1-84", "ovs_interfaceid": "3b77e3e1-84f9-470a-b684-e8bdc4996c68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:32:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Releasing lock "refresh_cache-6358e825-5705-45d6-86b6-3aacfa5a9bbb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:32:10 user nova-compute[73391]: DEBUG nova.compute.manager [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Instance network_info: |[{"id": "3b77e3e1-84f9-470a-b684-e8bdc4996c68", "address": "fa:16:3e:68:b6:f9", "network": {"id": "70d88082-aea7-48bb-abb4-d77d264aaf01", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b9acbe11654053bb905e7c92558a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b77e3e1-84", "ovs_interfaceid": "3b77e3e1-84f9-470a-b684-e8bdc4996c68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 05:32:10 user nova-compute[73391]: DEBUG nova.compute.manager [req-35a179b3-1aed-43fe-9132-740989c9f519 req-c34797b0-186e-4dea-8a9e-9d7630c9ad39 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received event network-vif-plugged-37e2378e-5659-401c-95ce-0424b61e2e1a {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:32:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-35a179b3-1aed-43fe-9132-740989c9f519 req-c34797b0-186e-4dea-8a9e-9d7630c9ad39 service nova] Acquiring lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-35a179b3-1aed-43fe-9132-740989c9f519 req-c34797b0-186e-4dea-8a9e-9d7630c9ad39 service nova] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-35a179b3-1aed-43fe-9132-740989c9f519 req-c34797b0-186e-4dea-8a9e-9d7630c9ad39 service nova] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:10 user nova-compute[73391]: DEBUG nova.compute.manager [req-35a179b3-1aed-43fe-9132-740989c9f519 req-c34797b0-186e-4dea-8a9e-9d7630c9ad39 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] No waiting events found dispatching network-vif-plugged-37e2378e-5659-401c-95ce-0424b61e2e1a {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:32:10 user nova-compute[73391]: WARNING nova.compute.manager [req-35a179b3-1aed-43fe-9132-740989c9f519 req-c34797b0-186e-4dea-8a9e-9d7630c9ad39 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received unexpected event network-vif-plugged-37e2378e-5659-401c-95ce-0424b61e2e1a for instance with vm_state building and task_state spawning.
Aug 15 05:32:10 user nova-compute[73391]: DEBUG nova.compute.manager [req-35a179b3-1aed-43fe-9132-740989c9f519 req-c34797b0-186e-4dea-8a9e-9d7630c9ad39 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received event network-vif-plugged-23d27a9f-a59d-4369-a8c2-0f09564bb78d {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:32:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-35a179b3-1aed-43fe-9132-740989c9f519 req-c34797b0-186e-4dea-8a9e-9d7630c9ad39 service nova] Acquiring lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-35a179b3-1aed-43fe-9132-740989c9f519 req-c34797b0-186e-4dea-8a9e-9d7630c9ad39 service nova] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-35a179b3-1aed-43fe-9132-740989c9f519 req-c34797b0-186e-4dea-8a9e-9d7630c9ad39 service nova] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:10 user nova-compute[73391]: DEBUG nova.compute.manager [req-35a179b3-1aed-43fe-9132-740989c9f519 req-c34797b0-186e-4dea-8a9e-9d7630c9ad39 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] No waiting events found dispatching network-vif-plugged-23d27a9f-a59d-4369-a8c2-0f09564bb78d {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:32:10 user nova-compute[73391]: WARNING nova.compute.manager [req-35a179b3-1aed-43fe-9132-740989c9f519 req-c34797b0-186e-4dea-8a9e-9d7630c9ad39 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received unexpected event network-vif-plugged-23d27a9f-a59d-4369-a8c2-0f09564bb78d for instance with vm_state building and task_state spawning.
Aug 15 05:32:10 user nova-compute[73391]: DEBUG nova.compute.manager [req-35a179b3-1aed-43fe-9132-740989c9f519 req-c34797b0-186e-4dea-8a9e-9d7630c9ad39 service nova] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Received event network-changed-3b77e3e1-84f9-470a-b684-e8bdc4996c68 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:32:10 user nova-compute[73391]: DEBUG nova.compute.manager [req-35a179b3-1aed-43fe-9132-740989c9f519 req-c34797b0-186e-4dea-8a9e-9d7630c9ad39 service nova] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Refreshing instance network info cache due to event network-changed-3b77e3e1-84f9-470a-b684-e8bdc4996c68. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:32:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-35a179b3-1aed-43fe-9132-740989c9f519 req-c34797b0-186e-4dea-8a9e-9d7630c9ad39 service nova] Acquiring lock "refresh_cache-6358e825-5705-45d6-86b6-3aacfa5a9bbb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:32:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-35a179b3-1aed-43fe-9132-740989c9f519 req-c34797b0-186e-4dea-8a9e-9d7630c9ad39 service nova] Acquired lock "refresh_cache-6358e825-5705-45d6-86b6-3aacfa5a9bbb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:32:10 user nova-compute[73391]: DEBUG nova.network.neutron [req-35a179b3-1aed-43fe-9132-740989c9f519 req-c34797b0-186e-4dea-8a9e-9d7630c9ad39 service nova] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Refreshing network info cache for port 3b77e3e1-84f9-470a-b684-e8bdc4996c68 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:32:10 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:10 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:10 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-50abbc6c-79d3-47ee-b9e3-e2e5344e5787 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.473s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:32:10 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-50abbc6c-79d3-47ee-b9e3-e2e5344e5787 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] <== connect_volume: return (1476ms) {'type': 'block', 'scsi_wwn': '23534643834613061', 'path': '/dev/sde'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:32:10 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50abbc6c-79d3-47ee-b9e3-e2e5344e5787 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] [instance: df00c15a-2512-41d0-9857-edb50374897e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23534643834613061', 'path': '/dev/sde'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 05:32:10 user nova-compute[73391]: DEBUG nova.objects.instance [None req-50abbc6c-79d3-47ee-b9e3-e2e5344e5787 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Lazy-loading 'flavor' on Instance uuid df00c15a-2512-41d0-9857-edb50374897e {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:32:10 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-50abbc6c-79d3-47ee-b9e3-e2e5344e5787 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 05:32:10 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:32:10 user nova-compute[73391]:   <source dev="/dev/sde"/>
Aug 15 05:32:10 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:32:10 user nova-compute[73391]:   <serial>10c42aea-dda6-436d-9698-7fde946ef419</serial>
Aug 15 05:32:10 user nova-compute[73391]: </disk>
Aug 15 05:32:10 user nova-compute[73391]:  {{(pid=73391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 05:32:10 user nova-compute[73391]: DEBUG nova.objects.instance [None req-a1812145-31cc-458c-b4b3-225c662d9181 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] Lazy-loading 'flavor' on Instance uuid ee96866e-7ee0-46a1-be1a-60439a52d513 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:32:10 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-a1812145-31cc-458c-b4b3-225c662d9181 tempest-VolumesAssistedSnapshotsTest-2112496230 tempest-VolumesAssistedSnapshotsTest-2112496230-project-admin] Lock "ee96866e-7ee0-46a1-be1a-60439a52d513" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 6.868s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:10 user nova-compute[73391]: DEBUG nova.compute.manager [req-af374f67-c3f6-402c-8d99-e5b4eddd9a8d req-773cebd7-e82a-4304-9888-988cfa83bbff service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received event network-vif-plugged-879124a9-46cd-45bb-b1a2-34cc8264cf25 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:32:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-af374f67-c3f6-402c-8d99-e5b4eddd9a8d req-773cebd7-e82a-4304-9888-988cfa83bbff service nova] Acquiring lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-af374f67-c3f6-402c-8d99-e5b4eddd9a8d req-773cebd7-e82a-4304-9888-988cfa83bbff service nova] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-af374f67-c3f6-402c-8d99-e5b4eddd9a8d req-773cebd7-e82a-4304-9888-988cfa83bbff service nova] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:10 user nova-compute[73391]: DEBUG nova.compute.manager [req-af374f67-c3f6-402c-8d99-e5b4eddd9a8d req-773cebd7-e82a-4304-9888-988cfa83bbff service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] No waiting events found dispatching network-vif-plugged-879124a9-46cd-45bb-b1a2-34cc8264cf25 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:32:10 user nova-compute[73391]: WARNING nova.compute.manager [req-af374f67-c3f6-402c-8d99-e5b4eddd9a8d req-773cebd7-e82a-4304-9888-988cfa83bbff service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received unexpected event network-vif-plugged-879124a9-46cd-45bb-b1a2-34cc8264cf25 for instance with vm_state building and task_state spawning.
Aug 15 05:32:10 user nova-compute[73391]: DEBUG nova.compute.manager [req-af374f67-c3f6-402c-8d99-e5b4eddd9a8d req-773cebd7-e82a-4304-9888-988cfa83bbff service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received event network-vif-plugged-33d14fed-6340-407f-bdf1-c858e9cf395c {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:32:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-af374f67-c3f6-402c-8d99-e5b4eddd9a8d req-773cebd7-e82a-4304-9888-988cfa83bbff service nova] Acquiring lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-af374f67-c3f6-402c-8d99-e5b4eddd9a8d req-773cebd7-e82a-4304-9888-988cfa83bbff service nova] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-af374f67-c3f6-402c-8d99-e5b4eddd9a8d req-773cebd7-e82a-4304-9888-988cfa83bbff service nova] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:10 user nova-compute[73391]: DEBUG nova.compute.manager [req-af374f67-c3f6-402c-8d99-e5b4eddd9a8d req-773cebd7-e82a-4304-9888-988cfa83bbff service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] No waiting events found dispatching network-vif-plugged-33d14fed-6340-407f-bdf1-c858e9cf395c {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:32:10 user nova-compute[73391]: WARNING nova.compute.manager [req-af374f67-c3f6-402c-8d99-e5b4eddd9a8d req-773cebd7-e82a-4304-9888-988cfa83bbff service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received unexpected event network-vif-plugged-33d14fed-6340-407f-bdf1-c858e9cf395c for instance with vm_state building and task_state spawning.
Aug 15 05:32:10 user nova-compute[73391]: DEBUG nova.compute.manager [req-af374f67-c3f6-402c-8d99-e5b4eddd9a8d req-773cebd7-e82a-4304-9888-988cfa83bbff service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received event network-vif-plugged-33d14fed-6340-407f-bdf1-c858e9cf395c {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:32:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-af374f67-c3f6-402c-8d99-e5b4eddd9a8d req-773cebd7-e82a-4304-9888-988cfa83bbff service nova] Acquiring lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-af374f67-c3f6-402c-8d99-e5b4eddd9a8d req-773cebd7-e82a-4304-9888-988cfa83bbff service nova] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-af374f67-c3f6-402c-8d99-e5b4eddd9a8d req-773cebd7-e82a-4304-9888-988cfa83bbff service nova] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:10 user nova-compute[73391]: DEBUG nova.compute.manager [req-af374f67-c3f6-402c-8d99-e5b4eddd9a8d req-773cebd7-e82a-4304-9888-988cfa83bbff service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] No waiting events found dispatching network-vif-plugged-33d14fed-6340-407f-bdf1-c858e9cf395c {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:32:10 user nova-compute[73391]: WARNING nova.compute.manager [req-af374f67-c3f6-402c-8d99-e5b4eddd9a8d req-773cebd7-e82a-4304-9888-988cfa83bbff service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received unexpected event network-vif-plugged-33d14fed-6340-407f-bdf1-c858e9cf395c for instance with vm_state building and task_state spawning.
Aug 15 05:32:10 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-50abbc6c-79d3-47ee-b9e3-e2e5344e5787 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:32:10 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-50abbc6c-79d3-47ee-b9e3-e2e5344e5787 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] No BDM found with device name hda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:32:10 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-50abbc6c-79d3-47ee-b9e3-e2e5344e5787 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] No VIF found with MAC fa:16:3e:92:27:fb, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:32:10 user nova-compute[73391]: DEBUG nova.network.neutron [req-35a179b3-1aed-43fe-9132-740989c9f519 req-c34797b0-186e-4dea-8a9e-9d7630c9ad39 service nova] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Updated VIF entry in instance network info cache for port 3b77e3e1-84f9-470a-b684-e8bdc4996c68. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:32:10 user nova-compute[73391]: DEBUG nova.network.neutron [req-35a179b3-1aed-43fe-9132-740989c9f519 req-c34797b0-186e-4dea-8a9e-9d7630c9ad39 service nova] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Updating instance_info_cache with network_info: [{"id": "3b77e3e1-84f9-470a-b684-e8bdc4996c68", "address": "fa:16:3e:68:b6:f9", "network": {"id": "70d88082-aea7-48bb-abb4-d77d264aaf01", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b9acbe11654053bb905e7c92558a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b77e3e1-84", "ovs_interfaceid": "3b77e3e1-84f9-470a-b684-e8bdc4996c68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:32:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-35a179b3-1aed-43fe-9132-740989c9f519 req-c34797b0-186e-4dea-8a9e-9d7630c9ad39 service nova] Releasing lock "refresh_cache-6358e825-5705-45d6-86b6-3aacfa5a9bbb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:32:10 user nova-compute[73391]: DEBUG nova.compute.manager [req-35a179b3-1aed-43fe-9132-740989c9f519 req-c34797b0-186e-4dea-8a9e-9d7630c9ad39 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received event network-vif-plugged-23d27a9f-a59d-4369-a8c2-0f09564bb78d {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:32:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-35a179b3-1aed-43fe-9132-740989c9f519 req-c34797b0-186e-4dea-8a9e-9d7630c9ad39 service nova] Acquiring lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-35a179b3-1aed-43fe-9132-740989c9f519 req-c34797b0-186e-4dea-8a9e-9d7630c9ad39 service nova] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-35a179b3-1aed-43fe-9132-740989c9f519 req-c34797b0-186e-4dea-8a9e-9d7630c9ad39 service nova] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:10 user nova-compute[73391]: DEBUG nova.compute.manager [req-35a179b3-1aed-43fe-9132-740989c9f519 req-c34797b0-186e-4dea-8a9e-9d7630c9ad39 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] No waiting events found dispatching network-vif-plugged-23d27a9f-a59d-4369-a8c2-0f09564bb78d {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:32:10 user nova-compute[73391]: WARNING nova.compute.manager [req-35a179b3-1aed-43fe-9132-740989c9f519 req-c34797b0-186e-4dea-8a9e-9d7630c9ad39 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received unexpected event network-vif-plugged-23d27a9f-a59d-4369-a8c2-0f09564bb78d for instance with vm_state building and task_state spawning.
Aug 15 05:32:10 user nova-compute[73391]: DEBUG nova.compute.manager [req-35a179b3-1aed-43fe-9132-740989c9f519 req-c34797b0-186e-4dea-8a9e-9d7630c9ad39 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received event network-vif-plugged-a09443ce-b3e9-4fe7-b24a-b1c609cb2553 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:32:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-35a179b3-1aed-43fe-9132-740989c9f519 req-c34797b0-186e-4dea-8a9e-9d7630c9ad39 service nova] Acquiring lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-35a179b3-1aed-43fe-9132-740989c9f519 req-c34797b0-186e-4dea-8a9e-9d7630c9ad39 service nova] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-35a179b3-1aed-43fe-9132-740989c9f519 req-c34797b0-186e-4dea-8a9e-9d7630c9ad39 service nova] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:10 user nova-compute[73391]: DEBUG nova.compute.manager [req-35a179b3-1aed-43fe-9132-740989c9f519 req-c34797b0-186e-4dea-8a9e-9d7630c9ad39 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] No waiting events found dispatching network-vif-plugged-a09443ce-b3e9-4fe7-b24a-b1c609cb2553 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:32:10 user nova-compute[73391]: WARNING nova.compute.manager [req-35a179b3-1aed-43fe-9132-740989c9f519 req-c34797b0-186e-4dea-8a9e-9d7630c9ad39 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received unexpected event network-vif-plugged-a09443ce-b3e9-4fe7-b24a-b1c609cb2553 for instance with vm_state building and task_state spawning.
Aug 15 05:32:11 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:11 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-50abbc6c-79d3-47ee-b9e3-e2e5344e5787 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Lock "df00c15a-2512-41d0-9857-edb50374897e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.807s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:11 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:11 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:11 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:11 user nova-compute[73391]: DEBUG nova.compute.manager [req-89e329ee-d43d-444e-9c96-22a48ea228cd req-1aa18f03-3b1b-4a9c-8965-dc6f83173627 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received event network-vif-plugged-7adbd6a6-9a65-4e61-9ff2-63351d5dfaad {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:32:11 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-89e329ee-d43d-444e-9c96-22a48ea228cd req-1aa18f03-3b1b-4a9c-8965-dc6f83173627 service nova] Acquiring lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:11 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-89e329ee-d43d-444e-9c96-22a48ea228cd req-1aa18f03-3b1b-4a9c-8965-dc6f83173627 service nova] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:11 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-89e329ee-d43d-444e-9c96-22a48ea228cd req-1aa18f03-3b1b-4a9c-8965-dc6f83173627 service nova] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:11 user nova-compute[73391]: DEBUG nova.compute.manager [req-89e329ee-d43d-444e-9c96-22a48ea228cd req-1aa18f03-3b1b-4a9c-8965-dc6f83173627 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] No waiting events found dispatching network-vif-plugged-7adbd6a6-9a65-4e61-9ff2-63351d5dfaad {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:32:11 user nova-compute[73391]: WARNING nova.compute.manager [req-89e329ee-d43d-444e-9c96-22a48ea228cd req-1aa18f03-3b1b-4a9c-8965-dc6f83173627 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received unexpected event network-vif-plugged-7adbd6a6-9a65-4e61-9ff2-63351d5dfaad for instance with vm_state building and task_state spawning.
Aug 15 05:32:11 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:32:11 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:11 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:11 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:11 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Auditing locally available compute resources for user (node: user) {{(pid=73391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 05:32:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee96866e-7ee0-46a1-be1a-60439a52d513/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee96866e-7ee0-46a1-be1a-60439a52d513/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee96866e-7ee0-46a1-be1a-60439a52d513/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:12 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077532.1201735, 96c5782e-9d00-4bb8-8e1d-99416bc7d556 => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:32:12 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] VM Resumed (Lifecycle Event)
Aug 15 05:32:12 user nova-compute[73391]: DEBUG nova.compute.manager [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:32:12 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Guest created on hypervisor {{(pid=73391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 05:32:12 user nova-compute[73391]: DEBUG nova.compute.manager [req-8467c6d6-0ccb-493b-aac5-3618aec96c59 req-5621eaaf-f54d-4e0a-bbdb-0e7120c4bed1 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received event network-vif-plugged-a09443ce-b3e9-4fe7-b24a-b1c609cb2553 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:32:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-8467c6d6-0ccb-493b-aac5-3618aec96c59 req-5621eaaf-f54d-4e0a-bbdb-0e7120c4bed1 service nova] Acquiring lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-8467c6d6-0ccb-493b-aac5-3618aec96c59 req-5621eaaf-f54d-4e0a-bbdb-0e7120c4bed1 service nova] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-8467c6d6-0ccb-493b-aac5-3618aec96c59 req-5621eaaf-f54d-4e0a-bbdb-0e7120c4bed1 service nova] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:12 user nova-compute[73391]: DEBUG nova.compute.manager [req-8467c6d6-0ccb-493b-aac5-3618aec96c59 req-5621eaaf-f54d-4e0a-bbdb-0e7120c4bed1 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] No waiting events found dispatching network-vif-plugged-a09443ce-b3e9-4fe7-b24a-b1c609cb2553 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:32:12 user nova-compute[73391]: WARNING nova.compute.manager [req-8467c6d6-0ccb-493b-aac5-3618aec96c59 req-5621eaaf-f54d-4e0a-bbdb-0e7120c4bed1 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received unexpected event network-vif-plugged-a09443ce-b3e9-4fe7-b24a-b1c609cb2553 for instance with vm_state building and task_state spawning.
Aug 15 05:32:12 user nova-compute[73391]: DEBUG nova.compute.manager [req-8467c6d6-0ccb-493b-aac5-3618aec96c59 req-5621eaaf-f54d-4e0a-bbdb-0e7120c4bed1 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received event network-vif-plugged-ae52a22f-e13e-4da6-9561-ba679ac242b1 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:32:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-8467c6d6-0ccb-493b-aac5-3618aec96c59 req-5621eaaf-f54d-4e0a-bbdb-0e7120c4bed1 service nova] Acquiring lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-8467c6d6-0ccb-493b-aac5-3618aec96c59 req-5621eaaf-f54d-4e0a-bbdb-0e7120c4bed1 service nova] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-8467c6d6-0ccb-493b-aac5-3618aec96c59 req-5621eaaf-f54d-4e0a-bbdb-0e7120c4bed1 service nova] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:12 user nova-compute[73391]: DEBUG nova.compute.manager [req-8467c6d6-0ccb-493b-aac5-3618aec96c59 req-5621eaaf-f54d-4e0a-bbdb-0e7120c4bed1 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] No waiting events found dispatching network-vif-plugged-ae52a22f-e13e-4da6-9561-ba679ac242b1 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:32:12 user nova-compute[73391]: WARNING nova.compute.manager [req-8467c6d6-0ccb-493b-aac5-3618aec96c59 req-5621eaaf-f54d-4e0a-bbdb-0e7120c4bed1 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received unexpected event network-vif-plugged-ae52a22f-e13e-4da6-9561-ba679ac242b1 for instance with vm_state building and task_state spawning.
Aug 15 05:32:12 user nova-compute[73391]: DEBUG nova.compute.manager [req-8467c6d6-0ccb-493b-aac5-3618aec96c59 req-5621eaaf-f54d-4e0a-bbdb-0e7120c4bed1 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received event network-vif-plugged-ae52a22f-e13e-4da6-9561-ba679ac242b1 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:32:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-8467c6d6-0ccb-493b-aac5-3618aec96c59 req-5621eaaf-f54d-4e0a-bbdb-0e7120c4bed1 service nova] Acquiring lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-8467c6d6-0ccb-493b-aac5-3618aec96c59 req-5621eaaf-f54d-4e0a-bbdb-0e7120c4bed1 service nova] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-8467c6d6-0ccb-493b-aac5-3618aec96c59 req-5621eaaf-f54d-4e0a-bbdb-0e7120c4bed1 service nova] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:12 user nova-compute[73391]: DEBUG nova.compute.manager [req-8467c6d6-0ccb-493b-aac5-3618aec96c59 req-5621eaaf-f54d-4e0a-bbdb-0e7120c4bed1 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] No waiting events found dispatching network-vif-plugged-ae52a22f-e13e-4da6-9561-ba679ac242b1 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:32:12 user nova-compute[73391]: WARNING nova.compute.manager [req-8467c6d6-0ccb-493b-aac5-3618aec96c59 req-5621eaaf-f54d-4e0a-bbdb-0e7120c4bed1 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received unexpected event network-vif-plugged-ae52a22f-e13e-4da6-9561-ba679ac242b1 for instance with vm_state building and task_state spawning.
Aug 15 05:32:12 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:32:12 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Instance spawned successfully.
Aug 15 05:32:12 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 05:32:12 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:32:12 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:32:12 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077532.1209757, 96c5782e-9d00-4bb8-8e1d-99416bc7d556 => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:32:12 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] VM Started (Lifecycle Event)
Aug 15 05:32:12 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Found default for hw_cdrom_bus of ide {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:32:12 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Found default for hw_disk_bus of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:32:12 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Found default for hw_input_bus of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:32:12 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Found default for hw_pointer_model of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:32:12 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Found default for hw_video_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:32:12 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Found default for hw_vif_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:32:12 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:32:12 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:32:12 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:32:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ee96866e-7ee0-46a1-be1a-60439a52d513/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:12 user nova-compute[73391]: INFO nova.compute.manager [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Took 13.28 seconds to spawn the instance on the hypervisor.
Aug 15 05:32:12 user nova-compute[73391]: DEBUG nova.compute.manager [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:32:12 user nova-compute[73391]: INFO nova.compute.manager [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Took 73.27 seconds to build instance.
Aug 15 05:32:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e0b32f8f-6f85-471e-9515-a9e5a1884e98 tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 73.392s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b7704e3-f48b-473c-89ae-5437a690f06a/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d634b900-4de1-4951-82df-02f0cd6b1847 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Acquiring lock "df00c15a-2512-41d0-9857-edb50374897e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d634b900-4de1-4951-82df-02f0cd6b1847 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Lock "df00c15a-2512-41d0-9857-edb50374897e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:12 user nova-compute[73391]: INFO nova.compute.manager [None req-d634b900-4de1-4951-82df-02f0cd6b1847 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] [instance: df00c15a-2512-41d0-9857-edb50374897e] Detaching volume 10c42aea-dda6-436d-9698-7fde946ef419
Aug 15 05:32:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b7704e3-f48b-473c-89ae-5437a690f06a/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b7704e3-f48b-473c-89ae-5437a690f06a/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:13 user nova-compute[73391]: INFO nova.virt.block_device [None req-d634b900-4de1-4951-82df-02f0cd6b1847 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] [instance: df00c15a-2512-41d0-9857-edb50374897e] Attempting to driver detach volume 10c42aea-dda6-436d-9698-7fde946ef419 from mountpoint /dev/vdb
Aug 15 05:32:13 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-d634b900-4de1-4951-82df-02f0cd6b1847 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Attempting to detach device vdb from instance df00c15a-2512-41d0-9857-edb50374897e from the persistent domain config. {{(pid=73391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-d634b900-4de1-4951-82df-02f0cd6b1847 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 05:32:13 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:32:13 user nova-compute[73391]:   <source dev="/dev/sde"/>
Aug 15 05:32:13 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:32:13 user nova-compute[73391]:   <serial>10c42aea-dda6-436d-9698-7fde946ef419</serial>
Aug 15 05:32:13 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 15 05:32:13 user nova-compute[73391]: </disk>
Aug 15 05:32:13 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 05:32:13 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-d634b900-4de1-4951-82df-02f0cd6b1847 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Successfully detached device vdb from instance df00c15a-2512-41d0-9857-edb50374897e from the persistent domain config.
Aug 15 05:32:13 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-d634b900-4de1-4951-82df-02f0cd6b1847 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance df00c15a-2512-41d0-9857-edb50374897e from the live domain config. {{(pid=73391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-d634b900-4de1-4951-82df-02f0cd6b1847 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 05:32:13 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:32:13 user nova-compute[73391]:   <source dev="/dev/sde"/>
Aug 15 05:32:13 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:32:13 user nova-compute[73391]:   <serial>10c42aea-dda6-436d-9698-7fde946ef419</serial>
Aug 15 05:32:13 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 15 05:32:13 user nova-compute[73391]: </disk>
Aug 15 05:32:13 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b7704e3-f48b-473c-89ae-5437a690f06a/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0169df15-335e-46e6-a5c8-9deb7095bb84/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0169df15-335e-46e6-a5c8-9deb7095bb84/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0169df15-335e-46e6-a5c8-9deb7095bb84/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Received event <DeviceRemovedEvent: 1692077533.493363, df00c15a-2512-41d0-9857-edb50374897e => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73391) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-d634b900-4de1-4951-82df-02f0cd6b1847 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance df00c15a-2512-41d0-9857-edb50374897e {{(pid=73391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 05:32:13 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-d634b900-4de1-4951-82df-02f0cd6b1847 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Successfully detached device vdb from instance df00c15a-2512-41d0-9857-edb50374897e from the live domain config.
Aug 15 05:32:13 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d634b900-4de1-4951-82df-02f0cd6b1847 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] [instance: df00c15a-2512-41d0-9857-edb50374897e] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d634b900-4de1-4951-82df-02f0cd6b1847 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:10c42aea-dda6-436d-9698-7fde946ef419'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wgqiPeTv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:32:13 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-d634b900-4de1-4951-82df-02f0cd6b1847 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:32:13 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-d634b900-4de1-4951-82df-02f0cd6b1847 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-d634b900-4de1-4951-82df-02f0cd6b1847 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d634b900-4de1-4951-82df-02f0cd6b1847 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10c42aea-dda6-436d-9698-7fde946ef419', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f4f139-faa2-4c64-902e-66ca20c3ee5d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10c42aea-dda6-436d-9698-7fde946ef419\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0169df15-335e-46e6-a5c8-9deb7095bb84/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdi (vdc) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3149497a-f85b-4443-8345-f824ce2902bc]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10c42aea-dda6-436d-9698-7fde946ef419 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d634b900-4de1-4951-82df-02f0cd6b1847 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)
Aug 15 05:32:13 user nova-compute[73391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)
Aug 15 05:32:13 user nova-compute[73391]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10c42aea-dda6-436d-9698-7fde946ef419 (non-flash)
Aug 15 05:32:13 user nova-compute[73391]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:32:13 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:32:13 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:32:13 user nova-compute[73391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)
Aug 15 05:32:13 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:32:13 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d634b900-4de1-4951-82df-02f0cd6b1847 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)
Aug 15 05:32:13 user nova-compute[73391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)
Aug 15 05:32:13 user nova-compute[73391]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10c42aea-dda6-436d-9698-7fde946ef419 (non-flash)
Aug 15 05:32:13 user nova-compute[73391]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:32:13 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:32:13 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:32:13 user nova-compute[73391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)
Aug 15 05:32:13 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:32:13 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d634b900-4de1-4951-82df-02f0cd6b1847 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7757fd1870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10c42aea-dda6-436d-9698-7fde946ef419'): ({'sde'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-d634b900-4de1-4951-82df-02f0cd6b1847 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Removing single pathed devices sde {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0315f9-cf3e-4df6-bc90-6fbbe6192279]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b49ce6-6a72-4913-af64-537ba0dc55ef]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-d634b900-4de1-4951-82df-02f0cd6b1847 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Flushing IO for device /dev/sde {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7198b1-0b2b-4cae-acc1-e122c5426fc3]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-d634b900-4de1-4951-82df-02f0cd6b1847 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.047s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d00ffa3d-514b-4dc7-b3d2-6eea8e68d46d]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-d634b900-4de1-4951-82df-02f0cd6b1847 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-d634b900-4de1-4951-82df-02f0cd6b1847 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] SCSI volumes sde have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d634b900-4de1-4951-82df-02f0cd6b1847 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10c42aea-dda6-436d-9698-7fde946ef419')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10c42aea-dda6-436d-9698-7fde946ef419 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10c42aea-dda6-436d-9698-7fde946ef419 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d85cdf-8ae7-4bdb-b6d1-c84987d37369]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d634b900-4de1-4951-82df-02f0cd6b1847 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10c42aea-dda6-436d-9698-7fde946ef419 -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10c42aea-dda6-436d-9698-7fde946ef419 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[677f338a-3bc2-4475-bb16-11686bee29d9]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:10c42aea-dda6-436d-9698-7fde946ef419, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:10c42aea-dda6-436d-9698-7fde946ef419, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d634b900-4de1-4951-82df-02f0cd6b1847 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:10c42aea-dda6-436d-9698-7fde946ef419, portal: 172.16.0.220,3260]
Aug 15 05:32:13 user nova-compute[73391]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:10c42aea-dda6-436d-9698-7fde946ef419, portal: 172.16.0.220,3260] successful.
Aug 15 05:32:13 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10c42aea-dda6-436d-9698-7fde946ef419 -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10c42aea-dda6-436d-9698-7fde946ef419 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.044s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0541aff7-75bc-4cfe-99fd-15790fe5dd20]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d634b900-4de1-4951-82df-02f0cd6b1847 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-d634b900-4de1-4951-82df-02f0cd6b1847 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d634b900-4de1-4951-82df-02f0cd6b1847 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] <== disconnect_volume: return (373ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d634b900-4de1-4951-82df-02f0cd6b1847 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] [instance: df00c15a-2512-41d0-9857-edb50374897e] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 05:32:13 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b9f5970-65c5-4eff-a4bf-d18a9c916c90/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b9f5970-65c5-4eff-a4bf-d18a9c916c90/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b9f5970-65c5-4eff-a4bf-d18a9c916c90/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b9f5970-65c5-4eff-a4bf-d18a9c916c90/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df00c15a-2512-41d0-9857-edb50374897e/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df00c15a-2512-41d0-9857-edb50374897e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df00c15a-2512-41d0-9857-edb50374897e/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/df00c15a-2512-41d0-9857-edb50374897e/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:32:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:32:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:32:15 user nova-compute[73391]: DEBUG nova.objects.instance [None req-d634b900-4de1-4951-82df-02f0cd6b1847 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Lazy-loading 'flavor' on Instance uuid df00c15a-2512-41d0-9857-edb50374897e {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:32:15 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:32:15 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:32:15 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Hypervisor/Node resource view: name=user free_ram=7490MB free_disk=25.551502227783203GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 05:32:15 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:15 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:15 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:15 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d634b900-4de1-4951-82df-02f0cd6b1847 tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Lock "df00c15a-2512-41d0-9857-edb50374897e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.683s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:15 user nova-compute[73391]: DEBUG nova.compute.manager [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'POMEuziG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0169df15-335e-46e6-a5c8-9deb7095bb84', 'attached_at': '', 'detached_at': '', 'volume_id': '4003a351-ce41-40db-8e1f-95bd0985e3e9', 'serial': '4003a351-ce41-40db-8e1f-95bd0985e3e9'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XYflAmQI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '0169df15-335e-46e6-a5c8-9deb7095bb84', 'attached_at': '', 'detached_at': '', 'volume_id': 'fb592ee0-ed3e-427a-8cc4-05091385a40a', 'serial'} {{(pid=73391) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 15 05:32:15 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 05:32:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'POMEuziG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:32:15 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:32:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:32:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:32:15 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:32:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:32:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:32:15 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 05:32:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9 -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:15 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9dbad5b-c203-44a0-8950-2adeaa6add95]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 05:32:15 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:15 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 8f08782b-f793-415e-b0d6-5caad1c3d426 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:32:15 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 6ac9d5dc-56be-402f-b9d4-3327bdfd9220 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:32:15 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 4b9f5970-65c5-4eff-a4bf-d18a9c916c90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:32:15 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance df00c15a-2512-41d0-9857-edb50374897e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:32:15 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 0169df15-335e-46e6-a5c8-9deb7095bb84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:32:15 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance ee96866e-7ee0-46a1-be1a-60439a52d513 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:32:15 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 7b7704e3-f48b-473c-89ae-5437a690f06a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:32:15 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:32:15 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 96c5782e-9d00-4bb8-8e1d-99416bc7d556 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:32:15 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 6358e825-5705-45d6-86b6-3aacfa5a9bbb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:32:15 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 05:32:15 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 05:32:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:15 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8a00c7-d734-4263-b37c-d45ece6d589b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9] added
Aug 15 05:32:15 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:15 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[73be7f5e-31ee-4f4a-97d3-e4e455c1d550]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:15 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ea18ca-5e69-4cac-ab67-29cf4033ffac]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v POMEuziG {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v POMEuziG" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:15 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c7eeca-c7bc-49f9-af6d-30e09d5f6ed3]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'POMEuziG'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:15 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[525ce61d-3798-40be-aab3-e6b68caed231]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:15 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7676b204-c082-49c0-982d-3ea420b4562f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)
Aug 15 05:32:15 user nova-compute[73391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)
Aug 15 05:32:15 user nova-compute[73391]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:32:15 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:32:15 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:32:15 user nova-compute[73391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)
Aug 15 05:32:15 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:32:15 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:32:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)
Aug 15 05:32:15 user nova-compute[73391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)
Aug 15 05:32:15 user nova-compute[73391]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:32:15 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:32:15 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:32:15 user nova-compute[73391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)
Aug 15 05:32:15 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:32:15 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:32:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9 -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9 -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:15 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b0f77e-d96d-4e99-95d6-1949daa069a8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9, portal: 172.16.0.220,3260]
Aug 15 05:32:15 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9, portal: 172.16.0.220,3260] successful.
Aug 15 05:32:15 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:15 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[055f3e6e-e98b-4987-ae63-65e20a656f3d]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:16 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3576b481-5f51-41f9-a0fd-1807e4d11803]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:16 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)
Aug 15 05:32:16 user nova-compute[73391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)
Aug 15 05:32:16 user nova-compute[73391]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9 (non-flash)
Aug 15 05:32:16 user nova-compute[73391]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:32:16 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:32:16 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:32:16 user nova-compute[73391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)
Aug 15 05:32:16 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:32:16 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:32:16 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)
Aug 15 05:32:16 user nova-compute[73391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)
Aug 15 05:32:16 user nova-compute[73391]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9 (non-flash)
Aug 15 05:32:16 user nova-compute[73391]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:32:16 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:32:16 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:32:16 user nova-compute[73391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)
Aug 15 05:32:16 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:32:16 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:32:16 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.384s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:32:16 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 05:32:16 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] HCTL ('36', '-', '-', 0) found on session 13 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 05:32:16 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 05:32:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:16 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:32:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.079s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:16 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f443b14-54b5-4bde-815e-72425eb2408b]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:16 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] Searching for a device in session 13 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:32:16 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'POMEuziG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 05:32:16 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:32:16 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Compute_service record updated for user:user {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 05:32:16 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.662s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:16 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-74fd441f-0a1e-4398-9a32-c83841eafe0f tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Acquiring lock "interface-df00c15a-2512-41d0-9857-edb50374897e-f2700be5-db51-43e4-bfaa-aa91b76489af" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:16 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-74fd441f-0a1e-4398-9a32-c83841eafe0f tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Lock "interface-df00c15a-2512-41d0-9857-edb50374897e-f2700be5-db51-43e4-bfaa-aa91b76489af" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:16 user nova-compute[73391]: DEBUG nova.objects.instance [None req-74fd441f-0a1e-4398-9a32-c83841eafe0f tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Lazy-loading 'flavor' on Instance uuid df00c15a-2512-41d0-9857-edb50374897e {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:32:16 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-74fd441f-0a1e-4398-9a32-c83841eafe0f tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T05:29:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1483983120',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1483983120',id=6,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2gCgxFYyHMvanjOmlhgs+PtTOvShgOshpOoTRWbXBVti5EI5YAHx014n7qsJi2J2bJRkI0PBGeXP5u90VAUBx25BB0y6ovoKoEveKinIqcQDUv9GNl+Dqk3GoYb9mVVg==',key_name='tempest-keypair-1486183318',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:30:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d2905fedccc4085a38a905192ba079b',ramdisk_id='',reservation_id='r-j2lev19d',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1390153553',owner_user_name='tempest-TaggedAttachmentsTest-1390153553-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:30:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='42f8f8600f9a4d81a72afbaf2bbd53a5',uuid=df00c15a-2512-41d0-9857-edb50374897e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f2700be5-db51-43e4-bfaa-aa91b76489af", "address": "fa:16:3e:ac:36:4b", "network": {"id": "a0603438-6866-4c65-af22-30fac1b66aaa", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-963064482", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1d2905fedccc4085a38a905192ba079b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2700be5-db", "ovs_interfaceid": "f2700be5-db51-43e4-bfaa-aa91b76489af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:32:16 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-74fd441f-0a1e-4398-9a32-c83841eafe0f tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Converting VIF {"id": "f2700be5-db51-43e4-bfaa-aa91b76489af", "address": "fa:16:3e:ac:36:4b", "network": {"id": "a0603438-6866-4c65-af22-30fac1b66aaa", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-963064482", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1d2905fedccc4085a38a905192ba079b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2700be5-db", "ovs_interfaceid": "f2700be5-db51-43e4-bfaa-aa91b76489af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:32:16 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-74fd441f-0a1e-4398-9a32-c83841eafe0f tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:36:4b,bridge_name='br-int',has_traffic_filtering=True,id=f2700be5-db51-43e4-bfaa-aa91b76489af,network=Network(a0603438-6866-4c65-af22-30fac1b66aaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2700be5-db') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:32:16 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-74fd441f-0a1e-4398-9a32-c83841eafe0f tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:ac:36:4b"/><model type="virtio"/><mtu size="1442"/><target dev="tapf2700be5-db"/></interface> {{(pid=73391) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 15 05:32:16 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-74fd441f-0a1e-4398-9a32-c83841eafe0f tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:ac:36:4b"/><model type="virtio"/><mtu size="1442"/><target dev="tapf2700be5-db"/></interface> {{(pid=73391) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 15 05:32:16 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-74fd441f-0a1e-4398-9a32-c83841eafe0f tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Attempting to detach device tapf2700be5-db from instance df00c15a-2512-41d0-9857-edb50374897e from the persistent domain config. {{(pid=73391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 05:32:16 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-74fd441f-0a1e-4398-9a32-c83841eafe0f tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] detach device xml: <interface type="ethernet">
Aug 15 05:32:16 user nova-compute[73391]:   <mac address="fa:16:3e:ac:36:4b"/>
Aug 15 05:32:16 user nova-compute[73391]:   <model type="virtio"/>
Aug 15 05:32:16 user nova-compute[73391]:   <mtu size="1442"/>
Aug 15 05:32:16 user nova-compute[73391]:   <target dev="tapf2700be5-db"/>
Aug 15 05:32:16 user nova-compute[73391]: </interface>
Aug 15 05:32:16 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 05:32:16 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-74fd441f-0a1e-4398-9a32-c83841eafe0f tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:ac:36:4b"/><model type="virtio"/><mtu size="1442"/><target dev="tapf2700be5-db"/></interface> {{(pid=73391) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 15 05:32:16 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-74fd441f-0a1e-4398-9a32-c83841eafe0f tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:ac:36:4b"/><model type="virtio"/><mtu size="1442"/><target dev="tapf2700be5-db"/></interface>not found in domain: <domain type='kvm' id='6'>
Aug 15 05:32:16 user nova-compute[73391]:   <name>instance-00000006</name>
Aug 15 05:32:16 user nova-compute[73391]:   <uuid>df00c15a-2512-41d0-9857-edb50374897e</uuid>
Aug 15 05:32:16 user nova-compute[73391]:   <metadata>
Aug 15 05:32:16 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:32:16 user nova-compute[73391]:   <nova:package version="0.0.0"/>
Aug 15 05:32:16 user nova-compute[73391]:   <nova:name>tempest-device-tagging-server-1483983120</nova:name>
Aug 15 05:32:16 user nova-compute[73391]:   <nova:creationTime>2023-08-15 05:31:49</nova:creationTime>
Aug 15 05:32:16 user nova-compute[73391]:   <nova:flavor name="m1.tiny">
Aug 15 05:32:16 user nova-compute[73391]:     <nova:memory>512</nova:memory>
Aug 15 05:32:16 user nova-compute[73391]:     <nova:disk>1</nova:disk>
Aug 15 05:32:16 user nova-compute[73391]:     <nova:swap>0</nova:swap>
Aug 15 05:32:16 user nova-compute[73391]:     <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:32:16 user nova-compute[73391]:     <nova:vcpus>1</nova:vcpus>
Aug 15 05:32:16 user nova-compute[73391]:   </nova:flavor>
Aug 15 05:32:16 user nova-compute[73391]:   <nova:owner>
Aug 15 05:32:16 user nova-compute[73391]:     <nova:user uuid="42f8f8600f9a4d81a72afbaf2bbd53a5">tempest-TaggedAttachmentsTest-1390153553-project-member</nova:user>
Aug 15 05:32:16 user nova-compute[73391]:     <nova:project uuid="1d2905fedccc4085a38a905192ba079b">tempest-TaggedAttachmentsTest-1390153553</nova:project>
Aug 15 05:32:16 user nova-compute[73391]:   </nova:owner>
Aug 15 05:32:16 user nova-compute[73391]:   <nova:root type="image" uuid="191b1dad-305e-4d1c-9b15-515ec59a3278"/>
Aug 15 05:32:16 user nova-compute[73391]:   <nova:ports>
Aug 15 05:32:16 user nova-compute[73391]:     <nova:port uuid="c065ab29-c8d1-463f-bf12-7921829c9ede">
Aug 15 05:32:16 user nova-compute[73391]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 05:32:16 user nova-compute[73391]:     </nova:port>
Aug 15 05:32:16 user nova-compute[73391]:     <nova:port uuid="f2700be5-db51-43e4-bfaa-aa91b76489af">
Aug 15 05:32:16 user nova-compute[73391]:       <nova:ip type="fixed" address="10.10.10.247" ipVersion="4"/>
Aug 15 05:32:16 user nova-compute[73391]:     </nova:port>
Aug 15 05:32:16 user nova-compute[73391]:   </nova:ports>
Aug 15 05:32:16 user nova-compute[73391]: </nova:instance>
Aug 15 05:32:16 user nova-compute[73391]:   </metadata>
Aug 15 05:32:16 user nova-compute[73391]:   <memory unit='KiB'>524288</memory>
Aug 15 05:32:16 user nova-compute[73391]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 15 05:32:16 user nova-compute[73391]:   <vcpu placement='static'>1</vcpu>
Aug 15 05:32:16 user nova-compute[73391]:   <resource>
Aug 15 05:32:16 user nova-compute[73391]:     <partition>/machine</partition>
Aug 15 05:32:16 user nova-compute[73391]:   </resource>
Aug 15 05:32:16 user nova-compute[73391]:   <sysinfo type='smbios'>
Aug 15 05:32:16 user nova-compute[73391]:     <system>
Aug 15 05:32:16 user nova-compute[73391]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 15 05:32:16 user nova-compute[73391]:       <entry name='product'>OpenStack Nova</entry>
Aug 15 05:32:16 user nova-compute[73391]:       <entry name='version'>0.0.0</entry>
Aug 15 05:32:16 user nova-compute[73391]:       <entry name='serial'>df00c15a-2512-41d0-9857-edb50374897e</entry>
Aug 15 05:32:16 user nova-compute[73391]:       <entry name='uuid'>df00c15a-2512-41d0-9857-edb50374897e</entry>
Aug 15 05:32:16 user nova-compute[73391]:       <entry name='family'>Virtual Machine</entry>
Aug 15 05:32:16 user nova-compute[73391]:     </system>
Aug 15 05:32:16 user nova-compute[73391]:   </sysinfo>
Aug 15 05:32:16 user nova-compute[73391]:   <os>
Aug 15 05:32:16 user nova-compute[73391]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 15 05:32:16 user nova-compute[73391]:     <boot dev='hd'/>
Aug 15 05:32:16 user nova-compute[73391]:     <smbios mode='sysinfo'/>
Aug 15 05:32:16 user nova-compute[73391]:   </os>
Aug 15 05:32:16 user nova-compute[73391]:   <features>
Aug 15 05:32:16 user nova-compute[73391]:     <acpi/>
Aug 15 05:32:16 user nova-compute[73391]:     <apic/>
Aug 15 05:32:16 user nova-compute[73391]:     <vmcoreinfo state='on'/>
Aug 15 05:32:16 user nova-compute[73391]:   </features>
Aug 15 05:32:16 user nova-compute[73391]:   <cpu mode='custom' match='exact' check='full'>
Aug 15 05:32:16 user nova-compute[73391]:     <model fallback='forbid'>Nehalem</model>
Aug 15 05:32:16 user nova-compute[73391]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 15 05:32:16 user nova-compute[73391]:     <feature policy='require' name='vme'/>
Aug 15 05:32:16 user nova-compute[73391]:     <feature policy='require' name='x2apic'/>
Aug 15 05:32:16 user nova-compute[73391]:     <feature policy='require' name='hypervisor'/>
Aug 15 05:32:16 user nova-compute[73391]:   </cpu>
Aug 15 05:32:16 user nova-compute[73391]:   <clock offset='utc'>
Aug 15 05:32:16 user nova-compute[73391]:     <timer name='pit' tickpolicy='delay'/>
Aug 15 05:32:16 user nova-compute[73391]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 15 05:32:16 user nova-compute[73391]:     <timer name='hpet' present='no'/>
Aug 15 05:32:16 user nova-compute[73391]:   </clock>
Aug 15 05:32:16 user nova-compute[73391]:   <on_poweroff>destroy</on_poweroff>
Aug 15 05:32:16 user nova-compute[73391]:   <on_reboot>restart</on_reboot>
Aug 15 05:32:16 user nova-compute[73391]:   <on_crash>destroy</on_crash>
Aug 15 05:32:16 user nova-compute[73391]:   <devices>
Aug 15 05:32:16 user nova-compute[73391]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 15 05:32:16 user nova-compute[73391]:     <disk type='file' device='disk'>
Aug 15 05:32:16 user nova-compute[73391]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 15 05:32:16 user nova-compute[73391]:       <source file='/opt/stack/data/nova/instances/df00c15a-2512-41d0-9857-edb50374897e/disk' index='2'/>
Aug 15 05:32:16 user nova-compute[73391]:       <backingStore type='file' index='3'>
Aug 15 05:32:16 user nova-compute[73391]:         <format type='raw'/>
Aug 15 05:32:16 user nova-compute[73391]:         <source file='/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b'/>
Aug 15 05:32:16 user nova-compute[73391]:         <backingStore/>
Aug 15 05:32:16 user nova-compute[73391]:       </backingStore>
Aug 15 05:32:16 user nova-compute[73391]:       <target dev='vda' bus='virtio'/>
Aug 15 05:32:16 user nova-compute[73391]:       <alias name='virtio-disk0'/>
Aug 15 05:32:16 user nova-compute[73391]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 15 05:32:16 user nova-compute[73391]:     </disk>
Aug 15 05:32:16 user nova-compute[73391]:     <disk type='file' device='cdrom'>
Aug 15 05:32:16 user nova-compute[73391]:       <driver name='qemu' type='raw' cache='none'/>
Aug 15 05:32:16 user nova-compute[73391]:       <source file='/opt/stack/data/nova/instances/df00c15a-2512-41d0-9857-edb50374897e/disk.config' index='1'/>
Aug 15 05:32:16 user nova-compute[73391]:       <backingStore/>
Aug 15 05:32:16 user nova-compute[73391]:       <target dev='hda' bus='ide'/>
Aug 15 05:32:16 user nova-compute[73391]:       <readonly/>
Aug 15 05:32:16 user nova-compute[73391]:       <alias name='ide0-0-0'/>
Aug 15 05:32:16 user nova-compute[73391]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 15 05:32:16 user nova-compute[73391]:     </disk>
Aug 15 05:32:16 user nova-compute[73391]:     <controller type='usb' index='0' model='none'>
Aug 15 05:32:16 user nova-compute[73391]:       <alias name='usb'/>
Aug 15 05:32:16 user nova-compute[73391]:     </controller>
Aug 15 05:32:16 user nova-compute[73391]:     <controller type='pci' index='0' model='pci-root'>
Aug 15 05:32:16 user nova-compute[73391]:       <alias name='pci.0'/>
Aug 15 05:32:16 user nova-compute[73391]:     </controller>
Aug 15 05:32:16 user nova-compute[73391]:     <controller type='ide' index='0'>
Aug 15 05:32:16 user nova-compute[73391]:       <alias name='ide'/>
Aug 15 05:32:16 user nova-compute[73391]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 15 05:32:16 user nova-compute[73391]:     </controller>
Aug 15 05:32:16 user nova-compute[73391]:     <interface type='ethernet'>
Aug 15 05:32:16 user nova-compute[73391]:       <mac address='fa:16:3e:92:27:fb'/>
Aug 15 05:32:16 user nova-compute[73391]:       <target dev='tapc065ab29-c8'/>
Aug 15 05:32:16 user nova-compute[73391]:       <model type='virtio'/>
Aug 15 05:32:16 user nova-compute[73391]:       <mtu size='1442'/>
Aug 15 05:32:16 user nova-compute[73391]:       <alias name='net0'/>
Aug 15 05:32:16 user nova-compute[73391]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 15 05:32:16 user nova-compute[73391]:     </interface>
Aug 15 05:32:16 user nova-compute[73391]:     <interface type='ethernet'>
Aug 15 05:32:16 user nova-compute[73391]:       <mac address='fa:16:3e:ac:36:4b'/>
Aug 15 05:32:16 user nova-compute[73391]:       <target dev='tapf2700be5-db'/>
Aug 15 05:32:16 user nova-compute[73391]:       <model type='virtio'/>
Aug 15 05:32:16 user nova-compute[73391]:       <mtu size='1442'/>
Aug 15 05:32:16 user nova-compute[73391]:       <alias name='net1'/>
Aug 15 05:32:16 user nova-compute[73391]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Aug 15 05:32:16 user nova-compute[73391]:     </interface>
Aug 15 05:32:16 user nova-compute[73391]:     <serial type='pty'>
Aug 15 05:32:16 user nova-compute[73391]:       <source path='/dev/pts/6'/>
Aug 15 05:32:16 user nova-compute[73391]:       <log file='/opt/stack/data/nova/instances/df00c15a-2512-41d0-9857-edb50374897e/console.log' append='off'/>
Aug 15 05:32:16 user nova-compute[73391]:       <target type='isa-serial' port='0'>
Aug 15 05:32:16 user nova-compute[73391]:         <model name='isa-serial'/>
Aug 15 05:32:16 user nova-compute[73391]:       </target>
Aug 15 05:32:16 user nova-compute[73391]:       <alias name='serial0'/>
Aug 15 05:32:16 user nova-compute[73391]:     </serial>
Aug 15 05:32:16 user nova-compute[73391]:     <console type='pty' tty='/dev/pts/6'>
Aug 15 05:32:16 user nova-compute[73391]:       <source path='/dev/pts/6'/>
Aug 15 05:32:16 user nova-compute[73391]:       <log file='/opt/stack/data/nova/instances/df00c15a-2512-41d0-9857-edb50374897e/console.log' append='off'/>
Aug 15 05:32:16 user nova-compute[73391]:       <target type='serial' port='0'/>
Aug 15 05:32:16 user nova-compute[73391]:       <alias name='serial0'/>
Aug 15 05:32:16 user nova-compute[73391]:     </console>
Aug 15 05:32:16 user nova-compute[73391]:     <input type='mouse' bus='ps2'>
Aug 15 05:32:16 user nova-compute[73391]:       <alias name='input0'/>
Aug 15 05:32:16 user nova-compute[73391]:     </input>
Aug 15 05:32:16 user nova-compute[73391]:     <input type='keyboard' bus='ps2'>
Aug 15 05:32:16 user nova-compute[73391]:       <alias name='input1'/>
Aug 15 05:32:16 user nova-compute[73391]:     </input>
Aug 15 05:32:16 user nova-compute[73391]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Aug 15 05:32:16 user nova-compute[73391]:       <listen type='address' address='0.0.0.0'/>
Aug 15 05:32:16 user nova-compute[73391]:     </graphics>
Aug 15 05:32:16 user nova-compute[73391]:     <audio id='1' type='none'/>
Aug 15 05:32:16 user nova-compute[73391]:     <video>
Aug 15 05:32:16 user nova-compute[73391]:       <model type='virtio' heads='1' primary='yes'/>
Aug 15 05:32:16 user nova-compute[73391]:       <alias name='video0'/>
Aug 15 05:32:16 user nova-compute[73391]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 15 05:32:16 user nova-compute[73391]:     </video>
Aug 15 05:32:16 user nova-compute[73391]:     <memballoon model='virtio'>
Aug 15 05:32:16 user nova-compute[73391]:       <stats period='10'/>
Aug 15 05:32:16 user nova-compute[73391]:       <alias name='balloon0'/>
Aug 15 05:32:16 user nova-compute[73391]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 15 05:32:16 user nova-compute[73391]:     </memballoon>
Aug 15 05:32:16 user nova-compute[73391]:     <rng model='virtio'>
Aug 15 05:32:16 user nova-compute[73391]:       <backend model='random'>/dev/urandom</backend>
Aug 15 05:32:16 user nova-compute[73391]:       <alias name='rng0'/>
Aug 15 05:32:16 user nova-compute[73391]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 15 05:32:16 user nova-compute[73391]:     </rng>
Aug 15 05:32:16 user nova-compute[73391]:   </devices>
Aug 15 05:32:16 user nova-compute[73391]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 15 05:32:16 user nova-compute[73391]:     <label>libvirt-df00c15a-2512-41d0-9857-edb50374897e</label>
Aug 15 05:32:16 user nova-compute[73391]:     <imagelabel>libvirt-df00c15a-2512-41d0-9857-edb50374897e</imagelabel>
Aug 15 05:32:16 user nova-compute[73391]:   </seclabel>
Aug 15 05:32:16 user nova-compute[73391]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 15 05:32:16 user nova-compute[73391]:     <label>+64055:+108</label>
Aug 15 05:32:16 user nova-compute[73391]:     <imagelabel>+64055:+108</imagelabel>
Aug 15 05:32:16 user nova-compute[73391]:   </seclabel>
Aug 15 05:32:16 user nova-compute[73391]: </domain>
Aug 15 05:32:16 user nova-compute[73391]:  {{(pid=73391) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 15 05:32:16 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-74fd441f-0a1e-4398-9a32-c83841eafe0f tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Successfully detached device tapf2700be5-db from instance df00c15a-2512-41d0-9857-edb50374897e from the persistent domain config.
Aug 15 05:32:16 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-74fd441f-0a1e-4398-9a32-c83841eafe0f tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] (1/8): Attempting to detach device tapf2700be5-db with device alias net1 from instance df00c15a-2512-41d0-9857-edb50374897e from the live domain config. {{(pid=73391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 05:32:16 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-74fd441f-0a1e-4398-9a32-c83841eafe0f tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] detach device xml: <interface type="ethernet">
Aug 15 05:32:16 user nova-compute[73391]:   <mac address="fa:16:3e:ac:36:4b"/>
Aug 15 05:32:16 user nova-compute[73391]:   <model type="virtio"/>
Aug 15 05:32:16 user nova-compute[73391]:   <mtu size="1442"/>
Aug 15 05:32:16 user nova-compute[73391]:   <target dev="tapf2700be5-db"/>
Aug 15 05:32:16 user nova-compute[73391]: </interface>
Aug 15 05:32:16 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 05:32:16 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:16 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Received event <DeviceRemovedEvent: 1692077536.8275821, df00c15a-2512-41d0-9857-edb50374897e => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73391) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 05:32:16 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-74fd441f-0a1e-4398-9a32-c83841eafe0f tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Start waiting for the detach event from libvirt for device tapf2700be5-db with device alias net1 for instance df00c15a-2512-41d0-9857-edb50374897e {{(pid=73391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 05:32:16 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-74fd441f-0a1e-4398-9a32-c83841eafe0f tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:ac:36:4b"/><model type="virtio"/><mtu size="1442"/><target dev="tapf2700be5-db"/></interface> {{(pid=73391) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 15 05:32:16 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:16 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-74fd441f-0a1e-4398-9a32-c83841eafe0f tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:ac:36:4b"/><model type="virtio"/><mtu size="1442"/><target dev="tapf2700be5-db"/></interface>not found in domain: <domain type='kvm' id='6'>
Aug 15 05:32:16 user nova-compute[73391]:   <name>instance-00000006</name>
Aug 15 05:32:16 user nova-compute[73391]:   <uuid>df00c15a-2512-41d0-9857-edb50374897e</uuid>
Aug 15 05:32:16 user nova-compute[73391]:   <metadata>
Aug 15 05:32:16 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:32:16 user nova-compute[73391]:   <nova:package version="0.0.0"/>
Aug 15 05:32:16 user nova-compute[73391]:   <nova:name>tempest-device-tagging-server-1483983120</nova:name>
Aug 15 05:32:16 user nova-compute[73391]:   <nova:creationTime>2023-08-15 05:31:49</nova:creationTime>
Aug 15 05:32:16 user nova-compute[73391]:   <nova:flavor name="m1.tiny">
Aug 15 05:32:16 user nova-compute[73391]:     <nova:memory>512</nova:memory>
Aug 15 05:32:16 user nova-compute[73391]:     <nova:disk>1</nova:disk>
Aug 15 05:32:16 user nova-compute[73391]:     <nova:swap>0</nova:swap>
Aug 15 05:32:16 user nova-compute[73391]:     <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:32:16 user nova-compute[73391]:     <nova:vcpus>1</nova:vcpus>
Aug 15 05:32:16 user nova-compute[73391]:   </nova:flavor>
Aug 15 05:32:16 user nova-compute[73391]:   <nova:owner>
Aug 15 05:32:16 user nova-compute[73391]:     <nova:user uuid="42f8f8600f9a4d81a72afbaf2bbd53a5">tempest-TaggedAttachmentsTest-1390153553-project-member</nova:user>
Aug 15 05:32:16 user nova-compute[73391]:     <nova:project uuid="1d2905fedccc4085a38a905192ba079b">tempest-TaggedAttachmentsTest-1390153553</nova:project>
Aug 15 05:32:16 user nova-compute[73391]:   </nova:owner>
Aug 15 05:32:16 user nova-compute[73391]:   <nova:root type="image" uuid="191b1dad-305e-4d1c-9b15-515ec59a3278"/>
Aug 15 05:32:16 user nova-compute[73391]:   <nova:ports>
Aug 15 05:32:16 user nova-compute[73391]:     <nova:port uuid="c065ab29-c8d1-463f-bf12-7921829c9ede">
Aug 15 05:32:16 user nova-compute[73391]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 05:32:16 user nova-compute[73391]:     </nova:port>
Aug 15 05:32:16 user nova-compute[73391]:     <nova:port uuid="f2700be5-db51-43e4-bfaa-aa91b76489af">
Aug 15 05:32:16 user nova-compute[73391]:       <nova:ip type="fixed" address="10.10.10.247" ipVersion="4"/>
Aug 15 05:32:16 user nova-compute[73391]:     </nova:port>
Aug 15 05:32:16 user nova-compute[73391]:   </nova:ports>
Aug 15 05:32:16 user nova-compute[73391]: </nova:instance>
Aug 15 05:32:16 user nova-compute[73391]:   </metadata>
Aug 15 05:32:16 user nova-compute[73391]:   <memory unit='KiB'>524288</memory>
Aug 15 05:32:16 user nova-compute[73391]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 15 05:32:16 user nova-compute[73391]:   <vcpu placement='static'>1</vcpu>
Aug 15 05:32:16 user nova-compute[73391]:   <resource>
Aug 15 05:32:16 user nova-compute[73391]:     <partition>/machine</partition>
Aug 15 05:32:16 user nova-compute[73391]:   </resource>
Aug 15 05:32:16 user nova-compute[73391]:   <sysinfo type='smbios'>
Aug 15 05:32:16 user nova-compute[73391]:     <system>
Aug 15 05:32:16 user nova-compute[73391]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 15 05:32:16 user nova-compute[73391]:       <entry name='product'>OpenStack Nova</entry>
Aug 15 05:32:16 user nova-compute[73391]:       <entry name='version'>0.0.0</entry>
Aug 15 05:32:16 user nova-compute[73391]:       <entry name='serial'>df00c15a-2512-41d0-9857-edb50374897e</entry>
Aug 15 05:32:16 user nova-compute[73391]:       <entry name='uuid'>df00c15a-2512-41d0-9857-edb50374897e</entry>
Aug 15 05:32:16 user nova-compute[73391]:       <entry name='family'>Virtual Machine</entry>
Aug 15 05:32:16 user nova-compute[73391]:     </system>
Aug 15 05:32:16 user nova-compute[73391]:   </sysinfo>
Aug 15 05:32:16 user nova-compute[73391]:   <os>
Aug 15 05:32:16 user nova-compute[73391]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 15 05:32:16 user nova-compute[73391]:     <boot dev='hd'/>
Aug 15 05:32:16 user nova-compute[73391]:     <smbios mode='sysinfo'/>
Aug 15 05:32:16 user nova-compute[73391]:   </os>
Aug 15 05:32:16 user nova-compute[73391]:   <features>
Aug 15 05:32:16 user nova-compute[73391]:     <acpi/>
Aug 15 05:32:16 user nova-compute[73391]:     <apic/>
Aug 15 05:32:16 user nova-compute[73391]:     <vmcoreinfo state='on'/>
Aug 15 05:32:16 user nova-compute[73391]:   </features>
Aug 15 05:32:16 user nova-compute[73391]:   <cpu mode='custom' match='exact' check='full'>
Aug 15 05:32:16 user nova-compute[73391]:     <model fallback='forbid'>Nehalem</model>
Aug 15 05:32:16 user nova-compute[73391]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 15 05:32:16 user nova-compute[73391]:     <feature policy='require' name='vme'/>
Aug 15 05:32:16 user nova-compute[73391]:     <feature policy='require' name='x2apic'/>
Aug 15 05:32:16 user nova-compute[73391]:     <feature policy='require' name='hypervisor'/>
Aug 15 05:32:16 user nova-compute[73391]:   </cpu>
Aug 15 05:32:16 user nova-compute[73391]:   <clock offset='utc'>
Aug 15 05:32:16 user nova-compute[73391]:     <timer name='pit' tickpolicy='delay'/>
Aug 15 05:32:16 user nova-compute[73391]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 15 05:32:16 user nova-compute[73391]:     <timer name='hpet' present='no'/>
Aug 15 05:32:16 user nova-compute[73391]:   </clock>
Aug 15 05:32:16 user nova-compute[73391]:   <on_poweroff>destroy</on_poweroff>
Aug 15 05:32:16 user nova-compute[73391]:   <on_reboot>restart</on_reboot>
Aug 15 05:32:16 user nova-compute[73391]:   <on_crash>destroy</on_crash>
Aug 15 05:32:16 user nova-compute[73391]:   <devices>
Aug 15 05:32:16 user nova-compute[73391]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 15 05:32:16 user nova-compute[73391]:     <disk type='file' device='disk'>
Aug 15 05:32:16 user nova-compute[73391]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 15 05:32:16 user nova-compute[73391]:       <source file='/opt/stack/data/nova/instances/df00c15a-2512-41d0-9857-edb50374897e/disk' index='2'/>
Aug 15 05:32:16 user nova-compute[73391]:       <backingStore type='file' index='3'>
Aug 15 05:32:16 user nova-compute[73391]:         <format type='raw'/>
Aug 15 05:32:16 user nova-compute[73391]:         <source file='/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b'/>
Aug 15 05:32:16 user nova-compute[73391]:         <backingStore/>
Aug 15 05:32:16 user nova-compute[73391]:       </backingStore>
Aug 15 05:32:16 user nova-compute[73391]:       <target dev='vda' bus='virtio'/>
Aug 15 05:32:16 user nova-compute[73391]:       <alias name='virtio-disk0'/>
Aug 15 05:32:16 user nova-compute[73391]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 15 05:32:16 user nova-compute[73391]:     </disk>
Aug 15 05:32:16 user nova-compute[73391]:     <disk type='file' device='cdrom'>
Aug 15 05:32:16 user nova-compute[73391]:       <driver name='qemu' type='raw' cache='none'/>
Aug 15 05:32:16 user nova-compute[73391]:       <source file='/opt/stack/data/nova/instances/df00c15a-2512-41d0-9857-edb50374897e/disk.config' index='1'/>
Aug 15 05:32:16 user nova-compute[73391]:       <backingStore/>
Aug 15 05:32:16 user nova-compute[73391]:       <target dev='hda' bus='ide'/>
Aug 15 05:32:16 user nova-compute[73391]:       <readonly/>
Aug 15 05:32:16 user nova-compute[73391]:       <alias name='ide0-0-0'/>
Aug 15 05:32:16 user nova-compute[73391]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 15 05:32:16 user nova-compute[73391]:     </disk>
Aug 15 05:32:16 user nova-compute[73391]:     <controller type='usb' index='0' model='none'>
Aug 15 05:32:16 user nova-compute[73391]:       <alias name='usb'/>
Aug 15 05:32:16 user nova-compute[73391]:     </controller>
Aug 15 05:32:16 user nova-compute[73391]:     <controller type='pci' index='0' model='pci-root'>
Aug 15 05:32:16 user nova-compute[73391]:       <alias name='pci.0'/>
Aug 15 05:32:16 user nova-compute[73391]:     </controller>
Aug 15 05:32:16 user nova-compute[73391]:     <controller type='ide' index='0'>
Aug 15 05:32:16 user nova-compute[73391]:       <alias name='ide'/>
Aug 15 05:32:16 user nova-compute[73391]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 15 05:32:16 user nova-compute[73391]:     </controller>
Aug 15 05:32:16 user nova-compute[73391]:     <interface type='ethernet'>
Aug 15 05:32:16 user nova-compute[73391]:       <mac address='fa:16:3e:92:27:fb'/>
Aug 15 05:32:16 user nova-compute[73391]:       <target dev='tapc065ab29-c8'/>
Aug 15 05:32:16 user nova-compute[73391]:       <model type='virtio'/>
Aug 15 05:32:16 user nova-compute[73391]:       <mtu size='1442'/>
Aug 15 05:32:16 user nova-compute[73391]:       <alias name='net0'/>
Aug 15 05:32:16 user nova-compute[73391]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 15 05:32:16 user nova-compute[73391]:     </interface>
Aug 15 05:32:16 user nova-compute[73391]:     <serial type='pty'>
Aug 15 05:32:16 user nova-compute[73391]:       <source path='/dev/pts/6'/>
Aug 15 05:32:16 user nova-compute[73391]:       <log file='/opt/stack/data/nova/instances/df00c15a-2512-41d0-9857-edb50374897e/console.log' append='off'/>
Aug 15 05:32:16 user nova-compute[73391]:       <target type='isa-serial' port='0'>
Aug 15 05:32:16 user nova-compute[73391]:         <model name='isa-serial'/>
Aug 15 05:32:16 user nova-compute[73391]:       </target>
Aug 15 05:32:16 user nova-compute[73391]:       <alias name='serial0'/>
Aug 15 05:32:16 user nova-compute[73391]:     </serial>
Aug 15 05:32:16 user nova-compute[73391]:     <console type='pty' tty='/dev/pts/6'>
Aug 15 05:32:16 user nova-compute[73391]:       <source path='/dev/pts/6'/>
Aug 15 05:32:16 user nova-compute[73391]:       <log file='/opt/stack/data/nova/instances/df00c15a-2512-41d0-9857-edb50374897e/console.log' append='off'/>
Aug 15 05:32:16 user nova-compute[73391]:       <target type='serial' port='0'/>
Aug 15 05:32:16 user nova-compute[73391]:       <alias name='serial0'/>
Aug 15 05:32:16 user nova-compute[73391]:     </console>
Aug 15 05:32:16 user nova-compute[73391]:     <input type='mouse' bus='ps2'>
Aug 15 05:32:16 user nova-compute[73391]:       <alias name='input0'/>
Aug 15 05:32:16 user nova-compute[73391]:     </input>
Aug 15 05:32:16 user nova-compute[73391]:     <input type='keyboard' bus='ps2'>
Aug 15 05:32:16 user nova-compute[73391]:       <alias name='input1'/>
Aug 15 05:32:16 user nova-compute[73391]:     </input>
Aug 15 05:32:16 user nova-compute[73391]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Aug 15 05:32:16 user nova-compute[73391]:       <listen type='address' address='0.0.0.0'/>
Aug 15 05:32:16 user nova-compute[73391]:     </graphics>
Aug 15 05:32:16 user nova-compute[73391]:     <audio id='1' type='none'/>
Aug 15 05:32:16 user nova-compute[73391]:     <video>
Aug 15 05:32:16 user nova-compute[73391]:       <model type='virtio' heads='1' primary='yes'/>
Aug 15 05:32:16 user nova-compute[73391]:       <alias name='video0'/>
Aug 15 05:32:16 user nova-compute[73391]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 15 05:32:16 user nova-compute[73391]:     </video>
Aug 15 05:32:16 user nova-compute[73391]:     <memballoon model='virtio'>
Aug 15 05:32:16 user nova-compute[73391]:       <stats period='10'/>
Aug 15 05:32:16 user nova-compute[73391]:       <alias name='balloon0'/>
Aug 15 05:32:16 user nova-compute[73391]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 15 05:32:16 user nova-compute[73391]:     </memballoon>
Aug 15 05:32:16 user nova-compute[73391]:     <rng model='virtio'>
Aug 15 05:32:16 user nova-compute[73391]:       <backend model='random'>/dev/urandom</backend>
Aug 15 05:32:16 user nova-compute[73391]:       <alias name='rng0'/>
Aug 15 05:32:16 user nova-compute[73391]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 15 05:32:16 user nova-compute[73391]:     </rng>
Aug 15 05:32:16 user nova-compute[73391]:   </devices>
Aug 15 05:32:16 user nova-compute[73391]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 15 05:32:16 user nova-compute[73391]:     <label>libvirt-df00c15a-2512-41d0-9857-edb50374897e</label>
Aug 15 05:32:16 user nova-compute[73391]:     <imagelabel>libvirt-df00c15a-2512-41d0-9857-edb50374897e</imagelabel>
Aug 15 05:32:16 user nova-compute[73391]:   </seclabel>
Aug 15 05:32:16 user nova-compute[73391]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 15 05:32:16 user nova-compute[73391]:     <label>+64055:+108</label>
Aug 15 05:32:16 user nova-compute[73391]:     <imagelabel>+64055:+108</imagelabel>
Aug 15 05:32:16 user nova-compute[73391]:   </seclabel>
Aug 15 05:32:16 user nova-compute[73391]: </domain>
Aug 15 05:32:16 user nova-compute[73391]:  {{(pid=73391) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 15 05:32:16 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-74fd441f-0a1e-4398-9a32-c83841eafe0f tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Successfully detached device tapf2700be5-db from instance df00c15a-2512-41d0-9857-edb50374897e from the live domain config.
Aug 15 05:32:16 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-74fd441f-0a1e-4398-9a32-c83841eafe0f tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T05:29:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1483983120',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1483983120',id=6,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2gCgxFYyHMvanjOmlhgs+PtTOvShgOshpOoTRWbXBVti5EI5YAHx014n7qsJi2J2bJRkI0PBGeXP5u90VAUBx25BB0y6ovoKoEveKinIqcQDUv9GNl+Dqk3GoYb9mVVg==',key_name='tempest-keypair-1486183318',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:30:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d2905fedccc4085a38a905192ba079b',ramdisk_id='',reservation_id='r-j2lev19d',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1390153553',owner_user_name='tempest-TaggedAttachmentsTest-1390153553-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:30:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='42f8f8600f9a4d81a72afbaf2bbd53a5',uuid=df00c15a-2512-41d0-9857-edb50374897e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f2700be5-db51-43e4-bfaa-aa91b76489af", "address": "fa:16:3e:ac:36:4b", "network": {"id": "a0603438-6866-4c65-af22-30fac1b66aaa", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-963064482", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1d2905fedccc4085a38a905192ba079b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2700be5-db", "ovs_interfaceid": "f2700be5-db51-43e4-bfaa-aa91b76489af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:32:16 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-74fd441f-0a1e-4398-9a32-c83841eafe0f tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Converting VIF {"id": "f2700be5-db51-43e4-bfaa-aa91b76489af", "address": "fa:16:3e:ac:36:4b", "network": {"id": "a0603438-6866-4c65-af22-30fac1b66aaa", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-963064482", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1d2905fedccc4085a38a905192ba079b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2700be5-db", "ovs_interfaceid": "f2700be5-db51-43e4-bfaa-aa91b76489af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:32:16 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-74fd441f-0a1e-4398-9a32-c83841eafe0f tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:36:4b,bridge_name='br-int',has_traffic_filtering=True,id=f2700be5-db51-43e4-bfaa-aa91b76489af,network=Network(a0603438-6866-4c65-af22-30fac1b66aaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2700be5-db') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:32:16 user nova-compute[73391]: DEBUG os_vif [None req-74fd441f-0a1e-4398-9a32-c83841eafe0f tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:36:4b,bridge_name='br-int',has_traffic_filtering=True,id=f2700be5-db51-43e4-bfaa-aa91b76489af,network=Network(a0603438-6866-4c65-af22-30fac1b66aaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2700be5-db') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:32:16 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:16 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:16 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf2700be5-db, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:32:16 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:16 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:32:16 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:16 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:16 user nova-compute[73391]: INFO os_vif [None req-74fd441f-0a1e-4398-9a32-c83841eafe0f tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:36:4b,bridge_name='br-int',has_traffic_filtering=True,id=f2700be5-db51-43e4-bfaa-aa91b76489af,network=Network(a0603438-6866-4c65-af22-30fac1b66aaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2700be5-db')
Aug 15 05:32:16 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-74fd441f-0a1e-4398-9a32-c83841eafe0f tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:32:16 user nova-compute[73391]:   <nova:package version="0.0.0"/>
Aug 15 05:32:16 user nova-compute[73391]:   <nova:name>tempest-device-tagging-server-1483983120</nova:name>
Aug 15 05:32:16 user nova-compute[73391]:   <nova:creationTime>2023-08-15 05:32:16</nova:creationTime>
Aug 15 05:32:16 user nova-compute[73391]:   <nova:flavor name="m1.tiny">
Aug 15 05:32:16 user nova-compute[73391]:     <nova:memory>512</nova:memory>
Aug 15 05:32:16 user nova-compute[73391]:     <nova:disk>1</nova:disk>
Aug 15 05:32:16 user nova-compute[73391]:     <nova:swap>0</nova:swap>
Aug 15 05:32:16 user nova-compute[73391]:     <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:32:16 user nova-compute[73391]:     <nova:vcpus>1</nova:vcpus>
Aug 15 05:32:16 user nova-compute[73391]:   </nova:flavor>
Aug 15 05:32:16 user nova-compute[73391]:   <nova:owner>
Aug 15 05:32:16 user nova-compute[73391]:     <nova:user uuid="42f8f8600f9a4d81a72afbaf2bbd53a5">tempest-TaggedAttachmentsTest-1390153553-project-member</nova:user>
Aug 15 05:32:16 user nova-compute[73391]:     <nova:project uuid="1d2905fedccc4085a38a905192ba079b">tempest-TaggedAttachmentsTest-1390153553</nova:project>
Aug 15 05:32:16 user nova-compute[73391]:   </nova:owner>
Aug 15 05:32:16 user nova-compute[73391]:   <nova:root type="image" uuid="191b1dad-305e-4d1c-9b15-515ec59a3278"/>
Aug 15 05:32:16 user nova-compute[73391]:   <nova:ports>
Aug 15 05:32:16 user nova-compute[73391]:     <nova:port uuid="c065ab29-c8d1-463f-bf12-7921829c9ede">
Aug 15 05:32:16 user nova-compute[73391]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 05:32:16 user nova-compute[73391]:     </nova:port>
Aug 15 05:32:16 user nova-compute[73391]:   </nova:ports>
Aug 15 05:32:16 user nova-compute[73391]: </nova:instance>
Aug 15 05:32:16 user nova-compute[73391]:  {{(pid=73391) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 15 05:32:17 user nova-compute[73391]: DEBUG nova.compute.manager [req-aac0b282-dcaa-4ce0-9300-9fe21f43deb1 req-7d2626cf-7086-42d4-ad99-3cb3b582cba9 service nova] [instance: df00c15a-2512-41d0-9857-edb50374897e] Received event network-vif-unplugged-f2700be5-db51-43e4-bfaa-aa91b76489af {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:32:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-aac0b282-dcaa-4ce0-9300-9fe21f43deb1 req-7d2626cf-7086-42d4-ad99-3cb3b582cba9 service nova] Acquiring lock "df00c15a-2512-41d0-9857-edb50374897e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-aac0b282-dcaa-4ce0-9300-9fe21f43deb1 req-7d2626cf-7086-42d4-ad99-3cb3b582cba9 service nova] Lock "df00c15a-2512-41d0-9857-edb50374897e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-aac0b282-dcaa-4ce0-9300-9fe21f43deb1 req-7d2626cf-7086-42d4-ad99-3cb3b582cba9 service nova] Lock "df00c15a-2512-41d0-9857-edb50374897e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:17 user nova-compute[73391]: DEBUG nova.compute.manager [req-aac0b282-dcaa-4ce0-9300-9fe21f43deb1 req-7d2626cf-7086-42d4-ad99-3cb3b582cba9 service nova] [instance: df00c15a-2512-41d0-9857-edb50374897e] No waiting events found dispatching network-vif-unplugged-f2700be5-db51-43e4-bfaa-aa91b76489af {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:32:17 user nova-compute[73391]: WARNING nova.compute.manager [req-aac0b282-dcaa-4ce0-9300-9fe21f43deb1 req-7d2626cf-7086-42d4-ad99-3cb3b582cba9 service nova] [instance: df00c15a-2512-41d0-9857-edb50374897e] Received unexpected event network-vif-unplugged-f2700be5-db51-43e4-bfaa-aa91b76489af for instance with vm_state active and task_state None.
Aug 15 05:32:17 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.496s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:32:17 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] <== connect_volume: return (1498ms) {'type': 'block', 'scsi_wwn': '23439613363333365', 'path': '/dev/sde'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:32:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23439613363333365', 'path': '/dev/sde'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 05:32:17 user nova-compute[73391]: DEBUG nova.objects.instance [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] Lazy-loading 'flavor' on Instance uuid 0169df15-335e-46e6-a5c8-9deb7095bb84 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:32:17 user nova-compute[73391]: DEBUG nova.compute.manager [req-b9b165c2-e8ab-41bd-adfa-b97c2bf21571 req-4532b415-bc74-4e33-81fa-becfcc4727de service nova] [instance: df00c15a-2512-41d0-9857-edb50374897e] Received event network-vif-deleted-f2700be5-db51-43e4-bfaa-aa91b76489af {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:32:17 user nova-compute[73391]: INFO nova.compute.manager [req-b9b165c2-e8ab-41bd-adfa-b97c2bf21571 req-4532b415-bc74-4e33-81fa-becfcc4727de service nova] [instance: df00c15a-2512-41d0-9857-edb50374897e] Neutron deleted interface f2700be5-db51-43e4-bfaa-aa91b76489af; detaching it from the instance and deleting it from the info cache
Aug 15 05:32:17 user nova-compute[73391]: DEBUG nova.network.neutron [req-b9b165c2-e8ab-41bd-adfa-b97c2bf21571 req-4532b415-bc74-4e33-81fa-becfcc4727de service nova] [instance: df00c15a-2512-41d0-9857-edb50374897e] Updating instance_info_cache with network_info: [{"id": "c065ab29-c8d1-463f-bf12-7921829c9ede", "address": "fa:16:3e:92:27:fb", "network": {"id": "6605a4f0-a8e4-4044-a7d3-36dd84d3870c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-694227201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d2905fedccc4085a38a905192ba079b", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc065ab29-c8", "ovs_interfaceid": "c065ab29-c8d1-463f-bf12-7921829c9ede", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:32:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-74fd441f-0a1e-4398-9a32-c83841eafe0f tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Acquiring lock "refresh_cache-df00c15a-2512-41d0-9857-edb50374897e" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:32:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-74fd441f-0a1e-4398-9a32-c83841eafe0f tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Acquired lock "refresh_cache-df00c15a-2512-41d0-9857-edb50374897e" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:32:17 user nova-compute[73391]: DEBUG nova.network.neutron [None req-74fd441f-0a1e-4398-9a32-c83841eafe0f tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] [instance: df00c15a-2512-41d0-9857-edb50374897e] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:32:17 user nova-compute[73391]: DEBUG nova.objects.instance [req-b9b165c2-e8ab-41bd-adfa-b97c2bf21571 req-4532b415-bc74-4e33-81fa-becfcc4727de service nova] Lazy-loading 'system_metadata' on Instance uuid df00c15a-2512-41d0-9857-edb50374897e {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:32:17 user nova-compute[73391]: DEBUG nova.objects.instance [req-b9b165c2-e8ab-41bd-adfa-b97c2bf21571 req-4532b415-bc74-4e33-81fa-becfcc4727de service nova] Lazy-loading 'flavor' on Instance uuid df00c15a-2512-41d0-9857-edb50374897e {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:32:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [req-b9b165c2-e8ab-41bd-adfa-b97c2bf21571 req-4532b415-bc74-4e33-81fa-becfcc4727de service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T05:29:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1483983120',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1483983120',id=6,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2gCgxFYyHMvanjOmlhgs+PtTOvShgOshpOoTRWbXBVti5EI5YAHx014n7qsJi2J2bJRkI0PBGeXP5u90VAUBx25BB0y6ovoKoEveKinIqcQDUv9GNl+Dqk3GoYb9mVVg==',key_name='tempest-keypair-1486183318',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:30:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d2905fedccc4085a38a905192ba079b',ramdisk_id='',reservation_id='r-j2lev19d',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1390153553',owner_user_name='tempest-TaggedAttachmentsTest-1390153553-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:30:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='42f8f8600f9a4d81a72afbaf2bbd53a5',uuid=df00c15a-2512-41d0-9857-edb50374897e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f2700be5-db51-43e4-bfaa-aa91b76489af", "address": "fa:16:3e:ac:36:4b", "network": {"id": "a0603438-6866-4c65-af22-30fac1b66aaa", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-963064482", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1d2905fedccc4085a38a905192ba079b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2700be5-db", "ovs_interfaceid": "f2700be5-db51-43e4-bfaa-aa91b76489af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:32:17 user nova-compute[73391]: DEBUG nova.network.os_vif_util [req-b9b165c2-e8ab-41bd-adfa-b97c2bf21571 req-4532b415-bc74-4e33-81fa-becfcc4727de service nova] Converting VIF {"id": "f2700be5-db51-43e4-bfaa-aa91b76489af", "address": "fa:16:3e:ac:36:4b", "network": {"id": "a0603438-6866-4c65-af22-30fac1b66aaa", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-963064482", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1d2905fedccc4085a38a905192ba079b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2700be5-db", "ovs_interfaceid": "f2700be5-db51-43e4-bfaa-aa91b76489af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:32:17 user nova-compute[73391]: DEBUG nova.network.os_vif_util [req-b9b165c2-e8ab-41bd-adfa-b97c2bf21571 req-4532b415-bc74-4e33-81fa-becfcc4727de service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:36:4b,bridge_name='br-int',has_traffic_filtering=True,id=f2700be5-db51-43e4-bfaa-aa91b76489af,network=Network(a0603438-6866-4c65-af22-30fac1b66aaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2700be5-db') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:32:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [req-b9b165c2-e8ab-41bd-adfa-b97c2bf21571 req-4532b415-bc74-4e33-81fa-becfcc4727de service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:ac:36:4b"/><model type="virtio"/><mtu size="1442"/><target dev="tapf2700be5-db"/></interface> {{(pid=73391) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 15 05:32:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [req-b9b165c2-e8ab-41bd-adfa-b97c2bf21571 req-4532b415-bc74-4e33-81fa-becfcc4727de service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:ac:36:4b"/><model type="virtio"/><mtu size="1442"/><target dev="tapf2700be5-db"/></interface>not found in domain: <domain type='kvm' id='6'>
Aug 15 05:32:17 user nova-compute[73391]:   <name>instance-00000006</name>
Aug 15 05:32:17 user nova-compute[73391]:   <uuid>df00c15a-2512-41d0-9857-edb50374897e</uuid>
Aug 15 05:32:17 user nova-compute[73391]:   <metadata>
Aug 15 05:32:17 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:32:17 user nova-compute[73391]:   <nova:package version="0.0.0"/>
Aug 15 05:32:17 user nova-compute[73391]:   <nova:name>tempest-device-tagging-server-1483983120</nova:name>
Aug 15 05:32:17 user nova-compute[73391]:   <nova:creationTime>2023-08-15 05:32:16</nova:creationTime>
Aug 15 05:32:17 user nova-compute[73391]:   <nova:flavor name="m1.tiny">
Aug 15 05:32:17 user nova-compute[73391]:     <nova:memory>512</nova:memory>
Aug 15 05:32:17 user nova-compute[73391]:     <nova:disk>1</nova:disk>
Aug 15 05:32:17 user nova-compute[73391]:     <nova:swap>0</nova:swap>
Aug 15 05:32:17 user nova-compute[73391]:     <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:32:17 user nova-compute[73391]:     <nova:vcpus>1</nova:vcpus>
Aug 15 05:32:17 user nova-compute[73391]:   </nova:flavor>
Aug 15 05:32:17 user nova-compute[73391]:   <nova:owner>
Aug 15 05:32:17 user nova-compute[73391]:     <nova:user uuid="42f8f8600f9a4d81a72afbaf2bbd53a5">tempest-TaggedAttachmentsTest-1390153553-project-member</nova:user>
Aug 15 05:32:17 user nova-compute[73391]:     <nova:project uuid="1d2905fedccc4085a38a905192ba079b">tempest-TaggedAttachmentsTest-1390153553</nova:project>
Aug 15 05:32:17 user nova-compute[73391]:   </nova:owner>
Aug 15 05:32:17 user nova-compute[73391]:   <nova:root type="image" uuid="191b1dad-305e-4d1c-9b15-515ec59a3278"/>
Aug 15 05:32:17 user nova-compute[73391]:   <nova:ports>
Aug 15 05:32:17 user nova-compute[73391]:     <nova:port uuid="c065ab29-c8d1-463f-bf12-7921829c9ede">
Aug 15 05:32:17 user nova-compute[73391]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 05:32:17 user nova-compute[73391]:     </nova:port>
Aug 15 05:32:17 user nova-compute[73391]:   </nova:ports>
Aug 15 05:32:17 user nova-compute[73391]: </nova:instance>
Aug 15 05:32:17 user nova-compute[73391]:   </metadata>
Aug 15 05:32:17 user nova-compute[73391]:   <memory unit='KiB'>524288</memory>
Aug 15 05:32:17 user nova-compute[73391]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 15 05:32:17 user nova-compute[73391]:   <vcpu placement='static'>1</vcpu>
Aug 15 05:32:17 user nova-compute[73391]:   <resource>
Aug 15 05:32:17 user nova-compute[73391]:     <partition>/machine</partition>
Aug 15 05:32:17 user nova-compute[73391]:   </resource>
Aug 15 05:32:17 user nova-compute[73391]:   <sysinfo type='smbios'>
Aug 15 05:32:17 user nova-compute[73391]:     <system>
Aug 15 05:32:17 user nova-compute[73391]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 15 05:32:17 user nova-compute[73391]:       <entry name='product'>OpenStack Nova</entry>
Aug 15 05:32:17 user nova-compute[73391]:       <entry name='version'>0.0.0</entry>
Aug 15 05:32:17 user nova-compute[73391]:       <entry name='serial'>df00c15a-2512-41d0-9857-edb50374897e</entry>
Aug 15 05:32:17 user nova-compute[73391]:       <entry name='uuid'>df00c15a-2512-41d0-9857-edb50374897e</entry>
Aug 15 05:32:17 user nova-compute[73391]:       <entry name='family'>Virtual Machine</entry>
Aug 15 05:32:17 user nova-compute[73391]:     </system>
Aug 15 05:32:17 user nova-compute[73391]:   </sysinfo>
Aug 15 05:32:17 user nova-compute[73391]:   <os>
Aug 15 05:32:17 user nova-compute[73391]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 15 05:32:17 user nova-compute[73391]:     <boot dev='hd'/>
Aug 15 05:32:17 user nova-compute[73391]:     <smbios mode='sysinfo'/>
Aug 15 05:32:17 user nova-compute[73391]:   </os>
Aug 15 05:32:17 user nova-compute[73391]:   <features>
Aug 15 05:32:17 user nova-compute[73391]:     <acpi/>
Aug 15 05:32:17 user nova-compute[73391]:     <apic/>
Aug 15 05:32:17 user nova-compute[73391]:     <vmcoreinfo state='on'/>
Aug 15 05:32:17 user nova-compute[73391]:   </features>
Aug 15 05:32:17 user nova-compute[73391]:   <cpu mode='custom' match='exact' check='full'>
Aug 15 05:32:17 user nova-compute[73391]:     <model fallback='forbid'>Nehalem</model>
Aug 15 05:32:17 user nova-compute[73391]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 15 05:32:17 user nova-compute[73391]:     <feature policy='require' name='vme'/>
Aug 15 05:32:17 user nova-compute[73391]:     <feature policy='require' name='x2apic'/>
Aug 15 05:32:17 user nova-compute[73391]:     <feature policy='require' name='hypervisor'/>
Aug 15 05:32:17 user nova-compute[73391]:   </cpu>
Aug 15 05:32:17 user nova-compute[73391]:   <clock offset='utc'>
Aug 15 05:32:17 user nova-compute[73391]:     <timer name='pit' tickpolicy='delay'/>
Aug 15 05:32:17 user nova-compute[73391]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 15 05:32:17 user nova-compute[73391]:     <timer name='hpet' present='no'/>
Aug 15 05:32:17 user nova-compute[73391]:   </clock>
Aug 15 05:32:17 user nova-compute[73391]:   <on_poweroff>destroy</on_poweroff>
Aug 15 05:32:17 user nova-compute[73391]:   <on_reboot>restart</on_reboot>
Aug 15 05:32:17 user nova-compute[73391]:   <on_crash>destroy</on_crash>
Aug 15 05:32:17 user nova-compute[73391]:   <devices>
Aug 15 05:32:17 user nova-compute[73391]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 15 05:32:17 user nova-compute[73391]:     <disk type='file' device='disk'>
Aug 15 05:32:17 user nova-compute[73391]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 15 05:32:17 user nova-compute[73391]:       <source file='/opt/stack/data/nova/instances/df00c15a-2512-41d0-9857-edb50374897e/disk' index='2'/>
Aug 15 05:32:17 user nova-compute[73391]:       <backingStore type='file' index='3'>
Aug 15 05:32:17 user nova-compute[73391]:         <format type='raw'/>
Aug 15 05:32:17 user nova-compute[73391]:         <source file='/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b'/>
Aug 15 05:32:17 user nova-compute[73391]:         <backingStore/>
Aug 15 05:32:17 user nova-compute[73391]:       </backingStore>
Aug 15 05:32:17 user nova-compute[73391]:       <target dev='vda' bus='virtio'/>
Aug 15 05:32:17 user nova-compute[73391]:       <alias name='virtio-disk0'/>
Aug 15 05:32:17 user nova-compute[73391]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 15 05:32:17 user nova-compute[73391]:     </disk>
Aug 15 05:32:17 user nova-compute[73391]:     <disk type='file' device='cdrom'>
Aug 15 05:32:17 user nova-compute[73391]:       <driver name='qemu' type='raw' cache='none'/>
Aug 15 05:32:17 user nova-compute[73391]:       <source file='/opt/stack/data/nova/instances/df00c15a-2512-41d0-9857-edb50374897e/disk.config' index='1'/>
Aug 15 05:32:17 user nova-compute[73391]:       <backingStore/>
Aug 15 05:32:17 user nova-compute[73391]:       <target dev='hda' bus='ide'/>
Aug 15 05:32:17 user nova-compute[73391]:       <readonly/>
Aug 15 05:32:17 user nova-compute[73391]:       <alias name='ide0-0-0'/>
Aug 15 05:32:17 user nova-compute[73391]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 15 05:32:17 user nova-compute[73391]:     </disk>
Aug 15 05:32:17 user nova-compute[73391]:     <controller type='usb' index='0' model='none'>
Aug 15 05:32:17 user nova-compute[73391]:       <alias name='usb'/>
Aug 15 05:32:17 user nova-compute[73391]:     </controller>
Aug 15 05:32:17 user nova-compute[73391]:     <controller type='pci' index='0' model='pci-root'>
Aug 15 05:32:17 user nova-compute[73391]:       <alias name='pci.0'/>
Aug 15 05:32:17 user nova-compute[73391]:     </controller>
Aug 15 05:32:17 user nova-compute[73391]:     <controller type='ide' index='0'>
Aug 15 05:32:17 user nova-compute[73391]:       <alias name='ide'/>
Aug 15 05:32:17 user nova-compute[73391]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 15 05:32:17 user nova-compute[73391]:     </controller>
Aug 15 05:32:17 user nova-compute[73391]:     <interface type='ethernet'>
Aug 15 05:32:17 user nova-compute[73391]:       <mac address='fa:16:3e:92:27:fb'/>
Aug 15 05:32:17 user nova-compute[73391]:       <target dev='tapc065ab29-c8'/>
Aug 15 05:32:17 user nova-compute[73391]:       <model type='virtio'/>
Aug 15 05:32:17 user nova-compute[73391]:       <mtu size='1442'/>
Aug 15 05:32:17 user nova-compute[73391]:       <alias name='net0'/>
Aug 15 05:32:17 user nova-compute[73391]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 15 05:32:17 user nova-compute[73391]:     </interface>
Aug 15 05:32:17 user nova-compute[73391]:     <serial type='pty'>
Aug 15 05:32:17 user nova-compute[73391]:       <source path='/dev/pts/6'/>
Aug 15 05:32:17 user nova-compute[73391]:       <log file='/opt/stack/data/nova/instances/df00c15a-2512-41d0-9857-edb50374897e/console.log' append='off'/>
Aug 15 05:32:17 user nova-compute[73391]:       <target type='isa-serial' port='0'>
Aug 15 05:32:17 user nova-compute[73391]:         <model name='isa-serial'/>
Aug 15 05:32:17 user nova-compute[73391]:       </target>
Aug 15 05:32:17 user nova-compute[73391]:       <alias name='serial0'/>
Aug 15 05:32:17 user nova-compute[73391]:     </serial>
Aug 15 05:32:17 user nova-compute[73391]:     <console type='pty' tty='/dev/pts/6'>
Aug 15 05:32:17 user nova-compute[73391]:       <source path='/dev/pts/6'/>
Aug 15 05:32:17 user nova-compute[73391]:       <log file='/opt/stack/data/nova/instances/df00c15a-2512-41d0-9857-edb50374897e/console.log' append='off'/>
Aug 15 05:32:17 user nova-compute[73391]:       <target type='serial' port='0'/>
Aug 15 05:32:17 user nova-compute[73391]:       <alias name='serial0'/>
Aug 15 05:32:17 user nova-compute[73391]:     </console>
Aug 15 05:32:17 user nova-compute[73391]:     <input type='mouse' bus='ps2'>
Aug 15 05:32:17 user nova-compute[73391]:       <alias name='input0'/>
Aug 15 05:32:17 user nova-compute[73391]:     </input>
Aug 15 05:32:17 user nova-compute[73391]:     <input type='keyboard' bus='ps2'>
Aug 15 05:32:17 user nova-compute[73391]:       <alias name='input1'/>
Aug 15 05:32:17 user nova-compute[73391]:     </input>
Aug 15 05:32:17 user nova-compute[73391]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Aug 15 05:32:17 user nova-compute[73391]:       <listen type='address' address='0.0.0.0'/>
Aug 15 05:32:17 user nova-compute[73391]:     </graphics>
Aug 15 05:32:17 user nova-compute[73391]:     <audio id='1' type='none'/>
Aug 15 05:32:17 user nova-compute[73391]:     <video>
Aug 15 05:32:17 user nova-compute[73391]:       <model type='virtio' heads='1' primary='yes'/>
Aug 15 05:32:17 user nova-compute[73391]:       <alias name='video0'/>
Aug 15 05:32:17 user nova-compute[73391]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 15 05:32:17 user nova-compute[73391]:     </video>
Aug 15 05:32:17 user nova-compute[73391]:     <memballoon model='virtio'>
Aug 15 05:32:17 user nova-compute[73391]:       <stats period='10'/>
Aug 15 05:32:17 user nova-compute[73391]:       <alias name='balloon0'/>
Aug 15 05:32:17 user nova-compute[73391]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 15 05:32:17 user nova-compute[73391]:     </memballoon>
Aug 15 05:32:17 user nova-compute[73391]:     <rng model='virtio'>
Aug 15 05:32:17 user nova-compute[73391]:       <backend model='random'>/dev/urandom</backend>
Aug 15 05:32:17 user nova-compute[73391]:       <alias name='rng0'/>
Aug 15 05:32:17 user nova-compute[73391]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 15 05:32:17 user nova-compute[73391]:     </rng>
Aug 15 05:32:17 user nova-compute[73391]:   </devices>
Aug 15 05:32:17 user nova-compute[73391]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 15 05:32:17 user nova-compute[73391]:     <label>libvirt-df00c15a-2512-41d0-9857-edb50374897e</label>
Aug 15 05:32:17 user nova-compute[73391]:     <imagelabel>libvirt-df00c15a-2512-41d0-9857-edb50374897e</imagelabel>
Aug 15 05:32:17 user nova-compute[73391]:   </seclabel>
Aug 15 05:32:17 user nova-compute[73391]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 15 05:32:17 user nova-compute[73391]:     <label>+64055:+108</label>
Aug 15 05:32:17 user nova-compute[73391]:     <imagelabel>+64055:+108</imagelabel>
Aug 15 05:32:17 user nova-compute[73391]:   </seclabel>
Aug 15 05:32:17 user nova-compute[73391]: </domain>
Aug 15 05:32:17 user nova-compute[73391]:  {{(pid=73391) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 15 05:32:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [req-b9b165c2-e8ab-41bd-adfa-b97c2bf21571 req-4532b415-bc74-4e33-81fa-becfcc4727de service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:ac:36:4b"/><model type="virtio"/><mtu size="1442"/><target dev="tapf2700be5-db"/></interface> {{(pid=73391) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Aug 15 05:32:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [req-b9b165c2-e8ab-41bd-adfa-b97c2bf21571 req-4532b415-bc74-4e33-81fa-becfcc4727de service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:ac:36:4b"/><model type="virtio"/><mtu size="1442"/><target dev="tapf2700be5-db"/></interface>not found in domain: <domain type='kvm' id='6'>
Aug 15 05:32:17 user nova-compute[73391]:   <name>instance-00000006</name>
Aug 15 05:32:17 user nova-compute[73391]:   <uuid>df00c15a-2512-41d0-9857-edb50374897e</uuid>
Aug 15 05:32:17 user nova-compute[73391]:   <metadata>
Aug 15 05:32:17 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:32:17 user nova-compute[73391]:   <nova:package version="0.0.0"/>
Aug 15 05:32:17 user nova-compute[73391]:   <nova:name>tempest-device-tagging-server-1483983120</nova:name>
Aug 15 05:32:17 user nova-compute[73391]:   <nova:creationTime>2023-08-15 05:32:16</nova:creationTime>
Aug 15 05:32:17 user nova-compute[73391]:   <nova:flavor name="m1.tiny">
Aug 15 05:32:17 user nova-compute[73391]:     <nova:memory>512</nova:memory>
Aug 15 05:32:17 user nova-compute[73391]:     <nova:disk>1</nova:disk>
Aug 15 05:32:17 user nova-compute[73391]:     <nova:swap>0</nova:swap>
Aug 15 05:32:17 user nova-compute[73391]:     <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:32:17 user nova-compute[73391]:     <nova:vcpus>1</nova:vcpus>
Aug 15 05:32:17 user nova-compute[73391]:   </nova:flavor>
Aug 15 05:32:17 user nova-compute[73391]:   <nova:owner>
Aug 15 05:32:17 user nova-compute[73391]:     <nova:user uuid="42f8f8600f9a4d81a72afbaf2bbd53a5">tempest-TaggedAttachmentsTest-1390153553-project-member</nova:user>
Aug 15 05:32:17 user nova-compute[73391]:     <nova:project uuid="1d2905fedccc4085a38a905192ba079b">tempest-TaggedAttachmentsTest-1390153553</nova:project>
Aug 15 05:32:17 user nova-compute[73391]:   </nova:owner>
Aug 15 05:32:17 user nova-compute[73391]:   <nova:root type="image" uuid="191b1dad-305e-4d1c-9b15-515ec59a3278"/>
Aug 15 05:32:17 user nova-compute[73391]:   <nova:ports>
Aug 15 05:32:17 user nova-compute[73391]:     <nova:port uuid="c065ab29-c8d1-463f-bf12-7921829c9ede">
Aug 15 05:32:17 user nova-compute[73391]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 05:32:17 user nova-compute[73391]:     </nova:port>
Aug 15 05:32:17 user nova-compute[73391]:   </nova:ports>
Aug 15 05:32:17 user nova-compute[73391]: </nova:instance>
Aug 15 05:32:17 user nova-compute[73391]:   </metadata>
Aug 15 05:32:17 user nova-compute[73391]:   <memory unit='KiB'>524288</memory>
Aug 15 05:32:17 user nova-compute[73391]:   <currentMemory unit='KiB'>524288</currentMemory>
Aug 15 05:32:17 user nova-compute[73391]:   <vcpu placement='static'>1</vcpu>
Aug 15 05:32:17 user nova-compute[73391]:   <resource>
Aug 15 05:32:17 user nova-compute[73391]:     <partition>/machine</partition>
Aug 15 05:32:17 user nova-compute[73391]:   </resource>
Aug 15 05:32:17 user nova-compute[73391]:   <sysinfo type='smbios'>
Aug 15 05:32:17 user nova-compute[73391]:     <system>
Aug 15 05:32:17 user nova-compute[73391]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Aug 15 05:32:17 user nova-compute[73391]:       <entry name='product'>OpenStack Nova</entry>
Aug 15 05:32:17 user nova-compute[73391]:       <entry name='version'>0.0.0</entry>
Aug 15 05:32:17 user nova-compute[73391]:       <entry name='serial'>df00c15a-2512-41d0-9857-edb50374897e</entry>
Aug 15 05:32:17 user nova-compute[73391]:       <entry name='uuid'>df00c15a-2512-41d0-9857-edb50374897e</entry>
Aug 15 05:32:17 user nova-compute[73391]:       <entry name='family'>Virtual Machine</entry>
Aug 15 05:32:17 user nova-compute[73391]:     </system>
Aug 15 05:32:17 user nova-compute[73391]:   </sysinfo>
Aug 15 05:32:17 user nova-compute[73391]:   <os>
Aug 15 05:32:17 user nova-compute[73391]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Aug 15 05:32:17 user nova-compute[73391]:     <boot dev='hd'/>
Aug 15 05:32:17 user nova-compute[73391]:     <smbios mode='sysinfo'/>
Aug 15 05:32:17 user nova-compute[73391]:   </os>
Aug 15 05:32:17 user nova-compute[73391]:   <features>
Aug 15 05:32:17 user nova-compute[73391]:     <acpi/>
Aug 15 05:32:17 user nova-compute[73391]:     <apic/>
Aug 15 05:32:17 user nova-compute[73391]:     <vmcoreinfo state='on'/>
Aug 15 05:32:17 user nova-compute[73391]:   </features>
Aug 15 05:32:17 user nova-compute[73391]:   <cpu mode='custom' match='exact' check='full'>
Aug 15 05:32:17 user nova-compute[73391]:     <model fallback='forbid'>Nehalem</model>
Aug 15 05:32:17 user nova-compute[73391]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Aug 15 05:32:17 user nova-compute[73391]:     <feature policy='require' name='vme'/>
Aug 15 05:32:17 user nova-compute[73391]:     <feature policy='require' name='x2apic'/>
Aug 15 05:32:17 user nova-compute[73391]:     <feature policy='require' name='hypervisor'/>
Aug 15 05:32:17 user nova-compute[73391]:   </cpu>
Aug 15 05:32:17 user nova-compute[73391]:   <clock offset='utc'>
Aug 15 05:32:17 user nova-compute[73391]:     <timer name='pit' tickpolicy='delay'/>
Aug 15 05:32:17 user nova-compute[73391]:     <timer name='rtc' tickpolicy='catchup'/>
Aug 15 05:32:17 user nova-compute[73391]:     <timer name='hpet' present='no'/>
Aug 15 05:32:17 user nova-compute[73391]:   </clock>
Aug 15 05:32:17 user nova-compute[73391]:   <on_poweroff>destroy</on_poweroff>
Aug 15 05:32:17 user nova-compute[73391]:   <on_reboot>restart</on_reboot>
Aug 15 05:32:17 user nova-compute[73391]:   <on_crash>destroy</on_crash>
Aug 15 05:32:17 user nova-compute[73391]:   <devices>
Aug 15 05:32:17 user nova-compute[73391]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Aug 15 05:32:17 user nova-compute[73391]:     <disk type='file' device='disk'>
Aug 15 05:32:17 user nova-compute[73391]:       <driver name='qemu' type='qcow2' cache='none'/>
Aug 15 05:32:17 user nova-compute[73391]:       <source file='/opt/stack/data/nova/instances/df00c15a-2512-41d0-9857-edb50374897e/disk' index='2'/>
Aug 15 05:32:17 user nova-compute[73391]:       <backingStore type='file' index='3'>
Aug 15 05:32:17 user nova-compute[73391]:         <format type='raw'/>
Aug 15 05:32:17 user nova-compute[73391]:         <source file='/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b'/>
Aug 15 05:32:17 user nova-compute[73391]:         <backingStore/>
Aug 15 05:32:17 user nova-compute[73391]:       </backingStore>
Aug 15 05:32:17 user nova-compute[73391]:       <target dev='vda' bus='virtio'/>
Aug 15 05:32:17 user nova-compute[73391]:       <alias name='virtio-disk0'/>
Aug 15 05:32:17 user nova-compute[73391]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Aug 15 05:32:17 user nova-compute[73391]:     </disk>
Aug 15 05:32:17 user nova-compute[73391]:     <disk type='file' device='cdrom'>
Aug 15 05:32:17 user nova-compute[73391]:       <driver name='qemu' type='raw' cache='none'/>
Aug 15 05:32:17 user nova-compute[73391]:       <source file='/opt/stack/data/nova/instances/df00c15a-2512-41d0-9857-edb50374897e/disk.config' index='1'/>
Aug 15 05:32:17 user nova-compute[73391]:       <backingStore/>
Aug 15 05:32:17 user nova-compute[73391]:       <target dev='hda' bus='ide'/>
Aug 15 05:32:17 user nova-compute[73391]:       <readonly/>
Aug 15 05:32:17 user nova-compute[73391]:       <alias name='ide0-0-0'/>
Aug 15 05:32:17 user nova-compute[73391]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Aug 15 05:32:17 user nova-compute[73391]:     </disk>
Aug 15 05:32:17 user nova-compute[73391]:     <controller type='usb' index='0' model='none'>
Aug 15 05:32:17 user nova-compute[73391]:       <alias name='usb'/>
Aug 15 05:32:17 user nova-compute[73391]:     </controller>
Aug 15 05:32:17 user nova-compute[73391]:     <controller type='pci' index='0' model='pci-root'>
Aug 15 05:32:17 user nova-compute[73391]:       <alias name='pci.0'/>
Aug 15 05:32:17 user nova-compute[73391]:     </controller>
Aug 15 05:32:17 user nova-compute[73391]:     <controller type='ide' index='0'>
Aug 15 05:32:17 user nova-compute[73391]:       <alias name='ide'/>
Aug 15 05:32:17 user nova-compute[73391]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Aug 15 05:32:17 user nova-compute[73391]:     </controller>
Aug 15 05:32:17 user nova-compute[73391]:     <interface type='ethernet'>
Aug 15 05:32:17 user nova-compute[73391]:       <mac address='fa:16:3e:92:27:fb'/>
Aug 15 05:32:17 user nova-compute[73391]:       <target dev='tapc065ab29-c8'/>
Aug 15 05:32:17 user nova-compute[73391]:       <model type='virtio'/>
Aug 15 05:32:17 user nova-compute[73391]:       <mtu size='1442'/>
Aug 15 05:32:17 user nova-compute[73391]:       <alias name='net0'/>
Aug 15 05:32:17 user nova-compute[73391]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Aug 15 05:32:17 user nova-compute[73391]:     </interface>
Aug 15 05:32:17 user nova-compute[73391]:     <serial type='pty'>
Aug 15 05:32:17 user nova-compute[73391]:       <source path='/dev/pts/6'/>
Aug 15 05:32:17 user nova-compute[73391]:       <log file='/opt/stack/data/nova/instances/df00c15a-2512-41d0-9857-edb50374897e/console.log' append='off'/>
Aug 15 05:32:17 user nova-compute[73391]:       <target type='isa-serial' port='0'>
Aug 15 05:32:17 user nova-compute[73391]:         <model name='isa-serial'/>
Aug 15 05:32:17 user nova-compute[73391]:       </target>
Aug 15 05:32:17 user nova-compute[73391]:       <alias name='serial0'/>
Aug 15 05:32:17 user nova-compute[73391]:     </serial>
Aug 15 05:32:17 user nova-compute[73391]:     <console type='pty' tty='/dev/pts/6'>
Aug 15 05:32:17 user nova-compute[73391]:       <source path='/dev/pts/6'/>
Aug 15 05:32:17 user nova-compute[73391]:       <log file='/opt/stack/data/nova/instances/df00c15a-2512-41d0-9857-edb50374897e/console.log' append='off'/>
Aug 15 05:32:17 user nova-compute[73391]:       <target type='serial' port='0'/>
Aug 15 05:32:17 user nova-compute[73391]:       <alias name='serial0'/>
Aug 15 05:32:17 user nova-compute[73391]:     </console>
Aug 15 05:32:17 user nova-compute[73391]:     <input type='mouse' bus='ps2'>
Aug 15 05:32:17 user nova-compute[73391]:       <alias name='input0'/>
Aug 15 05:32:17 user nova-compute[73391]:     </input>
Aug 15 05:32:17 user nova-compute[73391]:     <input type='keyboard' bus='ps2'>
Aug 15 05:32:17 user nova-compute[73391]:       <alias name='input1'/>
Aug 15 05:32:17 user nova-compute[73391]:     </input>
Aug 15 05:32:17 user nova-compute[73391]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Aug 15 05:32:17 user nova-compute[73391]:       <listen type='address' address='0.0.0.0'/>
Aug 15 05:32:17 user nova-compute[73391]:     </graphics>
Aug 15 05:32:17 user nova-compute[73391]:     <audio id='1' type='none'/>
Aug 15 05:32:17 user nova-compute[73391]:     <video>
Aug 15 05:32:17 user nova-compute[73391]:       <model type='virtio' heads='1' primary='yes'/>
Aug 15 05:32:17 user nova-compute[73391]:       <alias name='video0'/>
Aug 15 05:32:17 user nova-compute[73391]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Aug 15 05:32:17 user nova-compute[73391]:     </video>
Aug 15 05:32:17 user nova-compute[73391]:     <memballoon model='virtio'>
Aug 15 05:32:17 user nova-compute[73391]:       <stats period='10'/>
Aug 15 05:32:17 user nova-compute[73391]:       <alias name='balloon0'/>
Aug 15 05:32:17 user nova-compute[73391]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Aug 15 05:32:17 user nova-compute[73391]:     </memballoon>
Aug 15 05:32:17 user nova-compute[73391]:     <rng model='virtio'>
Aug 15 05:32:17 user nova-compute[73391]:       <backend model='random'>/dev/urandom</backend>
Aug 15 05:32:17 user nova-compute[73391]:       <alias name='rng0'/>
Aug 15 05:32:17 user nova-compute[73391]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Aug 15 05:32:17 user nova-compute[73391]:     </rng>
Aug 15 05:32:17 user nova-compute[73391]:   </devices>
Aug 15 05:32:17 user nova-compute[73391]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Aug 15 05:32:17 user nova-compute[73391]:     <label>libvirt-df00c15a-2512-41d0-9857-edb50374897e</label>
Aug 15 05:32:17 user nova-compute[73391]:     <imagelabel>libvirt-df00c15a-2512-41d0-9857-edb50374897e</imagelabel>
Aug 15 05:32:17 user nova-compute[73391]:   </seclabel>
Aug 15 05:32:17 user nova-compute[73391]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Aug 15 05:32:17 user nova-compute[73391]:     <label>+64055:+108</label>
Aug 15 05:32:17 user nova-compute[73391]:     <imagelabel>+64055:+108</imagelabel>
Aug 15 05:32:17 user nova-compute[73391]:   </seclabel>
Aug 15 05:32:17 user nova-compute[73391]: </domain>
Aug 15 05:32:17 user nova-compute[73391]:  {{(pid=73391) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Aug 15 05:32:17 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [req-b9b165c2-e8ab-41bd-adfa-b97c2bf21571 req-4532b415-bc74-4e33-81fa-becfcc4727de service nova] [instance: df00c15a-2512-41d0-9857-edb50374897e] Detaching interface fa:16:3e:ac:36:4b failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapf2700be5-db' not found.
Aug 15 05:32:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [req-b9b165c2-e8ab-41bd-adfa-b97c2bf21571 req-4532b415-bc74-4e33-81fa-becfcc4727de service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T05:29:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1483983120',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1483983120',id=6,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2gCgxFYyHMvanjOmlhgs+PtTOvShgOshpOoTRWbXBVti5EI5YAHx014n7qsJi2J2bJRkI0PBGeXP5u90VAUBx25BB0y6ovoKoEveKinIqcQDUv9GNl+Dqk3GoYb9mVVg==',key_name='tempest-keypair-1486183318',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:30:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d2905fedccc4085a38a905192ba079b',ramdisk_id='',reservation_id='r-j2lev19d',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1390153553',owner_user_name='tempest-TaggedAttachmentsTest-1390153553-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:30:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='42f8f8600f9a4d81a72afbaf2bbd53a5',uuid=df00c15a-2512-41d0-9857-edb50374897e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f2700be5-db51-43e4-bfaa-aa91b76489af", "address": "fa:16:3e:ac:36:4b", "network": {"id": "a0603438-6866-4c65-af22-30fac1b66aaa", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-963064482", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1d2905fedccc4085a38a905192ba079b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2700be5-db", "ovs_interfaceid": "f2700be5-db51-43e4-bfaa-aa91b76489af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:32:17 user nova-compute[73391]: DEBUG nova.network.os_vif_util [req-b9b165c2-e8ab-41bd-adfa-b97c2bf21571 req-4532b415-bc74-4e33-81fa-becfcc4727de service nova] Converting VIF {"id": "f2700be5-db51-43e4-bfaa-aa91b76489af", "address": "fa:16:3e:ac:36:4b", "network": {"id": "a0603438-6866-4c65-af22-30fac1b66aaa", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-963064482", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "1d2905fedccc4085a38a905192ba079b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2700be5-db", "ovs_interfaceid": "f2700be5-db51-43e4-bfaa-aa91b76489af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:32:17 user nova-compute[73391]: DEBUG nova.network.os_vif_util [req-b9b165c2-e8ab-41bd-adfa-b97c2bf21571 req-4532b415-bc74-4e33-81fa-becfcc4727de service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:36:4b,bridge_name='br-int',has_traffic_filtering=True,id=f2700be5-db51-43e4-bfaa-aa91b76489af,network=Network(a0603438-6866-4c65-af22-30fac1b66aaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2700be5-db') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:32:17 user nova-compute[73391]: DEBUG os_vif [req-b9b165c2-e8ab-41bd-adfa-b97c2bf21571 req-4532b415-bc74-4e33-81fa-becfcc4727de service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:36:4b,bridge_name='br-int',has_traffic_filtering=True,id=f2700be5-db51-43e4-bfaa-aa91b76489af,network=Network(a0603438-6866-4c65-af22-30fac1b66aaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2700be5-db') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:32:17 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:17 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf2700be5-db, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:32:17 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:32:17 user nova-compute[73391]: INFO os_vif [req-b9b165c2-e8ab-41bd-adfa-b97c2bf21571 req-4532b415-bc74-4e33-81fa-becfcc4727de service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:36:4b,bridge_name='br-int',has_traffic_filtering=True,id=f2700be5-db51-43e4-bfaa-aa91b76489af,network=Network(a0603438-6866-4c65-af22-30fac1b66aaa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2700be5-db')
Aug 15 05:32:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [req-b9b165c2-e8ab-41bd-adfa-b97c2bf21571 req-4532b415-bc74-4e33-81fa-becfcc4727de service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:32:17 user nova-compute[73391]:   <nova:package version="0.0.0"/>
Aug 15 05:32:17 user nova-compute[73391]:   <nova:name>tempest-device-tagging-server-1483983120</nova:name>
Aug 15 05:32:17 user nova-compute[73391]:   <nova:creationTime>2023-08-15 05:32:17</nova:creationTime>
Aug 15 05:32:17 user nova-compute[73391]:   <nova:flavor name="m1.tiny">
Aug 15 05:32:17 user nova-compute[73391]:     <nova:memory>512</nova:memory>
Aug 15 05:32:17 user nova-compute[73391]:     <nova:disk>1</nova:disk>
Aug 15 05:32:17 user nova-compute[73391]:     <nova:swap>0</nova:swap>
Aug 15 05:32:17 user nova-compute[73391]:     <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:32:17 user nova-compute[73391]:     <nova:vcpus>1</nova:vcpus>
Aug 15 05:32:17 user nova-compute[73391]:   </nova:flavor>
Aug 15 05:32:17 user nova-compute[73391]:   <nova:owner>
Aug 15 05:32:17 user nova-compute[73391]:     <nova:user uuid="42f8f8600f9a4d81a72afbaf2bbd53a5">tempest-TaggedAttachmentsTest-1390153553-project-member</nova:user>
Aug 15 05:32:17 user nova-compute[73391]:     <nova:project uuid="1d2905fedccc4085a38a905192ba079b">tempest-TaggedAttachmentsTest-1390153553</nova:project>
Aug 15 05:32:17 user nova-compute[73391]:   </nova:owner>
Aug 15 05:32:17 user nova-compute[73391]:   <nova:root type="image" uuid="191b1dad-305e-4d1c-9b15-515ec59a3278"/>
Aug 15 05:32:17 user nova-compute[73391]:   <nova:ports>
Aug 15 05:32:17 user nova-compute[73391]:     <nova:port uuid="c065ab29-c8d1-463f-bf12-7921829c9ede">
Aug 15 05:32:17 user nova-compute[73391]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 05:32:17 user nova-compute[73391]:     </nova:port>
Aug 15 05:32:17 user nova-compute[73391]:   </nova:ports>
Aug 15 05:32:17 user nova-compute[73391]: </nova:instance>
Aug 15 05:32:17 user nova-compute[73391]:  {{(pid=73391) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Aug 15 05:32:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=73391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 05:32:18 user nova-compute[73391]: INFO nova.network.neutron [None req-74fd441f-0a1e-4398-9a32-c83841eafe0f tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] [instance: df00c15a-2512-41d0-9857-edb50374897e] Port f2700be5-db51-43e4-bfaa-aa91b76489af from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Aug 15 05:32:18 user nova-compute[73391]: DEBUG nova.network.neutron [None req-74fd441f-0a1e-4398-9a32-c83841eafe0f tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] [instance: df00c15a-2512-41d0-9857-edb50374897e] Updating instance_info_cache with network_info: [{"id": "c065ab29-c8d1-463f-bf12-7921829c9ede", "address": "fa:16:3e:92:27:fb", "network": {"id": "6605a4f0-a8e4-4044-a7d3-36dd84d3870c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-694227201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d2905fedccc4085a38a905192ba079b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc065ab29-c8", "ovs_interfaceid": "c065ab29-c8d1-463f-bf12-7921829c9ede", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:32:18 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] COPY block job progress, current cursor: 164626432 final cursor: 1073741824 {{(pid=73391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 05:32:18 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:32:18 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Starting heal instance info cache {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 05:32:18 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-74fd441f-0a1e-4398-9a32-c83841eafe0f tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Releasing lock "refresh_cache-df00c15a-2512-41d0-9857-edb50374897e" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:32:18 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-74fd441f-0a1e-4398-9a32-c83841eafe0f tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Lock "interface-df00c15a-2512-41d0-9857-edb50374897e-f2700be5-db51-43e4-bfaa-aa91b76489af" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 1.816s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:18 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "refresh_cache-6ac9d5dc-56be-402f-b9d4-3327bdfd9220" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:32:18 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquired lock "refresh_cache-6ac9d5dc-56be-402f-b9d4-3327bdfd9220" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:32:18 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Forcefully refreshing network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 05:32:18 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] COPY block job progress, current cursor: 325058560 final cursor: 1073741824 {{(pid=73391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 05:32:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:19 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Updating instance_info_cache with network_info: [{"id": "9cde10e9-3186-4680-8e4d-a3bb0d8600d0", "address": "fa:16:3e:50:39:e0", "network": {"id": "610f78de-5741-4743-815d-d12ba05f8000", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1518164868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b01853a82243369bd71dc0dbedb5d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cde10e9-31", "ovs_interfaceid": "9cde10e9-3186-4680-8e4d-a3bb0d8600d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:32:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Releasing lock "refresh_cache-6ac9d5dc-56be-402f-b9d4-3327bdfd9220" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:32:19 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Updated the network info_cache for instance {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 05:32:19 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:32:19 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:32:19 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 05:32:19 user nova-compute[73391]: DEBUG nova.compute.manager [req-fd2bc6a5-170c-4506-b4c5-b02b99b1c0c0 req-9827b50f-3a72-456b-a7b8-6ea0894aa8ee service nova] [instance: df00c15a-2512-41d0-9857-edb50374897e] Received event network-vif-plugged-f2700be5-db51-43e4-bfaa-aa91b76489af {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:32:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-fd2bc6a5-170c-4506-b4c5-b02b99b1c0c0 req-9827b50f-3a72-456b-a7b8-6ea0894aa8ee service nova] Acquiring lock "df00c15a-2512-41d0-9857-edb50374897e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-fd2bc6a5-170c-4506-b4c5-b02b99b1c0c0 req-9827b50f-3a72-456b-a7b8-6ea0894aa8ee service nova] Lock "df00c15a-2512-41d0-9857-edb50374897e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-fd2bc6a5-170c-4506-b4c5-b02b99b1c0c0 req-9827b50f-3a72-456b-a7b8-6ea0894aa8ee service nova] Lock "df00c15a-2512-41d0-9857-edb50374897e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:19 user nova-compute[73391]: DEBUG nova.compute.manager [req-fd2bc6a5-170c-4506-b4c5-b02b99b1c0c0 req-9827b50f-3a72-456b-a7b8-6ea0894aa8ee service nova] [instance: df00c15a-2512-41d0-9857-edb50374897e] No waiting events found dispatching network-vif-plugged-f2700be5-db51-43e4-bfaa-aa91b76489af {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:32:19 user nova-compute[73391]: WARNING nova.compute.manager [req-fd2bc6a5-170c-4506-b4c5-b02b99b1c0c0 req-9827b50f-3a72-456b-a7b8-6ea0894aa8ee service nova] [instance: df00c15a-2512-41d0-9857-edb50374897e] Received unexpected event network-vif-plugged-f2700be5-db51-43e4-bfaa-aa91b76489af for instance with vm_state active and task_state None.
Aug 15 05:32:19 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] COPY block job progress, current cursor: 501219328 final cursor: 1073741824 {{(pid=73391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 05:32:19 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] COPY block job progress, current cursor: 663748608 final cursor: 1073741824 {{(pid=73391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 05:32:19 user nova-compute[73391]: DEBUG os_brick.utils [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:32:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:19 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6cb32a3-36cd-4c27-8e0d-5aaa1165a7b9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:19 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b27603-5266-4ceb-9baa-bb0fba3bea63]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:19 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[58553ae9-ca18-4ca0-ad35-a89bda9f2b93]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:19 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a75ad00-b284-41ce-8ed5-c9ea4644d13e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:32:19 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 05:32:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:32:20 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 05:32:20 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c578be-96a0-46fd-9cf9-5e95c37ef153]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 05:32:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 05:32:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 05:32:20 user nova-compute[73391]: DEBUG os_brick.utils [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:32:20 user nova-compute[73391]: DEBUG nova.virt.block_device [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Updating existing volume attachment record: 068a15d7-3013-4b34-a615-fd36d5b1d5a4 {{(pid=73391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 05:32:20 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] COPY block job progress, current cursor: 817889280 final cursor: 1073741824 {{(pid=73391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 05:32:20 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] COPY block job progress, current cursor: 983564288 final cursor: 1073741824 {{(pid=73391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 05:32:21 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 05:32:21 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 05:32:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XYflAmQI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:32:21 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:32:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:32:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:32:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 05:32:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:21 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[37073144-add0-4883-a039-62d349d510d0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:21 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[64d94931-629e-43f7-961c-8a40b2ad3039]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)
Aug 15 05:32:21 user nova-compute[73391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)
Aug 15 05:32:21 user nova-compute[73391]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9 (non-flash)
Aug 15 05:32:21 user nova-compute[73391]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:32:21 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:32:21 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:32:21 user nova-compute[73391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)
Aug 15 05:32:21 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:32:21 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:32:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)
Aug 15 05:32:21 user nova-compute[73391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)
Aug 15 05:32:21 user nova-compute[73391]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9 (non-flash)
Aug 15 05:32:21 user nova-compute[73391]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:32:21 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:32:21 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:32:21 user nova-compute[73391]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)
Aug 15 05:32:21 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:32:21 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:32:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f772848e3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a'): ({'sdf'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 05:32:21 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] Removing single pathed devices sdf {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 05:32:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.036s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:21 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d163ac99-4db6-4c61-88b4-4fa1a6ad01cb]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:21 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3386e917-2f91-40db-a94c-4c55a9d892fd]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:21 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] Flushing IO for device /dev/sdf {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 05:32:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:21 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f556680-c4d4-465d-8fc9-e57fe5d48157]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:21 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 05:32:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.054s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:21 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42c3364-e2be-4b21-95d4-5cb22e1f89b6]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:21 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 05:32:21 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] SCSI volumes sdf have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 05:32:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 05:32:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:21 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[816064cf-4d1f-4da2-bab4-c703c1ff8719]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:21 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07f86f5-2d5c-4e75-9e05-6c3e8c7e6eeb]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a, portal: 172.16.0.220,3260]
Aug 15 05:32:21 user nova-compute[73391]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a, portal: 172.16.0.220,3260] successful.
Aug 15 05:32:21 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:21 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ad6156-7760-4e38-8f4e-5823bfa77af8]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:32:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] <== disconnect_volume: return (351ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:32:21 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 05:32:21 user nova-compute[73391]: DEBUG nova.compute.manager [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'POMEuziG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '0169df15-335e-46e6-a5c8-9deb7095bb84', 'attached_at': '', 'detached_at': '', 'volume_id': '4003a351-ce41-40db-8e1f-95bd0985e3e9', 'serial'} {{(pid=73391) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 15 05:32:21 user nova-compute[73391]: DEBUG nova.compute.manager [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] swap_volume: removing Cinder connection for volume fb592ee0-ed3e-427a-8cc4-05091385a40a {{(pid=73391) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 15 05:32:21 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:22 user nova-compute[73391]: DEBUG nova.compute.manager [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] swap_volume: Updating volume fb592ee0-ed3e-427a-8cc4-05091385a40a BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "POMEuziG", "auth_password": "SxlJE62n3p0GMc", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sde", "volume_id": "4003a351-ce41-40db-8e1f-95bd0985e3e9"}, "status": "reserved", "instance": "0169df15-335e-46e6-a5c8-9deb7095bb84", "attached_at": "", "detached_at": "", "volume_id": "4003a351-ce41-40db-8e1f-95bd0985e3e9", "serial": "4003a351-ce41-40db-8e1f-95bd0985e3e9"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '4003a351-ce41-40db-8e1f-95bd0985e3e9', 'no_device': None, 'attachment_id': '86f9205c-9fef-41b9-b2d6-8902350d794c'} {{(pid=73391) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 15 05:32:22 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d31ee7c2-677f-4393-bc70-79dc8808f030 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] Lock "0169df15-335e-46e6-a5c8-9deb7095bb84" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 21.869s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:23 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] Acquiring lock "0169df15-335e-46e6-a5c8-9deb7095bb84" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:23 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] Lock "0169df15-335e-46e6-a5c8-9deb7095bb84" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:23 user nova-compute[73391]: DEBUG os_brick.utils [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:32:23 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:23 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:23 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[138f376a-e09d-460a-97eb-0fbd4aab9c32]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:23 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:23 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:23 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84d0e63-cd32-440e-a1ee-7cc6655155f3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:23 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:24 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2bcc3a-e889-41bb-98d3-6e746d894566]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:24 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a79efb-6127-4c9e-bfa3-a33a60c5755a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:32:24 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 05:32:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:32:24 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 05:32:24 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f11232-232a-425c-a5e7-7c8c118b1c72]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:24 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 05:32:24 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 05:32:24 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 05:32:24 user nova-compute[73391]: DEBUG os_brick.utils [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:32:24 user nova-compute[73391]: INFO nova.compute.manager [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Swapping volume 4003a351-ce41-40db-8e1f-95bd0985e3e9 for fb592ee0-ed3e-427a-8cc4-05091385a40a
Aug 15 05:32:26 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG nova.compute.manager [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Start spawning the instance on the hypervisor. {{(pid=73391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Creating instance directory {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 05:32:31 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Creating image(s)
Aug 15 05:32:31 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Did not create local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Ensure instance console log exists: /opt/stack/data/nova/instances/6358e825-5705-45d6-86b6-3aacfa5a9bbb/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Start _get_guest_xml network_info=[{"id": "3b77e3e1-84f9-470a-b684-e8bdc4996c68", "address": "fa:16:3e:68:b6:f9", "network": {"id": "70d88082-aea7-48bb-abb4-d77d264aaf01", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b9acbe11654053bb905e7c92558a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b77e3e1-84", "ovs_interfaceid": "3b77e3e1-84f9-470a-b684-e8bdc4996c68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yNsuhABc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6358e825-5705-45d6-86b6-3aacfa5a9bbb', 'attached_at': '', 'detached_at': '', 'volume_id': '80371ba5-8b71-45bc-b67d-43676d63163e', 'serial': '80371ba5-8b71-45bc-b67d-43676d63163e'}, 'attachment_id': '068a15d7-3013-4b34-a615-fd36d5b1d5a4', 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:32:31 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:32:31 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:32:31 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yNsuhABc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:32:31 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:32:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:32:31 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:32:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:32:31 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 05:32:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8dae9a6-68ac-420d-9db5-4332e9c584a3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 05:32:31 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ecb203-7490-48eb-afe0-bfc224718d90]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e] added
Aug 15 05:32:31 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86f2a3d-7b56-4b42-bfb4-1af633bf8171]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8259dd06-44ee-4a75-9524-c00d959a01eb]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yNsuhABc {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yNsuhABc" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d852b65-bc1e-4e4a-a7fc-25b9b1844758]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yNsuhABc'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5dbc251-3470-45d7-a5d4-88ce726e934d]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74dee5f-c943-468e-a576-4fb449b8dac8]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)
Aug 15 05:32:31 user nova-compute[73391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)
Aug 15 05:32:31 user nova-compute[73391]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9 (non-flash)
Aug 15 05:32:31 user nova-compute[73391]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:32:31 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:32:31 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:32:31 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:32:31 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)
Aug 15 05:32:31 user nova-compute[73391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)
Aug 15 05:32:31 user nova-compute[73391]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9 (non-flash)
Aug 15 05:32:31 user nova-compute[73391]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:32:31 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:32:31 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:32:31 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:32:31 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e -p 172.16.0.220:3260 --login" returned: 0 in 0.090s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dda26df-4aff-4194-bd7b-3fe33683dd5f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e, portal: 172.16.0.220,3260]
Aug 15 05:32:31 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e, portal: 172.16.0.220,3260] successful.
Aug 15 05:32:31 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:32 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbbc5a9-d5a0-4078-9a57-5184116838fc]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:32 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:32 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ce832f-88b8-42a6-b2fb-58c5299f8f26]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:32 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)
Aug 15 05:32:32 user nova-compute[73391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)
Aug 15 05:32:32 user nova-compute[73391]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9 (non-flash)
Aug 15 05:32:32 user nova-compute[73391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:32:32 user nova-compute[73391]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:32:32 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:32:32 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:32:32 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:32:32 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:32:32 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)
Aug 15 05:32:32 user nova-compute[73391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)
Aug 15 05:32:32 user nova-compute[73391]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9 (non-flash)
Aug 15 05:32:32 user nova-compute[73391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:32:32 user nova-compute[73391]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:32:32 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:32:32 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:32:32 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:32:32 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:32:32 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:32:32 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 05:32:32 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] HCTL ('37', '-', '-', 0) found on session 14 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 05:32:32 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 05:32:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:32 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[52db02b6-b8f8-4ce7-98b8-ff8402f2edb0]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:32 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Searching for a device in session 14 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:32:32 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yNsuhABc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 05:32:32 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:33 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.401s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:32:33 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] <== connect_volume: return (1403ms) {'type': 'block', 'scsi_wwn': '26361303339663834', 'path': '/dev/sdf'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:32:33 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361303339663834', 'path': '/dev/sdf'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 05:32:33 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:32:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-668367840',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-668367840',id=12,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83b9acbe11654053bb905e7c92558a35',ramdisk_id='',reservation_id='r-t0vgeqpl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1045163116',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:32:06Z,user_data=None,user_id='887f0846cf554e12acf92a663f5ab266',uuid=6358e825-5705-45d6-86b6-3aacfa5a9bbb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b77e3e1-84f9-470a-b684-e8bdc4996c68", "address": "fa:16:3e:68:b6:f9", "network": {"id": "70d88082-aea7-48bb-abb4-d77d264aaf01", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b9acbe11654053bb905e7c92558a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b77e3e1-84", "ovs_interfaceid": "3b77e3e1-84f9-470a-b684-e8bdc4996c68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:32:33 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Converting VIF {"id": "3b77e3e1-84f9-470a-b684-e8bdc4996c68", "address": "fa:16:3e:68:b6:f9", "network": {"id": "70d88082-aea7-48bb-abb4-d77d264aaf01", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b9acbe11654053bb905e7c92558a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b77e3e1-84", "ovs_interfaceid": "3b77e3e1-84f9-470a-b684-e8bdc4996c68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:32:33 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:b6:f9,bridge_name='br-int',has_traffic_filtering=True,id=3b77e3e1-84f9-470a-b684-e8bdc4996c68,network=Network(70d88082-aea7-48bb-abb4-d77d264aaf01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b77e3e1-84') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:32:33 user nova-compute[73391]: DEBUG nova.objects.instance [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lazy-loading 'pci_devices' on Instance uuid 6358e825-5705-45d6-86b6-3aacfa5a9bbb {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:32:33 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:32:33 user nova-compute[73391]:   <uuid>6358e825-5705-45d6-86b6-3aacfa5a9bbb</uuid>
Aug 15 05:32:33 user nova-compute[73391]:   <name>instance-0000000c</name>
Aug 15 05:32:33 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:32:33 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:32:33 user nova-compute[73391]:   <metadata>
Aug 15 05:32:33 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:32:33 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:32:33 user nova-compute[73391]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-668367840</nova:name>
Aug 15 05:32:33 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:32:31</nova:creationTime>
Aug 15 05:32:33 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:32:33 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:32:33 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:32:33 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:32:33 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:32:33 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:32:33 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:32:33 user nova-compute[73391]:       <nova:owner>
Aug 15 05:32:33 user nova-compute[73391]:         <nova:user uuid="887f0846cf554e12acf92a663f5ab266">tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member</nova:user>
Aug 15 05:32:33 user nova-compute[73391]:         <nova:project uuid="83b9acbe11654053bb905e7c92558a35">tempest-ServerBootFromVolumeStableRescueTest-1045163116</nova:project>
Aug 15 05:32:33 user nova-compute[73391]:       </nova:owner>
Aug 15 05:32:33 user nova-compute[73391]:       <nova:root type="image" uuid="191b1dad-305e-4d1c-9b15-515ec59a3278"/>
Aug 15 05:32:33 user nova-compute[73391]:       <nova:ports>
Aug 15 05:32:33 user nova-compute[73391]:         <nova:port uuid="3b77e3e1-84f9-470a-b684-e8bdc4996c68">
Aug 15 05:32:33 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 05:32:33 user nova-compute[73391]:         </nova:port>
Aug 15 05:32:33 user nova-compute[73391]:       </nova:ports>
Aug 15 05:32:33 user nova-compute[73391]:     </nova:instance>
Aug 15 05:32:33 user nova-compute[73391]:   </metadata>
Aug 15 05:32:33 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:32:33 user nova-compute[73391]:     <system>
Aug 15 05:32:33 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:32:33 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:32:33 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:32:33 user nova-compute[73391]:       <entry name="serial">6358e825-5705-45d6-86b6-3aacfa5a9bbb</entry>
Aug 15 05:32:33 user nova-compute[73391]:       <entry name="uuid">6358e825-5705-45d6-86b6-3aacfa5a9bbb</entry>
Aug 15 05:32:33 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:32:33 user nova-compute[73391]:     </system>
Aug 15 05:32:33 user nova-compute[73391]:   </sysinfo>
Aug 15 05:32:33 user nova-compute[73391]:   <os>
Aug 15 05:32:33 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:32:33 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:32:33 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:32:33 user nova-compute[73391]:   </os>
Aug 15 05:32:33 user nova-compute[73391]:   <features>
Aug 15 05:32:33 user nova-compute[73391]:     <acpi/>
Aug 15 05:32:33 user nova-compute[73391]:     <apic/>
Aug 15 05:32:33 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:32:33 user nova-compute[73391]:   </features>
Aug 15 05:32:33 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:32:33 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:32:33 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:32:33 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:32:33 user nova-compute[73391]:   </clock>
Aug 15 05:32:33 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:32:33 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:32:33 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:32:33 user nova-compute[73391]:   </cpu>
Aug 15 05:32:33 user nova-compute[73391]:   <devices>
Aug 15 05:32:33 user nova-compute[73391]:     <disk type="block" device="disk">
Aug 15 05:32:33 user nova-compute[73391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:32:33 user nova-compute[73391]:       <source dev="/dev/sdf"/>
Aug 15 05:32:33 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:32:33 user nova-compute[73391]:       <serial>80371ba5-8b71-45bc-b67d-43676d63163e</serial>
Aug 15 05:32:33 user nova-compute[73391]:     </disk>
Aug 15 05:32:33 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:32:33 user nova-compute[73391]:       <mac address="fa:16:3e:68:b6:f9"/>
Aug 15 05:32:33 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:32:33 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:32:33 user nova-compute[73391]:       <target dev="tap3b77e3e1-84"/>
Aug 15 05:32:33 user nova-compute[73391]:     </interface>
Aug 15 05:32:33 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:32:33 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/6358e825-5705-45d6-86b6-3aacfa5a9bbb/console.log" append="off"/>
Aug 15 05:32:33 user nova-compute[73391]:     </serial>
Aug 15 05:32:33 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:32:33 user nova-compute[73391]:     <video>
Aug 15 05:32:33 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:32:33 user nova-compute[73391]:     </video>
Aug 15 05:32:33 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:32:33 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:32:33 user nova-compute[73391]:     </rng>
Aug 15 05:32:33 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:32:33 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:32:33 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:32:33 user nova-compute[73391]:     </memballoon>
Aug 15 05:32:33 user nova-compute[73391]:   </devices>
Aug 15 05:32:33 user nova-compute[73391]: </domain>
Aug 15 05:32:33 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:32:33 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:32:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-668367840',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-668367840',id=12,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83b9acbe11654053bb905e7c92558a35',ramdisk_id='',reservation_id='r-t0vgeqpl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1045163116',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:32:06Z,user_data=None,user_id='887f0846cf554e12acf92a663f5ab266',uuid=6358e825-5705-45d6-86b6-3aacfa5a9bbb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b77e3e1-84f9-470a-b684-e8bdc4996c68", "address": "fa:16:3e:68:b6:f9", "network": {"id": "70d88082-aea7-48bb-abb4-d77d264aaf01", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b9acbe11654053bb905e7c92558a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b77e3e1-84", "ovs_interfaceid": "3b77e3e1-84f9-470a-b684-e8bdc4996c68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:32:33 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Converting VIF {"id": "3b77e3e1-84f9-470a-b684-e8bdc4996c68", "address": "fa:16:3e:68:b6:f9", "network": {"id": "70d88082-aea7-48bb-abb4-d77d264aaf01", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b9acbe11654053bb905e7c92558a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b77e3e1-84", "ovs_interfaceid": "3b77e3e1-84f9-470a-b684-e8bdc4996c68", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:32:33 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:68:b6:f9,bridge_name='br-int',has_traffic_filtering=True,id=3b77e3e1-84f9-470a-b684-e8bdc4996c68,network=Network(70d88082-aea7-48bb-abb4-d77d264aaf01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b77e3e1-84') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:32:33 user nova-compute[73391]: DEBUG os_vif [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:b6:f9,bridge_name='br-int',has_traffic_filtering=True,id=3b77e3e1-84f9-470a-b684-e8bdc4996c68,network=Network(70d88082-aea7-48bb-abb4-d77d264aaf01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b77e3e1-84') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:32:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:32:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:32:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b77e3e1-84, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:32:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3b77e3e1-84, col_values=(('external_ids', {'iface-id': '3b77e3e1-84f9-470a-b684-e8bdc4996c68', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:68:b6:f9', 'vm-uuid': '6358e825-5705-45d6-86b6-3aacfa5a9bbb'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:32:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:32:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:33 user nova-compute[73391]: INFO os_vif [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:68:b6:f9,bridge_name='br-int',has_traffic_filtering=True,id=3b77e3e1-84f9-470a-b684-e8bdc4996c68,network=Network(70d88082-aea7-48bb-abb4-d77d264aaf01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b77e3e1-84')
Aug 15 05:32:33 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:32:33 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] No VIF found with MAC fa:16:3e:68:b6:f9, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:32:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-1f9a78b5-a6f4-4a47-9c0a-96f21a1c8bf1 tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Acquiring lock "7b7704e3-f48b-473c-89ae-5437a690f06a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-1f9a78b5-a6f4-4a47-9c0a-96f21a1c8bf1 tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Lock "7b7704e3-f48b-473c-89ae-5437a690f06a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-1f9a78b5-a6f4-4a47-9c0a-96f21a1c8bf1 tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Acquiring lock "7b7704e3-f48b-473c-89ae-5437a690f06a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-1f9a78b5-a6f4-4a47-9c0a-96f21a1c8bf1 tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Lock "7b7704e3-f48b-473c-89ae-5437a690f06a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-1f9a78b5-a6f4-4a47-9c0a-96f21a1c8bf1 tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Lock "7b7704e3-f48b-473c-89ae-5437a690f06a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:33 user nova-compute[73391]: INFO nova.compute.manager [None req-1f9a78b5-a6f4-4a47-9c0a-96f21a1c8bf1 tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Terminating instance
Aug 15 05:32:33 user nova-compute[73391]: DEBUG nova.compute.manager [None req-1f9a78b5-a6f4-4a47-9c0a-96f21a1c8bf1 tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Start destroying the instance on the hypervisor. {{(pid=73391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 05:32:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:34 user nova-compute[73391]: DEBUG nova.compute.manager [req-ff5bbb19-4aac-4400-9fdb-321f9985afaa req-824420c1-bd37-4f73-8e7c-fe1b982cc941 service nova] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Received event network-vif-unplugged-dcef2b4d-2a9a-4c46-9d5f-a60c4ac7b5de {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:32:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ff5bbb19-4aac-4400-9fdb-321f9985afaa req-824420c1-bd37-4f73-8e7c-fe1b982cc941 service nova] Acquiring lock "7b7704e3-f48b-473c-89ae-5437a690f06a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ff5bbb19-4aac-4400-9fdb-321f9985afaa req-824420c1-bd37-4f73-8e7c-fe1b982cc941 service nova] Lock "7b7704e3-f48b-473c-89ae-5437a690f06a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ff5bbb19-4aac-4400-9fdb-321f9985afaa req-824420c1-bd37-4f73-8e7c-fe1b982cc941 service nova] Lock "7b7704e3-f48b-473c-89ae-5437a690f06a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:34 user nova-compute[73391]: DEBUG nova.compute.manager [req-ff5bbb19-4aac-4400-9fdb-321f9985afaa req-824420c1-bd37-4f73-8e7c-fe1b982cc941 service nova] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] No waiting events found dispatching network-vif-unplugged-dcef2b4d-2a9a-4c46-9d5f-a60c4ac7b5de {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:32:34 user nova-compute[73391]: DEBUG nova.compute.manager [req-ff5bbb19-4aac-4400-9fdb-321f9985afaa req-824420c1-bd37-4f73-8e7c-fe1b982cc941 service nova] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Received event network-vif-unplugged-dcef2b4d-2a9a-4c46-9d5f-a60c4ac7b5de for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 05:32:34 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Instance destroyed successfully.
Aug 15 05:32:34 user nova-compute[73391]: DEBUG nova.objects.instance [None req-1f9a78b5-a6f4-4a47-9c0a-96f21a1c8bf1 tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Lazy-loading 'resources' on Instance uuid 7b7704e3-f48b-473c-89ae-5437a690f06a {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:32:34 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-1f9a78b5-a6f4-4a47-9c0a-96f21a1c8bf1 tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:30:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1562824869',display_name='tempest-VolumesActionsTest-instance-1562824869',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1562824869',id=9,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:30:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='628ed773a4de409084f7b3930d8c4dce',ramdisk_id='',reservation_id='r-ksxm0fmy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-2132169708',owner_user_name='tempest-VolumesActionsTest-2132169708-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:30:50Z,user_data=None,user_id='1cf057edc97f43aa9281ecc44885adaa',uuid=7b7704e3-f48b-473c-89ae-5437a690f06a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dcef2b4d-2a9a-4c46-9d5f-a60c4ac7b5de", "address": "fa:16:3e:bd:31:78", "network": {"id": "2a2a0416-9965-47d3-976b-28e0e0b3340a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-179068040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628ed773a4de409084f7b3930d8c4dce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcef2b4d-2a", "ovs_interfaceid": "dcef2b4d-2a9a-4c46-9d5f-a60c4ac7b5de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:32:34 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-1f9a78b5-a6f4-4a47-9c0a-96f21a1c8bf1 tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Converting VIF {"id": "dcef2b4d-2a9a-4c46-9d5f-a60c4ac7b5de", "address": "fa:16:3e:bd:31:78", "network": {"id": "2a2a0416-9965-47d3-976b-28e0e0b3340a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-179068040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628ed773a4de409084f7b3930d8c4dce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcef2b4d-2a", "ovs_interfaceid": "dcef2b4d-2a9a-4c46-9d5f-a60c4ac7b5de", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:32:34 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-1f9a78b5-a6f4-4a47-9c0a-96f21a1c8bf1 tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:31:78,bridge_name='br-int',has_traffic_filtering=True,id=dcef2b4d-2a9a-4c46-9d5f-a60c4ac7b5de,network=Network(2a2a0416-9965-47d3-976b-28e0e0b3340a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcef2b4d-2a') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:32:34 user nova-compute[73391]: DEBUG os_vif [None req-1f9a78b5-a6f4-4a47-9c0a-96f21a1c8bf1 tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:31:78,bridge_name='br-int',has_traffic_filtering=True,id=dcef2b4d-2a9a-4c46-9d5f-a60c4ac7b5de,network=Network(2a2a0416-9965-47d3-976b-28e0e0b3340a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcef2b4d-2a') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:32:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdcef2b4d-2a, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:32:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:32:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:34 user nova-compute[73391]: INFO os_vif [None req-1f9a78b5-a6f4-4a47-9c0a-96f21a1c8bf1 tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:31:78,bridge_name='br-int',has_traffic_filtering=True,id=dcef2b4d-2a9a-4c46-9d5f-a60c4ac7b5de,network=Network(2a2a0416-9965-47d3-976b-28e0e0b3340a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdcef2b4d-2a')
Aug 15 05:32:34 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-1f9a78b5-a6f4-4a47-9c0a-96f21a1c8bf1 tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Deleting instance files /opt/stack/data/nova/instances/7b7704e3-f48b-473c-89ae-5437a690f06a_del
Aug 15 05:32:34 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-1f9a78b5-a6f4-4a47-9c0a-96f21a1c8bf1 tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Deletion of /opt/stack/data/nova/instances/7b7704e3-f48b-473c-89ae-5437a690f06a_del complete
Aug 15 05:32:34 user nova-compute[73391]: INFO nova.compute.manager [None req-1f9a78b5-a6f4-4a47-9c0a-96f21a1c8bf1 tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Took 1.05 seconds to destroy the instance on the hypervisor.
Aug 15 05:32:34 user nova-compute[73391]: DEBUG oslo.service.loopingcall [None req-1f9a78b5-a6f4-4a47-9c0a-96f21a1c8bf1 tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 05:32:34 user nova-compute[73391]: DEBUG nova.compute.manager [-] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Deallocating network for instance {{(pid=73391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 05:32:34 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] deallocate_for_instance() {{(pid=73391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG nova.compute.manager [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XYflAmQI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '0169df15-335e-46e6-a5c8-9deb7095bb84', 'attached_at': '', 'detached_at': '', 'volume_id': 'fb592ee0-ed3e-427a-8cc4-05091385a40a', 'serial': 'fb592ee0-ed3e-427a-8cc4-05091385a40a'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'POMEuziG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': '4003a351-ce41-40db-8e1f-95bd0985e3e9'}, 'status': 'reserved', 'instance': '0169df15-335e-46e6-a5c8-9deb7095bb84', 'attached_at': '', 'detached_at': '', 'volume_id': '4003a351-ce41-40db-8e1f-95bd0985e3e9', 'serial'} {{(pid=73391) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XYflAmQI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:32:35 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:32:35 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:32:35 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:32:35 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:32:35 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 05:32:35 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[164c0f24-6848-4db9-84f0-a35854d5d1c3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 05:32:35 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[719ac820-be56-4280-bc29-54becdb27cc5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a] added
Aug 15 05:32:35 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ba01dc-9b49-4243-a149-74c420fa39b8]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fddfc314-2183-41ed-87d9-459855e6026f]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XYflAmQI {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XYflAmQI" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[71461b83-a2f8-4f4a-9886-03ea1d3f66a0]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XYflAmQI'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c47baba-75d5-4da9-8ea4-06e5d1754f75]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[76cd6c82-0f0b-43e5-a22c-dac5e6f35494]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)
Aug 15 05:32:35 user nova-compute[73391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)
Aug 15 05:32:35 user nova-compute[73391]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9 (non-flash)
Aug 15 05:32:35 user nova-compute[73391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:32:35 user nova-compute[73391]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:32:35 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:32:35 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:32:35 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:32:35 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)
Aug 15 05:32:35 user nova-compute[73391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)
Aug 15 05:32:35 user nova-compute[73391]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9 (non-flash)
Aug 15 05:32:35 user nova-compute[73391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:32:35 user nova-compute[73391]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:32:35 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:32:35 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:32:35 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:32:35 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[202fce1e-a043-46a4-831f-df4d21800c4f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a, portal: 172.16.0.220,3260]
Aug 15 05:32:35 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a, portal: 172.16.0.220,3260] successful.
Aug 15 05:32:35 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9154b59-2ca4-4456-9911-4bc988ccdb31]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:32:35 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Took 0.67 seconds to deallocate network for instance.
Aug 15 05:32:35 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1185802-f998-4c0a-9ef7-16ab55938572]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)
Aug 15 05:32:35 user nova-compute[73391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)
Aug 15 05:32:35 user nova-compute[73391]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9 (non-flash)
Aug 15 05:32:35 user nova-compute[73391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:32:35 user nova-compute[73391]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)
Aug 15 05:32:35 user nova-compute[73391]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:32:35 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:32:35 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:32:35 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:32:35 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)
Aug 15 05:32:35 user nova-compute[73391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)
Aug 15 05:32:35 user nova-compute[73391]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9 (non-flash)
Aug 15 05:32:35 user nova-compute[73391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:32:35 user nova-compute[73391]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)
Aug 15 05:32:35 user nova-compute[73391]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:32:35 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:32:35 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:32:35 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:32:35 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] HCTL ('41', '-', '-', 0) found on session 15 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] Scanning host 41 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG nova.compute.manager [req-04e2d282-6da3-4724-881b-bef8e70fec98 req-c91bfd49-31b1-4e29-9983-b2580bef61f9 service nova] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Received event network-vif-plugged-3b77e3e1-84f9-470a-b684-e8bdc4996c68 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-04e2d282-6da3-4724-881b-bef8e70fec98 req-c91bfd49-31b1-4e29-9983-b2580bef61f9 service nova] Acquiring lock "6358e825-5705-45d6-86b6-3aacfa5a9bbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-04e2d282-6da3-4724-881b-bef8e70fec98 req-c91bfd49-31b1-4e29-9983-b2580bef61f9 service nova] Lock "6358e825-5705-45d6-86b6-3aacfa5a9bbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-04e2d282-6da3-4724-881b-bef8e70fec98 req-c91bfd49-31b1-4e29-9983-b2580bef61f9 service nova] Lock "6358e825-5705-45d6-86b6-3aacfa5a9bbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG nova.compute.manager [req-04e2d282-6da3-4724-881b-bef8e70fec98 req-c91bfd49-31b1-4e29-9983-b2580bef61f9 service nova] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] No waiting events found dispatching network-vif-plugged-3b77e3e1-84f9-470a-b684-e8bdc4996c68 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:32:35 user nova-compute[73391]: WARNING nova.compute.manager [req-04e2d282-6da3-4724-881b-bef8e70fec98 req-c91bfd49-31b1-4e29-9983-b2580bef61f9 service nova] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Received unexpected event network-vif-plugged-3b77e3e1-84f9-470a-b684-e8bdc4996c68 for instance with vm_state building and task_state spawning.
Aug 15 05:32:35 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG nova.compute.manager [req-cf1b7674-7e1e-4bd3-bd10-f8ecc340d9f1 req-80102e23-21db-4c1b-8b2b-201fbf59f268 service nova] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Received event network-vif-deleted-dcef2b4d-2a9a-4c46-9d5f-a60c4ac7b5de {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.026s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c15113-ea7a-4aa0-87b3-d32fc0777edd]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] Searching for a device in session 15 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] Connected to sdj using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XYflAmQI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-1f9a78b5-a6f4-4a47-9c0a-96f21a1c8bf1 tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-1f9a78b5-a6f4-4a47-9c0a-96f21a1c8bf1 tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:36 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-1f9a78b5-a6f4-4a47-9c0a-96f21a1c8bf1 tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:32:36 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-1f9a78b5-a6f4-4a47-9c0a-96f21a1c8bf1 tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:32:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-1f9a78b5-a6f4-4a47-9c0a-96f21a1c8bf1 tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.329s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:36 user nova-compute[73391]: INFO nova.scheduler.client.report [None req-1f9a78b5-a6f4-4a47-9c0a-96f21a1c8bf1 tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Deleted allocations for instance 7b7704e3-f48b-473c-89ae-5437a690f06a
Aug 15 05:32:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-1f9a78b5-a6f4-4a47-9c0a-96f21a1c8bf1 tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Lock "7b7704e3-f48b-473c-89ae-5437a690f06a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.309s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:36 user nova-compute[73391]: DEBUG nova.compute.manager [req-43d158a0-703c-4f49-9eb0-fbee799c247c req-320f79a5-ff72-4fca-8dfe-b5354bdd4eeb service nova] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Received event network-vif-plugged-dcef2b4d-2a9a-4c46-9d5f-a60c4ac7b5de {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:32:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-43d158a0-703c-4f49-9eb0-fbee799c247c req-320f79a5-ff72-4fca-8dfe-b5354bdd4eeb service nova] Acquiring lock "7b7704e3-f48b-473c-89ae-5437a690f06a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-43d158a0-703c-4f49-9eb0-fbee799c247c req-320f79a5-ff72-4fca-8dfe-b5354bdd4eeb service nova] Lock "7b7704e3-f48b-473c-89ae-5437a690f06a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-43d158a0-703c-4f49-9eb0-fbee799c247c req-320f79a5-ff72-4fca-8dfe-b5354bdd4eeb service nova] Lock "7b7704e3-f48b-473c-89ae-5437a690f06a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:36 user nova-compute[73391]: DEBUG nova.compute.manager [req-43d158a0-703c-4f49-9eb0-fbee799c247c req-320f79a5-ff72-4fca-8dfe-b5354bdd4eeb service nova] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] No waiting events found dispatching network-vif-plugged-dcef2b4d-2a9a-4c46-9d5f-a60c4ac7b5de {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:32:36 user nova-compute[73391]: WARNING nova.compute.manager [req-43d158a0-703c-4f49-9eb0-fbee799c247c req-320f79a5-ff72-4fca-8dfe-b5354bdd4eeb service nova] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Received unexpected event network-vif-plugged-dcef2b4d-2a9a-4c46-9d5f-a60c4ac7b5de for instance with vm_state deleted and task_state None.
Aug 15 05:32:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.399s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:32:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] <== connect_volume: return (1402ms) {'type': 'block', 'scsi_wwn': '23534633138326161', 'path': '/dev/sdj'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:32:36 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23534633138326161', 'path': '/dev/sdj'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 05:32:36 user nova-compute[73391]: DEBUG nova.objects.instance [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] Lazy-loading 'flavor' on Instance uuid 0169df15-335e-46e6-a5c8-9deb7095bb84 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:32:37 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] COPY block job progress, current cursor: 10485760 final cursor: 1073741824 {{(pid=73391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 05:32:37 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077557.6212614, 6358e825-5705-45d6-86b6-3aacfa5a9bbb => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:32:37 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] VM Resumed (Lifecycle Event)
Aug 15 05:32:37 user nova-compute[73391]: DEBUG nova.compute.manager [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:32:37 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Guest created on hypervisor {{(pid=73391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 05:32:37 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Instance spawned successfully.
Aug 15 05:32:37 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 05:32:37 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:32:37 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:32:37 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Found default for hw_cdrom_bus of ide {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:32:37 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Found default for hw_disk_bus of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:32:37 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Found default for hw_input_bus of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:32:37 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Found default for hw_pointer_model of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:32:37 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Found default for hw_video_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:32:37 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Found default for hw_vif_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:32:37 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:32:37 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077557.6237257, 6358e825-5705-45d6-86b6-3aacfa5a9bbb => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:32:37 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] VM Started (Lifecycle Event)
Aug 15 05:32:37 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:32:37 user nova-compute[73391]: DEBUG nova.compute.manager [req-7ce9f3f8-84cf-4259-a288-f5e0fd581cd1 req-b2ab3aee-6554-4fc6-b821-710e3aa181b6 service nova] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Received event network-vif-plugged-3b77e3e1-84f9-470a-b684-e8bdc4996c68 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:32:37 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-7ce9f3f8-84cf-4259-a288-f5e0fd581cd1 req-b2ab3aee-6554-4fc6-b821-710e3aa181b6 service nova] Acquiring lock "6358e825-5705-45d6-86b6-3aacfa5a9bbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:37 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-7ce9f3f8-84cf-4259-a288-f5e0fd581cd1 req-b2ab3aee-6554-4fc6-b821-710e3aa181b6 service nova] Lock "6358e825-5705-45d6-86b6-3aacfa5a9bbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:37 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-7ce9f3f8-84cf-4259-a288-f5e0fd581cd1 req-b2ab3aee-6554-4fc6-b821-710e3aa181b6 service nova] Lock "6358e825-5705-45d6-86b6-3aacfa5a9bbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:37 user nova-compute[73391]: DEBUG nova.compute.manager [req-7ce9f3f8-84cf-4259-a288-f5e0fd581cd1 req-b2ab3aee-6554-4fc6-b821-710e3aa181b6 service nova] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] No waiting events found dispatching network-vif-plugged-3b77e3e1-84f9-470a-b684-e8bdc4996c68 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:32:37 user nova-compute[73391]: WARNING nova.compute.manager [req-7ce9f3f8-84cf-4259-a288-f5e0fd581cd1 req-b2ab3aee-6554-4fc6-b821-710e3aa181b6 service nova] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Received unexpected event network-vif-plugged-3b77e3e1-84f9-470a-b684-e8bdc4996c68 for instance with vm_state building and task_state spawning.
Aug 15 05:32:37 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:32:37 user nova-compute[73391]: INFO nova.compute.manager [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Took 6.14 seconds to spawn the instance on the hypervisor.
Aug 15 05:32:37 user nova-compute[73391]: DEBUG nova.compute.manager [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:32:37 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:32:37 user nova-compute[73391]: INFO nova.compute.manager [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Took 32.28 seconds to build instance.
Aug 15 05:32:37 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] COPY block job progress, current cursor: 170917888 final cursor: 1073741824 {{(pid=73391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 05:32:37 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8ed2853f-5a23-4781-a502-a97ab3eef1cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "6358e825-5705-45d6-86b6-3aacfa5a9bbb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 32.397s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:38 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] COPY block job progress, current cursor: 316669952 final cursor: 1073741824 {{(pid=73391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 05:32:38 user nova-compute[73391]: DEBUG nova.compute.manager [req-ff653772-4340-4ef7-a08e-bf8259c52aa1 req-d8254721-3d27-42bb-ad1d-c7d0d1f08f19 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received event network-changed-397ea76b-8bbd-4602-b966-cf7331d13e9f {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:32:38 user nova-compute[73391]: DEBUG nova.compute.manager [req-ff653772-4340-4ef7-a08e-bf8259c52aa1 req-d8254721-3d27-42bb-ad1d-c7d0d1f08f19 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Refreshing instance network info cache due to event network-changed-397ea76b-8bbd-4602-b966-cf7331d13e9f. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:32:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ff653772-4340-4ef7-a08e-bf8259c52aa1 req-d8254721-3d27-42bb-ad1d-c7d0d1f08f19 service nova] Acquiring lock "refresh_cache-da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:32:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ff653772-4340-4ef7-a08e-bf8259c52aa1 req-d8254721-3d27-42bb-ad1d-c7d0d1f08f19 service nova] Acquired lock "refresh_cache-da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:32:38 user nova-compute[73391]: DEBUG nova.network.neutron [req-ff653772-4340-4ef7-a08e-bf8259c52aa1 req-d8254721-3d27-42bb-ad1d-c7d0d1f08f19 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Refreshing network info cache for port 397ea76b-8bbd-4602-b966-cf7331d13e9f {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:32:38 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] COPY block job progress, current cursor: 478150656 final cursor: 1073741824 {{(pid=73391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 05:32:38 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:39 user nova-compute[73391]: DEBUG nova.network.neutron [req-ff653772-4340-4ef7-a08e-bf8259c52aa1 req-d8254721-3d27-42bb-ad1d-c7d0d1f08f19 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Updated VIF entry in instance network info cache for port 397ea76b-8bbd-4602-b966-cf7331d13e9f. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:32:39 user nova-compute[73391]: DEBUG nova.network.neutron [req-ff653772-4340-4ef7-a08e-bf8259c52aa1 req-d8254721-3d27-42bb-ad1d-c7d0d1f08f19 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Updating instance_info_cache with network_info: [{"id": "397ea76b-8bbd-4602-b966-cf7331d13e9f", "address": "fa:16:3e:61:64:15", "network": {"id": "63ea02b8-a8de-4680-a96b-496a4480c84e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1311691765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap397ea76b-8b", "ovs_interfaceid": "397ea76b-8bbd-4602-b966-cf7331d13e9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c165877a-edce-4fec-8aa4-e7708b384676", "address": "fa:16:3e:fd:7f:88", "network": {"id": "13d2edf3-6d96-4829-8c78-2dee6654aac3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1748402198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc165877a-ed", "ovs_interfaceid": "c165877a-edce-4fec-8aa4-e7708b384676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "22ffe1b4-8207-4909-b0ba-0db5dc955912", "address": "fa:16:3e:40:11:5a", "network": {"id": "13d2edf3-6d96-4829-8c78-2dee6654aac3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1748402198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ffe1b4-82", "ovs_interfaceid": "22ffe1b4-8207-4909-b0ba-0db5dc955912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "72a3d29f-9af1-4d78-bb33-db5cc02856aa", "address": "fa:16:3e:bf:7b:60", "network": {"id": "13d2edf3-6d96-4829-8c78-2dee6654aac3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1748402198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a3d29f-9a", "ovs_interfaceid": "72a3d29f-9af1-4d78-bb33-db5cc02856aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "88d012e5-b40e-4398-99a1-14b37a890c47", "address": "fa:16:3e:ff:a2:52", "network": {"id": "13d2edf3-6d96-4829-8c78-2dee6654aac3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1748402198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88d012e5-b4", "ovs_interfaceid": "88d012e5-b40e-4398-99a1-14b37a890c47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "544b22aa-6b69-4b4d-985f-19bdc248d641", "address": "fa:16:3e:df:ec:65", "network": {"id": "dddb77ca-d38f-4817-bf06-e8dcc8552539", "bridge": "br-int", "label": "tempest-device-tagging-net2-1958061298", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap544b22aa-6b", "ovs_interfaceid": "544b22aa-6b69-4b4d-985f-19bdc248d641", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a519d774-56a5-4a6c-9cd3-94e260332725", "address": "fa:16:3e:d1:a5:ec", "network": {"id": "dddb77ca-d38f-4817-bf06-e8dcc8552539", "bridge": "br-int", "label": "tempest-device-tagging-net2-1958061298", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa519d774-56", "ovs_interfaceid": "a519d774-56a5-4a6c-9cd3-94e260332725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:32:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ff653772-4340-4ef7-a08e-bf8259c52aa1 req-d8254721-3d27-42bb-ad1d-c7d0d1f08f19 service nova] Releasing lock "refresh_cache-da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:32:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Acquiring lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Acquiring lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:39 user nova-compute[73391]: INFO nova.compute.manager [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Terminating instance
Aug 15 05:32:39 user nova-compute[73391]: DEBUG nova.compute.manager [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Start destroying the instance on the hypervisor. {{(pid=73391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 05:32:39 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] COPY block job progress, current cursor: 643825664 final cursor: 1073741824 {{(pid=73391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 05:32:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:39 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] COPY block job progress, current cursor: 794820608 final cursor: 1073741824 {{(pid=73391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 05:32:39 user nova-compute[73391]: DEBUG nova.compute.manager [req-339a5688-bf14-4a9f-a109-4a407dc725b9 req-03632df7-3659-4329-93ea-17c423bf39cd service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received event network-vif-unplugged-c165877a-edce-4fec-8aa4-e7708b384676 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:32:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-339a5688-bf14-4a9f-a109-4a407dc725b9 req-03632df7-3659-4329-93ea-17c423bf39cd service nova] Acquiring lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-339a5688-bf14-4a9f-a109-4a407dc725b9 req-03632df7-3659-4329-93ea-17c423bf39cd service nova] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-339a5688-bf14-4a9f-a109-4a407dc725b9 req-03632df7-3659-4329-93ea-17c423bf39cd service nova] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:39 user nova-compute[73391]: DEBUG nova.compute.manager [req-339a5688-bf14-4a9f-a109-4a407dc725b9 req-03632df7-3659-4329-93ea-17c423bf39cd service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] No waiting events found dispatching network-vif-unplugged-c165877a-edce-4fec-8aa4-e7708b384676 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:32:39 user nova-compute[73391]: DEBUG nova.compute.manager [req-339a5688-bf14-4a9f-a109-4a407dc725b9 req-03632df7-3659-4329-93ea-17c423bf39cd service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received event network-vif-unplugged-c165877a-edce-4fec-8aa4-e7708b384676 for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 05:32:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:40 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] COPY block job progress, current cursor: 830472192 final cursor: 1073741824 {{(pid=73391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 05:32:40 user nova-compute[73391]: DEBUG nova.compute.manager [req-89efb67f-c6cd-4126-bd68-193d88656704 req-78a4eb8b-7936-4b62-ad89-404428a0bbd7 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received event network-vif-unplugged-72a3d29f-9af1-4d78-bb33-db5cc02856aa {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:32:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-89efb67f-c6cd-4126-bd68-193d88656704 req-78a4eb8b-7936-4b62-ad89-404428a0bbd7 service nova] Acquiring lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-89efb67f-c6cd-4126-bd68-193d88656704 req-78a4eb8b-7936-4b62-ad89-404428a0bbd7 service nova] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-89efb67f-c6cd-4126-bd68-193d88656704 req-78a4eb8b-7936-4b62-ad89-404428a0bbd7 service nova] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:40 user nova-compute[73391]: DEBUG nova.compute.manager [req-89efb67f-c6cd-4126-bd68-193d88656704 req-78a4eb8b-7936-4b62-ad89-404428a0bbd7 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] No waiting events found dispatching network-vif-unplugged-72a3d29f-9af1-4d78-bb33-db5cc02856aa {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:32:40 user nova-compute[73391]: DEBUG nova.compute.manager [req-89efb67f-c6cd-4126-bd68-193d88656704 req-78a4eb8b-7936-4b62-ad89-404428a0bbd7 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received event network-vif-unplugged-72a3d29f-9af1-4d78-bb33-db5cc02856aa for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 05:32:40 user nova-compute[73391]: DEBUG nova.compute.manager [req-07f676bd-cd89-4083-914c-fba81c8d47d0 req-322c5b8c-087c-4a17-9180-ee3ad3532fa5 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received event network-vif-unplugged-397ea76b-8bbd-4602-b966-cf7331d13e9f {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:32:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-07f676bd-cd89-4083-914c-fba81c8d47d0 req-322c5b8c-087c-4a17-9180-ee3ad3532fa5 service nova] Acquiring lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-07f676bd-cd89-4083-914c-fba81c8d47d0 req-322c5b8c-087c-4a17-9180-ee3ad3532fa5 service nova] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-07f676bd-cd89-4083-914c-fba81c8d47d0 req-322c5b8c-087c-4a17-9180-ee3ad3532fa5 service nova] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:40 user nova-compute[73391]: DEBUG nova.compute.manager [req-07f676bd-cd89-4083-914c-fba81c8d47d0 req-322c5b8c-087c-4a17-9180-ee3ad3532fa5 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] No waiting events found dispatching network-vif-unplugged-397ea76b-8bbd-4602-b966-cf7331d13e9f {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:32:40 user nova-compute[73391]: DEBUG nova.compute.manager [req-07f676bd-cd89-4083-914c-fba81c8d47d0 req-322c5b8c-087c-4a17-9180-ee3ad3532fa5 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received event network-vif-unplugged-397ea76b-8bbd-4602-b966-cf7331d13e9f for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 05:32:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:40 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] COPY block job progress, current cursor: 993001472 final cursor: 1073741824 {{(pid=73391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 05:32:41 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Instance destroyed successfully.
Aug 15 05:32:41 user nova-compute[73391]: DEBUG nova.objects.instance [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Lazy-loading 'resources' on Instance uuid da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T05:30:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-118546539',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-118546539',id=10,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVdOrqYNwV4MLMHxNmTDhEmFPOR9rOnQPmrNIXpeoWg1qLlFK+xdylhYEL2zGy51LkM6RTKBrNl9yWnnwsJkCQ0pK6QVUH89mFZcZYjyoFgJpATZPF1Wux6OL5jmVUb9Q==',key_name='tempest-keypair-2147219675',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:31:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='49eba1f86e8c412e81feba30657c278a',ramdisk_id='',reservation_id='r-a6usm2mn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2085483445',owner_user_name='tempest-TaggedBootDevicesTest-2085483445-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:31:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c3532caac1f479995f501b1345ebcb2',uuid=da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "397ea76b-8bbd-4602-b966-cf7331d13e9f", "address": "fa:16:3e:61:64:15", "network": {"id": "63ea02b8-a8de-4680-a96b-496a4480c84e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1311691765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap397ea76b-8b", "ovs_interfaceid": "397ea76b-8bbd-4602-b966-cf7331d13e9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Converting VIF {"id": "397ea76b-8bbd-4602-b966-cf7331d13e9f", "address": "fa:16:3e:61:64:15", "network": {"id": "63ea02b8-a8de-4680-a96b-496a4480c84e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1311691765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap397ea76b-8b", "ovs_interfaceid": "397ea76b-8bbd-4602-b966-cf7331d13e9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:64:15,bridge_name='br-int',has_traffic_filtering=True,id=397ea76b-8bbd-4602-b966-cf7331d13e9f,network=Network(63ea02b8-a8de-4680-a96b-496a4480c84e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap397ea76b-8b') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG os_vif [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:64:15,bridge_name='br-int',has_traffic_filtering=True,id=397ea76b-8bbd-4602-b966-cf7331d13e9f,network=Network(63ea02b8-a8de-4680-a96b-496a4480c84e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap397ea76b-8b') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap397ea76b-8b, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:41 user nova-compute[73391]: INFO os_vif [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:64:15,bridge_name='br-int',has_traffic_filtering=True,id=397ea76b-8bbd-4602-b966-cf7331d13e9f,network=Network(63ea02b8-a8de-4680-a96b-496a4480c84e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap397ea76b-8b')
Aug 15 05:32:41 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T05:30:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-118546539',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-118546539',id=10,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVdOrqYNwV4MLMHxNmTDhEmFPOR9rOnQPmrNIXpeoWg1qLlFK+xdylhYEL2zGy51LkM6RTKBrNl9yWnnwsJkCQ0pK6QVUH89mFZcZYjyoFgJpATZPF1Wux6OL5jmVUb9Q==',key_name='tempest-keypair-2147219675',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:31:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='49eba1f86e8c412e81feba30657c278a',ramdisk_id='',reservation_id='r-a6usm2mn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2085483445',owner_user_name='tempest-TaggedBootDevicesTest-2085483445-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:31:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c3532caac1f479995f501b1345ebcb2',uuid=da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c165877a-edce-4fec-8aa4-e7708b384676", "address": "fa:16:3e:fd:7f:88", "network": {"id": "13d2edf3-6d96-4829-8c78-2dee6654aac3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1748402198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc165877a-ed", "ovs_interfaceid": "c165877a-edce-4fec-8aa4-e7708b384676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Converting VIF {"id": "c165877a-edce-4fec-8aa4-e7708b384676", "address": "fa:16:3e:fd:7f:88", "network": {"id": "13d2edf3-6d96-4829-8c78-2dee6654aac3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1748402198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc165877a-ed", "ovs_interfaceid": "c165877a-edce-4fec-8aa4-e7708b384676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:7f:88,bridge_name='br-int',has_traffic_filtering=True,id=c165877a-edce-4fec-8aa4-e7708b384676,network=Network(13d2edf3-6d96-4829-8c78-2dee6654aac3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc165877a-ed') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG os_vif [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:7f:88,bridge_name='br-int',has_traffic_filtering=True,id=c165877a-edce-4fec-8aa4-e7708b384676,network=Network(13d2edf3-6d96-4829-8c78-2dee6654aac3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc165877a-ed') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc165877a-ed, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=73391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:41 user nova-compute[73391]: INFO os_vif [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:7f:88,bridge_name='br-int',has_traffic_filtering=True,id=c165877a-edce-4fec-8aa4-e7708b384676,network=Network(13d2edf3-6d96-4829-8c78-2dee6654aac3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc165877a-ed')
Aug 15 05:32:41 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T05:30:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-118546539',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-118546539',id=10,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVdOrqYNwV4MLMHxNmTDhEmFPOR9rOnQPmrNIXpeoWg1qLlFK+xdylhYEL2zGy51LkM6RTKBrNl9yWnnwsJkCQ0pK6QVUH89mFZcZYjyoFgJpATZPF1Wux6OL5jmVUb9Q==',key_name='tempest-keypair-2147219675',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:31:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='49eba1f86e8c412e81feba30657c278a',ramdisk_id='',reservation_id='r-a6usm2mn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2085483445',owner_user_name='tempest-TaggedBootDevicesTest-2085483445-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:31:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c3532caac1f479995f501b1345ebcb2',uuid=da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "22ffe1b4-8207-4909-b0ba-0db5dc955912", "address": "fa:16:3e:40:11:5a", "network": {"id": "13d2edf3-6d96-4829-8c78-2dee6654aac3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1748402198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ffe1b4-82", "ovs_interfaceid": "22ffe1b4-8207-4909-b0ba-0db5dc955912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Converting VIF {"id": "22ffe1b4-8207-4909-b0ba-0db5dc955912", "address": "fa:16:3e:40:11:5a", "network": {"id": "13d2edf3-6d96-4829-8c78-2dee6654aac3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1748402198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ffe1b4-82", "ovs_interfaceid": "22ffe1b4-8207-4909-b0ba-0db5dc955912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:40:11:5a,bridge_name='br-int',has_traffic_filtering=True,id=22ffe1b4-8207-4909-b0ba-0db5dc955912,network=Network(13d2edf3-6d96-4829-8c78-2dee6654aac3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap22ffe1b4-82') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG os_vif [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:11:5a,bridge_name='br-int',has_traffic_filtering=True,id=22ffe1b4-8207-4909-b0ba-0db5dc955912,network=Network(13d2edf3-6d96-4829-8c78-2dee6654aac3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap22ffe1b4-82') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap22ffe1b4-82, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:41 user nova-compute[73391]: INFO os_vif [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:40:11:5a,bridge_name='br-int',has_traffic_filtering=True,id=22ffe1b4-8207-4909-b0ba-0db5dc955912,network=Network(13d2edf3-6d96-4829-8c78-2dee6654aac3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap22ffe1b4-82')
Aug 15 05:32:41 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T05:30:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-118546539',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-118546539',id=10,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVdOrqYNwV4MLMHxNmTDhEmFPOR9rOnQPmrNIXpeoWg1qLlFK+xdylhYEL2zGy51LkM6RTKBrNl9yWnnwsJkCQ0pK6QVUH89mFZcZYjyoFgJpATZPF1Wux6OL5jmVUb9Q==',key_name='tempest-keypair-2147219675',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:31:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='49eba1f86e8c412e81feba30657c278a',ramdisk_id='',reservation_id='r-a6usm2mn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2085483445',owner_user_name='tempest-TaggedBootDevicesTest-2085483445-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:31:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c3532caac1f479995f501b1345ebcb2',uuid=da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "72a3d29f-9af1-4d78-bb33-db5cc02856aa", "address": "fa:16:3e:bf:7b:60", "network": {"id": "13d2edf3-6d96-4829-8c78-2dee6654aac3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1748402198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a3d29f-9a", "ovs_interfaceid": "72a3d29f-9af1-4d78-bb33-db5cc02856aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Converting VIF {"id": "72a3d29f-9af1-4d78-bb33-db5cc02856aa", "address": "fa:16:3e:bf:7b:60", "network": {"id": "13d2edf3-6d96-4829-8c78-2dee6654aac3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1748402198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.158", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap72a3d29f-9a", "ovs_interfaceid": "72a3d29f-9af1-4d78-bb33-db5cc02856aa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:7b:60,bridge_name='br-int',has_traffic_filtering=True,id=72a3d29f-9af1-4d78-bb33-db5cc02856aa,network=Network(13d2edf3-6d96-4829-8c78-2dee6654aac3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72a3d29f-9a') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG os_vif [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:7b:60,bridge_name='br-int',has_traffic_filtering=True,id=72a3d29f-9af1-4d78-bb33-db5cc02856aa,network=Network(13d2edf3-6d96-4829-8c78-2dee6654aac3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72a3d29f-9a') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap72a3d29f-9a, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:41 user nova-compute[73391]: INFO os_vif [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:7b:60,bridge_name='br-int',has_traffic_filtering=True,id=72a3d29f-9af1-4d78-bb33-db5cc02856aa,network=Network(13d2edf3-6d96-4829-8c78-2dee6654aac3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap72a3d29f-9a')
Aug 15 05:32:41 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T05:30:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-118546539',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-118546539',id=10,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVdOrqYNwV4MLMHxNmTDhEmFPOR9rOnQPmrNIXpeoWg1qLlFK+xdylhYEL2zGy51LkM6RTKBrNl9yWnnwsJkCQ0pK6QVUH89mFZcZYjyoFgJpATZPF1Wux6OL5jmVUb9Q==',key_name='tempest-keypair-2147219675',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:31:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='49eba1f86e8c412e81feba30657c278a',ramdisk_id='',reservation_id='r-a6usm2mn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2085483445',owner_user_name='tempest-TaggedBootDevicesTest-2085483445-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:31:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c3532caac1f479995f501b1345ebcb2',uuid=da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "88d012e5-b40e-4398-99a1-14b37a890c47", "address": "fa:16:3e:ff:a2:52", "network": {"id": "13d2edf3-6d96-4829-8c78-2dee6654aac3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1748402198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88d012e5-b4", "ovs_interfaceid": "88d012e5-b40e-4398-99a1-14b37a890c47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Converting VIF {"id": "88d012e5-b40e-4398-99a1-14b37a890c47", "address": "fa:16:3e:ff:a2:52", "network": {"id": "13d2edf3-6d96-4829-8c78-2dee6654aac3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1748402198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88d012e5-b4", "ovs_interfaceid": "88d012e5-b40e-4398-99a1-14b37a890c47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:a2:52,bridge_name='br-int',has_traffic_filtering=True,id=88d012e5-b40e-4398-99a1-14b37a890c47,network=Network(13d2edf3-6d96-4829-8c78-2dee6654aac3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88d012e5-b4') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG os_vif [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:a2:52,bridge_name='br-int',has_traffic_filtering=True,id=88d012e5-b40e-4398-99a1-14b37a890c47,network=Network(13d2edf3-6d96-4829-8c78-2dee6654aac3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88d012e5-b4') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap88d012e5-b4, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'POMEuziG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': '4003a351-ce41-40db-8e1f-95bd0985e3e9'}, None), 'kwargs': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:32:41 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:32:41 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:41 user nova-compute[73391]: INFO os_vif [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:a2:52,bridge_name='br-int',has_traffic_filtering=True,id=88d012e5-b40e-4398-99a1-14b37a890c47,network=Network(13d2edf3-6d96-4829-8c78-2dee6654aac3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88d012e5-b4')
Aug 15 05:32:41 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T05:30:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-118546539',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-118546539',id=10,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVdOrqYNwV4MLMHxNmTDhEmFPOR9rOnQPmrNIXpeoWg1qLlFK+xdylhYEL2zGy51LkM6RTKBrNl9yWnnwsJkCQ0pK6QVUH89mFZcZYjyoFgJpATZPF1Wux6OL5jmVUb9Q==',key_name='tempest-keypair-2147219675',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:31:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='49eba1f86e8c412e81feba30657c278a',ramdisk_id='',reservation_id='r-a6usm2mn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2085483445',owner_user_name='tempest-TaggedBootDevicesTest-2085483445-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:31:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c3532caac1f479995f501b1345ebcb2',uuid=da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "544b22aa-6b69-4b4d-985f-19bdc248d641", "address": "fa:16:3e:df:ec:65", "network": {"id": "dddb77ca-d38f-4817-bf06-e8dcc8552539", "bridge": "br-int", "label": "tempest-device-tagging-net2-1958061298", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap544b22aa-6b", "ovs_interfaceid": "544b22aa-6b69-4b4d-985f-19bdc248d641", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Converting VIF {"id": "544b22aa-6b69-4b4d-985f-19bdc248d641", "address": "fa:16:3e:df:ec:65", "network": {"id": "dddb77ca-d38f-4817-bf06-e8dcc8552539", "bridge": "br-int", "label": "tempest-device-tagging-net2-1958061298", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap544b22aa-6b", "ovs_interfaceid": "544b22aa-6b69-4b4d-985f-19bdc248d641", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:ec:65,bridge_name='br-int',has_traffic_filtering=True,id=544b22aa-6b69-4b4d-985f-19bdc248d641,network=Network(dddb77ca-d38f-4817-bf06-e8dcc8552539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap544b22aa-6b') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG os_vif [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:ec:65,bridge_name='br-int',has_traffic_filtering=True,id=544b22aa-6b69-4b4d-985f-19bdc248d641,network=Network(dddb77ca-d38f-4817-bf06-e8dcc8552539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap544b22aa-6b') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap544b22aa-6b, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9f4e92-ed07-4cb9-9ef3-185039204735]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:41 user nova-compute[73391]: INFO os_vif [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:ec:65,bridge_name='br-int',has_traffic_filtering=True,id=544b22aa-6b69-4b4d-985f-19bdc248d641,network=Network(dddb77ca-d38f-4817-bf06-e8dcc8552539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap544b22aa-6b')
Aug 15 05:32:41 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T05:30:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-118546539',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-118546539',id=10,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJVdOrqYNwV4MLMHxNmTDhEmFPOR9rOnQPmrNIXpeoWg1qLlFK+xdylhYEL2zGy51LkM6RTKBrNl9yWnnwsJkCQ0pK6QVUH89mFZcZYjyoFgJpATZPF1Wux6OL5jmVUb9Q==',key_name='tempest-keypair-2147219675',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:31:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='49eba1f86e8c412e81feba30657c278a',ramdisk_id='',reservation_id='r-a6usm2mn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2085483445',owner_user_name='tempest-TaggedBootDevicesTest-2085483445-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:31:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c3532caac1f479995f501b1345ebcb2',uuid=da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a519d774-56a5-4a6c-9cd3-94e260332725", "address": "fa:16:3e:d1:a5:ec", "network": {"id": "dddb77ca-d38f-4817-bf06-e8dcc8552539", "bridge": "br-int", "label": "tempest-device-tagging-net2-1958061298", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa519d774-56", "ovs_interfaceid": "a519d774-56a5-4a6c-9cd3-94e260332725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Converting VIF {"id": "a519d774-56a5-4a6c-9cd3-94e260332725", "address": "fa:16:3e:d1:a5:ec", "network": {"id": "dddb77ca-d38f-4817-bf06-e8dcc8552539", "bridge": "br-int", "label": "tempest-device-tagging-net2-1958061298", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa519d774-56", "ovs_interfaceid": "a519d774-56a5-4a6c-9cd3-94e260332725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:a5:ec,bridge_name='br-int',has_traffic_filtering=True,id=a519d774-56a5-4a6c-9cd3-94e260332725,network=Network(dddb77ca-d38f-4817-bf06-e8dcc8552539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa519d774-56') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG os_vif [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:a5:ec,bridge_name='br-int',has_traffic_filtering=True,id=a519d774-56a5-4a6c-9cd3-94e260332725,network=Network(dddb77ca-d38f-4817-bf06-e8dcc8552539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa519d774-56') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa519d774-56, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:32:41 user nova-compute[73391]: INFO os_vif [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:a5:ec,bridge_name='br-int',has_traffic_filtering=True,id=a519d774-56a5-4a6c-9cd3-94e260332725,network=Network(dddb77ca-d38f-4817-bf06-e8dcc8552539),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa519d774-56')
Aug 15 05:32:41 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jMNqLDeK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:32:41 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:32:41 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8288cb8-28af-405b-91c6-197e8fb2f9ef]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)
Aug 15 05:32:41 user nova-compute[73391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)
Aug 15 05:32:41 user nova-compute[73391]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9 (non-flash)
Aug 15 05:32:41 user nova-compute[73391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:32:41 user nova-compute[73391]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)
Aug 15 05:32:41 user nova-compute[73391]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:32:41 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:32:41 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:32:41 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:32:41 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)
Aug 15 05:32:41 user nova-compute[73391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)
Aug 15 05:32:41 user nova-compute[73391]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9 (non-flash)
Aug 15 05:32:41 user nova-compute[73391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:32:41 user nova-compute[73391]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)
Aug 15 05:32:41 user nova-compute[73391]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:32:41 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:32:41 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:32:41 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:32:41 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7728497910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9'): ({'sde'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] Removing single pathed devices sde {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac48a06-a9a5-444b-9733-b3586ceb9297]: (4, ('path checker states:\nup                  9\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c41dbc-7dde-454e-8c6f-1f321b1e6c91]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] Flushing IO for device /dev/sde {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2b9993-c976-44e9-b6bd-a29778bbd68b]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.058s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73f736c-29cc-4b5f-84eb-29b4a3cb66c9]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] SCSI volumes sde have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a4ff158-9e66-4efc-a0ef-de67025413d2]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9 -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1635ba6d-1775-4a46-9229-e11af126751e]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9, portal: 172.16.0.220,3260]
Aug 15 05:32:41 user nova-compute[73391]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9, portal: 172.16.0.220,3260] successful.
Aug 15 05:32:41 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9 -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4003a351-ce41-40db-8e1f-95bd0985e3e9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f9eeb3-44f6-4c8d-8b9b-c02ee2007548]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] <== disconnect_volume: return (347ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.300s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a559e34-8f38-4b6c-a245-a8e49c1ef9c6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG nova.compute.manager [req-e6aa1fd1-3c89-4459-ba1c-80cd9f5192da req-7566a993-0a08-4cab-9dc6-a1a10a1ffa89 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received event network-vif-plugged-c165877a-edce-4fec-8aa4-e7708b384676 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e6aa1fd1-3c89-4459-ba1c-80cd9f5192da req-7566a993-0a08-4cab-9dc6-a1a10a1ffa89 service nova] Acquiring lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e6aa1fd1-3c89-4459-ba1c-80cd9f5192da req-7566a993-0a08-4cab-9dc6-a1a10a1ffa89 service nova] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e6aa1fd1-3c89-4459-ba1c-80cd9f5192da req-7566a993-0a08-4cab-9dc6-a1a10a1ffa89 service nova] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG nova.compute.manager [req-e6aa1fd1-3c89-4459-ba1c-80cd9f5192da req-7566a993-0a08-4cab-9dc6-a1a10a1ffa89 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] No waiting events found dispatching network-vif-plugged-c165877a-edce-4fec-8aa4-e7708b384676 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:32:41 user nova-compute[73391]: WARNING nova.compute.manager [req-e6aa1fd1-3c89-4459-ba1c-80cd9f5192da req-7566a993-0a08-4cab-9dc6-a1a10a1ffa89 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received unexpected event network-vif-plugged-c165877a-edce-4fec-8aa4-e7708b384676 for instance with vm_state active and task_state deleting.
Aug 15 05:32:41 user nova-compute[73391]: DEBUG nova.compute.manager [req-e6aa1fd1-3c89-4459-ba1c-80cd9f5192da req-7566a993-0a08-4cab-9dc6-a1a10a1ffa89 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received event network-vif-unplugged-22ffe1b4-8207-4909-b0ba-0db5dc955912 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e6aa1fd1-3c89-4459-ba1c-80cd9f5192da req-7566a993-0a08-4cab-9dc6-a1a10a1ffa89 service nova] Acquiring lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e6aa1fd1-3c89-4459-ba1c-80cd9f5192da req-7566a993-0a08-4cab-9dc6-a1a10a1ffa89 service nova] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e6aa1fd1-3c89-4459-ba1c-80cd9f5192da req-7566a993-0a08-4cab-9dc6-a1a10a1ffa89 service nova] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG nova.compute.manager [req-e6aa1fd1-3c89-4459-ba1c-80cd9f5192da req-7566a993-0a08-4cab-9dc6-a1a10a1ffa89 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] No waiting events found dispatching network-vif-unplugged-22ffe1b4-8207-4909-b0ba-0db5dc955912 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG nova.compute.manager [req-e6aa1fd1-3c89-4459-ba1c-80cd9f5192da req-7566a993-0a08-4cab-9dc6-a1a10a1ffa89 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received event network-vif-unplugged-22ffe1b4-8207-4909-b0ba-0db5dc955912 for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG nova.compute.manager [req-e6aa1fd1-3c89-4459-ba1c-80cd9f5192da req-7566a993-0a08-4cab-9dc6-a1a10a1ffa89 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received event network-vif-plugged-22ffe1b4-8207-4909-b0ba-0db5dc955912 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e6aa1fd1-3c89-4459-ba1c-80cd9f5192da req-7566a993-0a08-4cab-9dc6-a1a10a1ffa89 service nova] Acquiring lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e6aa1fd1-3c89-4459-ba1c-80cd9f5192da req-7566a993-0a08-4cab-9dc6-a1a10a1ffa89 service nova] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e6aa1fd1-3c89-4459-ba1c-80cd9f5192da req-7566a993-0a08-4cab-9dc6-a1a10a1ffa89 service nova] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG nova.compute.manager [req-e6aa1fd1-3c89-4459-ba1c-80cd9f5192da req-7566a993-0a08-4cab-9dc6-a1a10a1ffa89 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] No waiting events found dispatching network-vif-plugged-22ffe1b4-8207-4909-b0ba-0db5dc955912 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:32:41 user nova-compute[73391]: WARNING nova.compute.manager [req-e6aa1fd1-3c89-4459-ba1c-80cd9f5192da req-7566a993-0a08-4cab-9dc6-a1a10a1ffa89 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received unexpected event network-vif-plugged-22ffe1b4-8207-4909-b0ba-0db5dc955912 for instance with vm_state active and task_state deleting.
Aug 15 05:32:41 user nova-compute[73391]: DEBUG nova.compute.manager [req-e6aa1fd1-3c89-4459-ba1c-80cd9f5192da req-7566a993-0a08-4cab-9dc6-a1a10a1ffa89 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received event network-vif-unplugged-a519d774-56a5-4a6c-9cd3-94e260332725 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e6aa1fd1-3c89-4459-ba1c-80cd9f5192da req-7566a993-0a08-4cab-9dc6-a1a10a1ffa89 service nova] Acquiring lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e6aa1fd1-3c89-4459-ba1c-80cd9f5192da req-7566a993-0a08-4cab-9dc6-a1a10a1ffa89 service nova] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e6aa1fd1-3c89-4459-ba1c-80cd9f5192da req-7566a993-0a08-4cab-9dc6-a1a10a1ffa89 service nova] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG nova.compute.manager [req-e6aa1fd1-3c89-4459-ba1c-80cd9f5192da req-7566a993-0a08-4cab-9dc6-a1a10a1ffa89 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] No waiting events found dispatching network-vif-unplugged-a519d774-56a5-4a6c-9cd3-94e260332725 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG nova.compute.manager [req-e6aa1fd1-3c89-4459-ba1c-80cd9f5192da req-7566a993-0a08-4cab-9dc6-a1a10a1ffa89 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received event network-vif-unplugged-a519d774-56a5-4a6c-9cd3-94e260332725 for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG nova.compute.manager [req-e6aa1fd1-3c89-4459-ba1c-80cd9f5192da req-7566a993-0a08-4cab-9dc6-a1a10a1ffa89 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received event network-vif-plugged-a519d774-56a5-4a6c-9cd3-94e260332725 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e6aa1fd1-3c89-4459-ba1c-80cd9f5192da req-7566a993-0a08-4cab-9dc6-a1a10a1ffa89 service nova] Acquiring lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e6aa1fd1-3c89-4459-ba1c-80cd9f5192da req-7566a993-0a08-4cab-9dc6-a1a10a1ffa89 service nova] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e6aa1fd1-3c89-4459-ba1c-80cd9f5192da req-7566a993-0a08-4cab-9dc6-a1a10a1ffa89 service nova] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG nova.compute.manager [req-e6aa1fd1-3c89-4459-ba1c-80cd9f5192da req-7566a993-0a08-4cab-9dc6-a1a10a1ffa89 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] No waiting events found dispatching network-vif-plugged-a519d774-56a5-4a6c-9cd3-94e260332725 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:32:41 user nova-compute[73391]: WARNING nova.compute.manager [req-e6aa1fd1-3c89-4459-ba1c-80cd9f5192da req-7566a993-0a08-4cab-9dc6-a1a10a1ffa89 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received unexpected event network-vif-plugged-a519d774-56a5-4a6c-9cd3-94e260332725 for instance with vm_state active and task_state deleting.
Aug 15 05:32:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0ccb20d-4062-48ca-a5d9-d8bfbf9fc0ec]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)
Aug 15 05:32:41 user nova-compute[73391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)
Aug 15 05:32:41 user nova-compute[73391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:32:41 user nova-compute[73391]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)
Aug 15 05:32:41 user nova-compute[73391]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:32:41 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:32:41 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:32:41 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:32:41 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)
Aug 15 05:32:41 user nova-compute[73391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)
Aug 15 05:32:41 user nova-compute[73391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:32:41 user nova-compute[73391]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)
Aug 15 05:32:41 user nova-compute[73391]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 (non-flash)
Aug 15 05:32:41 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:32:41 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:32:41 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:32:41 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77482200d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7'): ({'sdb'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Removing single pathed devices sdb {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG nova.compute.manager [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XYflAmQI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, 'status': 'reserved', 'instance': '0169df15-335e-46e6-a5c8-9deb7095bb84', 'attached_at': '', 'detached_at': '', 'volume_id': 'fb592ee0-ed3e-427a-8cc4-05091385a40a', 'serial'} {{(pid=73391) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG nova.compute.manager [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] swap_volume: removing Cinder connection for volume 4003a351-ce41-40db-8e1f-95bd0985e3e9 {{(pid=73391) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Aug 15 05:32:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d885f8bf-31f1-4c81-a30a-6c0ba57c0e1e]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a9ce230-8707-4a6c-a315-42dbfa739bcb]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Flushing IO for device /dev/sdb {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca04e95-ab3f-48ea-b698-6d747496fdb5]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a16c5f-1e87-4133-ae51-33a5c4508dbe]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] SCSI volumes sdb have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff631c8-1734-4737-ae3d-0b9b13828c75]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc059e9-cda2-43a5-81b0-a9552d08d3be]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7, portal: 172.16.0.220,3260]
Aug 15 05:32:42 user nova-compute[73391]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7, portal: 172.16.0.220,3260] successful.
Aug 15 05:32:42 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:19a3dc05-2c38-4eea-aab9-23510f1716c7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ea1fca-6c06-4508-8df9-40e4bcd2cc94]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] <== disconnect_volume: return (662ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WPoDVQFw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:32:42 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:32:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc19ee6-5559-4023-b836-41291645f764]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6330410e-34f4-4135-9a2e-1c1fbe595200]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)
Aug 15 05:32:42 user nova-compute[73391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)
Aug 15 05:32:42 user nova-compute[73391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:32:42 user nova-compute[73391]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)
Aug 15 05:32:42 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:32:42 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:32:42 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:32:42 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)
Aug 15 05:32:42 user nova-compute[73391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)
Aug 15 05:32:42 user nova-compute[73391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:32:42 user nova-compute[73391]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)
Aug 15 05:32:42 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:32:42 user nova-compute[73391]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 (non-flash)
Aug 15 05:32:42 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:32:42 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7748421b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296'): ({'sdd'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Removing single pathed devices sdd {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff0cecd-bae6-48a0-a05f-48923391e2e9]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ca43ea-1470-4176-87d5-0b8c3fdb5255]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Flushing IO for device /dev/sdd {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5afe2d3-7138-4ae8-904d-c8c5853924c3]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb82ddb-2400-4b17-bbe5-da741d1c9288]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] SCSI volumes sdd have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bcb33d6-9b76-4032-b82c-fa1e25b1abcd]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a7bc0c-60f8-4d5e-b069-6ba9c353c737]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296, portal: 172.16.0.220,3260]
Aug 15 05:32:42 user nova-compute[73391]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296, portal: 172.16.0.220,3260] successful.
Aug 15 05:32:42 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG nova.compute.manager [req-ac91d0e8-beb9-46a2-b869-530d8b02cd4c req-90cac9dc-756b-40f8-88d8-6dcf50a76fba service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received event network-vif-plugged-72a3d29f-9af1-4d78-bb33-db5cc02856aa {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ac91d0e8-beb9-46a2-b869-530d8b02cd4c req-90cac9dc-756b-40f8-88d8-6dcf50a76fba service nova] Acquiring lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ac91d0e8-beb9-46a2-b869-530d8b02cd4c req-90cac9dc-756b-40f8-88d8-6dcf50a76fba service nova] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ac91d0e8-beb9-46a2-b869-530d8b02cd4c req-90cac9dc-756b-40f8-88d8-6dcf50a76fba service nova] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG nova.compute.manager [req-ac91d0e8-beb9-46a2-b869-530d8b02cd4c req-90cac9dc-756b-40f8-88d8-6dcf50a76fba service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] No waiting events found dispatching network-vif-plugged-72a3d29f-9af1-4d78-bb33-db5cc02856aa {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:32:42 user nova-compute[73391]: WARNING nova.compute.manager [req-ac91d0e8-beb9-46a2-b869-530d8b02cd4c req-90cac9dc-756b-40f8-88d8-6dcf50a76fba service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received unexpected event network-vif-plugged-72a3d29f-9af1-4d78-bb33-db5cc02856aa for instance with vm_state active and task_state deleting.
Aug 15 05:32:42 user nova-compute[73391]: DEBUG nova.compute.manager [req-ac91d0e8-beb9-46a2-b869-530d8b02cd4c req-90cac9dc-756b-40f8-88d8-6dcf50a76fba service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received event network-vif-unplugged-88d012e5-b40e-4398-99a1-14b37a890c47 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ac91d0e8-beb9-46a2-b869-530d8b02cd4c req-90cac9dc-756b-40f8-88d8-6dcf50a76fba service nova] Acquiring lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ac91d0e8-beb9-46a2-b869-530d8b02cd4c req-90cac9dc-756b-40f8-88d8-6dcf50a76fba service nova] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ac91d0e8-beb9-46a2-b869-530d8b02cd4c req-90cac9dc-756b-40f8-88d8-6dcf50a76fba service nova] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG nova.compute.manager [req-ac91d0e8-beb9-46a2-b869-530d8b02cd4c req-90cac9dc-756b-40f8-88d8-6dcf50a76fba service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] No waiting events found dispatching network-vif-unplugged-88d012e5-b40e-4398-99a1-14b37a890c47 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG nova.compute.manager [req-ac91d0e8-beb9-46a2-b869-530d8b02cd4c req-90cac9dc-756b-40f8-88d8-6dcf50a76fba service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received event network-vif-unplugged-88d012e5-b40e-4398-99a1-14b37a890c47 for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG nova.compute.manager [req-ac91d0e8-beb9-46a2-b869-530d8b02cd4c req-90cac9dc-756b-40f8-88d8-6dcf50a76fba service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received event network-vif-plugged-88d012e5-b40e-4398-99a1-14b37a890c47 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ac91d0e8-beb9-46a2-b869-530d8b02cd4c req-90cac9dc-756b-40f8-88d8-6dcf50a76fba service nova] Acquiring lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ac91d0e8-beb9-46a2-b869-530d8b02cd4c req-90cac9dc-756b-40f8-88d8-6dcf50a76fba service nova] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ac91d0e8-beb9-46a2-b869-530d8b02cd4c req-90cac9dc-756b-40f8-88d8-6dcf50a76fba service nova] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG nova.compute.manager [req-ac91d0e8-beb9-46a2-b869-530d8b02cd4c req-90cac9dc-756b-40f8-88d8-6dcf50a76fba service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] No waiting events found dispatching network-vif-plugged-88d012e5-b40e-4398-99a1-14b37a890c47 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:32:42 user nova-compute[73391]: WARNING nova.compute.manager [req-ac91d0e8-beb9-46a2-b869-530d8b02cd4c req-90cac9dc-756b-40f8-88d8-6dcf50a76fba service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received unexpected event network-vif-plugged-88d012e5-b40e-4398-99a1-14b37a890c47 for instance with vm_state active and task_state deleting.
Aug 15 05:32:42 user nova-compute[73391]: DEBUG nova.compute.manager [req-ac91d0e8-beb9-46a2-b869-530d8b02cd4c req-90cac9dc-756b-40f8-88d8-6dcf50a76fba service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received event network-vif-unplugged-544b22aa-6b69-4b4d-985f-19bdc248d641 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ac91d0e8-beb9-46a2-b869-530d8b02cd4c req-90cac9dc-756b-40f8-88d8-6dcf50a76fba service nova] Acquiring lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ac91d0e8-beb9-46a2-b869-530d8b02cd4c req-90cac9dc-756b-40f8-88d8-6dcf50a76fba service nova] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ac91d0e8-beb9-46a2-b869-530d8b02cd4c req-90cac9dc-756b-40f8-88d8-6dcf50a76fba service nova] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG nova.compute.manager [req-ac91d0e8-beb9-46a2-b869-530d8b02cd4c req-90cac9dc-756b-40f8-88d8-6dcf50a76fba service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] No waiting events found dispatching network-vif-unplugged-544b22aa-6b69-4b4d-985f-19bdc248d641 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG nova.compute.manager [req-ac91d0e8-beb9-46a2-b869-530d8b02cd4c req-90cac9dc-756b-40f8-88d8-6dcf50a76fba service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received event network-vif-unplugged-544b22aa-6b69-4b4d-985f-19bdc248d641 for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3eec2145-f305-421e-8259-a2b495036296 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2757850-2af3-44a2-be97-d545a7ab518a]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] <== disconnect_volume: return (337ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG nova.compute.manager [req-4090a015-23c0-4ce1-8a5e-c6cffe7b8712 req-667903b2-2915-497d-bacb-ad8495106841 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received event network-vif-plugged-397ea76b-8bbd-4602-b966-cf7331d13e9f {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-4090a015-23c0-4ce1-8a5e-c6cffe7b8712 req-667903b2-2915-497d-bacb-ad8495106841 service nova] Acquiring lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-4090a015-23c0-4ce1-8a5e-c6cffe7b8712 req-667903b2-2915-497d-bacb-ad8495106841 service nova] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-4090a015-23c0-4ce1-8a5e-c6cffe7b8712 req-667903b2-2915-497d-bacb-ad8495106841 service nova] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG nova.compute.manager [req-4090a015-23c0-4ce1-8a5e-c6cffe7b8712 req-667903b2-2915-497d-bacb-ad8495106841 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] No waiting events found dispatching network-vif-plugged-397ea76b-8bbd-4602-b966-cf7331d13e9f {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:32:42 user nova-compute[73391]: WARNING nova.compute.manager [req-4090a015-23c0-4ce1-8a5e-c6cffe7b8712 req-667903b2-2915-497d-bacb-ad8495106841 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received unexpected event network-vif-plugged-397ea76b-8bbd-4602-b966-cf7331d13e9f for instance with vm_state active and task_state deleting.
Aug 15 05:32:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XezUgYOQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:32:42 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:32:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d724bdaa-0f5e-47f6-b9b0-b0b8944d56d3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda215da-a157-4100-9407-c6fe6c9b66cb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)
Aug 15 05:32:42 user nova-compute[73391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)
Aug 15 05:32:42 user nova-compute[73391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:32:42 user nova-compute[73391]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)
Aug 15 05:32:42 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:32:42 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:32:42 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)
Aug 15 05:32:42 user nova-compute[73391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)
Aug 15 05:32:42 user nova-compute[73391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:32:42 user nova-compute[73391]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)
Aug 15 05:32:42 user nova-compute[73391]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 (non-flash)
Aug 15 05:32:42 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:32:42 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77484c7520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44'): ({'sdc'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Removing single pathed devices sdc {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a673d2-d186-412b-8067-597c0b2bfac9]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b3b125-73ec-4260-9ea9-9c70a0605a7d]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Flushing IO for device /dev/sdc {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee1730d-c001-40fb-88c8-e0fd81ff1370]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b207e1-ac6c-494c-b867-8a9228fd8cc1]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] SCSI volumes sdc have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9d67ed0-4aed-4d17-95bb-f50e011de07a]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e978494-4053-4529-b7b2-e7217d8fb1d5]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44, portal: 172.16.0.220,3260]
Aug 15 05:32:42 user nova-compute[73391]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44, portal: 172.16.0.220,3260] successful.
Aug 15 05:32:42 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG nova.compute.manager [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] swap_volume: Updating volume 4003a351-ce41-40db-8e1f-95bd0985e3e9 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqns": ["iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a"], "target_portals": ["172.16.0.220:3260"], "target_luns": [0], "target_discovered": false, "auth_method": "CHAP", "auth_username": "XYflAmQI", "auth_password": "eaqVjhIyD5H1Zn", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdj", "volume_id": "fb592ee0-ed3e-427a-8cc4-05091385a40a"}, "status": "reserved", "instance": "0169df15-335e-46e6-a5c8-9deb7095bb84", "attached_at": "", "detached_at": "", "volume_id": "fb592ee0-ed3e-427a-8cc4-05091385a40a", "serial": "fb592ee0-ed3e-427a-8cc4-05091385a40a"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'fb592ee0-ed3e-427a-8cc4-05091385a40a', 'no_device': None, 'attachment_id': '0ac7b022-b963-413b-b517-9d1a52c821a3'} {{(pid=73391) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-5599a4c7-66ae-4240-82e9-441d7c18ec20 tempest-TestVolumeSwap-1385055413 tempest-TestVolumeSwap-1385055413-project-admin] Lock "0169df15-335e-46e6-a5c8-9deb7095bb84" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 18.996s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d16a4c26-9b62-456a-89b5-f6eb00a73d44 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd126984-c7ad-483d-85a4-48c82a365bc9]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.302s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] <== disconnect_volume: return (304ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:32:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 05:32:42 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Deleting instance files /opt/stack/data/nova/instances/da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb_del
Aug 15 05:32:42 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Deletion of /opt/stack/data/nova/instances/da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb_del complete
Aug 15 05:32:43 user nova-compute[73391]: INFO nova.compute.manager [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Took 3.66 seconds to destroy the instance on the hypervisor.
Aug 15 05:32:43 user nova-compute[73391]: DEBUG oslo.service.loopingcall [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 05:32:43 user nova-compute[73391]: DEBUG nova.compute.manager [-] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Deallocating network for instance {{(pid=73391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 05:32:43 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] deallocate_for_instance() {{(pid=73391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 05:32:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-9760f2d4-f8ee-4877-b229-e9f46517e668 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Acquiring lock "0169df15-335e-46e6-a5c8-9deb7095bb84" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-9760f2d4-f8ee-4877-b229-e9f46517e668 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Lock "0169df15-335e-46e6-a5c8-9deb7095bb84" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:43 user nova-compute[73391]: INFO nova.compute.manager [None req-9760f2d4-f8ee-4877-b229-e9f46517e668 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Detaching volume fb592ee0-ed3e-427a-8cc4-05091385a40a
Aug 15 05:32:43 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:44 user nova-compute[73391]: INFO nova.virt.block_device [None req-9760f2d4-f8ee-4877-b229-e9f46517e668 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Attempting to driver detach volume fb592ee0-ed3e-427a-8cc4-05091385a40a from mountpoint /dev/vdb
Aug 15 05:32:44 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-9760f2d4-f8ee-4877-b229-e9f46517e668 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Attempting to detach device vdb from instance 0169df15-335e-46e6-a5c8-9deb7095bb84 from the persistent domain config. {{(pid=73391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 05:32:44 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-9760f2d4-f8ee-4877-b229-e9f46517e668 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 05:32:44 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:32:44 user nova-compute[73391]:   <source dev="/dev/sdj"/>
Aug 15 05:32:44 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:32:44 user nova-compute[73391]:   <serial>fb592ee0-ed3e-427a-8cc4-05091385a40a</serial>
Aug 15 05:32:44 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 05:32:44 user nova-compute[73391]: </disk>
Aug 15 05:32:44 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 05:32:44 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-9760f2d4-f8ee-4877-b229-e9f46517e668 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Successfully detached device vdb from instance 0169df15-335e-46e6-a5c8-9deb7095bb84 from the persistent domain config.
Aug 15 05:32:44 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-9760f2d4-f8ee-4877-b229-e9f46517e668 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0169df15-335e-46e6-a5c8-9deb7095bb84 from the live domain config. {{(pid=73391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 05:32:44 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-9760f2d4-f8ee-4877-b229-e9f46517e668 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 05:32:44 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:32:44 user nova-compute[73391]:   <source dev="/dev/sdj"/>
Aug 15 05:32:44 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:32:44 user nova-compute[73391]:   <serial>fb592ee0-ed3e-427a-8cc4-05091385a40a</serial>
Aug 15 05:32:44 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 05:32:44 user nova-compute[73391]: </disk>
Aug 15 05:32:44 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 05:32:44 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Received event <DeviceRemovedEvent: 1692077564.4553103, 0169df15-335e-46e6-a5c8-9deb7095bb84 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73391) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 05:32:44 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-9760f2d4-f8ee-4877-b229-e9f46517e668 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0169df15-335e-46e6-a5c8-9deb7095bb84 {{(pid=73391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 05:32:44 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-9760f2d4-f8ee-4877-b229-e9f46517e668 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Successfully detached device vdb from instance 0169df15-335e-46e6-a5c8-9deb7095bb84 from the live domain config.
Aug 15 05:32:44 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9760f2d4-f8ee-4877-b229-e9f46517e668 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 05:32:44 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9760f2d4-f8ee-4877-b229-e9f46517e668 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XYflAmQI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj', 'volume_id': 'fb592ee0-ed3e-427a-8cc4-05091385a40a'}, None), 'kwargs': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:32:44 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-9760f2d4-f8ee-4877-b229-e9f46517e668 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:32:44 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-9760f2d4-f8ee-4877-b229-e9f46517e668 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:32:44 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-9760f2d4-f8ee-4877-b229-e9f46517e668 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:32:44 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9760f2d4-f8ee-4877-b229-e9f46517e668 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 05:32:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:44 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[37820e87-be71-4003-8659-8d5463f30bcc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:44 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[34136dbf-3fec-493b-9733-13d271d09500]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:44 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9760f2d4-f8ee-4877-b229-e9f46517e668 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)
Aug 15 05:32:44 user nova-compute[73391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)
Aug 15 05:32:44 user nova-compute[73391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:32:44 user nova-compute[73391]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)
Aug 15 05:32:44 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:32:44 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:32:44 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9760f2d4-f8ee-4877-b229-e9f46517e668 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)
Aug 15 05:32:44 user nova-compute[73391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)
Aug 15 05:32:44 user nova-compute[73391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:32:44 user nova-compute[73391]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a (non-flash)
Aug 15 05:32:44 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:32:44 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:32:44 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9760f2d4-f8ee-4877-b229-e9f46517e668 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7728497eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a'): ({'sdj'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 05:32:44 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-9760f2d4-f8ee-4877-b229-e9f46517e668 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Removing single pathed devices sdj {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 05:32:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:44 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[745bbc5c-bf2a-48f4-9850-8d70653ddddb]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:44 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e9bfed-6be0-49f6-a8a1-4fc41fd36c47]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:44 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-9760f2d4-f8ee-4877-b229-e9f46517e668 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Flushing IO for device /dev/sdj {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 05:32:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.015s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:44 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5602d83-62fb-4023-b48e-96fa0755e1b1]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:44 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-9760f2d4-f8ee-4877-b229-e9f46517e668 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 05:32:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:44 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.054s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:44 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[952a38d7-49e4-48c0-a2ef-ca9c6a104150]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:44 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-9760f2d4-f8ee-4877-b229-e9f46517e668 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 05:32:44 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-9760f2d4-f8ee-4877-b229-e9f46517e668 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] SCSI volumes sdj have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 05:32:44 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9760f2d4-f8ee-4877-b229-e9f46517e668 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 05:32:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:44 user nova-compute[73391]: DEBUG nova.compute.manager [req-61643545-6ec4-41d7-8ec0-26972e29fbf8 req-57ec6f5d-9544-4461-9797-220a0a31b204 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received event network-vif-plugged-544b22aa-6b69-4b4d-985f-19bdc248d641 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:32:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-61643545-6ec4-41d7-8ec0-26972e29fbf8 req-57ec6f5d-9544-4461-9797-220a0a31b204 service nova] Acquiring lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-61643545-6ec4-41d7-8ec0-26972e29fbf8 req-57ec6f5d-9544-4461-9797-220a0a31b204 service nova] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-61643545-6ec4-41d7-8ec0-26972e29fbf8 req-57ec6f5d-9544-4461-9797-220a0a31b204 service nova] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:44 user nova-compute[73391]: DEBUG nova.compute.manager [req-61643545-6ec4-41d7-8ec0-26972e29fbf8 req-57ec6f5d-9544-4461-9797-220a0a31b204 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] No waiting events found dispatching network-vif-plugged-544b22aa-6b69-4b4d-985f-19bdc248d641 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:32:44 user nova-compute[73391]: WARNING nova.compute.manager [req-61643545-6ec4-41d7-8ec0-26972e29fbf8 req-57ec6f5d-9544-4461-9797-220a0a31b204 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received unexpected event network-vif-plugged-544b22aa-6b69-4b4d-985f-19bdc248d641 for instance with vm_state active and task_state deleting.
Aug 15 05:32:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:44 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0954b0bd-7b75-4f79-bd40-3681b2216e05]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:44 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9760f2d4-f8ee-4877-b229-e9f46517e668 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:44 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d16a9d8-5d36-4fce-a278-65f1ed7dd7ab]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:44 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9760f2d4-f8ee-4877-b229-e9f46517e668 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a, portal: 172.16.0.220,3260]
Aug 15 05:32:44 user nova-compute[73391]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a, portal: 172.16.0.220,3260] successful.
Aug 15 05:32:44 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb592ee0-ed3e-427a-8cc4-05091385a40a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:44 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f95ac26-32b8-4bcf-b456-221669bf3bf7]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:44 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9760f2d4-f8ee-4877-b229-e9f46517e668 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:32:44 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-9760f2d4-f8ee-4877-b229-e9f46517e668 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:32:44 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9760f2d4-f8ee-4877-b229-e9f46517e668 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] <== disconnect_volume: return (318ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:32:44 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9760f2d4-f8ee-4877-b229-e9f46517e668 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 05:32:45 user nova-compute[73391]: DEBUG nova.objects.instance [None req-9760f2d4-f8ee-4877-b229-e9f46517e668 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Lazy-loading 'flavor' on Instance uuid 0169df15-335e-46e6-a5c8-9deb7095bb84 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:32:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-9760f2d4-f8ee-4877-b229-e9f46517e668 tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Lock "0169df15-335e-46e6-a5c8-9deb7095bb84" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.787s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:45 user nova-compute[73391]: DEBUG nova.compute.manager [req-45777a8e-3866-478f-ac37-8b2b124d6f5e req-735f7fab-42b8-47ee-870b-e4595ca18c78 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received event network-vif-deleted-72a3d29f-9af1-4d78-bb33-db5cc02856aa {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:32:45 user nova-compute[73391]: INFO nova.compute.manager [req-45777a8e-3866-478f-ac37-8b2b124d6f5e req-735f7fab-42b8-47ee-870b-e4595ca18c78 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Neutron deleted interface 72a3d29f-9af1-4d78-bb33-db5cc02856aa; detaching it from the instance and deleting it from the info cache
Aug 15 05:32:45 user nova-compute[73391]: DEBUG nova.network.neutron [req-45777a8e-3866-478f-ac37-8b2b124d6f5e req-735f7fab-42b8-47ee-870b-e4595ca18c78 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Updating instance_info_cache with network_info: [{"id": "397ea76b-8bbd-4602-b966-cf7331d13e9f", "address": "fa:16:3e:61:64:15", "network": {"id": "63ea02b8-a8de-4680-a96b-496a4480c84e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1311691765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap397ea76b-8b", "ovs_interfaceid": "397ea76b-8bbd-4602-b966-cf7331d13e9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c165877a-edce-4fec-8aa4-e7708b384676", "address": "fa:16:3e:fd:7f:88", "network": {"id": "13d2edf3-6d96-4829-8c78-2dee6654aac3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1748402198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc165877a-ed", "ovs_interfaceid": "c165877a-edce-4fec-8aa4-e7708b384676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "22ffe1b4-8207-4909-b0ba-0db5dc955912", "address": "fa:16:3e:40:11:5a", "network": {"id": "13d2edf3-6d96-4829-8c78-2dee6654aac3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1748402198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ffe1b4-82", "ovs_interfaceid": "22ffe1b4-8207-4909-b0ba-0db5dc955912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "88d012e5-b40e-4398-99a1-14b37a890c47", "address": "fa:16:3e:ff:a2:52", "network": {"id": "13d2edf3-6d96-4829-8c78-2dee6654aac3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1748402198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88d012e5-b4", "ovs_interfaceid": "88d012e5-b40e-4398-99a1-14b37a890c47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "544b22aa-6b69-4b4d-985f-19bdc248d641", "address": "fa:16:3e:df:ec:65", "network": {"id": "dddb77ca-d38f-4817-bf06-e8dcc8552539", "bridge": "br-int", "label": "tempest-device-tagging-net2-1958061298", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap544b22aa-6b", "ovs_interfaceid": "544b22aa-6b69-4b4d-985f-19bdc248d641", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a519d774-56a5-4a6c-9cd3-94e260332725", "address": "fa:16:3e:d1:a5:ec", "network": {"id": "dddb77ca-d38f-4817-bf06-e8dcc8552539", "bridge": "br-int", "label": "tempest-device-tagging-net2-1958061298", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa519d774-56", "ovs_interfaceid": "a519d774-56a5-4a6c-9cd3-94e260332725", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:32:45 user nova-compute[73391]: DEBUG nova.compute.manager [req-45777a8e-3866-478f-ac37-8b2b124d6f5e req-735f7fab-42b8-47ee-870b-e4595ca18c78 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Detach interface failed, port_id=72a3d29f-9af1-4d78-bb33-db5cc02856aa, reason: Instance da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb could not be found. {{(pid=73391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 05:32:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:47 user nova-compute[73391]: DEBUG nova.compute.manager [req-aaa01675-93ee-417d-9bf9-65b694d15636 req-4bd4be0d-5bb7-4445-b779-34475b9e6684 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received event network-vif-deleted-a519d774-56a5-4a6c-9cd3-94e260332725 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:32:47 user nova-compute[73391]: INFO nova.compute.manager [req-aaa01675-93ee-417d-9bf9-65b694d15636 req-4bd4be0d-5bb7-4445-b779-34475b9e6684 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Neutron deleted interface a519d774-56a5-4a6c-9cd3-94e260332725; detaching it from the instance and deleting it from the info cache
Aug 15 05:32:47 user nova-compute[73391]: DEBUG nova.network.neutron [req-aaa01675-93ee-417d-9bf9-65b694d15636 req-4bd4be0d-5bb7-4445-b779-34475b9e6684 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Updating instance_info_cache with network_info: [{"id": "397ea76b-8bbd-4602-b966-cf7331d13e9f", "address": "fa:16:3e:61:64:15", "network": {"id": "63ea02b8-a8de-4680-a96b-496a4480c84e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1311691765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap397ea76b-8b", "ovs_interfaceid": "397ea76b-8bbd-4602-b966-cf7331d13e9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c165877a-edce-4fec-8aa4-e7708b384676", "address": "fa:16:3e:fd:7f:88", "network": {"id": "13d2edf3-6d96-4829-8c78-2dee6654aac3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1748402198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc165877a-ed", "ovs_interfaceid": "c165877a-edce-4fec-8aa4-e7708b384676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "22ffe1b4-8207-4909-b0ba-0db5dc955912", "address": "fa:16:3e:40:11:5a", "network": {"id": "13d2edf3-6d96-4829-8c78-2dee6654aac3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1748402198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ffe1b4-82", "ovs_interfaceid": "22ffe1b4-8207-4909-b0ba-0db5dc955912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "88d012e5-b40e-4398-99a1-14b37a890c47", "address": "fa:16:3e:ff:a2:52", "network": {"id": "13d2edf3-6d96-4829-8c78-2dee6654aac3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1748402198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88d012e5-b4", "ovs_interfaceid": "88d012e5-b40e-4398-99a1-14b37a890c47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "544b22aa-6b69-4b4d-985f-19bdc248d641", "address": "fa:16:3e:df:ec:65", "network": {"id": "dddb77ca-d38f-4817-bf06-e8dcc8552539", "bridge": "br-int", "label": "tempest-device-tagging-net2-1958061298", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap544b22aa-6b", "ovs_interfaceid": "544b22aa-6b69-4b4d-985f-19bdc248d641", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:32:47 user nova-compute[73391]: DEBUG nova.compute.manager [req-aaa01675-93ee-417d-9bf9-65b694d15636 req-4bd4be0d-5bb7-4445-b779-34475b9e6684 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Detach interface failed, port_id=a519d774-56a5-4a6c-9cd3-94e260332725, reason: Instance da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb could not be found. {{(pid=73391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 05:32:47 user nova-compute[73391]: DEBUG nova.compute.manager [req-aaa01675-93ee-417d-9bf9-65b694d15636 req-4bd4be0d-5bb7-4445-b779-34475b9e6684 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received event network-vif-deleted-544b22aa-6b69-4b4d-985f-19bdc248d641 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:32:47 user nova-compute[73391]: INFO nova.compute.manager [req-aaa01675-93ee-417d-9bf9-65b694d15636 req-4bd4be0d-5bb7-4445-b779-34475b9e6684 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Neutron deleted interface 544b22aa-6b69-4b4d-985f-19bdc248d641; detaching it from the instance and deleting it from the info cache
Aug 15 05:32:47 user nova-compute[73391]: DEBUG nova.network.neutron [req-aaa01675-93ee-417d-9bf9-65b694d15636 req-4bd4be0d-5bb7-4445-b779-34475b9e6684 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Updating instance_info_cache with network_info: [{"id": "397ea76b-8bbd-4602-b966-cf7331d13e9f", "address": "fa:16:3e:61:64:15", "network": {"id": "63ea02b8-a8de-4680-a96b-496a4480c84e", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1311691765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap397ea76b-8b", "ovs_interfaceid": "397ea76b-8bbd-4602-b966-cf7331d13e9f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c165877a-edce-4fec-8aa4-e7708b384676", "address": "fa:16:3e:fd:7f:88", "network": {"id": "13d2edf3-6d96-4829-8c78-2dee6654aac3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1748402198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc165877a-ed", "ovs_interfaceid": "c165877a-edce-4fec-8aa4-e7708b384676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "22ffe1b4-8207-4909-b0ba-0db5dc955912", "address": "fa:16:3e:40:11:5a", "network": {"id": "13d2edf3-6d96-4829-8c78-2dee6654aac3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1748402198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ffe1b4-82", "ovs_interfaceid": "22ffe1b4-8207-4909-b0ba-0db5dc955912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "88d012e5-b40e-4398-99a1-14b37a890c47", "address": "fa:16:3e:ff:a2:52", "network": {"id": "13d2edf3-6d96-4829-8c78-2dee6654aac3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1748402198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88d012e5-b4", "ovs_interfaceid": "88d012e5-b40e-4398-99a1-14b37a890c47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:32:47 user nova-compute[73391]: DEBUG nova.compute.manager [req-aaa01675-93ee-417d-9bf9-65b694d15636 req-4bd4be0d-5bb7-4445-b779-34475b9e6684 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Detach interface failed, port_id=544b22aa-6b69-4b4d-985f-19bdc248d641, reason: Instance da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb could not be found. {{(pid=73391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 05:32:47 user nova-compute[73391]: DEBUG nova.compute.manager [req-aaa01675-93ee-417d-9bf9-65b694d15636 req-4bd4be0d-5bb7-4445-b779-34475b9e6684 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received event network-vif-deleted-397ea76b-8bbd-4602-b966-cf7331d13e9f {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:32:47 user nova-compute[73391]: INFO nova.compute.manager [req-aaa01675-93ee-417d-9bf9-65b694d15636 req-4bd4be0d-5bb7-4445-b779-34475b9e6684 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Neutron deleted interface 397ea76b-8bbd-4602-b966-cf7331d13e9f; detaching it from the instance and deleting it from the info cache
Aug 15 05:32:47 user nova-compute[73391]: DEBUG nova.network.neutron [req-aaa01675-93ee-417d-9bf9-65b694d15636 req-4bd4be0d-5bb7-4445-b779-34475b9e6684 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Updating instance_info_cache with network_info: [{"id": "c165877a-edce-4fec-8aa4-e7708b384676", "address": "fa:16:3e:fd:7f:88", "network": {"id": "13d2edf3-6d96-4829-8c78-2dee6654aac3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1748402198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.109", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc165877a-ed", "ovs_interfaceid": "c165877a-edce-4fec-8aa4-e7708b384676", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "22ffe1b4-8207-4909-b0ba-0db5dc955912", "address": "fa:16:3e:40:11:5a", "network": {"id": "13d2edf3-6d96-4829-8c78-2dee6654aac3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1748402198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.191", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap22ffe1b4-82", "ovs_interfaceid": "22ffe1b4-8207-4909-b0ba-0db5dc955912", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "88d012e5-b40e-4398-99a1-14b37a890c47", "address": "fa:16:3e:ff:a2:52", "network": {"id": "13d2edf3-6d96-4829-8c78-2dee6654aac3", "bridge": "br-int", "label": "tempest-device-tagging-net1-1748402198", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.52", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "49eba1f86e8c412e81feba30657c278a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88d012e5-b4", "ovs_interfaceid": "88d012e5-b40e-4398-99a1-14b37a890c47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:32:47 user nova-compute[73391]: DEBUG nova.compute.manager [req-aaa01675-93ee-417d-9bf9-65b694d15636 req-4bd4be0d-5bb7-4445-b779-34475b9e6684 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Detach interface failed, port_id=397ea76b-8bbd-4602-b966-cf7331d13e9f, reason: Instance da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb could not be found. {{(pid=73391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 05:32:47 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:32:48 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Took 5.00 seconds to deallocate network for instance.
Aug 15 05:32:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:49 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692077554.8413866, 7b7704e3-f48b-473c-89ae-5437a690f06a => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:32:49 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] VM Stopped (Lifecycle Event)
Aug 15 05:32:49 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3820c47d-0ff0-4923-aa3f-ef6c008784e6 None None] [instance: 7b7704e3-f48b-473c-89ae-5437a690f06a] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:32:49 user nova-compute[73391]: DEBUG nova.compute.manager [req-d10e0a86-ca8f-4d2f-9cb1-622b7aa1d1e7 req-18c8511c-0243-428a-98d5-00112c1b5f56 service nova] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Received event network-vif-deleted-88d012e5-b40e-4398-99a1-14b37a890c47 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:32:50 user nova-compute[73391]: INFO nova.compute.manager [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Took 2.46 seconds to detach 3 volumes for instance.
Aug 15 05:32:50 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:50 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:50 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:32:50 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:32:50 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.343s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:50 user nova-compute[73391]: INFO nova.scheduler.client.report [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Deleted allocations for instance da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb
Aug 15 05:32:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0dc6a1a2-b03a-4a40-8ae7-b1a1cf8ec284 tempest-TaggedBootDevicesTest-2085483445 tempest-TaggedBootDevicesTest-2085483445-project-member] Lock "da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.689s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Acquiring lock "ad326342-29f1-4665-bc1b-7e8623751ddc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Lock "ad326342-29f1-4665-bc1b-7e8623751ddc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:51 user nova-compute[73391]: DEBUG nova.compute.manager [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Starting instance... {{(pid=73391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 05:32:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:51 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:51 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 05:32:51 user nova-compute[73391]: INFO nova.compute.claims [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Claim successful on node user
Aug 15 05:32:51 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:51 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:32:51 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:32:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.389s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:51 user nova-compute[73391]: DEBUG nova.compute.manager [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Start building networks asynchronously for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 05:32:52 user nova-compute[73391]: DEBUG nova.compute.manager [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Allocating IP information in the background. {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 05:32:52 user nova-compute[73391]: DEBUG nova.network.neutron [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] allocate_for_instance() {{(pid=73391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 05:32:52 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 05:32:52 user nova-compute[73391]: DEBUG nova.compute.manager [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Start building block device mappings for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 05:32:52 user nova-compute[73391]: DEBUG nova.policy [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1ec3b8ac7ed748b49325a372f164f931', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d2058584e624e869bf316e4cee4d669', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73391) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 05:32:52 user nova-compute[73391]: DEBUG nova.compute.manager [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Start spawning the instance on the hypervisor. {{(pid=73391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 05:32:52 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Creating instance directory {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 05:32:52 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Creating image(s)
Aug 15 05:32:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Acquiring lock "/opt/stack/data/nova/instances/ad326342-29f1-4665-bc1b-7e8623751ddc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Lock "/opt/stack/data/nova/instances/ad326342-29f1-4665-bc1b-7e8623751ddc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Lock "/opt/stack/data/nova/instances/ad326342-29f1-4665-bc1b-7e8623751ddc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.215s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Acquiring lock "999b315ba87151d8252d543312ae7790e7e1583b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.202s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/ad326342-29f1-4665-bc1b-7e8623751ddc/disk 1073741824 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/ad326342-29f1-4665-bc1b-7e8623751ddc/disk 1073741824" returned: 0 in 0.063s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:52 user nova-compute[73391]: DEBUG nova.network.neutron [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Successfully created port: f5385666-bfb5-4bc5-89eb-011bf055eefd {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 05:32:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.184s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:52 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ad326342-29f1-4665-bc1b-7e8623751ddc/disk. size=1073741824 {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 05:32:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad326342-29f1-4665-bc1b-7e8623751ddc/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:53 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad326342-29f1-4665-bc1b-7e8623751ddc/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:53 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Cannot resize image /opt/stack/data/nova/instances/ad326342-29f1-4665-bc1b-7e8623751ddc/disk to a smaller size. {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 05:32:53 user nova-compute[73391]: DEBUG nova.objects.instance [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Lazy-loading 'migration_context' on Instance uuid ad326342-29f1-4665-bc1b-7e8623751ddc {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:32:53 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Created local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 05:32:53 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Ensure instance console log exists: /opt/stack/data/nova/instances/ad326342-29f1-4665-bc1b-7e8623751ddc/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 05:32:53 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:53 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:53 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:53 user nova-compute[73391]: DEBUG nova.network.neutron [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Successfully updated port: f5385666-bfb5-4bc5-89eb-011bf055eefd {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:32:53 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Acquiring lock "refresh_cache-ad326342-29f1-4665-bc1b-7e8623751ddc" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:32:53 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Acquired lock "refresh_cache-ad326342-29f1-4665-bc1b-7e8623751ddc" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:32:53 user nova-compute[73391]: DEBUG nova.network.neutron [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:32:53 user nova-compute[73391]: DEBUG nova.compute.manager [req-d0bae20a-ea82-44de-bf58-6968e78beb50 req-a9628df3-c19f-48fb-a43d-9db7df72782b service nova] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Received event network-changed-f5385666-bfb5-4bc5-89eb-011bf055eefd {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:32:53 user nova-compute[73391]: DEBUG nova.compute.manager [req-d0bae20a-ea82-44de-bf58-6968e78beb50 req-a9628df3-c19f-48fb-a43d-9db7df72782b service nova] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Refreshing instance network info cache due to event network-changed-f5385666-bfb5-4bc5-89eb-011bf055eefd. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:32:53 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d0bae20a-ea82-44de-bf58-6968e78beb50 req-a9628df3-c19f-48fb-a43d-9db7df72782b service nova] Acquiring lock "refresh_cache-ad326342-29f1-4665-bc1b-7e8623751ddc" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:32:53 user nova-compute[73391]: DEBUG nova.network.neutron [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:32:53 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:54 user nova-compute[73391]: DEBUG nova.network.neutron [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Updating instance_info_cache with network_info: [{"id": "f5385666-bfb5-4bc5-89eb-011bf055eefd", "address": "fa:16:3e:61:5c:ad", "network": {"id": "f69631d8-9da0-4c6d-8530-e8c455942703", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-108520740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d2058584e624e869bf316e4cee4d669", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5385666-bf", "ovs_interfaceid": "f5385666-bfb5-4bc5-89eb-011bf055eefd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:32:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Releasing lock "refresh_cache-ad326342-29f1-4665-bc1b-7e8623751ddc" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:32:54 user nova-compute[73391]: DEBUG nova.compute.manager [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Instance network_info: |[{"id": "f5385666-bfb5-4bc5-89eb-011bf055eefd", "address": "fa:16:3e:61:5c:ad", "network": {"id": "f69631d8-9da0-4c6d-8530-e8c455942703", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-108520740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d2058584e624e869bf316e4cee4d669", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5385666-bf", "ovs_interfaceid": "f5385666-bfb5-4bc5-89eb-011bf055eefd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 05:32:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d0bae20a-ea82-44de-bf58-6968e78beb50 req-a9628df3-c19f-48fb-a43d-9db7df72782b service nova] Acquired lock "refresh_cache-ad326342-29f1-4665-bc1b-7e8623751ddc" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:32:54 user nova-compute[73391]: DEBUG nova.network.neutron [req-d0bae20a-ea82-44de-bf58-6968e78beb50 req-a9628df3-c19f-48fb-a43d-9db7df72782b service nova] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Refreshing network info cache for port f5385666-bfb5-4bc5-89eb-011bf055eefd {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:32:54 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Start _get_guest_xml network_info=[{"id": "f5385666-bfb5-4bc5-89eb-011bf055eefd", "address": "fa:16:3e:61:5c:ad", "network": {"id": "f69631d8-9da0-4c6d-8530-e8c455942703", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-108520740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d2058584e624e869bf316e4cee4d669", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5385666-bf", "ovs_interfaceid": "f5385666-bfb5-4bc5-89eb-011bf055eefd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '191b1dad-305e-4d1c-9b15-515ec59a3278'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:32:54 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:32:54 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:32:54 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:32:54 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:32:54 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:32:54 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:32:54 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:32:54 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:32:54 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:32:54 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:32:54 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:32:54 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:32:54 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:32:54 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:32:54 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:32:54 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:32:54 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:32:54 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:32:54 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:32:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-506140877',display_name='tempest-VolumesAdminNegativeTest-server-506140877',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-506140877',id=13,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d2058584e624e869bf316e4cee4d669',ramdisk_id='',reservation_id='r-r68vp03g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1183783318',owner_user_name='tempest-VolumesAdminNegativeTest-1183783318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:32:52Z,user_data=None,user_id='1ec3b8ac7ed748b49325a372f164f931',uuid=ad326342-29f1-4665-bc1b-7e8623751ddc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5385666-bfb5-4bc5-89eb-011bf055eefd", "address": "fa:16:3e:61:5c:ad", "network": {"id": "f69631d8-9da0-4c6d-8530-e8c455942703", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-108520740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d2058584e624e869bf316e4cee4d669", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5385666-bf", "ovs_interfaceid": "f5385666-bfb5-4bc5-89eb-011bf055eefd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:32:54 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Converting VIF {"id": "f5385666-bfb5-4bc5-89eb-011bf055eefd", "address": "fa:16:3e:61:5c:ad", "network": {"id": "f69631d8-9da0-4c6d-8530-e8c455942703", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-108520740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d2058584e624e869bf316e4cee4d669", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5385666-bf", "ovs_interfaceid": "f5385666-bfb5-4bc5-89eb-011bf055eefd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:32:54 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:5c:ad,bridge_name='br-int',has_traffic_filtering=True,id=f5385666-bfb5-4bc5-89eb-011bf055eefd,network=Network(f69631d8-9da0-4c6d-8530-e8c455942703),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5385666-bf') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:32:54 user nova-compute[73391]: DEBUG nova.objects.instance [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Lazy-loading 'pci_devices' on Instance uuid ad326342-29f1-4665-bc1b-7e8623751ddc {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:32:54 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:32:54 user nova-compute[73391]:   <uuid>ad326342-29f1-4665-bc1b-7e8623751ddc</uuid>
Aug 15 05:32:54 user nova-compute[73391]:   <name>instance-0000000d</name>
Aug 15 05:32:54 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:32:54 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:32:54 user nova-compute[73391]:   <metadata>
Aug 15 05:32:54 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:32:54 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:32:54 user nova-compute[73391]:       <nova:name>tempest-VolumesAdminNegativeTest-server-506140877</nova:name>
Aug 15 05:32:54 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:32:54</nova:creationTime>
Aug 15 05:32:54 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:32:54 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:32:54 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:32:54 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:32:54 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:32:54 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:32:54 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:32:54 user nova-compute[73391]:       <nova:owner>
Aug 15 05:32:54 user nova-compute[73391]:         <nova:user uuid="1ec3b8ac7ed748b49325a372f164f931">tempest-VolumesAdminNegativeTest-1183783318-project-member</nova:user>
Aug 15 05:32:54 user nova-compute[73391]:         <nova:project uuid="9d2058584e624e869bf316e4cee4d669">tempest-VolumesAdminNegativeTest-1183783318</nova:project>
Aug 15 05:32:54 user nova-compute[73391]:       </nova:owner>
Aug 15 05:32:54 user nova-compute[73391]:       <nova:root type="image" uuid="191b1dad-305e-4d1c-9b15-515ec59a3278"/>
Aug 15 05:32:54 user nova-compute[73391]:       <nova:ports>
Aug 15 05:32:54 user nova-compute[73391]:         <nova:port uuid="f5385666-bfb5-4bc5-89eb-011bf055eefd">
Aug 15 05:32:54 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 05:32:54 user nova-compute[73391]:         </nova:port>
Aug 15 05:32:54 user nova-compute[73391]:       </nova:ports>
Aug 15 05:32:54 user nova-compute[73391]:     </nova:instance>
Aug 15 05:32:54 user nova-compute[73391]:   </metadata>
Aug 15 05:32:54 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:32:54 user nova-compute[73391]:     <system>
Aug 15 05:32:54 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:32:54 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:32:54 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:32:54 user nova-compute[73391]:       <entry name="serial">ad326342-29f1-4665-bc1b-7e8623751ddc</entry>
Aug 15 05:32:54 user nova-compute[73391]:       <entry name="uuid">ad326342-29f1-4665-bc1b-7e8623751ddc</entry>
Aug 15 05:32:54 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:32:54 user nova-compute[73391]:     </system>
Aug 15 05:32:54 user nova-compute[73391]:   </sysinfo>
Aug 15 05:32:54 user nova-compute[73391]:   <os>
Aug 15 05:32:54 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:32:54 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:32:54 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:32:54 user nova-compute[73391]:   </os>
Aug 15 05:32:54 user nova-compute[73391]:   <features>
Aug 15 05:32:54 user nova-compute[73391]:     <acpi/>
Aug 15 05:32:54 user nova-compute[73391]:     <apic/>
Aug 15 05:32:54 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:32:54 user nova-compute[73391]:   </features>
Aug 15 05:32:54 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:32:54 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:32:54 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:32:54 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:32:54 user nova-compute[73391]:   </clock>
Aug 15 05:32:54 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:32:54 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:32:54 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:32:54 user nova-compute[73391]:   </cpu>
Aug 15 05:32:54 user nova-compute[73391]:   <devices>
Aug 15 05:32:54 user nova-compute[73391]:     <disk type="file" device="disk">
Aug 15 05:32:54 user nova-compute[73391]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 05:32:54 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/ad326342-29f1-4665-bc1b-7e8623751ddc/disk"/>
Aug 15 05:32:54 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:32:54 user nova-compute[73391]:     </disk>
Aug 15 05:32:54 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:32:54 user nova-compute[73391]:       <mac address="fa:16:3e:61:5c:ad"/>
Aug 15 05:32:54 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:32:54 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:32:54 user nova-compute[73391]:       <target dev="tapf5385666-bf"/>
Aug 15 05:32:54 user nova-compute[73391]:     </interface>
Aug 15 05:32:54 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:32:54 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/ad326342-29f1-4665-bc1b-7e8623751ddc/console.log" append="off"/>
Aug 15 05:32:54 user nova-compute[73391]:     </serial>
Aug 15 05:32:54 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:32:54 user nova-compute[73391]:     <video>
Aug 15 05:32:54 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:32:54 user nova-compute[73391]:     </video>
Aug 15 05:32:54 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:32:54 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:32:54 user nova-compute[73391]:     </rng>
Aug 15 05:32:54 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:32:54 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:32:54 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:32:54 user nova-compute[73391]:     </memballoon>
Aug 15 05:32:54 user nova-compute[73391]:   </devices>
Aug 15 05:32:54 user nova-compute[73391]: </domain>
Aug 15 05:32:54 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:32:54 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:32:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-506140877',display_name='tempest-VolumesAdminNegativeTest-server-506140877',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-506140877',id=13,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d2058584e624e869bf316e4cee4d669',ramdisk_id='',reservation_id='r-r68vp03g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1183783318',owner_user_name='tempest-VolumesAdminNegativeTest-1183783318-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:32:52Z,user_data=None,user_id='1ec3b8ac7ed748b49325a372f164f931',uuid=ad326342-29f1-4665-bc1b-7e8623751ddc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5385666-bfb5-4bc5-89eb-011bf055eefd", "address": "fa:16:3e:61:5c:ad", "network": {"id": "f69631d8-9da0-4c6d-8530-e8c455942703", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-108520740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d2058584e624e869bf316e4cee4d669", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5385666-bf", "ovs_interfaceid": "f5385666-bfb5-4bc5-89eb-011bf055eefd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:32:54 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Converting VIF {"id": "f5385666-bfb5-4bc5-89eb-011bf055eefd", "address": "fa:16:3e:61:5c:ad", "network": {"id": "f69631d8-9da0-4c6d-8530-e8c455942703", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-108520740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d2058584e624e869bf316e4cee4d669", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5385666-bf", "ovs_interfaceid": "f5385666-bfb5-4bc5-89eb-011bf055eefd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:32:54 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:5c:ad,bridge_name='br-int',has_traffic_filtering=True,id=f5385666-bfb5-4bc5-89eb-011bf055eefd,network=Network(f69631d8-9da0-4c6d-8530-e8c455942703),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5385666-bf') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:32:54 user nova-compute[73391]: DEBUG os_vif [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:5c:ad,bridge_name='br-int',has_traffic_filtering=True,id=f5385666-bfb5-4bc5-89eb-011bf055eefd,network=Network(f69631d8-9da0-4c6d-8530-e8c455942703),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5385666-bf') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:32:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:32:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:32:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf5385666-bf, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:32:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf5385666-bf, col_values=(('external_ids', {'iface-id': 'f5385666-bfb5-4bc5-89eb-011bf055eefd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:61:5c:ad', 'vm-uuid': 'ad326342-29f1-4665-bc1b-7e8623751ddc'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:32:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:32:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:54 user nova-compute[73391]: INFO os_vif [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:5c:ad,bridge_name='br-int',has_traffic_filtering=True,id=f5385666-bfb5-4bc5-89eb-011bf055eefd,network=Network(f69631d8-9da0-4c6d-8530-e8c455942703),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5385666-bf')
Aug 15 05:32:54 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:32:54 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] No VIF found with MAC fa:16:3e:61:5c:ad, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:32:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:54 user nova-compute[73391]: DEBUG nova.network.neutron [req-d0bae20a-ea82-44de-bf58-6968e78beb50 req-a9628df3-c19f-48fb-a43d-9db7df72782b service nova] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Updated VIF entry in instance network info cache for port f5385666-bfb5-4bc5-89eb-011bf055eefd. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:32:54 user nova-compute[73391]: DEBUG nova.network.neutron [req-d0bae20a-ea82-44de-bf58-6968e78beb50 req-a9628df3-c19f-48fb-a43d-9db7df72782b service nova] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Updating instance_info_cache with network_info: [{"id": "f5385666-bfb5-4bc5-89eb-011bf055eefd", "address": "fa:16:3e:61:5c:ad", "network": {"id": "f69631d8-9da0-4c6d-8530-e8c455942703", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-108520740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d2058584e624e869bf316e4cee4d669", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5385666-bf", "ovs_interfaceid": "f5385666-bfb5-4bc5-89eb-011bf055eefd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:32:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d0bae20a-ea82-44de-bf58-6968e78beb50 req-a9628df3-c19f-48fb-a43d-9db7df72782b service nova] Releasing lock "refresh_cache-ad326342-29f1-4665-bc1b-7e8623751ddc" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:32:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:56 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692077561.2060962, da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:32:56 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] VM Stopped (Lifecycle Event)
Aug 15 05:32:56 user nova-compute[73391]: DEBUG nova.compute.manager [None req-4098b38a-4bca-4560-ab93-3723fce9e2ba None None] [instance: da8f0dc4-a6cd-46a6-a9b5-fa70fee2b2fb] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:32:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Acquiring lock "a397a3f0-9b98-4e2b-87a0-f5ff85247c11" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Lock "a397a3f0-9b98-4e2b-87a0-f5ff85247c11" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:57 user nova-compute[73391]: DEBUG nova.compute.manager [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Starting instance... {{(pid=73391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 05:32:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:57 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 05:32:57 user nova-compute[73391]: INFO nova.compute.claims [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Claim successful on node user
Aug 15 05:32:57 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:32:57 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:32:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.629s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:57 user nova-compute[73391]: DEBUG nova.compute.manager [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Start building networks asynchronously for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 05:32:57 user nova-compute[73391]: DEBUG nova.compute.manager [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Allocating IP information in the background. {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 05:32:57 user nova-compute[73391]: DEBUG nova.network.neutron [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] allocate_for_instance() {{(pid=73391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 05:32:58 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 05:32:58 user nova-compute[73391]: DEBUG nova.compute.manager [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Start building block device mappings for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 05:32:58 user nova-compute[73391]: INFO nova.virt.block_device [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Booting with volume c9c0ff64-aff4-4c9a-b939-400975c79c52 at /dev/vda
Aug 15 05:32:58 user nova-compute[73391]: DEBUG nova.policy [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f78657dfe187469faa75e7210792871b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'becd05a5b0824a208cd692d8505ea05e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73391) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 05:32:58 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077578.1335273, ad326342-29f1-4665-bc1b-7e8623751ddc => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:32:58 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] VM Resumed (Lifecycle Event)
Aug 15 05:32:58 user nova-compute[73391]: DEBUG nova.compute.manager [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:32:58 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Guest created on hypervisor {{(pid=73391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 05:32:58 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Instance spawned successfully.
Aug 15 05:32:58 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 05:32:58 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:32:58 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:32:58 user nova-compute[73391]: DEBUG os_brick.utils [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:32:58 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Found default for hw_cdrom_bus of ide {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:32:58 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Found default for hw_disk_bus of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:32:58 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Found default for hw_input_bus of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:32:58 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Found default for hw_pointer_model of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:32:58 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Found default for hw_video_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:32:58 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Found default for hw_vif_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:32:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:58 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:32:58 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077578.135173, ad326342-29f1-4665-bc1b-7e8623751ddc => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:32:58 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] VM Started (Lifecycle Event)
Aug 15 05:32:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:58 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42e930b-1e2c-46e3-a6eb-4801c8d32364]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:58 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:32:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:58 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[00922388-c88c-4b9c-8423-34ce7119f845]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:58 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:32:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:32:58 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7822e02b-a4f9-42f7-b85d-cbf000b9b0ef]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:58 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:32:58 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[08c25664-af70-4e36-8dc0-89be90b1e3ad]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:32:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 05:32:58 user nova-compute[73391]: INFO nova.compute.manager [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Took 6.09 seconds to spawn the instance on the hypervisor.
Aug 15 05:32:58 user nova-compute[73391]: DEBUG nova.compute.manager [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:32:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:32:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:32:58 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 05:32:58 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5677acb0-1329-48c4-a8db-b700bac15449]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:32:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 05:32:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 05:32:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 05:32:58 user nova-compute[73391]: DEBUG os_brick.utils [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] <== get_connector_properties: return (222ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:32:58 user nova-compute[73391]: DEBUG nova.virt.block_device [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Updating existing volume attachment record: 86519fe2-975c-4808-9e09-bae46b05e3e6 {{(pid=73391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 05:32:58 user nova-compute[73391]: INFO nova.compute.manager [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Took 6.94 seconds to build instance.
Aug 15 05:32:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e6f12a34-30aa-4ec6-bf7e-c3634efb9a98 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Lock "ad326342-29f1-4665-bc1b-7e8623751ddc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.037s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:59 user nova-compute[73391]: DEBUG nova.network.neutron [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Successfully created port: f757ece4-baa7-4593-8327-d5fee9aa2d1a {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 05:32:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:32:59 user nova-compute[73391]: DEBUG nova.compute.manager [req-a9d75060-a553-4f9a-b414-b883efb55b0e req-ac78976e-c13f-47af-a2f3-045448eca9e4 service nova] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Received event network-vif-plugged-f5385666-bfb5-4bc5-89eb-011bf055eefd {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:32:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-a9d75060-a553-4f9a-b414-b883efb55b0e req-ac78976e-c13f-47af-a2f3-045448eca9e4 service nova] Acquiring lock "ad326342-29f1-4665-bc1b-7e8623751ddc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:32:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-a9d75060-a553-4f9a-b414-b883efb55b0e req-ac78976e-c13f-47af-a2f3-045448eca9e4 service nova] Lock "ad326342-29f1-4665-bc1b-7e8623751ddc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:32:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-a9d75060-a553-4f9a-b414-b883efb55b0e req-ac78976e-c13f-47af-a2f3-045448eca9e4 service nova] Lock "ad326342-29f1-4665-bc1b-7e8623751ddc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:32:59 user nova-compute[73391]: DEBUG nova.compute.manager [req-a9d75060-a553-4f9a-b414-b883efb55b0e req-ac78976e-c13f-47af-a2f3-045448eca9e4 service nova] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] No waiting events found dispatching network-vif-plugged-f5385666-bfb5-4bc5-89eb-011bf055eefd {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:32:59 user nova-compute[73391]: WARNING nova.compute.manager [req-a9d75060-a553-4f9a-b414-b883efb55b0e req-ac78976e-c13f-47af-a2f3-045448eca9e4 service nova] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Received unexpected event network-vif-plugged-f5385666-bfb5-4bc5-89eb-011bf055eefd for instance with vm_state active and task_state None.
Aug 15 05:33:00 user nova-compute[73391]: DEBUG nova.network.neutron [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Successfully updated port: f757ece4-baa7-4593-8327-d5fee9aa2d1a {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:33:00 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Acquiring lock "refresh_cache-a397a3f0-9b98-4e2b-87a0-f5ff85247c11" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:33:00 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Acquired lock "refresh_cache-a397a3f0-9b98-4e2b-87a0-f5ff85247c11" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:33:00 user nova-compute[73391]: DEBUG nova.network.neutron [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:33:00 user nova-compute[73391]: DEBUG nova.compute.manager [req-f1d020a3-7fbc-4572-9189-324304dc6d5c req-643d8282-82ff-443b-9f31-96bb9440c181 service nova] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Received event network-changed-f757ece4-baa7-4593-8327-d5fee9aa2d1a {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:33:00 user nova-compute[73391]: DEBUG nova.compute.manager [req-f1d020a3-7fbc-4572-9189-324304dc6d5c req-643d8282-82ff-443b-9f31-96bb9440c181 service nova] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Refreshing instance network info cache due to event network-changed-f757ece4-baa7-4593-8327-d5fee9aa2d1a. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:33:00 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f1d020a3-7fbc-4572-9189-324304dc6d5c req-643d8282-82ff-443b-9f31-96bb9440c181 service nova] Acquiring lock "refresh_cache-a397a3f0-9b98-4e2b-87a0-f5ff85247c11" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:33:00 user nova-compute[73391]: DEBUG nova.network.neutron [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:33:00 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-1d004e95-b1e6-49c7-8dca-0133235ae9aa tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Acquiring lock "ee96866e-7ee0-46a1-be1a-60439a52d513" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:00 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-1d004e95-b1e6-49c7-8dca-0133235ae9aa tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Lock "ee96866e-7ee0-46a1-be1a-60439a52d513" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:00 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-1d004e95-b1e6-49c7-8dca-0133235ae9aa tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Acquiring lock "ee96866e-7ee0-46a1-be1a-60439a52d513-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:00 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-1d004e95-b1e6-49c7-8dca-0133235ae9aa tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Lock "ee96866e-7ee0-46a1-be1a-60439a52d513-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:00 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-1d004e95-b1e6-49c7-8dca-0133235ae9aa tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Lock "ee96866e-7ee0-46a1-be1a-60439a52d513-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:00 user nova-compute[73391]: INFO nova.compute.manager [None req-1d004e95-b1e6-49c7-8dca-0133235ae9aa tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Terminating instance
Aug 15 05:33:00 user nova-compute[73391]: DEBUG nova.compute.manager [None req-1d004e95-b1e6-49c7-8dca-0133235ae9aa tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Start destroying the instance on the hypervisor. {{(pid=73391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 05:33:00 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:00 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:00 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:00 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:00 user nova-compute[73391]: DEBUG nova.network.neutron [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Updating instance_info_cache with network_info: [{"id": "f757ece4-baa7-4593-8327-d5fee9aa2d1a", "address": "fa:16:3e:3a:0d:16", "network": {"id": "843ec1f3-c64d-4564-a801-0bee7beb4d42", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1999293789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "becd05a5b0824a208cd692d8505ea05e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf757ece4-ba", "ovs_interfaceid": "f757ece4-baa7-4593-8327-d5fee9aa2d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:33:01 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Releasing lock "refresh_cache-a397a3f0-9b98-4e2b-87a0-f5ff85247c11" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:33:01 user nova-compute[73391]: DEBUG nova.compute.manager [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Instance network_info: |[{"id": "f757ece4-baa7-4593-8327-d5fee9aa2d1a", "address": "fa:16:3e:3a:0d:16", "network": {"id": "843ec1f3-c64d-4564-a801-0bee7beb4d42", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1999293789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "becd05a5b0824a208cd692d8505ea05e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf757ece4-ba", "ovs_interfaceid": "f757ece4-baa7-4593-8327-d5fee9aa2d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 05:33:01 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f1d020a3-7fbc-4572-9189-324304dc6d5c req-643d8282-82ff-443b-9f31-96bb9440c181 service nova] Acquired lock "refresh_cache-a397a3f0-9b98-4e2b-87a0-f5ff85247c11" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:33:01 user nova-compute[73391]: DEBUG nova.network.neutron [req-f1d020a3-7fbc-4572-9189-324304dc6d5c req-643d8282-82ff-443b-9f31-96bb9440c181 service nova] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Refreshing network info cache for port f757ece4-baa7-4593-8327-d5fee9aa2d1a {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:33:01 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Instance destroyed successfully.
Aug 15 05:33:01 user nova-compute[73391]: DEBUG nova.objects.instance [None req-1d004e95-b1e6-49c7-8dca-0133235ae9aa tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Lazy-loading 'resources' on Instance uuid ee96866e-7ee0-46a1-be1a-60439a52d513 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:33:01 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-1d004e95-b1e6-49c7-8dca-0133235ae9aa tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:29:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1135218455',display_name='tempest-VolumesAssistedSnapshotsTest-server-1135218455',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1135218455',id=8,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRy+f7MPRDFS/U6ge+o4VPuiEFdU7mGrHQ/7QrsqnD/O32WSuBs8IIvB8X63CpuMp/gPmQfyxhfZ97C7/qCgpEDZGVwx3+hWZq2I/WGX9pjRfizPn/lWrGKvXDP6LRBbg==',key_name='tempest-keypair-249089032',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:30:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2ff822a831e849e69cc772f2ff4b2c20',ramdisk_id='',reservation_id='r-l2ztsgo2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1454195170',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1454195170-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:30:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='58ec85e797fc4986ab7e771c98a56d67',uuid=ee96866e-7ee0-46a1-be1a-60439a52d513,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b6fe7cdf-66e0-40f5-a5df-b99d43175add", "address": "fa:16:3e:8d:8f:8c", "network": {"id": "d89ed364-c0b3-48b2-a677-2e3010aae495", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1213690697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff822a831e849e69cc772f2ff4b2c20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6fe7cdf-66", "ovs_interfaceid": "b6fe7cdf-66e0-40f5-a5df-b99d43175add", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:33:01 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-1d004e95-b1e6-49c7-8dca-0133235ae9aa tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Converting VIF {"id": "b6fe7cdf-66e0-40f5-a5df-b99d43175add", "address": "fa:16:3e:8d:8f:8c", "network": {"id": "d89ed364-c0b3-48b2-a677-2e3010aae495", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1213690697-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2ff822a831e849e69cc772f2ff4b2c20", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6fe7cdf-66", "ovs_interfaceid": "b6fe7cdf-66e0-40f5-a5df-b99d43175add", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:33:01 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-1d004e95-b1e6-49c7-8dca-0133235ae9aa tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:8f:8c,bridge_name='br-int',has_traffic_filtering=True,id=b6fe7cdf-66e0-40f5-a5df-b99d43175add,network=Network(d89ed364-c0b3-48b2-a677-2e3010aae495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6fe7cdf-66') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:33:01 user nova-compute[73391]: DEBUG os_vif [None req-1d004e95-b1e6-49c7-8dca-0133235ae9aa tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:8f:8c,bridge_name='br-int',has_traffic_filtering=True,id=b6fe7cdf-66e0-40f5-a5df-b99d43175add,network=Network(d89ed364-c0b3-48b2-a677-2e3010aae495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6fe7cdf-66') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:33:01 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:01 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb6fe7cdf-66, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:33:01 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:01 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:33:01 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:01 user nova-compute[73391]: INFO os_vif [None req-1d004e95-b1e6-49c7-8dca-0133235ae9aa tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:8f:8c,bridge_name='br-int',has_traffic_filtering=True,id=b6fe7cdf-66e0-40f5-a5df-b99d43175add,network=Network(d89ed364-c0b3-48b2-a677-2e3010aae495),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6fe7cdf-66')
Aug 15 05:33:01 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-1d004e95-b1e6-49c7-8dca-0133235ae9aa tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Deleting instance files /opt/stack/data/nova/instances/ee96866e-7ee0-46a1-be1a-60439a52d513_del
Aug 15 05:33:01 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-1d004e95-b1e6-49c7-8dca-0133235ae9aa tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Deletion of /opt/stack/data/nova/instances/ee96866e-7ee0-46a1-be1a-60439a52d513_del complete
Aug 15 05:33:01 user nova-compute[73391]: DEBUG nova.compute.manager [req-46622c75-5548-4d8e-8d00-2448b17eadfa req-b8b8d2d1-cba1-4f80-b5d0-9cef9884600a service nova] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Received event network-vif-plugged-f5385666-bfb5-4bc5-89eb-011bf055eefd {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:33:01 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-46622c75-5548-4d8e-8d00-2448b17eadfa req-b8b8d2d1-cba1-4f80-b5d0-9cef9884600a service nova] Acquiring lock "ad326342-29f1-4665-bc1b-7e8623751ddc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:01 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-46622c75-5548-4d8e-8d00-2448b17eadfa req-b8b8d2d1-cba1-4f80-b5d0-9cef9884600a service nova] Lock "ad326342-29f1-4665-bc1b-7e8623751ddc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:01 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-46622c75-5548-4d8e-8d00-2448b17eadfa req-b8b8d2d1-cba1-4f80-b5d0-9cef9884600a service nova] Lock "ad326342-29f1-4665-bc1b-7e8623751ddc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:01 user nova-compute[73391]: DEBUG nova.compute.manager [req-46622c75-5548-4d8e-8d00-2448b17eadfa req-b8b8d2d1-cba1-4f80-b5d0-9cef9884600a service nova] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] No waiting events found dispatching network-vif-plugged-f5385666-bfb5-4bc5-89eb-011bf055eefd {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:33:01 user nova-compute[73391]: WARNING nova.compute.manager [req-46622c75-5548-4d8e-8d00-2448b17eadfa req-b8b8d2d1-cba1-4f80-b5d0-9cef9884600a service nova] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Received unexpected event network-vif-plugged-f5385666-bfb5-4bc5-89eb-011bf055eefd for instance with vm_state active and task_state None.
Aug 15 05:33:01 user nova-compute[73391]: INFO nova.compute.manager [None req-1d004e95-b1e6-49c7-8dca-0133235ae9aa tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 15 05:33:01 user nova-compute[73391]: DEBUG oslo.service.loopingcall [None req-1d004e95-b1e6-49c7-8dca-0133235ae9aa tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 05:33:01 user nova-compute[73391]: DEBUG nova.compute.manager [-] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Deallocating network for instance {{(pid=73391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 05:33:01 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] deallocate_for_instance() {{(pid=73391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 05:33:01 user nova-compute[73391]: DEBUG nova.network.neutron [req-f1d020a3-7fbc-4572-9189-324304dc6d5c req-643d8282-82ff-443b-9f31-96bb9440c181 service nova] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Updated VIF entry in instance network info cache for port f757ece4-baa7-4593-8327-d5fee9aa2d1a. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:33:01 user nova-compute[73391]: DEBUG nova.network.neutron [req-f1d020a3-7fbc-4572-9189-324304dc6d5c req-643d8282-82ff-443b-9f31-96bb9440c181 service nova] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Updating instance_info_cache with network_info: [{"id": "f757ece4-baa7-4593-8327-d5fee9aa2d1a", "address": "fa:16:3e:3a:0d:16", "network": {"id": "843ec1f3-c64d-4564-a801-0bee7beb4d42", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1999293789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "becd05a5b0824a208cd692d8505ea05e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf757ece4-ba", "ovs_interfaceid": "f757ece4-baa7-4593-8327-d5fee9aa2d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:33:01 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f1d020a3-7fbc-4572-9189-324304dc6d5c req-643d8282-82ff-443b-9f31-96bb9440c181 service nova] Releasing lock "refresh_cache-a397a3f0-9b98-4e2b-87a0-f5ff85247c11" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:33:02 user nova-compute[73391]: DEBUG nova.compute.manager [req-38f82cd9-58c9-4da1-916d-190c5312c4e6 req-d55d49a3-b915-485d-aa57-b1b560ede745 service nova] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Received event network-vif-unplugged-b6fe7cdf-66e0-40f5-a5df-b99d43175add {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:33:02 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-38f82cd9-58c9-4da1-916d-190c5312c4e6 req-d55d49a3-b915-485d-aa57-b1b560ede745 service nova] Acquiring lock "ee96866e-7ee0-46a1-be1a-60439a52d513-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:02 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-38f82cd9-58c9-4da1-916d-190c5312c4e6 req-d55d49a3-b915-485d-aa57-b1b560ede745 service nova] Lock "ee96866e-7ee0-46a1-be1a-60439a52d513-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:02 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-38f82cd9-58c9-4da1-916d-190c5312c4e6 req-d55d49a3-b915-485d-aa57-b1b560ede745 service nova] Lock "ee96866e-7ee0-46a1-be1a-60439a52d513-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:02 user nova-compute[73391]: DEBUG nova.compute.manager [req-38f82cd9-58c9-4da1-916d-190c5312c4e6 req-d55d49a3-b915-485d-aa57-b1b560ede745 service nova] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] No waiting events found dispatching network-vif-unplugged-b6fe7cdf-66e0-40f5-a5df-b99d43175add {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:33:02 user nova-compute[73391]: DEBUG nova.compute.manager [req-38f82cd9-58c9-4da1-916d-190c5312c4e6 req-d55d49a3-b915-485d-aa57-b1b560ede745 service nova] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Received event network-vif-unplugged-b6fe7cdf-66e0-40f5-a5df-b99d43175add for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 05:33:02 user nova-compute[73391]: DEBUG nova.compute.manager [req-38f82cd9-58c9-4da1-916d-190c5312c4e6 req-d55d49a3-b915-485d-aa57-b1b560ede745 service nova] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Received event network-vif-plugged-b6fe7cdf-66e0-40f5-a5df-b99d43175add {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:33:02 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-38f82cd9-58c9-4da1-916d-190c5312c4e6 req-d55d49a3-b915-485d-aa57-b1b560ede745 service nova] Acquiring lock "ee96866e-7ee0-46a1-be1a-60439a52d513-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:02 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-38f82cd9-58c9-4da1-916d-190c5312c4e6 req-d55d49a3-b915-485d-aa57-b1b560ede745 service nova] Lock "ee96866e-7ee0-46a1-be1a-60439a52d513-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:02 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-38f82cd9-58c9-4da1-916d-190c5312c4e6 req-d55d49a3-b915-485d-aa57-b1b560ede745 service nova] Lock "ee96866e-7ee0-46a1-be1a-60439a52d513-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:02 user nova-compute[73391]: DEBUG nova.compute.manager [req-38f82cd9-58c9-4da1-916d-190c5312c4e6 req-d55d49a3-b915-485d-aa57-b1b560ede745 service nova] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] No waiting events found dispatching network-vif-plugged-b6fe7cdf-66e0-40f5-a5df-b99d43175add {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:33:02 user nova-compute[73391]: WARNING nova.compute.manager [req-38f82cd9-58c9-4da1-916d-190c5312c4e6 req-d55d49a3-b915-485d-aa57-b1b560ede745 service nova] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Received unexpected event network-vif-plugged-b6fe7cdf-66e0-40f5-a5df-b99d43175add for instance with vm_state active and task_state deleting.
Aug 15 05:33:02 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:33:02 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Took 1.00 seconds to deallocate network for instance.
Aug 15 05:33:02 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-1d004e95-b1e6-49c7-8dca-0133235ae9aa tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:02 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-1d004e95-b1e6-49c7-8dca-0133235ae9aa tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:03 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-1d004e95-b1e6-49c7-8dca-0133235ae9aa tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:33:03 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-1d004e95-b1e6-49c7-8dca-0133235ae9aa tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:33:03 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:03 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-1d004e95-b1e6-49c7-8dca-0133235ae9aa tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.435s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:03 user nova-compute[73391]: INFO nova.scheduler.client.report [None req-1d004e95-b1e6-49c7-8dca-0133235ae9aa tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Deleted allocations for instance ee96866e-7ee0-46a1-be1a-60439a52d513
Aug 15 05:33:03 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-1d004e95-b1e6-49c7-8dca-0133235ae9aa tempest-VolumesAssistedSnapshotsTest-1454195170 tempest-VolumesAssistedSnapshotsTest-1454195170-project-member] Lock "ee96866e-7ee0-46a1-be1a-60439a52d513" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.586s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:03 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:04 user nova-compute[73391]: DEBUG nova.compute.manager [req-9ee68d56-4348-4801-8128-3154ab46b47a req-e1efecff-aa65-4365-ba75-8a781fd2d58f service nova] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Received event network-vif-deleted-b6fe7cdf-66e0-40f5-a5df-b99d43175add {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:33:06 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Acquiring lock "3f88cd17-c89f-41f3-b630-8eb2c6698155" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "3f88cd17-c89f-41f3-b630-8eb2c6698155" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:07 user nova-compute[73391]: DEBUG nova.compute.manager [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Starting instance... {{(pid=73391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 05:33:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-067d5d72-386b-4d2f-87fa-e58f3d07814c tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Acquiring lock "df00c15a-2512-41d0-9857-edb50374897e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-067d5d72-386b-4d2f-87fa-e58f3d07814c tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Lock "df00c15a-2512-41d0-9857-edb50374897e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-067d5d72-386b-4d2f-87fa-e58f3d07814c tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Acquiring lock "df00c15a-2512-41d0-9857-edb50374897e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-067d5d72-386b-4d2f-87fa-e58f3d07814c tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Lock "df00c15a-2512-41d0-9857-edb50374897e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-067d5d72-386b-4d2f-87fa-e58f3d07814c tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Lock "df00c15a-2512-41d0-9857-edb50374897e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:07 user nova-compute[73391]: INFO nova.compute.manager [None req-067d5d72-386b-4d2f-87fa-e58f3d07814c tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] [instance: df00c15a-2512-41d0-9857-edb50374897e] Terminating instance
Aug 15 05:33:07 user nova-compute[73391]: DEBUG nova.compute.manager [None req-067d5d72-386b-4d2f-87fa-e58f3d07814c tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] [instance: df00c15a-2512-41d0-9857-edb50374897e] Start destroying the instance on the hypervisor. {{(pid=73391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 05:33:07 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:07 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 05:33:07 user nova-compute[73391]: INFO nova.compute.claims [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Claim successful on node user
Aug 15 05:33:07 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:07 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:07 user nova-compute[73391]: DEBUG nova.compute.manager [req-99d0f954-e7de-4a5d-ab6e-b80bfe6c4a16 req-fb8de7bb-f602-472a-803b-2ff212987f56 service nova] [instance: df00c15a-2512-41d0-9857-edb50374897e] Received event network-vif-unplugged-c065ab29-c8d1-463f-bf12-7921829c9ede {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:33:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-99d0f954-e7de-4a5d-ab6e-b80bfe6c4a16 req-fb8de7bb-f602-472a-803b-2ff212987f56 service nova] Acquiring lock "df00c15a-2512-41d0-9857-edb50374897e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-99d0f954-e7de-4a5d-ab6e-b80bfe6c4a16 req-fb8de7bb-f602-472a-803b-2ff212987f56 service nova] Lock "df00c15a-2512-41d0-9857-edb50374897e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-99d0f954-e7de-4a5d-ab6e-b80bfe6c4a16 req-fb8de7bb-f602-472a-803b-2ff212987f56 service nova] Lock "df00c15a-2512-41d0-9857-edb50374897e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:07 user nova-compute[73391]: DEBUG nova.compute.manager [req-99d0f954-e7de-4a5d-ab6e-b80bfe6c4a16 req-fb8de7bb-f602-472a-803b-2ff212987f56 service nova] [instance: df00c15a-2512-41d0-9857-edb50374897e] No waiting events found dispatching network-vif-unplugged-c065ab29-c8d1-463f-bf12-7921829c9ede {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:33:07 user nova-compute[73391]: DEBUG nova.compute.manager [req-99d0f954-e7de-4a5d-ab6e-b80bfe6c4a16 req-fb8de7bb-f602-472a-803b-2ff212987f56 service nova] [instance: df00c15a-2512-41d0-9857-edb50374897e] Received event network-vif-unplugged-c065ab29-c8d1-463f-bf12-7921829c9ede for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 05:33:08 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:33:08 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:33:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.695s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:08 user nova-compute[73391]: DEBUG nova.compute.manager [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Start building networks asynchronously for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 05:33:08 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: df00c15a-2512-41d0-9857-edb50374897e] Instance destroyed successfully.
Aug 15 05:33:08 user nova-compute[73391]: DEBUG nova.objects.instance [None req-067d5d72-386b-4d2f-87fa-e58f3d07814c tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Lazy-loading 'resources' on Instance uuid df00c15a-2512-41d0-9857-edb50374897e {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:33:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-067d5d72-386b-4d2f-87fa-e58f3d07814c tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T05:29:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1483983120',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1483983120',id=6,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2gCgxFYyHMvanjOmlhgs+PtTOvShgOshpOoTRWbXBVti5EI5YAHx014n7qsJi2J2bJRkI0PBGeXP5u90VAUBx25BB0y6ovoKoEveKinIqcQDUv9GNl+Dqk3GoYb9mVVg==',key_name='tempest-keypair-1486183318',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:30:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1d2905fedccc4085a38a905192ba079b',ramdisk_id='',reservation_id='r-j2lev19d',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1390153553',owner_user_name='tempest-TaggedAttachmentsTest-1390153553-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:30:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='42f8f8600f9a4d81a72afbaf2bbd53a5',uuid=df00c15a-2512-41d0-9857-edb50374897e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c065ab29-c8d1-463f-bf12-7921829c9ede", "address": "fa:16:3e:92:27:fb", "network": {"id": "6605a4f0-a8e4-4044-a7d3-36dd84d3870c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-694227201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d2905fedccc4085a38a905192ba079b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc065ab29-c8", "ovs_interfaceid": "c065ab29-c8d1-463f-bf12-7921829c9ede", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:33:08 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-067d5d72-386b-4d2f-87fa-e58f3d07814c tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Converting VIF {"id": "c065ab29-c8d1-463f-bf12-7921829c9ede", "address": "fa:16:3e:92:27:fb", "network": {"id": "6605a4f0-a8e4-4044-a7d3-36dd84d3870c", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-694227201-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1d2905fedccc4085a38a905192ba079b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc065ab29-c8", "ovs_interfaceid": "c065ab29-c8d1-463f-bf12-7921829c9ede", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:33:08 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-067d5d72-386b-4d2f-87fa-e58f3d07814c tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:92:27:fb,bridge_name='br-int',has_traffic_filtering=True,id=c065ab29-c8d1-463f-bf12-7921829c9ede,network=Network(6605a4f0-a8e4-4044-a7d3-36dd84d3870c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc065ab29-c8') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:33:08 user nova-compute[73391]: DEBUG os_vif [None req-067d5d72-386b-4d2f-87fa-e58f3d07814c tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:27:fb,bridge_name='br-int',has_traffic_filtering=True,id=c065ab29-c8d1-463f-bf12-7921829c9ede,network=Network(6605a4f0-a8e4-4044-a7d3-36dd84d3870c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc065ab29-c8') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:33:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc065ab29-c8, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:33:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:33:08 user nova-compute[73391]: INFO os_vif [None req-067d5d72-386b-4d2f-87fa-e58f3d07814c tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:92:27:fb,bridge_name='br-int',has_traffic_filtering=True,id=c065ab29-c8d1-463f-bf12-7921829c9ede,network=Network(6605a4f0-a8e4-4044-a7d3-36dd84d3870c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc065ab29-c8')
Aug 15 05:33:08 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-067d5d72-386b-4d2f-87fa-e58f3d07814c tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] [instance: df00c15a-2512-41d0-9857-edb50374897e] Deleting instance files /opt/stack/data/nova/instances/df00c15a-2512-41d0-9857-edb50374897e_del
Aug 15 05:33:08 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-067d5d72-386b-4d2f-87fa-e58f3d07814c tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] [instance: df00c15a-2512-41d0-9857-edb50374897e] Deletion of /opt/stack/data/nova/instances/df00c15a-2512-41d0-9857-edb50374897e_del complete
Aug 15 05:33:08 user nova-compute[73391]: DEBUG nova.compute.manager [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Allocating IP information in the background. {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 05:33:08 user nova-compute[73391]: DEBUG nova.network.neutron [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] allocate_for_instance() {{(pid=73391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 05:33:08 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 05:33:08 user nova-compute[73391]: DEBUG nova.compute.manager [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Start building block device mappings for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 05:33:08 user nova-compute[73391]: INFO nova.compute.manager [None req-067d5d72-386b-4d2f-87fa-e58f3d07814c tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] [instance: df00c15a-2512-41d0-9857-edb50374897e] Took 1.02 seconds to destroy the instance on the hypervisor.
Aug 15 05:33:08 user nova-compute[73391]: DEBUG oslo.service.loopingcall [None req-067d5d72-386b-4d2f-87fa-e58f3d07814c tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 05:33:08 user nova-compute[73391]: DEBUG nova.compute.manager [-] [instance: df00c15a-2512-41d0-9857-edb50374897e] Deallocating network for instance {{(pid=73391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 05:33:08 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: df00c15a-2512-41d0-9857-edb50374897e] deallocate_for_instance() {{(pid=73391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 05:33:08 user nova-compute[73391]: DEBUG nova.policy [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '49011bcb82534aa3b83e182485a388db', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '136ca1d3267b476db6dde10db3f21e06', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73391) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 05:33:08 user nova-compute[73391]: DEBUG nova.compute.manager [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Start spawning the instance on the hypervisor. {{(pid=73391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 05:33:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Creating instance directory {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 05:33:08 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Creating image(s)
Aug 15 05:33:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Acquiring lock "/opt/stack/data/nova/instances/3f88cd17-c89f-41f3-b630-8eb2c6698155/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "/opt/stack/data/nova/instances/3f88cd17-c89f-41f3-b630-8eb2c6698155/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "/opt/stack/data/nova/instances/3f88cd17-c89f-41f3-b630-8eb2c6698155/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:08 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:08 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:33:08 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:33:08 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.201s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Acquiring lock "999b315ba87151d8252d543312ae7790e7e1583b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:08 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:08 user nova-compute[73391]: DEBUG nova.compute.manager [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Start spawning the instance on the hypervisor. {{(pid=73391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 05:33:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Creating instance directory {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 05:33:08 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Creating image(s)
Aug 15 05:33:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Did not create local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 05:33:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Ensure instance console log exists: /opt/stack/data/nova/instances/a397a3f0-9b98-4e2b-87a0-f5ff85247c11/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 05:33:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Start _get_guest_xml network_info=[{"id": "f757ece4-baa7-4593-8327-d5fee9aa2d1a", "address": "fa:16:3e:3a:0d:16", "network": {"id": "843ec1f3-c64d-4564-a801-0bee7beb4d42", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1999293789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "becd05a5b0824a208cd692d8505ea05e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf757ece4-ba", "ovs_interfaceid": "f757ece4-baa7-4593-8327-d5fee9aa2d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NXzhsQRV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a397a3f0-9b98-4e2b-87a0-f5ff85247c11', 'attached_at': '', 'detached_at': '', 'volume_id': 'c9c0ff64-aff4-4c9a-b939-400975c79c52', 'serial': 'c9c0ff64-aff4-4c9a-b939-400975c79c52'}, 'attachment_id': '86519fe2-975c-4808-9e09-bae46b05e3e6', 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'volume_type': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:33:08 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:33:08 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:33:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:33:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:33:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:33:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:33:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:33:08 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:33:08 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:33:08 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:33:08 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:33:08 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:33:08 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:33:08 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:33:08 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:33:08 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:33:08 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:33:08 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:33:09 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 05:33:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NXzhsQRV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:33:09 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:33:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:33:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:33:09 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:33:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:33:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:33:09 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 05:33:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:09 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ae454d-091f-4bb6-aaf9-e7a13996cf38]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:33:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 05:33:09 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:33:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.030s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:09 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8b8eaa-d189-43e3-b882-7b6d1de267d7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:33:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52] added
Aug 15 05:33:09 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:33:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.221s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/3f88cd17-c89f-41f3-b630-8eb2c6698155/disk 1073741824 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:09 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[66622fd2-c5d9-4724-9147-3b6cf7b77a4b]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:33:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:33:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/3f88cd17-c89f-41f3-b630-8eb2c6698155/disk 1073741824" returned: 0 in 0.057s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:09 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:09 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a556e7-78f3-4ba6-8fde-566d2183bdec]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:33:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:33:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NXzhsQRV {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NXzhsQRV" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:09 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6b68993-0948-42d7-b0ba-4055f71449af]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:33:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NXzhsQRV'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:33:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:09 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[12bf3d2c-401b-4d38-bbe5-fdb0e74942c6]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:33:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:33:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:09 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce13497-1b7d-4913-bb2d-af99dae5571b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:33:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)
Aug 15 05:33:09 user nova-compute[73391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)
Aug 15 05:33:09 user nova-compute[73391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:33:09 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:33:09 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:33:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)
Aug 15 05:33:09 user nova-compute[73391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)
Aug 15 05:33:09 user nova-compute[73391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:33:09 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:33:09 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:33:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.240s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:09 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3f88cd17-c89f-41f3-b630-8eb2c6698155/disk. size=1073741824 {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 05:33:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f88cd17-c89f-41f3-b630-8eb2c6698155/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f88cd17-c89f-41f3-b630-8eb2c6698155/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:09 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Cannot resize image /opt/stack/data/nova/instances/3f88cd17-c89f-41f3-b630-8eb2c6698155/disk to a smaller size. {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 05:33:09 user nova-compute[73391]: DEBUG nova.objects.instance [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lazy-loading 'migration_context' on Instance uuid 3f88cd17-c89f-41f3-b630-8eb2c6698155 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:33:09 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Created local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 05:33:09 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Ensure instance console log exists: /opt/stack/data/nova/instances/3f88cd17-c89f-41f3-b630-8eb2c6698155/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 05:33:09 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:09 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:09 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:09 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:33:10 user nova-compute[73391]: DEBUG nova.compute.manager [req-81de67e6-e406-4bc5-9d88-840fa6f27a8e req-66c1b6ce-9564-4d79-a41d-f99595a9f026 service nova] [instance: df00c15a-2512-41d0-9857-edb50374897e] Received event network-vif-plugged-c065ab29-c8d1-463f-bf12-7921829c9ede {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:33:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-81de67e6-e406-4bc5-9d88-840fa6f27a8e req-66c1b6ce-9564-4d79-a41d-f99595a9f026 service nova] Acquiring lock "df00c15a-2512-41d0-9857-edb50374897e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-81de67e6-e406-4bc5-9d88-840fa6f27a8e req-66c1b6ce-9564-4d79-a41d-f99595a9f026 service nova] Lock "df00c15a-2512-41d0-9857-edb50374897e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-81de67e6-e406-4bc5-9d88-840fa6f27a8e req-66c1b6ce-9564-4d79-a41d-f99595a9f026 service nova] Lock "df00c15a-2512-41d0-9857-edb50374897e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:10 user nova-compute[73391]: DEBUG nova.compute.manager [req-81de67e6-e406-4bc5-9d88-840fa6f27a8e req-66c1b6ce-9564-4d79-a41d-f99595a9f026 service nova] [instance: df00c15a-2512-41d0-9857-edb50374897e] No waiting events found dispatching network-vif-plugged-c065ab29-c8d1-463f-bf12-7921829c9ede {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:33:10 user nova-compute[73391]: WARNING nova.compute.manager [req-81de67e6-e406-4bc5-9d88-840fa6f27a8e req-66c1b6ce-9564-4d79-a41d-f99595a9f026 service nova] [instance: df00c15a-2512-41d0-9857-edb50374897e] Received unexpected event network-vif-plugged-c065ab29-c8d1-463f-bf12-7921829c9ede for instance with vm_state active and task_state deleting.
Aug 15 05:33:10 user nova-compute[73391]: DEBUG nova.network.neutron [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Successfully created port: b00ad802-7ef5-4555-9a1b-7083cdd1c288 {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 05:33:10 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: df00c15a-2512-41d0-9857-edb50374897e] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:33:10 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: df00c15a-2512-41d0-9857-edb50374897e] Took 1.61 seconds to deallocate network for instance.
Aug 15 05:33:10 user nova-compute[73391]: DEBUG nova.compute.manager [req-42759651-2343-439f-9ebb-3dcce8c212c2 req-2c6a477b-1216-4f3a-a37a-215b62a8f24e service nova] [instance: df00c15a-2512-41d0-9857-edb50374897e] Received event network-vif-deleted-c065ab29-c8d1-463f-bf12-7921829c9ede {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:33:10 user nova-compute[73391]: INFO nova.compute.manager [req-42759651-2343-439f-9ebb-3dcce8c212c2 req-2c6a477b-1216-4f3a-a37a-215b62a8f24e service nova] [instance: df00c15a-2512-41d0-9857-edb50374897e] Neutron deleted interface c065ab29-c8d1-463f-bf12-7921829c9ede; detaching it from the instance and deleting it from the info cache
Aug 15 05:33:10 user nova-compute[73391]: DEBUG nova.network.neutron [req-42759651-2343-439f-9ebb-3dcce8c212c2 req-2c6a477b-1216-4f3a-a37a-215b62a8f24e service nova] [instance: df00c15a-2512-41d0-9857-edb50374897e] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:33:10 user nova-compute[73391]: DEBUG nova.compute.manager [req-42759651-2343-439f-9ebb-3dcce8c212c2 req-2c6a477b-1216-4f3a-a37a-215b62a8f24e service nova] [instance: df00c15a-2512-41d0-9857-edb50374897e] Detach interface failed, port_id=c065ab29-c8d1-463f-bf12-7921829c9ede, reason: Instance df00c15a-2512-41d0-9857-edb50374897e could not be found. {{(pid=73391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 05:33:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-067d5d72-386b-4d2f-87fa-e58f3d07814c tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-067d5d72-386b-4d2f-87fa-e58f3d07814c tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:10 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 -p 172.16.0.220:3260 --login" returned: 0 in 1.076s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:10 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e81bab-88dd-4520-893d-baf415db0759]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:33:10 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52, portal: 172.16.0.220,3260]
Aug 15 05:33:10 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52, portal: 172.16.0.220,3260] successful.
Aug 15 05:33:10 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:33:10 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:10 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:10 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c68f570c-8da3-4d70-a25e-b15d5932e772]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:33:10 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:33:10 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:10 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:10 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[415736cd-3e56-4afd-b5b2-56445a7e9364]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:33:10 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)
Aug 15 05:33:10 user nova-compute[73391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)
Aug 15 05:33:10 user nova-compute[73391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:33:10 user nova-compute[73391]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 (non-flash)
Aug 15 05:33:10 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:33:10 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:33:10 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)
Aug 15 05:33:10 user nova-compute[73391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)
Aug 15 05:33:10 user nova-compute[73391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:33:10 user nova-compute[73391]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 (non-flash)
Aug 15 05:33:10 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:33:10 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:33:10 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.448s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:33:10 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 05:33:10 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] HCTL ('33', '-', '-', 0) found on session 16 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 05:33:10 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 05:33:10 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:10 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:10 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[be10d01b-c279-4935-811d-108827690397]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:33:10 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Searching for a device in session 16 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:33:10 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NXzhsQRV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 05:33:10 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-067d5d72-386b-4d2f-87fa-e58f3d07814c tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:33:10 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-067d5d72-386b-4d2f-87fa-e58f3d07814c tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:33:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-067d5d72-386b-4d2f-87fa-e58f3d07814c tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.434s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:10 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:33:10 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:33:10 user nova-compute[73391]: INFO nova.scheduler.client.report [None req-067d5d72-386b-4d2f-87fa-e58f3d07814c tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Deleted allocations for instance df00c15a-2512-41d0-9857-edb50374897e
Aug 15 05:33:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-067d5d72-386b-4d2f-87fa-e58f3d07814c tempest-TaggedAttachmentsTest-1390153553 tempest-TaggedAttachmentsTest-1390153553-project-member] Lock "df00c15a-2512-41d0-9857-edb50374897e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.284s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:11 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquiring lock "8186459b-5bcb-4b5a-b6d8-d424909614e5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:11 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "8186459b-5bcb-4b5a-b6d8-d424909614e5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:11 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.496s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:33:11 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] <== connect_volume: return (2497ms) {'type': 'block', 'scsi_wwn': '23464653939666162', 'path': '/dev/sdb'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:33:11 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464653939666162', 'path': '/dev/sdb'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 05:33:11 user nova-compute[73391]: DEBUG nova.network.neutron [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Successfully updated port: b00ad802-7ef5-4555-9a1b-7083cdd1c288 {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:33:11 user nova-compute[73391]: DEBUG nova.compute.manager [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Starting instance... {{(pid=73391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 05:33:11 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Acquiring lock "refresh_cache-3f88cd17-c89f-41f3-b630-8eb2c6698155" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:33:11 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Acquired lock "refresh_cache-3f88cd17-c89f-41f3-b630-8eb2c6698155" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:33:11 user nova-compute[73391]: DEBUG nova.network.neutron [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:33:11 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:32:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-841273858',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-841273858',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNMgzXt9NjJohzQsGOG93ZxUTCjCzFBUN3Hf/vy9X7YUPJocPJVAdKrq1py25dd1+bQ6l0tu0hELDJB6TYYQgn1ARXbmD5JV7v4zuJ4KXoVbpP6mpPq+PpiOI9xbMnkxzg==',key_name='tempest-keypair-283788561',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='becd05a5b0824a208cd692d8505ea05e',ramdisk_id='',reservation_id='r-qxjdyr3i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1258386635',owner_user_name='tempest-ServerActionsV293TestJSON-1258386635-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:32:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f78657dfe187469faa75e7210792871b',uuid=a397a3f0-9b98-4e2b-87a0-f5ff85247c11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f757ece4-baa7-4593-8327-d5fee9aa2d1a", "address": "fa:16:3e:3a:0d:16", "network": {"id": "843ec1f3-c64d-4564-a801-0bee7beb4d42", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1999293789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "becd05a5b0824a208cd692d8505ea05e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf757ece4-ba", "ovs_interfaceid": "f757ece4-baa7-4593-8327-d5fee9aa2d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:33:11 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Converting VIF {"id": "f757ece4-baa7-4593-8327-d5fee9aa2d1a", "address": "fa:16:3e:3a:0d:16", "network": {"id": "843ec1f3-c64d-4564-a801-0bee7beb4d42", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1999293789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "becd05a5b0824a208cd692d8505ea05e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf757ece4-ba", "ovs_interfaceid": "f757ece4-baa7-4593-8327-d5fee9aa2d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:33:11 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:0d:16,bridge_name='br-int',has_traffic_filtering=True,id=f757ece4-baa7-4593-8327-d5fee9aa2d1a,network=Network(843ec1f3-c64d-4564-a801-0bee7beb4d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf757ece4-ba') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:33:11 user nova-compute[73391]: DEBUG nova.objects.instance [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Lazy-loading 'pci_devices' on Instance uuid a397a3f0-9b98-4e2b-87a0-f5ff85247c11 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:33:11 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:33:11 user nova-compute[73391]:   <uuid>a397a3f0-9b98-4e2b-87a0-f5ff85247c11</uuid>
Aug 15 05:33:11 user nova-compute[73391]:   <name>instance-0000000e</name>
Aug 15 05:33:11 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:33:11 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:33:11 user nova-compute[73391]:   <metadata>
Aug 15 05:33:11 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:33:11 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:33:11 user nova-compute[73391]:       <nova:name>tempest-ServerActionsV293TestJSON-server-841273858</nova:name>
Aug 15 05:33:11 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:33:08</nova:creationTime>
Aug 15 05:33:11 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:33:11 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:33:11 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:33:11 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:33:11 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:33:11 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:33:11 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:33:11 user nova-compute[73391]:       <nova:owner>
Aug 15 05:33:11 user nova-compute[73391]:         <nova:user uuid="f78657dfe187469faa75e7210792871b">tempest-ServerActionsV293TestJSON-1258386635-project-member</nova:user>
Aug 15 05:33:11 user nova-compute[73391]:         <nova:project uuid="becd05a5b0824a208cd692d8505ea05e">tempest-ServerActionsV293TestJSON-1258386635</nova:project>
Aug 15 05:33:11 user nova-compute[73391]:       </nova:owner>
Aug 15 05:33:11 user nova-compute[73391]:       <nova:ports>
Aug 15 05:33:11 user nova-compute[73391]:         <nova:port uuid="f757ece4-baa7-4593-8327-d5fee9aa2d1a">
Aug 15 05:33:11 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 15 05:33:11 user nova-compute[73391]:         </nova:port>
Aug 15 05:33:11 user nova-compute[73391]:       </nova:ports>
Aug 15 05:33:11 user nova-compute[73391]:     </nova:instance>
Aug 15 05:33:11 user nova-compute[73391]:   </metadata>
Aug 15 05:33:11 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:33:11 user nova-compute[73391]:     <system>
Aug 15 05:33:11 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:33:11 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:33:11 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:33:11 user nova-compute[73391]:       <entry name="serial">a397a3f0-9b98-4e2b-87a0-f5ff85247c11</entry>
Aug 15 05:33:11 user nova-compute[73391]:       <entry name="uuid">a397a3f0-9b98-4e2b-87a0-f5ff85247c11</entry>
Aug 15 05:33:11 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:33:11 user nova-compute[73391]:     </system>
Aug 15 05:33:11 user nova-compute[73391]:   </sysinfo>
Aug 15 05:33:11 user nova-compute[73391]:   <os>
Aug 15 05:33:11 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:33:11 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:33:11 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:33:11 user nova-compute[73391]:   </os>
Aug 15 05:33:11 user nova-compute[73391]:   <features>
Aug 15 05:33:11 user nova-compute[73391]:     <acpi/>
Aug 15 05:33:11 user nova-compute[73391]:     <apic/>
Aug 15 05:33:11 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:33:11 user nova-compute[73391]:   </features>
Aug 15 05:33:11 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:33:11 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:33:11 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:33:11 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:33:11 user nova-compute[73391]:   </clock>
Aug 15 05:33:11 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:33:11 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:33:11 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:33:11 user nova-compute[73391]:   </cpu>
Aug 15 05:33:11 user nova-compute[73391]:   <devices>
Aug 15 05:33:11 user nova-compute[73391]:     <disk type="block" device="disk">
Aug 15 05:33:11 user nova-compute[73391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:33:11 user nova-compute[73391]:       <source dev="/dev/sdb"/>
Aug 15 05:33:11 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:33:11 user nova-compute[73391]:       <serial>c9c0ff64-aff4-4c9a-b939-400975c79c52</serial>
Aug 15 05:33:11 user nova-compute[73391]:     </disk>
Aug 15 05:33:11 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:33:11 user nova-compute[73391]:       <mac address="fa:16:3e:3a:0d:16"/>
Aug 15 05:33:11 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:33:11 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:33:11 user nova-compute[73391]:       <target dev="tapf757ece4-ba"/>
Aug 15 05:33:11 user nova-compute[73391]:     </interface>
Aug 15 05:33:11 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:33:11 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/a397a3f0-9b98-4e2b-87a0-f5ff85247c11/console.log" append="off"/>
Aug 15 05:33:11 user nova-compute[73391]:     </serial>
Aug 15 05:33:11 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:33:11 user nova-compute[73391]:     <video>
Aug 15 05:33:11 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:33:11 user nova-compute[73391]:     </video>
Aug 15 05:33:11 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:33:11 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:33:11 user nova-compute[73391]:     </rng>
Aug 15 05:33:11 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:33:11 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:33:11 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:33:11 user nova-compute[73391]:     </memballoon>
Aug 15 05:33:11 user nova-compute[73391]:   </devices>
Aug 15 05:33:11 user nova-compute[73391]: </domain>
Aug 15 05:33:11 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:33:11 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:32:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-841273858',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-841273858',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNMgzXt9NjJohzQsGOG93ZxUTCjCzFBUN3Hf/vy9X7YUPJocPJVAdKrq1py25dd1+bQ6l0tu0hELDJB6TYYQgn1ARXbmD5JV7v4zuJ4KXoVbpP6mpPq+PpiOI9xbMnkxzg==',key_name='tempest-keypair-283788561',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='becd05a5b0824a208cd692d8505ea05e',ramdisk_id='',reservation_id='r-qxjdyr3i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1258386635',owner_user_name='tempest-ServerActionsV293TestJSON-1258386635-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:32:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f78657dfe187469faa75e7210792871b',uuid=a397a3f0-9b98-4e2b-87a0-f5ff85247c11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f757ece4-baa7-4593-8327-d5fee9aa2d1a", "address": "fa:16:3e:3a:0d:16", "network": {"id": "843ec1f3-c64d-4564-a801-0bee7beb4d42", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1999293789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "becd05a5b0824a208cd692d8505ea05e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf757ece4-ba", "ovs_interfaceid": "f757ece4-baa7-4593-8327-d5fee9aa2d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:33:11 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Converting VIF {"id": "f757ece4-baa7-4593-8327-d5fee9aa2d1a", "address": "fa:16:3e:3a:0d:16", "network": {"id": "843ec1f3-c64d-4564-a801-0bee7beb4d42", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1999293789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "becd05a5b0824a208cd692d8505ea05e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf757ece4-ba", "ovs_interfaceid": "f757ece4-baa7-4593-8327-d5fee9aa2d1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:33:11 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:0d:16,bridge_name='br-int',has_traffic_filtering=True,id=f757ece4-baa7-4593-8327-d5fee9aa2d1a,network=Network(843ec1f3-c64d-4564-a801-0bee7beb4d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf757ece4-ba') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:33:11 user nova-compute[73391]: DEBUG os_vif [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:0d:16,bridge_name='br-int',has_traffic_filtering=True,id=f757ece4-baa7-4593-8327-d5fee9aa2d1a,network=Network(843ec1f3-c64d-4564-a801-0bee7beb4d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf757ece4-ba') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:33:11 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:11 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:33:11 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:33:11 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:11 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf757ece4-ba, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:33:11 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf757ece4-ba, col_values=(('external_ids', {'iface-id': 'f757ece4-baa7-4593-8327-d5fee9aa2d1a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:0d:16', 'vm-uuid': 'a397a3f0-9b98-4e2b-87a0-f5ff85247c11'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:33:11 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:11 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:33:11 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:11 user nova-compute[73391]: INFO os_vif [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:0d:16,bridge_name='br-int',has_traffic_filtering=True,id=f757ece4-baa7-4593-8327-d5fee9aa2d1a,network=Network(843ec1f3-c64d-4564-a801-0bee7beb4d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf757ece4-ba')
Aug 15 05:33:11 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:33:11 user nova-compute[73391]: DEBUG nova.network.neutron [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:33:11 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:11 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:11 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:11 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 05:33:11 user nova-compute[73391]: INFO nova.compute.claims [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Claim successful on node user
Aug 15 05:33:11 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:33:11 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] No VIF found with MAC fa:16:3e:3a:0d:16, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG nova.network.neutron [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Updating instance_info_cache with network_info: [{"id": "b00ad802-7ef5-4555-9a1b-7083cdd1c288", "address": "fa:16:3e:62:a5:85", "network": {"id": "85e580e2-7f57-4ac1-87b1-9c805fdcb43f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-949359526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "136ca1d3267b476db6dde10db3f21e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00ad802-7e", "ovs_interfaceid": "b00ad802-7ef5-4555-9a1b-7083cdd1c288", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Releasing lock "refresh_cache-3f88cd17-c89f-41f3-b630-8eb2c6698155" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG nova.compute.manager [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Instance network_info: |[{"id": "b00ad802-7ef5-4555-9a1b-7083cdd1c288", "address": "fa:16:3e:62:a5:85", "network": {"id": "85e580e2-7f57-4ac1-87b1-9c805fdcb43f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-949359526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "136ca1d3267b476db6dde10db3f21e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00ad802-7e", "ovs_interfaceid": "b00ad802-7ef5-4555-9a1b-7083cdd1c288", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Start _get_guest_xml network_info=[{"id": "b00ad802-7ef5-4555-9a1b-7083cdd1c288", "address": "fa:16:3e:62:a5:85", "network": {"id": "85e580e2-7f57-4ac1-87b1-9c805fdcb43f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-949359526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "136ca1d3267b476db6dde10db3f21e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00ad802-7e", "ovs_interfaceid": "b00ad802-7ef5-4555-9a1b-7083cdd1c288", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '191b1dad-305e-4d1c-9b15-515ec59a3278'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:33:12 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:33:12 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:33:12 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:33:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1683927402',display_name='tempest-SnapshotDataIntegrityTests-server-1683927402',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1683927402',id=15,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrpSb8Vc0je36f1mNxFtquzr/fRmXGl6TpPRK5C1vgXu/GOKu04yY/2Bnu2ssyTb3mxXtgFEEyfO4RFAqZ/8hgdt305jvYRykTc6jumG0flu/S6BPMyOAw4weaR2sn3tg==',key_name='tempest-keypair-1212270873',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='136ca1d3267b476db6dde10db3f21e06',ramdisk_id='',reservation_id='r-psajbjru',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-604035675',owner_user_name='tempest-SnapshotDataIntegrityTests-604035675-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:33:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49011bcb82534aa3b83e182485a388db',uuid=3f88cd17-c89f-41f3-b630-8eb2c6698155,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b00ad802-7ef5-4555-9a1b-7083cdd1c288", "address": "fa:16:3e:62:a5:85", "network": {"id": "85e580e2-7f57-4ac1-87b1-9c805fdcb43f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-949359526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "136ca1d3267b476db6dde10db3f21e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00ad802-7e", "ovs_interfaceid": "b00ad802-7ef5-4555-9a1b-7083cdd1c288", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Converting VIF {"id": "b00ad802-7ef5-4555-9a1b-7083cdd1c288", "address": "fa:16:3e:62:a5:85", "network": {"id": "85e580e2-7f57-4ac1-87b1-9c805fdcb43f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-949359526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "136ca1d3267b476db6dde10db3f21e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00ad802-7e", "ovs_interfaceid": "b00ad802-7ef5-4555-9a1b-7083cdd1c288", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:a5:85,bridge_name='br-int',has_traffic_filtering=True,id=b00ad802-7ef5-4555-9a1b-7083cdd1c288,network=Network(85e580e2-7f57-4ac1-87b1-9c805fdcb43f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb00ad802-7e') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG nova.objects.instance [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lazy-loading 'pci_devices' on Instance uuid 3f88cd17-c89f-41f3-b630-8eb2c6698155 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:33:12 user nova-compute[73391]:   <uuid>3f88cd17-c89f-41f3-b630-8eb2c6698155</uuid>
Aug 15 05:33:12 user nova-compute[73391]:   <name>instance-0000000f</name>
Aug 15 05:33:12 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:33:12 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:33:12 user nova-compute[73391]:   <metadata>
Aug 15 05:33:12 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:33:12 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:33:12 user nova-compute[73391]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1683927402</nova:name>
Aug 15 05:33:12 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:33:12</nova:creationTime>
Aug 15 05:33:12 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:33:12 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:33:12 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:33:12 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:33:12 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:33:12 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:33:12 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:33:12 user nova-compute[73391]:       <nova:owner>
Aug 15 05:33:12 user nova-compute[73391]:         <nova:user uuid="49011bcb82534aa3b83e182485a388db">tempest-SnapshotDataIntegrityTests-604035675-project-member</nova:user>
Aug 15 05:33:12 user nova-compute[73391]:         <nova:project uuid="136ca1d3267b476db6dde10db3f21e06">tempest-SnapshotDataIntegrityTests-604035675</nova:project>
Aug 15 05:33:12 user nova-compute[73391]:       </nova:owner>
Aug 15 05:33:12 user nova-compute[73391]:       <nova:root type="image" uuid="191b1dad-305e-4d1c-9b15-515ec59a3278"/>
Aug 15 05:33:12 user nova-compute[73391]:       <nova:ports>
Aug 15 05:33:12 user nova-compute[73391]:         <nova:port uuid="b00ad802-7ef5-4555-9a1b-7083cdd1c288">
Aug 15 05:33:12 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 15 05:33:12 user nova-compute[73391]:         </nova:port>
Aug 15 05:33:12 user nova-compute[73391]:       </nova:ports>
Aug 15 05:33:12 user nova-compute[73391]:     </nova:instance>
Aug 15 05:33:12 user nova-compute[73391]:   </metadata>
Aug 15 05:33:12 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:33:12 user nova-compute[73391]:     <system>
Aug 15 05:33:12 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:33:12 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:33:12 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:33:12 user nova-compute[73391]:       <entry name="serial">3f88cd17-c89f-41f3-b630-8eb2c6698155</entry>
Aug 15 05:33:12 user nova-compute[73391]:       <entry name="uuid">3f88cd17-c89f-41f3-b630-8eb2c6698155</entry>
Aug 15 05:33:12 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:33:12 user nova-compute[73391]:     </system>
Aug 15 05:33:12 user nova-compute[73391]:   </sysinfo>
Aug 15 05:33:12 user nova-compute[73391]:   <os>
Aug 15 05:33:12 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:33:12 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:33:12 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:33:12 user nova-compute[73391]:   </os>
Aug 15 05:33:12 user nova-compute[73391]:   <features>
Aug 15 05:33:12 user nova-compute[73391]:     <acpi/>
Aug 15 05:33:12 user nova-compute[73391]:     <apic/>
Aug 15 05:33:12 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:33:12 user nova-compute[73391]:   </features>
Aug 15 05:33:12 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:33:12 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:33:12 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:33:12 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:33:12 user nova-compute[73391]:   </clock>
Aug 15 05:33:12 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:33:12 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:33:12 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:33:12 user nova-compute[73391]:   </cpu>
Aug 15 05:33:12 user nova-compute[73391]:   <devices>
Aug 15 05:33:12 user nova-compute[73391]:     <disk type="file" device="disk">
Aug 15 05:33:12 user nova-compute[73391]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 05:33:12 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/3f88cd17-c89f-41f3-b630-8eb2c6698155/disk"/>
Aug 15 05:33:12 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:33:12 user nova-compute[73391]:     </disk>
Aug 15 05:33:12 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:33:12 user nova-compute[73391]:       <mac address="fa:16:3e:62:a5:85"/>
Aug 15 05:33:12 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:33:12 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:33:12 user nova-compute[73391]:       <target dev="tapb00ad802-7e"/>
Aug 15 05:33:12 user nova-compute[73391]:     </interface>
Aug 15 05:33:12 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:33:12 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/3f88cd17-c89f-41f3-b630-8eb2c6698155/console.log" append="off"/>
Aug 15 05:33:12 user nova-compute[73391]:     </serial>
Aug 15 05:33:12 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:33:12 user nova-compute[73391]:     <video>
Aug 15 05:33:12 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:33:12 user nova-compute[73391]:     </video>
Aug 15 05:33:12 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:33:12 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:33:12 user nova-compute[73391]:     </rng>
Aug 15 05:33:12 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:33:12 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:33:12 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:33:12 user nova-compute[73391]:     </memballoon>
Aug 15 05:33:12 user nova-compute[73391]:   </devices>
Aug 15 05:33:12 user nova-compute[73391]: </domain>
Aug 15 05:33:12 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:33:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1683927402',display_name='tempest-SnapshotDataIntegrityTests-server-1683927402',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1683927402',id=15,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrpSb8Vc0je36f1mNxFtquzr/fRmXGl6TpPRK5C1vgXu/GOKu04yY/2Bnu2ssyTb3mxXtgFEEyfO4RFAqZ/8hgdt305jvYRykTc6jumG0flu/S6BPMyOAw4weaR2sn3tg==',key_name='tempest-keypair-1212270873',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='136ca1d3267b476db6dde10db3f21e06',ramdisk_id='',reservation_id='r-psajbjru',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-604035675',owner_user_name='tempest-SnapshotDataIntegrityTests-604035675-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:33:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49011bcb82534aa3b83e182485a388db',uuid=3f88cd17-c89f-41f3-b630-8eb2c6698155,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b00ad802-7ef5-4555-9a1b-7083cdd1c288", "address": "fa:16:3e:62:a5:85", "network": {"id": "85e580e2-7f57-4ac1-87b1-9c805fdcb43f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-949359526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "136ca1d3267b476db6dde10db3f21e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00ad802-7e", "ovs_interfaceid": "b00ad802-7ef5-4555-9a1b-7083cdd1c288", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Converting VIF {"id": "b00ad802-7ef5-4555-9a1b-7083cdd1c288", "address": "fa:16:3e:62:a5:85", "network": {"id": "85e580e2-7f57-4ac1-87b1-9c805fdcb43f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-949359526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "136ca1d3267b476db6dde10db3f21e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00ad802-7e", "ovs_interfaceid": "b00ad802-7ef5-4555-9a1b-7083cdd1c288", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:a5:85,bridge_name='br-int',has_traffic_filtering=True,id=b00ad802-7ef5-4555-9a1b-7083cdd1c288,network=Network(85e580e2-7f57-4ac1-87b1-9c805fdcb43f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb00ad802-7e') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG os_vif [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:a5:85,bridge_name='br-int',has_traffic_filtering=True,id=b00ad802-7ef5-4555-9a1b-7083cdd1c288,network=Network(85e580e2-7f57-4ac1-87b1-9c805fdcb43f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb00ad802-7e') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb00ad802-7e, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb00ad802-7e, col_values=(('external_ids', {'iface-id': 'b00ad802-7ef5-4555-9a1b-7083cdd1c288', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:a5:85', 'vm-uuid': '3f88cd17-c89f-41f3-b630-8eb2c6698155'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:12 user nova-compute[73391]: INFO os_vif [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:a5:85,bridge_name='br-int',has_traffic_filtering=True,id=b00ad802-7ef5-4555-9a1b-7083cdd1c288,network=Network(85e580e2-7f57-4ac1-87b1-9c805fdcb43f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb00ad802-7e')
Aug 15 05:33:12 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.469s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG nova.compute.manager [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Start building networks asynchronously for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.472s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Auditing locally available compute resources for user (node: user) {{(pid=73391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] No VIF found with MAC fa:16:3e:62:a5:85, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG nova.compute.manager [req-c3e8151a-3ca4-4313-b5bb-a4ebcb643c2a req-24fd3819-2e6e-4fcd-8a83-f9b3a7ab6c41 service nova] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Received event network-changed-b00ad802-7ef5-4555-9a1b-7083cdd1c288 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG nova.compute.manager [req-c3e8151a-3ca4-4313-b5bb-a4ebcb643c2a req-24fd3819-2e6e-4fcd-8a83-f9b3a7ab6c41 service nova] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Refreshing instance network info cache due to event network-changed-b00ad802-7ef5-4555-9a1b-7083cdd1c288. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-c3e8151a-3ca4-4313-b5bb-a4ebcb643c2a req-24fd3819-2e6e-4fcd-8a83-f9b3a7ab6c41 service nova] Acquiring lock "refresh_cache-3f88cd17-c89f-41f3-b630-8eb2c6698155" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-c3e8151a-3ca4-4313-b5bb-a4ebcb643c2a req-24fd3819-2e6e-4fcd-8a83-f9b3a7ab6c41 service nova] Acquired lock "refresh_cache-3f88cd17-c89f-41f3-b630-8eb2c6698155" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG nova.network.neutron [req-c3e8151a-3ca4-4313-b5bb-a4ebcb643c2a req-24fd3819-2e6e-4fcd-8a83-f9b3a7ab6c41 service nova] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Refreshing network info cache for port b00ad802-7ef5-4555-9a1b-7083cdd1c288 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG nova.compute.manager [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Allocating IP information in the background. {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG nova.network.neutron [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] allocate_for_instance() {{(pid=73391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 05:33:12 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 05:33:12 user nova-compute[73391]: DEBUG nova.compute.manager [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Start building block device mappings for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG nova.compute.manager [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Start spawning the instance on the hypervisor. {{(pid=73391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Creating instance directory {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 05:33:12 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Creating image(s)
Aug 15 05:33:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquiring lock "/opt/stack/data/nova/instances/8186459b-5bcb-4b5a-b6d8-d424909614e5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "/opt/stack/data/nova/instances/8186459b-5bcb-4b5a-b6d8-d424909614e5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "/opt/stack/data/nova/instances/8186459b-5bcb-4b5a-b6d8-d424909614e5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG nova.policy [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '124dcfde552147e2978970386274c70a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b01853a82243369bd71dc0dbedb5d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73391) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.174s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquiring lock "999b315ba87151d8252d543312ae7790e7e1583b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.176s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/8186459b-5bcb-4b5a-b6d8-d424909614e5/disk 1073741824 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/8186459b-5bcb-4b5a-b6d8-d424909614e5/disk 1073741824" returned: 0 in 0.048s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG nova.network.neutron [req-c3e8151a-3ca4-4313-b5bb-a4ebcb643c2a req-24fd3819-2e6e-4fcd-8a83-f9b3a7ab6c41 service nova] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Updated VIF entry in instance network info cache for port b00ad802-7ef5-4555-9a1b-7083cdd1c288. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG nova.network.neutron [req-c3e8151a-3ca4-4313-b5bb-a4ebcb643c2a req-24fd3819-2e6e-4fcd-8a83-f9b3a7ab6c41 service nova] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Updating instance_info_cache with network_info: [{"id": "b00ad802-7ef5-4555-9a1b-7083cdd1c288", "address": "fa:16:3e:62:a5:85", "network": {"id": "85e580e2-7f57-4ac1-87b1-9c805fdcb43f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-949359526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "136ca1d3267b476db6dde10db3f21e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00ad802-7e", "ovs_interfaceid": "b00ad802-7ef5-4555-9a1b-7083cdd1c288", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:33:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-c3e8151a-3ca4-4313-b5bb-a4ebcb643c2a req-24fd3819-2e6e-4fcd-8a83-f9b3a7ab6c41 service nova] Releasing lock "refresh_cache-3f88cd17-c89f-41f3-b630-8eb2c6698155" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:33:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.177s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:13 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8186459b-5bcb-4b5a-b6d8-d424909614e5/disk. size=1073741824 {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 05:33:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8186459b-5bcb-4b5a-b6d8-d424909614e5/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8186459b-5bcb-4b5a-b6d8-d424909614e5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:13 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Cannot resize image /opt/stack/data/nova/instances/8186459b-5bcb-4b5a-b6d8-d424909614e5/disk to a smaller size. {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 05:33:13 user nova-compute[73391]: DEBUG nova.objects.instance [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lazy-loading 'migration_context' on Instance uuid 8186459b-5bcb-4b5a-b6d8-d424909614e5 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:33:13 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Created local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 05:33:13 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Ensure instance console log exists: /opt/stack/data/nova/instances/8186459b-5bcb-4b5a-b6d8-d424909614e5/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 05:33:13 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:13 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:13 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:13 user nova-compute[73391]: DEBUG nova.network.neutron [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Successfully created port: de932b15-d8c8-4714-80c0-c9eedeb26588 {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 05:33:13 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:13 user nova-compute[73391]: DEBUG nova.network.neutron [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Successfully updated port: de932b15-d8c8-4714-80c0-c9eedeb26588 {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:33:13 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:13 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquiring lock "refresh_cache-8186459b-5bcb-4b5a-b6d8-d424909614e5" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:33:13 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquired lock "refresh_cache-8186459b-5bcb-4b5a-b6d8-d424909614e5" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:33:13 user nova-compute[73391]: DEBUG nova.network.neutron [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:33:13 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:13 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:14 user nova-compute[73391]: DEBUG nova.network.neutron [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:33:14 user nova-compute[73391]: DEBUG nova.compute.manager [req-59ad3473-4d60-4faf-9e87-d01231171d72 req-c71d415e-cc64-45bc-9d4f-9f8e046d5ee9 service nova] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Received event network-vif-plugged-f757ece4-baa7-4593-8327-d5fee9aa2d1a {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:33:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-59ad3473-4d60-4faf-9e87-d01231171d72 req-c71d415e-cc64-45bc-9d4f-9f8e046d5ee9 service nova] Acquiring lock "a397a3f0-9b98-4e2b-87a0-f5ff85247c11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-59ad3473-4d60-4faf-9e87-d01231171d72 req-c71d415e-cc64-45bc-9d4f-9f8e046d5ee9 service nova] Lock "a397a3f0-9b98-4e2b-87a0-f5ff85247c11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-59ad3473-4d60-4faf-9e87-d01231171d72 req-c71d415e-cc64-45bc-9d4f-9f8e046d5ee9 service nova] Lock "a397a3f0-9b98-4e2b-87a0-f5ff85247c11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:14 user nova-compute[73391]: DEBUG nova.compute.manager [req-59ad3473-4d60-4faf-9e87-d01231171d72 req-c71d415e-cc64-45bc-9d4f-9f8e046d5ee9 service nova] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] No waiting events found dispatching network-vif-plugged-f757ece4-baa7-4593-8327-d5fee9aa2d1a {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:33:14 user nova-compute[73391]: WARNING nova.compute.manager [req-59ad3473-4d60-4faf-9e87-d01231171d72 req-c71d415e-cc64-45bc-9d4f-9f8e046d5ee9 service nova] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Received unexpected event network-vif-plugged-f757ece4-baa7-4593-8327-d5fee9aa2d1a for instance with vm_state building and task_state spawning.
Aug 15 05:33:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:14 user nova-compute[73391]: DEBUG nova.compute.manager [req-f138e1d5-02c9-4641-b4ab-e38d6e3c33e1 req-c9c859bf-d1cf-4685-b3d7-dc59ca217a8a service nova] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Received event network-changed-de932b15-d8c8-4714-80c0-c9eedeb26588 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:33:14 user nova-compute[73391]: DEBUG nova.compute.manager [req-f138e1d5-02c9-4641-b4ab-e38d6e3c33e1 req-c9c859bf-d1cf-4685-b3d7-dc59ca217a8a service nova] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Refreshing instance network info cache due to event network-changed-de932b15-d8c8-4714-80c0-c9eedeb26588. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:33:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f138e1d5-02c9-4641-b4ab-e38d6e3c33e1 req-c9c859bf-d1cf-4685-b3d7-dc59ca217a8a service nova] Acquiring lock "refresh_cache-8186459b-5bcb-4b5a-b6d8-d424909614e5" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:33:14 user nova-compute[73391]: DEBUG nova.network.neutron [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Updating instance_info_cache with network_info: [{"id": "de932b15-d8c8-4714-80c0-c9eedeb26588", "address": "fa:16:3e:17:55:32", "network": {"id": "610f78de-5741-4743-815d-d12ba05f8000", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1518164868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b01853a82243369bd71dc0dbedb5d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde932b15-d8", "ovs_interfaceid": "de932b15-d8c8-4714-80c0-c9eedeb26588", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:33:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Releasing lock "refresh_cache-8186459b-5bcb-4b5a-b6d8-d424909614e5" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:33:14 user nova-compute[73391]: DEBUG nova.compute.manager [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Instance network_info: |[{"id": "de932b15-d8c8-4714-80c0-c9eedeb26588", "address": "fa:16:3e:17:55:32", "network": {"id": "610f78de-5741-4743-815d-d12ba05f8000", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1518164868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b01853a82243369bd71dc0dbedb5d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde932b15-d8", "ovs_interfaceid": "de932b15-d8c8-4714-80c0-c9eedeb26588", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 05:33:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f138e1d5-02c9-4641-b4ab-e38d6e3c33e1 req-c9c859bf-d1cf-4685-b3d7-dc59ca217a8a service nova] Acquired lock "refresh_cache-8186459b-5bcb-4b5a-b6d8-d424909614e5" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:33:14 user nova-compute[73391]: DEBUG nova.network.neutron [req-f138e1d5-02c9-4641-b4ab-e38d6e3c33e1 req-c9c859bf-d1cf-4685-b3d7-dc59ca217a8a service nova] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Refreshing network info cache for port de932b15-d8c8-4714-80c0-c9eedeb26588 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:33:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Start _get_guest_xml network_info=[{"id": "de932b15-d8c8-4714-80c0-c9eedeb26588", "address": "fa:16:3e:17:55:32", "network": {"id": "610f78de-5741-4743-815d-d12ba05f8000", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1518164868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b01853a82243369bd71dc0dbedb5d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde932b15-d8", "ovs_interfaceid": "de932b15-d8c8-4714-80c0-c9eedeb26588", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '191b1dad-305e-4d1c-9b15-515ec59a3278'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:33:14 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:33:14 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:33:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:33:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:33:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:33:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:33:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:33:14 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:33:14 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:33:14 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:33:14 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:33:14 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:33:14 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:33:14 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:33:14 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:33:14 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:33:14 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:33:14 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:33:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:33:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-812806078',display_name='tempest-tempest.common.compute-instance-812806078',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-812806078',id=16,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKQF8c52xIn/tpah2OQeeTlaAc50/7SkZ/oBXCnKk+8uX+Qv1Jri1CC3w4ewMsF9mvYSfBkgG+AekpaXFdh8jEXOjDMtbaHzPVlN2+XlP9ua4WN7/3eKAFOiv304VYf4sQ==',key_name='tempest-keypair-393045208',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60b01853a82243369bd71dc0dbedb5d6',ramdisk_id='',reservation_id='r-u8d1c087',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1927429987',owner_user_name='tempest-ServerActionsTestOtherA-1927429987-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:33:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='124dcfde552147e2978970386274c70a',uuid=8186459b-5bcb-4b5a-b6d8-d424909614e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de932b15-d8c8-4714-80c0-c9eedeb26588", "address": "fa:16:3e:17:55:32", "network": {"id": "610f78de-5741-4743-815d-d12ba05f8000", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1518164868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b01853a82243369bd71dc0dbedb5d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde932b15-d8", "ovs_interfaceid": "de932b15-d8c8-4714-80c0-c9eedeb26588", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:33:14 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Converting VIF {"id": "de932b15-d8c8-4714-80c0-c9eedeb26588", "address": "fa:16:3e:17:55:32", "network": {"id": "610f78de-5741-4743-815d-d12ba05f8000", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1518164868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b01853a82243369bd71dc0dbedb5d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde932b15-d8", "ovs_interfaceid": "de932b15-d8c8-4714-80c0-c9eedeb26588", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:33:14 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:55:32,bridge_name='br-int',has_traffic_filtering=True,id=de932b15-d8c8-4714-80c0-c9eedeb26588,network=Network(610f78de-5741-4743-815d-d12ba05f8000),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde932b15-d8') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:33:14 user nova-compute[73391]: DEBUG nova.objects.instance [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lazy-loading 'pci_devices' on Instance uuid 8186459b-5bcb-4b5a-b6d8-d424909614e5 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:33:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:33:14 user nova-compute[73391]:   <uuid>8186459b-5bcb-4b5a-b6d8-d424909614e5</uuid>
Aug 15 05:33:14 user nova-compute[73391]:   <name>instance-00000010</name>
Aug 15 05:33:14 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:33:14 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:33:14 user nova-compute[73391]:   <metadata>
Aug 15 05:33:14 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:33:14 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:33:14 user nova-compute[73391]:       <nova:name>tempest-tempest.common.compute-instance-812806078</nova:name>
Aug 15 05:33:14 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:33:14</nova:creationTime>
Aug 15 05:33:14 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:33:14 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:33:14 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:33:14 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:33:14 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:33:14 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:33:14 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:33:14 user nova-compute[73391]:       <nova:owner>
Aug 15 05:33:14 user nova-compute[73391]:         <nova:user uuid="124dcfde552147e2978970386274c70a">tempest-ServerActionsTestOtherA-1927429987-project-member</nova:user>
Aug 15 05:33:14 user nova-compute[73391]:         <nova:project uuid="60b01853a82243369bd71dc0dbedb5d6">tempest-ServerActionsTestOtherA-1927429987</nova:project>
Aug 15 05:33:14 user nova-compute[73391]:       </nova:owner>
Aug 15 05:33:14 user nova-compute[73391]:       <nova:root type="image" uuid="191b1dad-305e-4d1c-9b15-515ec59a3278"/>
Aug 15 05:33:14 user nova-compute[73391]:       <nova:ports>
Aug 15 05:33:14 user nova-compute[73391]:         <nova:port uuid="de932b15-d8c8-4714-80c0-c9eedeb26588">
Aug 15 05:33:14 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 15 05:33:14 user nova-compute[73391]:         </nova:port>
Aug 15 05:33:14 user nova-compute[73391]:       </nova:ports>
Aug 15 05:33:14 user nova-compute[73391]:     </nova:instance>
Aug 15 05:33:14 user nova-compute[73391]:   </metadata>
Aug 15 05:33:14 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:33:14 user nova-compute[73391]:     <system>
Aug 15 05:33:14 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:33:14 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:33:14 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:33:14 user nova-compute[73391]:       <entry name="serial">8186459b-5bcb-4b5a-b6d8-d424909614e5</entry>
Aug 15 05:33:14 user nova-compute[73391]:       <entry name="uuid">8186459b-5bcb-4b5a-b6d8-d424909614e5</entry>
Aug 15 05:33:14 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:33:14 user nova-compute[73391]:     </system>
Aug 15 05:33:14 user nova-compute[73391]:   </sysinfo>
Aug 15 05:33:14 user nova-compute[73391]:   <os>
Aug 15 05:33:14 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:33:14 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:33:14 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:33:14 user nova-compute[73391]:   </os>
Aug 15 05:33:14 user nova-compute[73391]:   <features>
Aug 15 05:33:14 user nova-compute[73391]:     <acpi/>
Aug 15 05:33:14 user nova-compute[73391]:     <apic/>
Aug 15 05:33:14 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:33:14 user nova-compute[73391]:   </features>
Aug 15 05:33:14 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:33:14 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:33:14 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:33:14 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:33:14 user nova-compute[73391]:   </clock>
Aug 15 05:33:14 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:33:14 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:33:14 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:33:14 user nova-compute[73391]:   </cpu>
Aug 15 05:33:14 user nova-compute[73391]:   <devices>
Aug 15 05:33:14 user nova-compute[73391]:     <disk type="file" device="disk">
Aug 15 05:33:14 user nova-compute[73391]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 05:33:14 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/8186459b-5bcb-4b5a-b6d8-d424909614e5/disk"/>
Aug 15 05:33:14 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:33:14 user nova-compute[73391]:     </disk>
Aug 15 05:33:14 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:33:14 user nova-compute[73391]:       <mac address="fa:16:3e:17:55:32"/>
Aug 15 05:33:14 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:33:14 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:33:14 user nova-compute[73391]:       <target dev="tapde932b15-d8"/>
Aug 15 05:33:14 user nova-compute[73391]:     </interface>
Aug 15 05:33:14 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:33:14 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/8186459b-5bcb-4b5a-b6d8-d424909614e5/console.log" append="off"/>
Aug 15 05:33:14 user nova-compute[73391]:     </serial>
Aug 15 05:33:14 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:33:14 user nova-compute[73391]:     <video>
Aug 15 05:33:14 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:33:14 user nova-compute[73391]:     </video>
Aug 15 05:33:14 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:33:14 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:33:14 user nova-compute[73391]:     </rng>
Aug 15 05:33:14 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:33:14 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:33:14 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:33:14 user nova-compute[73391]:     </memballoon>
Aug 15 05:33:14 user nova-compute[73391]:   </devices>
Aug 15 05:33:14 user nova-compute[73391]: </domain>
Aug 15 05:33:14 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:33:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:33:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-812806078',display_name='tempest-tempest.common.compute-instance-812806078',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-812806078',id=16,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKQF8c52xIn/tpah2OQeeTlaAc50/7SkZ/oBXCnKk+8uX+Qv1Jri1CC3w4ewMsF9mvYSfBkgG+AekpaXFdh8jEXOjDMtbaHzPVlN2+XlP9ua4WN7/3eKAFOiv304VYf4sQ==',key_name='tempest-keypair-393045208',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60b01853a82243369bd71dc0dbedb5d6',ramdisk_id='',reservation_id='r-u8d1c087',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1927429987',owner_user_name='tempest-ServerActionsTestOtherA-1927429987-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:33:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='124dcfde552147e2978970386274c70a',uuid=8186459b-5bcb-4b5a-b6d8-d424909614e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "de932b15-d8c8-4714-80c0-c9eedeb26588", "address": "fa:16:3e:17:55:32", "network": {"id": "610f78de-5741-4743-815d-d12ba05f8000", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1518164868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b01853a82243369bd71dc0dbedb5d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde932b15-d8", "ovs_interfaceid": "de932b15-d8c8-4714-80c0-c9eedeb26588", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:33:14 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Converting VIF {"id": "de932b15-d8c8-4714-80c0-c9eedeb26588", "address": "fa:16:3e:17:55:32", "network": {"id": "610f78de-5741-4743-815d-d12ba05f8000", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1518164868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b01853a82243369bd71dc0dbedb5d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde932b15-d8", "ovs_interfaceid": "de932b15-d8c8-4714-80c0-c9eedeb26588", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:33:14 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:55:32,bridge_name='br-int',has_traffic_filtering=True,id=de932b15-d8c8-4714-80c0-c9eedeb26588,network=Network(610f78de-5741-4743-815d-d12ba05f8000),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde932b15-d8') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:33:14 user nova-compute[73391]: DEBUG os_vif [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:55:32,bridge_name='br-int',has_traffic_filtering=True,id=de932b15-d8c8-4714-80c0-c9eedeb26588,network=Network(610f78de-5741-4743-815d-d12ba05f8000),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde932b15-d8') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:33:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:33:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:33:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapde932b15-d8, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:33:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapde932b15-d8, col_values=(('external_ids', {'iface-id': 'de932b15-d8c8-4714-80c0-c9eedeb26588', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:55:32', 'vm-uuid': '8186459b-5bcb-4b5a-b6d8-d424909614e5'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:33:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:33:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:14 user nova-compute[73391]: INFO os_vif [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:55:32,bridge_name='br-int',has_traffic_filtering=True,id=de932b15-d8c8-4714-80c0-c9eedeb26588,network=Network(610f78de-5741-4743-815d-d12ba05f8000),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde932b15-d8')
Aug 15 05:33:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:33:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] No VIF found with MAC fa:16:3e:17:55:32, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:33:15 user nova-compute[73391]: DEBUG nova.network.neutron [req-f138e1d5-02c9-4641-b4ab-e38d6e3c33e1 req-c9c859bf-d1cf-4685-b3d7-dc59ca217a8a service nova] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Updated VIF entry in instance network info cache for port de932b15-d8c8-4714-80c0-c9eedeb26588. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:33:15 user nova-compute[73391]: DEBUG nova.network.neutron [req-f138e1d5-02c9-4641-b4ab-e38d6e3c33e1 req-c9c859bf-d1cf-4685-b3d7-dc59ca217a8a service nova] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Updating instance_info_cache with network_info: [{"id": "de932b15-d8c8-4714-80c0-c9eedeb26588", "address": "fa:16:3e:17:55:32", "network": {"id": "610f78de-5741-4743-815d-d12ba05f8000", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1518164868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b01853a82243369bd71dc0dbedb5d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde932b15-d8", "ovs_interfaceid": "de932b15-d8c8-4714-80c0-c9eedeb26588", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:33:15 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f138e1d5-02c9-4641-b4ab-e38d6e3c33e1 req-c9c859bf-d1cf-4685-b3d7-dc59ca217a8a service nova] Releasing lock "refresh_cache-8186459b-5bcb-4b5a-b6d8-d424909614e5" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:33:15 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:15 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:15 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:15 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:15 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:16 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:16 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:16 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:16 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:16 user nova-compute[73391]: DEBUG nova.compute.manager [req-14ccd0f7-f03b-4a7a-9b4c-25544c9a1f00 req-dbc9e32f-dca9-4bb0-8951-82a3c6e366e6 service nova] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Received event network-vif-plugged-f757ece4-baa7-4593-8327-d5fee9aa2d1a {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:33:16 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-14ccd0f7-f03b-4a7a-9b4c-25544c9a1f00 req-dbc9e32f-dca9-4bb0-8951-82a3c6e366e6 service nova] Acquiring lock "a397a3f0-9b98-4e2b-87a0-f5ff85247c11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:16 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-14ccd0f7-f03b-4a7a-9b4c-25544c9a1f00 req-dbc9e32f-dca9-4bb0-8951-82a3c6e366e6 service nova] Lock "a397a3f0-9b98-4e2b-87a0-f5ff85247c11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:16 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-14ccd0f7-f03b-4a7a-9b4c-25544c9a1f00 req-dbc9e32f-dca9-4bb0-8951-82a3c6e366e6 service nova] Lock "a397a3f0-9b98-4e2b-87a0-f5ff85247c11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:16 user nova-compute[73391]: DEBUG nova.compute.manager [req-14ccd0f7-f03b-4a7a-9b4c-25544c9a1f00 req-dbc9e32f-dca9-4bb0-8951-82a3c6e366e6 service nova] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] No waiting events found dispatching network-vif-plugged-f757ece4-baa7-4593-8327-d5fee9aa2d1a {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:33:16 user nova-compute[73391]: WARNING nova.compute.manager [req-14ccd0f7-f03b-4a7a-9b4c-25544c9a1f00 req-dbc9e32f-dca9-4bb0-8951-82a3c6e366e6 service nova] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Received unexpected event network-vif-plugged-f757ece4-baa7-4593-8327-d5fee9aa2d1a for instance with vm_state building and task_state spawning.
Aug 15 05:33:16 user nova-compute[73391]: DEBUG nova.compute.manager [req-0e3e18aa-b0fe-4a40-ad60-96a2cc6f30b0 req-ae6c0052-cb91-49ce-8648-e2f46e2e0dee service nova] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Received event network-vif-plugged-b00ad802-7ef5-4555-9a1b-7083cdd1c288 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:33:16 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-0e3e18aa-b0fe-4a40-ad60-96a2cc6f30b0 req-ae6c0052-cb91-49ce-8648-e2f46e2e0dee service nova] Acquiring lock "3f88cd17-c89f-41f3-b630-8eb2c6698155-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:16 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-0e3e18aa-b0fe-4a40-ad60-96a2cc6f30b0 req-ae6c0052-cb91-49ce-8648-e2f46e2e0dee service nova] Lock "3f88cd17-c89f-41f3-b630-8eb2c6698155-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:16 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-0e3e18aa-b0fe-4a40-ad60-96a2cc6f30b0 req-ae6c0052-cb91-49ce-8648-e2f46e2e0dee service nova] Lock "3f88cd17-c89f-41f3-b630-8eb2c6698155-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:16 user nova-compute[73391]: DEBUG nova.compute.manager [req-0e3e18aa-b0fe-4a40-ad60-96a2cc6f30b0 req-ae6c0052-cb91-49ce-8648-e2f46e2e0dee service nova] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] No waiting events found dispatching network-vif-plugged-b00ad802-7ef5-4555-9a1b-7083cdd1c288 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:33:16 user nova-compute[73391]: WARNING nova.compute.manager [req-0e3e18aa-b0fe-4a40-ad60-96a2cc6f30b0 req-ae6c0052-cb91-49ce-8648-e2f46e2e0dee service nova] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Received unexpected event network-vif-plugged-b00ad802-7ef5-4555-9a1b-7083cdd1c288 for instance with vm_state building and task_state spawning.
Aug 15 05:33:16 user nova-compute[73391]: DEBUG nova.compute.manager [req-0e3e18aa-b0fe-4a40-ad60-96a2cc6f30b0 req-ae6c0052-cb91-49ce-8648-e2f46e2e0dee service nova] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Received event network-vif-plugged-b00ad802-7ef5-4555-9a1b-7083cdd1c288 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:33:16 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-0e3e18aa-b0fe-4a40-ad60-96a2cc6f30b0 req-ae6c0052-cb91-49ce-8648-e2f46e2e0dee service nova] Acquiring lock "3f88cd17-c89f-41f3-b630-8eb2c6698155-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:16 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-0e3e18aa-b0fe-4a40-ad60-96a2cc6f30b0 req-ae6c0052-cb91-49ce-8648-e2f46e2e0dee service nova] Lock "3f88cd17-c89f-41f3-b630-8eb2c6698155-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:16 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-0e3e18aa-b0fe-4a40-ad60-96a2cc6f30b0 req-ae6c0052-cb91-49ce-8648-e2f46e2e0dee service nova] Lock "3f88cd17-c89f-41f3-b630-8eb2c6698155-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:16 user nova-compute[73391]: DEBUG nova.compute.manager [req-0e3e18aa-b0fe-4a40-ad60-96a2cc6f30b0 req-ae6c0052-cb91-49ce-8648-e2f46e2e0dee service nova] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] No waiting events found dispatching network-vif-plugged-b00ad802-7ef5-4555-9a1b-7083cdd1c288 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:33:16 user nova-compute[73391]: WARNING nova.compute.manager [req-0e3e18aa-b0fe-4a40-ad60-96a2cc6f30b0 req-ae6c0052-cb91-49ce-8648-e2f46e2e0dee service nova] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Received unexpected event network-vif-plugged-b00ad802-7ef5-4555-9a1b-7083cdd1c288 for instance with vm_state building and task_state spawning.
Aug 15 05:33:16 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692077581.4253068, ee96866e-7ee0-46a1-be1a-60439a52d513 => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:33:16 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] VM Stopped (Lifecycle Event)
Aug 15 05:33:16 user nova-compute[73391]: DEBUG nova.compute.manager [None req-23665c97-8504-4aff-b722-eb533ef19e89 None None] [instance: ee96866e-7ee0-46a1-be1a-60439a52d513] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:33:16 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f88cd17-c89f-41f3-b630-8eb2c6698155/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f88cd17-c89f-41f3-b630-8eb2c6698155/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f88cd17-c89f-41f3-b630-8eb2c6698155/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f88cd17-c89f-41f3-b630-8eb2c6698155/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Acquiring lock "18c8138a-4efc-403f-8b42-e5080c6a51d3" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "18c8138a-4efc-403f-8b42-e5080c6a51d3" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:17 user nova-compute[73391]: INFO nova.compute.manager [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Unshelving
Aug 15 05:33:17 user nova-compute[73391]: INFO nova.virt.block_device [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Booting with volume b4522c9a-9c99-40b7-835b-5cd15575943e at /dev/vdc
Aug 15 05:33:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:17 user nova-compute[73391]: DEBUG os_brick.utils [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:33:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:17 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7713c5a-1280-4bf3-bb4b-0336ba5603b6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:33:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:17 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d952ab4-520c-4bf7-bffd-c313a085d962]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:33:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:17 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[45adcbe7-530e-41c5-afb4-a56ad09f3f7d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:33:17 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[058c5bd0-a8ab-454b-ad66-b9f4cda160ac]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:33:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:33:17 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 05:33:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:33:17 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 05:33:17 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[73097522-979a-4176-8583-e64eacc27aa9]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:33:17 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 05:33:17 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 05:33:17 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 05:33:17 user nova-compute[73391]: DEBUG os_brick.utils [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:33:17 user nova-compute[73391]: DEBUG nova.virt.block_device [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Updating existing volume attachment record: b3625933-8d73-4cbc-8c4e-af9f80d1c767 {{(pid=73391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 05:33:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0169df15-335e-46e6-a5c8-9deb7095bb84/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0169df15-335e-46e6-a5c8-9deb7095bb84/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0169df15-335e-46e6-a5c8-9deb7095bb84/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:17 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077597.8724654, 3f88cd17-c89f-41f3-b630-8eb2c6698155 => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:33:17 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] VM Resumed (Lifecycle Event)
Aug 15 05:33:17 user nova-compute[73391]: DEBUG nova.compute.manager [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:33:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Guest created on hypervisor {{(pid=73391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 05:33:17 user nova-compute[73391]: DEBUG nova.compute.manager [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:33:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Guest created on hypervisor {{(pid=73391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 05:33:17 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:33:17 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Instance spawned successfully.
Aug 15 05:33:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 05:33:17 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Instance spawned successfully.
Aug 15 05:33:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 05:33:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0169df15-335e-46e6-a5c8-9deb7095bb84/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:17 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:33:17 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:33:17 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077597.8932328, 3f88cd17-c89f-41f3-b630-8eb2c6698155 => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:33:17 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] VM Started (Lifecycle Event)
Aug 15 05:33:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Found default for hw_cdrom_bus of ide {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:33:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Found default for hw_disk_bus of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:33:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Found default for hw_input_bus of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:33:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Found default for hw_pointer_model of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:33:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Found default for hw_video_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:33:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Found default for hw_vif_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:33:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:33:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:33:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdi (vdc) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:33:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Found default for hw_cdrom_bus of ide {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:33:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Found default for hw_disk_bus of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:33:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Found default for hw_input_bus of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:33:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Found default for hw_pointer_model of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:33:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Found default for hw_video_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:33:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Found default for hw_vif_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:33:17 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:33:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:18 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:33:18 user nova-compute[73391]: INFO nova.compute.manager [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Took 9.12 seconds to spawn the instance on the hypervisor.
Aug 15 05:33:18 user nova-compute[73391]: DEBUG nova.compute.manager [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:33:18 user nova-compute[73391]: INFO nova.compute.manager [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Took 9.39 seconds to spawn the instance on the hypervisor.
Aug 15 05:33:18 user nova-compute[73391]: DEBUG nova.compute.manager [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:33:18 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:33:18 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077597.8934278, a397a3f0-9b98-4e2b-87a0-f5ff85247c11 => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:33:18 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] VM Resumed (Lifecycle Event)
Aug 15 05:33:18 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:33:18 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:33:18 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:33:18 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077597.8935547, a397a3f0-9b98-4e2b-87a0-f5ff85247c11 => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:33:18 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] VM Started (Lifecycle Event)
Aug 15 05:33:18 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:33:18 user nova-compute[73391]: INFO nova.compute.manager [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Took 10.56 seconds to build instance.
Aug 15 05:33:18 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:33:18 user nova-compute[73391]: INFO nova.compute.manager [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Took 20.91 seconds to build instance.
Aug 15 05:33:18 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-a1f83a6a-eb11-4a95-a076-eee56efdafdb tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "3f88cd17-c89f-41f3-b630-8eb2c6698155" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.684s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:18 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c393fb98-9238-4fb5-b8bd-50da4d58bf96 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Lock "a397a3f0-9b98-4e2b-87a0-f5ff85247c11" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.041s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:18 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:33:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b9f5970-65c5-4eff-a4bf-d18a9c916c90/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:18 user nova-compute[73391]: DEBUG nova.compute.manager [req-042ca4c0-c0de-41ea-9714-7443160c3ceb req-e766d950-3510-4d5c-ac6e-d1664067f27d service nova] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Received event network-vif-plugged-de932b15-d8c8-4714-80c0-c9eedeb26588 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:33:18 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-042ca4c0-c0de-41ea-9714-7443160c3ceb req-e766d950-3510-4d5c-ac6e-d1664067f27d service nova] Acquiring lock "8186459b-5bcb-4b5a-b6d8-d424909614e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:18 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-042ca4c0-c0de-41ea-9714-7443160c3ceb req-e766d950-3510-4d5c-ac6e-d1664067f27d service nova] Lock "8186459b-5bcb-4b5a-b6d8-d424909614e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:18 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-042ca4c0-c0de-41ea-9714-7443160c3ceb req-e766d950-3510-4d5c-ac6e-d1664067f27d service nova] Lock "8186459b-5bcb-4b5a-b6d8-d424909614e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:18 user nova-compute[73391]: DEBUG nova.compute.manager [req-042ca4c0-c0de-41ea-9714-7443160c3ceb req-e766d950-3510-4d5c-ac6e-d1664067f27d service nova] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] No waiting events found dispatching network-vif-plugged-de932b15-d8c8-4714-80c0-c9eedeb26588 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:33:18 user nova-compute[73391]: WARNING nova.compute.manager [req-042ca4c0-c0de-41ea-9714-7443160c3ceb req-e766d950-3510-4d5c-ac6e-d1664067f27d service nova] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Received unexpected event network-vif-plugged-de932b15-d8c8-4714-80c0-c9eedeb26588 for instance with vm_state building and task_state spawning.
Aug 15 05:33:18 user nova-compute[73391]: DEBUG nova.compute.manager [req-042ca4c0-c0de-41ea-9714-7443160c3ceb req-e766d950-3510-4d5c-ac6e-d1664067f27d service nova] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Received event network-vif-plugged-de932b15-d8c8-4714-80c0-c9eedeb26588 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:33:18 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-042ca4c0-c0de-41ea-9714-7443160c3ceb req-e766d950-3510-4d5c-ac6e-d1664067f27d service nova] Acquiring lock "8186459b-5bcb-4b5a-b6d8-d424909614e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:18 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-042ca4c0-c0de-41ea-9714-7443160c3ceb req-e766d950-3510-4d5c-ac6e-d1664067f27d service nova] Lock "8186459b-5bcb-4b5a-b6d8-d424909614e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:18 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-042ca4c0-c0de-41ea-9714-7443160c3ceb req-e766d950-3510-4d5c-ac6e-d1664067f27d service nova] Lock "8186459b-5bcb-4b5a-b6d8-d424909614e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:18 user nova-compute[73391]: DEBUG nova.compute.manager [req-042ca4c0-c0de-41ea-9714-7443160c3ceb req-e766d950-3510-4d5c-ac6e-d1664067f27d service nova] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] No waiting events found dispatching network-vif-plugged-de932b15-d8c8-4714-80c0-c9eedeb26588 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:33:18 user nova-compute[73391]: WARNING nova.compute.manager [req-042ca4c0-c0de-41ea-9714-7443160c3ceb req-e766d950-3510-4d5c-ac6e-d1664067f27d service nova] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Received unexpected event network-vif-plugged-de932b15-d8c8-4714-80c0-c9eedeb26588 for instance with vm_state building and task_state spawning.
Aug 15 05:33:18 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077598.5335202, 8186459b-5bcb-4b5a-b6d8-d424909614e5 => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:33:18 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] VM Resumed (Lifecycle Event)
Aug 15 05:33:18 user nova-compute[73391]: DEBUG nova.compute.manager [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:33:18 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Guest created on hypervisor {{(pid=73391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 05:33:18 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:33:18 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Instance spawned successfully.
Aug 15 05:33:18 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 05:33:18 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:33:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b9f5970-65c5-4eff-a4bf-d18a9c916c90/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b9f5970-65c5-4eff-a4bf-d18a9c916c90/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:18 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:33:18 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077598.5427098, 8186459b-5bcb-4b5a-b6d8-d424909614e5 => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:33:18 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] VM Started (Lifecycle Event)
Aug 15 05:33:18 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Found default for hw_cdrom_bus of ide {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:33:18 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Found default for hw_disk_bus of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:33:18 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Found default for hw_input_bus of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:33:18 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Found default for hw_pointer_model of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:33:18 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Found default for hw_video_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:33:18 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Found default for hw_vif_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:33:18 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:33:18 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:33:18 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:33:18 user nova-compute[73391]: INFO nova.compute.manager [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Took 6.36 seconds to spawn the instance on the hypervisor.
Aug 15 05:33:18 user nova-compute[73391]: DEBUG nova.compute.manager [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:33:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b9f5970-65c5-4eff-a4bf-d18a9c916c90/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:18 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:33:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad326342-29f1-4665-bc1b-7e8623751ddc/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:18 user nova-compute[73391]: INFO nova.compute.manager [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Took 7.23 seconds to build instance.
Aug 15 05:33:18 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-db8d6c10-c0b6-434c-b978-c140353844c8 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "8186459b-5bcb-4b5a-b6d8-d424909614e5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.562s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad326342-29f1-4665-bc1b-7e8623751ddc/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad326342-29f1-4665-bc1b-7e8623751ddc/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad326342-29f1-4665-bc1b-7e8623751ddc/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8186459b-5bcb-4b5a-b6d8-d424909614e5/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8186459b-5bcb-4b5a-b6d8-d424909614e5/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8186459b-5bcb-4b5a-b6d8-d424909614e5/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8186459b-5bcb-4b5a-b6d8-d424909614e5/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:20 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:33:20 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:33:20 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Hypervisor/Node resource view: name=user free_ram=7639MB free_disk=25.584850311279297GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 05:33:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:20 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 8f08782b-f793-415e-b0d6-5caad1c3d426 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:33:20 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 6ac9d5dc-56be-402f-b9d4-3327bdfd9220 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:33:20 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 4b9f5970-65c5-4eff-a4bf-d18a9c916c90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:33:20 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 0169df15-335e-46e6-a5c8-9deb7095bb84 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:33:20 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 96c5782e-9d00-4bb8-8e1d-99416bc7d556 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:33:20 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 6358e825-5705-45d6-86b6-3aacfa5a9bbb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:33:20 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance ad326342-29f1-4665-bc1b-7e8623751ddc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:33:20 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance a397a3f0-9b98-4e2b-87a0-f5ff85247c11 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:33:20 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 3f88cd17-c89f-41f3-b630-8eb2c6698155 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:33:20 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 8186459b-5bcb-4b5a-b6d8-d424909614e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:33:20 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 18c8138a-4efc-403f-8b42-e5080c6a51d3 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Aug 15 05:33:20 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 05:33:20 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 05:33:20 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:33:20 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:33:20 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Compute_service record updated for user:user {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 05:33:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.586s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:22 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:33:22 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:33:22 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Starting heal instance info cache {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 05:33:22 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Skipping network cache update for instance because it has been migrated to another host. {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9886}}
Aug 15 05:33:23 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "refresh_cache-4b9f5970-65c5-4eff-a4bf-d18a9c916c90" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:33:23 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquired lock "refresh_cache-4b9f5970-65c5-4eff-a4bf-d18a9c916c90" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:33:23 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Forcefully refreshing network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 05:33:23 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692077588.3280957, df00c15a-2512-41d0-9857-edb50374897e => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:33:23 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: df00c15a-2512-41d0-9857-edb50374897e] VM Stopped (Lifecycle Event)
Aug 15 05:33:23 user nova-compute[73391]: DEBUG nova.compute.manager [None req-0b52f225-fa86-4d37-9110-6b92eefba0e1 None None] [instance: df00c15a-2512-41d0-9857-edb50374897e] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:33:23 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Updating instance_info_cache with network_info: [{"id": "a5f1c5ab-e060-450e-82ee-aa1e4b0ee019", "address": "fa:16:3e:11:2e:cb", "network": {"id": "f69631d8-9da0-4c6d-8530-e8c455942703", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-108520740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d2058584e624e869bf316e4cee4d669", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f1c5ab-e0", "ovs_interfaceid": "a5f1c5ab-e060-450e-82ee-aa1e4b0ee019", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:33:23 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Releasing lock "refresh_cache-4b9f5970-65c5-4eff-a4bf-d18a9c916c90" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:33:23 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Updated the network info_cache for instance {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 05:33:23 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:33:23 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:33:23 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 05:33:23 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Acquiring lock "88847b7f-228c-4347-9091-334da8330201" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Lock "88847b7f-228c-4347-9091-334da8330201" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:25 user nova-compute[73391]: DEBUG nova.compute.manager [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 88847b7f-228c-4347-9091-334da8330201] Starting instance... {{(pid=73391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 05:33:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:25 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 05:33:25 user nova-compute[73391]: INFO nova.compute.claims [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 88847b7f-228c-4347-9091-334da8330201] Claim successful on node user
Aug 15 05:33:26 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:33:26 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:33:26 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.526s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:26 user nova-compute[73391]: DEBUG nova.compute.manager [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 88847b7f-228c-4347-9091-334da8330201] Start building networks asynchronously for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 05:33:26 user nova-compute[73391]: DEBUG nova.compute.manager [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 88847b7f-228c-4347-9091-334da8330201] Allocating IP information in the background. {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 05:33:26 user nova-compute[73391]: DEBUG nova.network.neutron [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 88847b7f-228c-4347-9091-334da8330201] allocate_for_instance() {{(pid=73391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 05:33:26 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 88847b7f-228c-4347-9091-334da8330201] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 05:33:26 user nova-compute[73391]: DEBUG nova.compute.manager [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 88847b7f-228c-4347-9091-334da8330201] Start building block device mappings for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 05:33:26 user nova-compute[73391]: DEBUG nova.compute.manager [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 88847b7f-228c-4347-9091-334da8330201] Start spawning the instance on the hypervisor. {{(pid=73391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 05:33:26 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 88847b7f-228c-4347-9091-334da8330201] Creating instance directory {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 05:33:26 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 88847b7f-228c-4347-9091-334da8330201] Creating image(s)
Aug 15 05:33:26 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Acquiring lock "/opt/stack/data/nova/instances/88847b7f-228c-4347-9091-334da8330201/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:26 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Lock "/opt/stack/data/nova/instances/88847b7f-228c-4347-9091-334da8330201/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:26 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Lock "/opt/stack/data/nova/instances/88847b7f-228c-4347-9091-334da8330201/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:26 user nova-compute[73391]: DEBUG nova.policy [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1cf057edc97f43aa9281ecc44885adaa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628ed773a4de409084f7b3930d8c4dce', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73391) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 05:33:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.182s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:26 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Acquiring lock "999b315ba87151d8252d543312ae7790e7e1583b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:26 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.188s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/88847b7f-228c-4347-9091-334da8330201/disk 1073741824 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/88847b7f-228c-4347-9091-334da8330201/disk 1073741824" returned: 0 in 0.049s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:26 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.184s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:26 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Checking if we can resize image /opt/stack/data/nova/instances/88847b7f-228c-4347-9091-334da8330201/disk. size=1073741824 {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 05:33:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88847b7f-228c-4347-9091-334da8330201/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88847b7f-228c-4347-9091-334da8330201/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:27 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Cannot resize image /opt/stack/data/nova/instances/88847b7f-228c-4347-9091-334da8330201/disk to a smaller size. {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 05:33:27 user nova-compute[73391]: DEBUG nova.objects.instance [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Lazy-loading 'migration_context' on Instance uuid 88847b7f-228c-4347-9091-334da8330201 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:33:27 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 88847b7f-228c-4347-9091-334da8330201] Created local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 05:33:27 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 88847b7f-228c-4347-9091-334da8330201] Ensure instance console log exists: /opt/stack/data/nova/instances/88847b7f-228c-4347-9091-334da8330201/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 05:33:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:27 user nova-compute[73391]: DEBUG nova.network.neutron [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 88847b7f-228c-4347-9091-334da8330201] Successfully created port: 8b6c87eb-382f-46f3-a3bd-c771022c8768 {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 05:33:28 user nova-compute[73391]: DEBUG nova.network.neutron [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 88847b7f-228c-4347-9091-334da8330201] Successfully updated port: 8b6c87eb-382f-46f3-a3bd-c771022c8768 {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:33:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Acquiring lock "refresh_cache-88847b7f-228c-4347-9091-334da8330201" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:33:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Acquired lock "refresh_cache-88847b7f-228c-4347-9091-334da8330201" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:33:28 user nova-compute[73391]: DEBUG nova.network.neutron [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 88847b7f-228c-4347-9091-334da8330201] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:33:28 user nova-compute[73391]: DEBUG nova.compute.manager [req-8382bd7f-c79f-40d2-920f-7f6e781061b7 req-27648383-30be-42d3-8a60-f76a935b0b73 service nova] [instance: 88847b7f-228c-4347-9091-334da8330201] Received event network-changed-8b6c87eb-382f-46f3-a3bd-c771022c8768 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:33:28 user nova-compute[73391]: DEBUG nova.compute.manager [req-8382bd7f-c79f-40d2-920f-7f6e781061b7 req-27648383-30be-42d3-8a60-f76a935b0b73 service nova] [instance: 88847b7f-228c-4347-9091-334da8330201] Refreshing instance network info cache due to event network-changed-8b6c87eb-382f-46f3-a3bd-c771022c8768. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:33:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-8382bd7f-c79f-40d2-920f-7f6e781061b7 req-27648383-30be-42d3-8a60-f76a935b0b73 service nova] Acquiring lock "refresh_cache-88847b7f-228c-4347-9091-334da8330201" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:33:28 user nova-compute[73391]: DEBUG nova.network.neutron [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 88847b7f-228c-4347-9091-334da8330201] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:33:28 user nova-compute[73391]: DEBUG nova.network.neutron [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 88847b7f-228c-4347-9091-334da8330201] Updating instance_info_cache with network_info: [{"id": "8b6c87eb-382f-46f3-a3bd-c771022c8768", "address": "fa:16:3e:f9:f8:57", "network": {"id": "2a2a0416-9965-47d3-976b-28e0e0b3340a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-179068040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628ed773a4de409084f7b3930d8c4dce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b6c87eb-38", "ovs_interfaceid": "8b6c87eb-382f-46f3-a3bd-c771022c8768", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:33:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Releasing lock "refresh_cache-88847b7f-228c-4347-9091-334da8330201" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:33:28 user nova-compute[73391]: DEBUG nova.compute.manager [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 88847b7f-228c-4347-9091-334da8330201] Instance network_info: |[{"id": "8b6c87eb-382f-46f3-a3bd-c771022c8768", "address": "fa:16:3e:f9:f8:57", "network": {"id": "2a2a0416-9965-47d3-976b-28e0e0b3340a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-179068040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628ed773a4de409084f7b3930d8c4dce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b6c87eb-38", "ovs_interfaceid": "8b6c87eb-382f-46f3-a3bd-c771022c8768", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 05:33:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-8382bd7f-c79f-40d2-920f-7f6e781061b7 req-27648383-30be-42d3-8a60-f76a935b0b73 service nova] Acquired lock "refresh_cache-88847b7f-228c-4347-9091-334da8330201" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:33:28 user nova-compute[73391]: DEBUG nova.network.neutron [req-8382bd7f-c79f-40d2-920f-7f6e781061b7 req-27648383-30be-42d3-8a60-f76a935b0b73 service nova] [instance: 88847b7f-228c-4347-9091-334da8330201] Refreshing network info cache for port 8b6c87eb-382f-46f3-a3bd-c771022c8768 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:33:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 88847b7f-228c-4347-9091-334da8330201] Start _get_guest_xml network_info=[{"id": "8b6c87eb-382f-46f3-a3bd-c771022c8768", "address": "fa:16:3e:f9:f8:57", "network": {"id": "2a2a0416-9965-47d3-976b-28e0e0b3340a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-179068040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628ed773a4de409084f7b3930d8c4dce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b6c87eb-38", "ovs_interfaceid": "8b6c87eb-382f-46f3-a3bd-c771022c8768", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '191b1dad-305e-4d1c-9b15-515ec59a3278'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:33:28 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:33:28 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:33:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:33:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:33:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:33:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:33:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:33:28 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:33:28 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:33:28 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:33:28 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:33:28 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:33:28 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:33:28 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:33:28 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:33:28 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:33:28 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:33:28 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:33:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:33:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1078306014',display_name='tempest-VolumesActionsTest-instance-1078306014',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1078306014',id=17,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='628ed773a4de409084f7b3930d8c4dce',ramdisk_id='',reservation_id='r-34h1y72q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2132169708',owner_user_name='tempest-VolumesActionsTest-2132169708-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:33:26Z,user_data=None,user_id='1cf057edc97f43aa9281ecc44885adaa',uuid=88847b7f-228c-4347-9091-334da8330201,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b6c87eb-382f-46f3-a3bd-c771022c8768", "address": "fa:16:3e:f9:f8:57", "network": {"id": "2a2a0416-9965-47d3-976b-28e0e0b3340a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-179068040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628ed773a4de409084f7b3930d8c4dce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b6c87eb-38", "ovs_interfaceid": "8b6c87eb-382f-46f3-a3bd-c771022c8768", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:33:28 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Converting VIF {"id": "8b6c87eb-382f-46f3-a3bd-c771022c8768", "address": "fa:16:3e:f9:f8:57", "network": {"id": "2a2a0416-9965-47d3-976b-28e0e0b3340a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-179068040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628ed773a4de409084f7b3930d8c4dce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b6c87eb-38", "ovs_interfaceid": "8b6c87eb-382f-46f3-a3bd-c771022c8768", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:33:28 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:f8:57,bridge_name='br-int',has_traffic_filtering=True,id=8b6c87eb-382f-46f3-a3bd-c771022c8768,network=Network(2a2a0416-9965-47d3-976b-28e0e0b3340a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b6c87eb-38') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:33:28 user nova-compute[73391]: DEBUG nova.objects.instance [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Lazy-loading 'pci_devices' on Instance uuid 88847b7f-228c-4347-9091-334da8330201 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:33:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:28 user nova-compute[73391]: DEBUG nova.objects.instance [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lazy-loading 'pci_requests' on Instance uuid 18c8138a-4efc-403f-8b42-e5080c6a51d3 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:33:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 88847b7f-228c-4347-9091-334da8330201] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:33:28 user nova-compute[73391]:   <uuid>88847b7f-228c-4347-9091-334da8330201</uuid>
Aug 15 05:33:28 user nova-compute[73391]:   <name>instance-00000011</name>
Aug 15 05:33:28 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:33:28 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:33:28 user nova-compute[73391]:   <metadata>
Aug 15 05:33:28 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:33:28 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:33:28 user nova-compute[73391]:       <nova:name>tempest-VolumesActionsTest-instance-1078306014</nova:name>
Aug 15 05:33:28 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:33:28</nova:creationTime>
Aug 15 05:33:28 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:33:28 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:33:28 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:33:28 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:33:28 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:33:28 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:33:28 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:33:28 user nova-compute[73391]:       <nova:owner>
Aug 15 05:33:28 user nova-compute[73391]:         <nova:user uuid="1cf057edc97f43aa9281ecc44885adaa">tempest-VolumesActionsTest-2132169708-project-member</nova:user>
Aug 15 05:33:28 user nova-compute[73391]:         <nova:project uuid="628ed773a4de409084f7b3930d8c4dce">tempest-VolumesActionsTest-2132169708</nova:project>
Aug 15 05:33:28 user nova-compute[73391]:       </nova:owner>
Aug 15 05:33:28 user nova-compute[73391]:       <nova:root type="image" uuid="191b1dad-305e-4d1c-9b15-515ec59a3278"/>
Aug 15 05:33:28 user nova-compute[73391]:       <nova:ports>
Aug 15 05:33:28 user nova-compute[73391]:         <nova:port uuid="8b6c87eb-382f-46f3-a3bd-c771022c8768">
Aug 15 05:33:28 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 05:33:28 user nova-compute[73391]:         </nova:port>
Aug 15 05:33:28 user nova-compute[73391]:       </nova:ports>
Aug 15 05:33:28 user nova-compute[73391]:     </nova:instance>
Aug 15 05:33:28 user nova-compute[73391]:   </metadata>
Aug 15 05:33:28 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:33:28 user nova-compute[73391]:     <system>
Aug 15 05:33:28 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:33:28 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:33:28 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:33:28 user nova-compute[73391]:       <entry name="serial">88847b7f-228c-4347-9091-334da8330201</entry>
Aug 15 05:33:28 user nova-compute[73391]:       <entry name="uuid">88847b7f-228c-4347-9091-334da8330201</entry>
Aug 15 05:33:28 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:33:28 user nova-compute[73391]:     </system>
Aug 15 05:33:28 user nova-compute[73391]:   </sysinfo>
Aug 15 05:33:28 user nova-compute[73391]:   <os>
Aug 15 05:33:28 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:33:28 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:33:28 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:33:28 user nova-compute[73391]:   </os>
Aug 15 05:33:28 user nova-compute[73391]:   <features>
Aug 15 05:33:28 user nova-compute[73391]:     <acpi/>
Aug 15 05:33:28 user nova-compute[73391]:     <apic/>
Aug 15 05:33:28 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:33:28 user nova-compute[73391]:   </features>
Aug 15 05:33:28 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:33:28 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:33:28 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:33:28 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:33:28 user nova-compute[73391]:   </clock>
Aug 15 05:33:28 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:33:28 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:33:28 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:33:28 user nova-compute[73391]:   </cpu>
Aug 15 05:33:28 user nova-compute[73391]:   <devices>
Aug 15 05:33:28 user nova-compute[73391]:     <disk type="file" device="disk">
Aug 15 05:33:28 user nova-compute[73391]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 05:33:28 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/88847b7f-228c-4347-9091-334da8330201/disk"/>
Aug 15 05:33:28 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:33:28 user nova-compute[73391]:     </disk>
Aug 15 05:33:28 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:33:28 user nova-compute[73391]:       <mac address="fa:16:3e:f9:f8:57"/>
Aug 15 05:33:28 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:33:28 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:33:28 user nova-compute[73391]:       <target dev="tap8b6c87eb-38"/>
Aug 15 05:33:28 user nova-compute[73391]:     </interface>
Aug 15 05:33:28 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:33:28 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/88847b7f-228c-4347-9091-334da8330201/console.log" append="off"/>
Aug 15 05:33:28 user nova-compute[73391]:     </serial>
Aug 15 05:33:28 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:33:28 user nova-compute[73391]:     <video>
Aug 15 05:33:28 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:33:28 user nova-compute[73391]:     </video>
Aug 15 05:33:28 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:33:28 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:33:28 user nova-compute[73391]:     </rng>
Aug 15 05:33:28 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:33:28 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:33:28 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:33:28 user nova-compute[73391]:     </memballoon>
Aug 15 05:33:28 user nova-compute[73391]:   </devices>
Aug 15 05:33:28 user nova-compute[73391]: </domain>
Aug 15 05:33:28 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:33:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:33:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1078306014',display_name='tempest-VolumesActionsTest-instance-1078306014',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1078306014',id=17,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='628ed773a4de409084f7b3930d8c4dce',ramdisk_id='',reservation_id='r-34h1y72q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2132169708',owner_user_name='tempest-VolumesActionsTest-2132169708-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:33:26Z,user_data=None,user_id='1cf057edc97f43aa9281ecc44885adaa',uuid=88847b7f-228c-4347-9091-334da8330201,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b6c87eb-382f-46f3-a3bd-c771022c8768", "address": "fa:16:3e:f9:f8:57", "network": {"id": "2a2a0416-9965-47d3-976b-28e0e0b3340a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-179068040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628ed773a4de409084f7b3930d8c4dce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b6c87eb-38", "ovs_interfaceid": "8b6c87eb-382f-46f3-a3bd-c771022c8768", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:33:28 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Converting VIF {"id": "8b6c87eb-382f-46f3-a3bd-c771022c8768", "address": "fa:16:3e:f9:f8:57", "network": {"id": "2a2a0416-9965-47d3-976b-28e0e0b3340a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-179068040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628ed773a4de409084f7b3930d8c4dce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b6c87eb-38", "ovs_interfaceid": "8b6c87eb-382f-46f3-a3bd-c771022c8768", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:33:28 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:f8:57,bridge_name='br-int',has_traffic_filtering=True,id=8b6c87eb-382f-46f3-a3bd-c771022c8768,network=Network(2a2a0416-9965-47d3-976b-28e0e0b3340a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b6c87eb-38') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:33:28 user nova-compute[73391]: DEBUG os_vif [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:f8:57,bridge_name='br-int',has_traffic_filtering=True,id=8b6c87eb-382f-46f3-a3bd-c771022c8768,network=Network(2a2a0416-9965-47d3-976b-28e0e0b3340a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b6c87eb-38') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:33:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:33:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:33:28 user nova-compute[73391]: DEBUG nova.objects.instance [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lazy-loading 'numa_topology' on Instance uuid 18c8138a-4efc-403f-8b42-e5080c6a51d3 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:33:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b6c87eb-38, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:33:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8b6c87eb-38, col_values=(('external_ids', {'iface-id': '8b6c87eb-382f-46f3-a3bd-c771022c8768', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:f8:57', 'vm-uuid': '88847b7f-228c-4347-9091-334da8330201'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:33:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:33:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:28 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 05:33:28 user nova-compute[73391]: INFO nova.compute.claims [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Claim successful on node user
Aug 15 05:33:28 user nova-compute[73391]: INFO os_vif [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:f8:57,bridge_name='br-int',has_traffic_filtering=True,id=8b6c87eb-382f-46f3-a3bd-c771022c8768,network=Network(2a2a0416-9965-47d3-976b-28e0e0b3340a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b6c87eb-38')
Aug 15 05:33:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:33:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] No VIF found with MAC fa:16:3e:f9:f8:57, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:33:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:29 user nova-compute[73391]: DEBUG nova.network.neutron [req-8382bd7f-c79f-40d2-920f-7f6e781061b7 req-27648383-30be-42d3-8a60-f76a935b0b73 service nova] [instance: 88847b7f-228c-4347-9091-334da8330201] Updated VIF entry in instance network info cache for port 8b6c87eb-382f-46f3-a3bd-c771022c8768. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:33:29 user nova-compute[73391]: DEBUG nova.network.neutron [req-8382bd7f-c79f-40d2-920f-7f6e781061b7 req-27648383-30be-42d3-8a60-f76a935b0b73 service nova] [instance: 88847b7f-228c-4347-9091-334da8330201] Updating instance_info_cache with network_info: [{"id": "8b6c87eb-382f-46f3-a3bd-c771022c8768", "address": "fa:16:3e:f9:f8:57", "network": {"id": "2a2a0416-9965-47d3-976b-28e0e0b3340a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-179068040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628ed773a4de409084f7b3930d8c4dce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b6c87eb-38", "ovs_interfaceid": "8b6c87eb-382f-46f3-a3bd-c771022c8768", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:33:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-8382bd7f-c79f-40d2-920f-7f6e781061b7 req-27648383-30be-42d3-8a60-f76a935b0b73 service nova] Releasing lock "refresh_cache-88847b7f-228c-4347-9091-334da8330201" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:33:29 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:33:29 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:33:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.570s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:29 user nova-compute[73391]: INFO nova.network.neutron [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Updating port bf92cfab-6648-42bd-b9f0-2a6f38562165 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 15 05:33:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Acquiring lock "refresh_cache-18c8138a-4efc-403f-8b42-e5080c6a51d3" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:33:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Acquired lock "refresh_cache-18c8138a-4efc-403f-8b42-e5080c6a51d3" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:33:30 user nova-compute[73391]: DEBUG nova.network.neutron [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:33:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:30 user nova-compute[73391]: DEBUG nova.compute.manager [req-7f86d8d2-f1b0-4d72-9df2-124dc0ae39fd req-5eb2a392-9bc0-41c9-afcf-b0315d07b011 service nova] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Received event network-changed-bf92cfab-6648-42bd-b9f0-2a6f38562165 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:33:30 user nova-compute[73391]: DEBUG nova.compute.manager [req-7f86d8d2-f1b0-4d72-9df2-124dc0ae39fd req-5eb2a392-9bc0-41c9-afcf-b0315d07b011 service nova] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Refreshing instance network info cache due to event network-changed-bf92cfab-6648-42bd-b9f0-2a6f38562165. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:33:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-7f86d8d2-f1b0-4d72-9df2-124dc0ae39fd req-5eb2a392-9bc0-41c9-afcf-b0315d07b011 service nova] Acquiring lock "refresh_cache-18c8138a-4efc-403f-8b42-e5080c6a51d3" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:33:30 user nova-compute[73391]: DEBUG nova.compute.manager [req-587f0990-1ecc-4026-af37-f700c89bbec9 req-022e3889-387a-495f-9aa1-126e6336c5a1 service nova] [instance: 88847b7f-228c-4347-9091-334da8330201] Received event network-vif-plugged-8b6c87eb-382f-46f3-a3bd-c771022c8768 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:33:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-587f0990-1ecc-4026-af37-f700c89bbec9 req-022e3889-387a-495f-9aa1-126e6336c5a1 service nova] Acquiring lock "88847b7f-228c-4347-9091-334da8330201-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-587f0990-1ecc-4026-af37-f700c89bbec9 req-022e3889-387a-495f-9aa1-126e6336c5a1 service nova] Lock "88847b7f-228c-4347-9091-334da8330201-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-587f0990-1ecc-4026-af37-f700c89bbec9 req-022e3889-387a-495f-9aa1-126e6336c5a1 service nova] Lock "88847b7f-228c-4347-9091-334da8330201-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:30 user nova-compute[73391]: DEBUG nova.compute.manager [req-587f0990-1ecc-4026-af37-f700c89bbec9 req-022e3889-387a-495f-9aa1-126e6336c5a1 service nova] [instance: 88847b7f-228c-4347-9091-334da8330201] No waiting events found dispatching network-vif-plugged-8b6c87eb-382f-46f3-a3bd-c771022c8768 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:33:30 user nova-compute[73391]: WARNING nova.compute.manager [req-587f0990-1ecc-4026-af37-f700c89bbec9 req-022e3889-387a-495f-9aa1-126e6336c5a1 service nova] [instance: 88847b7f-228c-4347-9091-334da8330201] Received unexpected event network-vif-plugged-8b6c87eb-382f-46f3-a3bd-c771022c8768 for instance with vm_state building and task_state spawning.
Aug 15 05:33:30 user nova-compute[73391]: DEBUG nova.network.neutron [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Updating instance_info_cache with network_info: [{"id": "bf92cfab-6648-42bd-b9f0-2a6f38562165", "address": "fa:16:3e:ba:49:5f", "network": {"id": "f67152a9-4f18-4d7f-9d3e-5e517bd46813", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-731866550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88871d09f7e347a4b9104a558604f2f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf92cfab-66", "ovs_interfaceid": "bf92cfab-6648-42bd-b9f0-2a6f38562165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:33:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Releasing lock "refresh_cache-18c8138a-4efc-403f-8b42-e5080c6a51d3" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:33:30 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Creating instance directory {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 05:33:30 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Creating image(s)
Aug 15 05:33:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Acquiring lock "/opt/stack/data/nova/instances/18c8138a-4efc-403f-8b42-e5080c6a51d3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "/opt/stack/data/nova/instances/18c8138a-4efc-403f-8b42-e5080c6a51d3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "/opt/stack/data/nova/instances/18c8138a-4efc-403f-8b42-e5080c6a51d3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:30 user nova-compute[73391]: DEBUG nova.objects.instance [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lazy-loading 'trusted_certs' on Instance uuid 18c8138a-4efc-403f-8b42-e5080c6a51d3 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:33:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-7f86d8d2-f1b0-4d72-9df2-124dc0ae39fd req-5eb2a392-9bc0-41c9-afcf-b0315d07b011 service nova] Acquired lock "refresh_cache-18c8138a-4efc-403f-8b42-e5080c6a51d3" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:33:30 user nova-compute[73391]: DEBUG nova.network.neutron [req-7f86d8d2-f1b0-4d72-9df2-124dc0ae39fd req-5eb2a392-9bc0-41c9-afcf-b0315d07b011 service nova] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Refreshing network info cache for port bf92cfab-6648-42bd-b9f0-2a6f38562165 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:33:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Acquiring lock "5879527ac474fa01d95e727ae35634824d86b876" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "5879527ac474fa01d95e727ae35634824d86b876" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5879527ac474fa01d95e727ae35634824d86b876.part --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5879527ac474fa01d95e727ae35634824d86b876.part --force-share --output=json" returned: 0 in 0.204s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:31 user nova-compute[73391]: DEBUG nova.virt.images [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] 7a7ff1bb-1715-4ce4-afca-751bea2e698b was qcow2, converting to raw {{(pid=73391) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 05:33:31 user nova-compute[73391]: DEBUG nova.privsep.utils [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73391) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 05:33:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5879527ac474fa01d95e727ae35634824d86b876.part /opt/stack/data/nova/instances/_base/5879527ac474fa01d95e727ae35634824d86b876.converted {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5879527ac474fa01d95e727ae35634824d86b876.part /opt/stack/data/nova/instances/_base/5879527ac474fa01d95e727ae35634824d86b876.converted" returned: 0 in 0.212s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5879527ac474fa01d95e727ae35634824d86b876.converted --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:32 user nova-compute[73391]: DEBUG nova.network.neutron [req-7f86d8d2-f1b0-4d72-9df2-124dc0ae39fd req-5eb2a392-9bc0-41c9-afcf-b0315d07b011 service nova] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Updated VIF entry in instance network info cache for port bf92cfab-6648-42bd-b9f0-2a6f38562165. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:33:32 user nova-compute[73391]: DEBUG nova.network.neutron [req-7f86d8d2-f1b0-4d72-9df2-124dc0ae39fd req-5eb2a392-9bc0-41c9-afcf-b0315d07b011 service nova] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Updating instance_info_cache with network_info: [{"id": "bf92cfab-6648-42bd-b9f0-2a6f38562165", "address": "fa:16:3e:ba:49:5f", "network": {"id": "f67152a9-4f18-4d7f-9d3e-5e517bd46813", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-731866550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88871d09f7e347a4b9104a558604f2f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf92cfab-66", "ovs_interfaceid": "bf92cfab-6648-42bd-b9f0-2a6f38562165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:33:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-7f86d8d2-f1b0-4d72-9df2-124dc0ae39fd req-5eb2a392-9bc0-41c9-afcf-b0315d07b011 service nova] Releasing lock "refresh_cache-18c8138a-4efc-403f-8b42-e5080c6a51d3" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:33:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5879527ac474fa01d95e727ae35634824d86b876.converted --force-share --output=json" returned: 0 in 0.213s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "5879527ac474fa01d95e727ae35634824d86b876" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.568s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5879527ac474fa01d95e727ae35634824d86b876 --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:32 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:32 user nova-compute[73391]: DEBUG nova.compute.manager [req-52fded66-b223-439f-ad04-e4f9894af2c6 req-99e83706-38c8-4514-ab81-197fe11a98ba service nova] [instance: 88847b7f-228c-4347-9091-334da8330201] Received event network-vif-plugged-8b6c87eb-382f-46f3-a3bd-c771022c8768 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:33:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-52fded66-b223-439f-ad04-e4f9894af2c6 req-99e83706-38c8-4514-ab81-197fe11a98ba service nova] Acquiring lock "88847b7f-228c-4347-9091-334da8330201-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-52fded66-b223-439f-ad04-e4f9894af2c6 req-99e83706-38c8-4514-ab81-197fe11a98ba service nova] Lock "88847b7f-228c-4347-9091-334da8330201-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-52fded66-b223-439f-ad04-e4f9894af2c6 req-99e83706-38c8-4514-ab81-197fe11a98ba service nova] Lock "88847b7f-228c-4347-9091-334da8330201-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:32 user nova-compute[73391]: DEBUG nova.compute.manager [req-52fded66-b223-439f-ad04-e4f9894af2c6 req-99e83706-38c8-4514-ab81-197fe11a98ba service nova] [instance: 88847b7f-228c-4347-9091-334da8330201] No waiting events found dispatching network-vif-plugged-8b6c87eb-382f-46f3-a3bd-c771022c8768 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:33:32 user nova-compute[73391]: WARNING nova.compute.manager [req-52fded66-b223-439f-ad04-e4f9894af2c6 req-99e83706-38c8-4514-ab81-197fe11a98ba service nova] [instance: 88847b7f-228c-4347-9091-334da8330201] Received unexpected event network-vif-plugged-8b6c87eb-382f-46f3-a3bd-c771022c8768 for instance with vm_state building and task_state spawning.
Aug 15 05:33:32 user nova-compute[73391]: DEBUG nova.compute.manager [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 88847b7f-228c-4347-9091-334da8330201] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:33:32 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 88847b7f-228c-4347-9091-334da8330201] Guest created on hypervisor {{(pid=73391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 05:33:32 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077612.6584108, 88847b7f-228c-4347-9091-334da8330201 => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:33:32 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 88847b7f-228c-4347-9091-334da8330201] VM Resumed (Lifecycle Event)
Aug 15 05:33:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5879527ac474fa01d95e727ae35634824d86b876 --force-share --output=json" returned: 0 in 0.247s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Acquiring lock "5879527ac474fa01d95e727ae35634824d86b876" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "5879527ac474fa01d95e727ae35634824d86b876" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5879527ac474fa01d95e727ae35634824d86b876 --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:32 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 88847b7f-228c-4347-9091-334da8330201] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:33:32 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 88847b7f-228c-4347-9091-334da8330201] Instance spawned successfully.
Aug 15 05:33:32 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 88847b7f-228c-4347-9091-334da8330201] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 05:33:32 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 88847b7f-228c-4347-9091-334da8330201] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:33:32 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 88847b7f-228c-4347-9091-334da8330201] Found default for hw_cdrom_bus of ide {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:33:32 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 88847b7f-228c-4347-9091-334da8330201] Found default for hw_disk_bus of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:33:32 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 88847b7f-228c-4347-9091-334da8330201] Found default for hw_input_bus of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:33:32 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 88847b7f-228c-4347-9091-334da8330201] Found default for hw_pointer_model of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:33:32 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 88847b7f-228c-4347-9091-334da8330201] Found default for hw_video_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:33:32 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 88847b7f-228c-4347-9091-334da8330201] Found default for hw_vif_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:33:32 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 88847b7f-228c-4347-9091-334da8330201] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:33:32 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077612.6674402, 88847b7f-228c-4347-9091-334da8330201 => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:33:32 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 88847b7f-228c-4347-9091-334da8330201] VM Started (Lifecycle Event)
Aug 15 05:33:32 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 88847b7f-228c-4347-9091-334da8330201] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:33:32 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 88847b7f-228c-4347-9091-334da8330201] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:33:32 user nova-compute[73391]: INFO nova.compute.manager [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 88847b7f-228c-4347-9091-334da8330201] Took 6.58 seconds to spawn the instance on the hypervisor.
Aug 15 05:33:32 user nova-compute[73391]: DEBUG nova.compute.manager [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 88847b7f-228c-4347-9091-334da8330201] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:33:32 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 88847b7f-228c-4347-9091-334da8330201] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:33:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5879527ac474fa01d95e727ae35634824d86b876 --force-share --output=json" returned: 0 in 0.222s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5879527ac474fa01d95e727ae35634824d86b876,backing_fmt=raw /opt/stack/data/nova/instances/18c8138a-4efc-403f-8b42-e5080c6a51d3/disk 1073741824 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:32 user nova-compute[73391]: INFO nova.compute.manager [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 88847b7f-228c-4347-9091-334da8330201] Took 7.41 seconds to build instance.
Aug 15 05:33:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5879527ac474fa01d95e727ae35634824d86b876,backing_fmt=raw /opt/stack/data/nova/instances/18c8138a-4efc-403f-8b42-e5080c6a51d3/disk 1073741824" returned: 0 in 0.059s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "5879527ac474fa01d95e727ae35634824d86b876" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5879527ac474fa01d95e727ae35634824d86b876 --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7d80e37d-49ad-4ecd-922b-24178676af5c tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Lock "88847b7f-228c-4347-9091-334da8330201" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.561s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:33 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5879527ac474fa01d95e727ae35634824d86b876 --force-share --output=json" returned: 0 in 0.187s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:33 user nova-compute[73391]: DEBUG nova.objects.instance [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lazy-loading 'migration_context' on Instance uuid 18c8138a-4efc-403f-8b42-e5080c6a51d3 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:33:33 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Rebasing disk image.
Aug 15 05:33:33 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:33 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.191s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:33 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b -F raw /opt/stack/data/nova/instances/18c8138a-4efc-403f-8b42-e5080c6a51d3/disk {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-b7bcc0c6-5187-4516-b994-6fed938c07ca tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Acquiring lock "0169df15-335e-46e6-a5c8-9deb7095bb84" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-b7bcc0c6-5187-4516-b994-6fed938c07ca tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Lock "0169df15-335e-46e6-a5c8-9deb7095bb84" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-b7bcc0c6-5187-4516-b994-6fed938c07ca tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Acquiring lock "0169df15-335e-46e6-a5c8-9deb7095bb84-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-b7bcc0c6-5187-4516-b994-6fed938c07ca tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Lock "0169df15-335e-46e6-a5c8-9deb7095bb84-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-b7bcc0c6-5187-4516-b994-6fed938c07ca tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Lock "0169df15-335e-46e6-a5c8-9deb7095bb84-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:34 user nova-compute[73391]: INFO nova.compute.manager [None req-b7bcc0c6-5187-4516-b994-6fed938c07ca tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Terminating instance
Aug 15 05:33:34 user nova-compute[73391]: DEBUG nova.compute.manager [None req-b7bcc0c6-5187-4516-b994-6fed938c07ca tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Start destroying the instance on the hypervisor. {{(pid=73391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG nova.compute.manager [req-7541773e-254b-40ff-98a2-06deb929dd34 req-e764f2e3-79c6-4d8d-8810-e0c0ebebc11f service nova] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Received event network-vif-unplugged-57ecc71f-8eb7-4129-bed4-3e085ce44291 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-7541773e-254b-40ff-98a2-06deb929dd34 req-e764f2e3-79c6-4d8d-8810-e0c0ebebc11f service nova] Acquiring lock "0169df15-335e-46e6-a5c8-9deb7095bb84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-7541773e-254b-40ff-98a2-06deb929dd34 req-e764f2e3-79c6-4d8d-8810-e0c0ebebc11f service nova] Lock "0169df15-335e-46e6-a5c8-9deb7095bb84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-7541773e-254b-40ff-98a2-06deb929dd34 req-e764f2e3-79c6-4d8d-8810-e0c0ebebc11f service nova] Lock "0169df15-335e-46e6-a5c8-9deb7095bb84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG nova.compute.manager [req-7541773e-254b-40ff-98a2-06deb929dd34 req-e764f2e3-79c6-4d8d-8810-e0c0ebebc11f service nova] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] No waiting events found dispatching network-vif-unplugged-57ecc71f-8eb7-4129-bed4-3e085ce44291 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG nova.compute.manager [req-7541773e-254b-40ff-98a2-06deb929dd34 req-e764f2e3-79c6-4d8d-8810-e0c0ebebc11f service nova] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Received event network-vif-unplugged-57ecc71f-8eb7-4129-bed4-3e085ce44291 for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 05:33:35 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Instance destroyed successfully.
Aug 15 05:33:35 user nova-compute[73391]: DEBUG nova.objects.instance [None req-b7bcc0c6-5187-4516-b994-6fed938c07ca tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Lazy-loading 'resources' on Instance uuid 0169df15-335e-46e6-a5c8-9deb7095bb84 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-b7bcc0c6-5187-4516-b994-6fed938c07ca tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:29:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-516794791',display_name='tempest-TestVolumeSwap-server-516794791',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-516794791',id=7,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtDKbF4Pl70MHN7gp19OmCBsNRSEKdMcGS9/K02eXD9H0YtBmg9vYc5H7bbTPNy5r/9WXx4K0EW6L1hN6CAnV02oXTKcZyJ2/xehN/J0spF9FiQQNQSoXXedzGtIYwh8w==',key_name='tempest-keypair-399201667',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:30:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a845478f29ec418db07b467f5d47f753',ramdisk_id='',reservation_id='r-f3x40bgb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-571689350',owner_user_name='tempest-TestVolumeSwap-571689350-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:30:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4cffa0765f9d4d0297e7f5d1b43b639a',uuid=0169df15-335e-46e6-a5c8-9deb7095bb84,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "57ecc71f-8eb7-4129-bed4-3e085ce44291", "address": "fa:16:3e:09:d0:87", "network": {"id": "5cff12e9-5977-4f76-b8c9-f166bdb40ffe", "bridge": "br-int", "label": "tempest-TestVolumeSwap-440667944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a845478f29ec418db07b467f5d47f753", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57ecc71f-8e", "ovs_interfaceid": "57ecc71f-8eb7-4129-bed4-3e085ce44291", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-b7bcc0c6-5187-4516-b994-6fed938c07ca tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Converting VIF {"id": "57ecc71f-8eb7-4129-bed4-3e085ce44291", "address": "fa:16:3e:09:d0:87", "network": {"id": "5cff12e9-5977-4f76-b8c9-f166bdb40ffe", "bridge": "br-int", "label": "tempest-TestVolumeSwap-440667944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a845478f29ec418db07b467f5d47f753", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57ecc71f-8e", "ovs_interfaceid": "57ecc71f-8eb7-4129-bed4-3e085ce44291", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-b7bcc0c6-5187-4516-b994-6fed938c07ca tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:d0:87,bridge_name='br-int',has_traffic_filtering=True,id=57ecc71f-8eb7-4129-bed4-3e085ce44291,network=Network(5cff12e9-5977-4f76-b8c9-f166bdb40ffe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57ecc71f-8e') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG os_vif [None req-b7bcc0c6-5187-4516-b994-6fed938c07ca tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:d0:87,bridge_name='br-int',has_traffic_filtering=True,id=57ecc71f-8eb7-4129-bed4-3e085ce44291,network=Network(5cff12e9-5977-4f76-b8c9-f166bdb40ffe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57ecc71f-8e') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b -F raw /opt/stack/data/nova/instances/18c8138a-4efc-403f-8b42-e5080c6a51d3/disk" returned: 0 in 2.392s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Created local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Ensure instance console log exists: /opt/stack/data/nova/instances/18c8138a-4efc-403f-8b42-e5080c6a51d3/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Start _get_guest_xml network_info=[{"id": "bf92cfab-6648-42bd-b9f0-2a6f38562165", "address": "fa:16:3e:ba:49:5f", "network": {"id": "f67152a9-4f18-4d7f-9d3e-5e517bd46813", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-731866550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88871d09f7e347a4b9104a558604f2f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf92cfab-66", "ovs_interfaceid": "bf92cfab-6648-42bd-b9f0-2a6f38562165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='e980469559147a4ef784a2e65b321be9',container_format='bare',created_at=2023-08-15T05:31:24Z,direct_url=<?>,disk_format='qcow2',id=7a7ff1bb-1715-4ce4-afca-751bea2e698b,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1277477436-shelved',owner='88871d09f7e347a4b9104a558604f2f6',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-15T05:31:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '191b1dad-305e-4d1c-9b15-515ec59a3278'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdc', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LeKPNMuf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '18c8138a-4efc-403f-8b42-e5080c6a51d3', 'attached_at': '', 'detached_at': '', 'volume_id': 'b4522c9a-9c99-40b7-835b-5cd15575943e', 'serial': 'b4522c9a-9c99-40b7-835b-5cd15575943e'}, 'attachment_id': 'b3625933-8d73-4cbc-8c4e-af9f80d1c767', 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap57ecc71f-8e, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:33:35 user nova-compute[73391]: INFO os_vif [None req-b7bcc0c6-5187-4516-b994-6fed938c07ca tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:d0:87,bridge_name='br-int',has_traffic_filtering=True,id=57ecc71f-8eb7-4129-bed4-3e085ce44291,network=Network(5cff12e9-5977-4f76-b8c9-f166bdb40ffe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57ecc71f-8e')
Aug 15 05:33:35 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-b7bcc0c6-5187-4516-b994-6fed938c07ca tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Deleting instance files /opt/stack/data/nova/instances/0169df15-335e-46e6-a5c8-9deb7095bb84_del
Aug 15 05:33:35 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-b7bcc0c6-5187-4516-b994-6fed938c07ca tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Deletion of /opt/stack/data/nova/instances/0169df15-335e-46e6-a5c8-9deb7095bb84_del complete
Aug 15 05:33:35 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:33:35 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:33:35 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='e980469559147a4ef784a2e65b321be9',container_format='bare',created_at=2023-08-15T05:31:24Z,direct_url=<?>,disk_format='qcow2',id=7a7ff1bb-1715-4ce4-afca-751bea2e698b,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1277477436-shelved',owner='88871d09f7e347a4b9104a558604f2f6',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-15T05:31:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG nova.objects.instance [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lazy-loading 'vcpu_model' on Instance uuid 18c8138a-4efc-403f-8b42-e5080c6a51d3 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LeKPNMuf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:33:35 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:33:35 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:33:35 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:33:35 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:33:35 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 05:33:35 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:35 user nova-compute[73391]: INFO nova.compute.manager [None req-b7bcc0c6-5187-4516-b994-6fed938c07ca tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Took 1.09 seconds to destroy the instance on the hypervisor.
Aug 15 05:33:35 user nova-compute[73391]: DEBUG oslo.service.loopingcall [None req-b7bcc0c6-5187-4516-b994-6fed938c07ca tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG nova.compute.manager [-] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Deallocating network for instance {{(pid=73391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] deallocate_for_instance() {{(pid=73391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc0a1dc-53cd-432d-97e5-fad731858223]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 05:33:35 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[71343751-eb23-4de7-a532-bf92f6a0a18b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e] added
Aug 15 05:33:35 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e09d68-3a01-4ef8-92ac-1a4a28b94430]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[054be677-4035-40a1-bc86-eb212af5b5c9]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LeKPNMuf {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LeKPNMuf" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b6ef75-0323-4594-b6a1-3db482c09037]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LeKPNMuf'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:33:35 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:36 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2afde9ea-dace-4540-a663-acb92b5ffc82]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:33:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:33:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:36 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[78515925-d310-4cad-b21e-efb9de7e873d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:33:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)
Aug 15 05:33:36 user nova-compute[73391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)
Aug 15 05:33:36 user nova-compute[73391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:33:36 user nova-compute[73391]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 (non-flash)
Aug 15 05:33:36 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:33:36 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:33:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)
Aug 15 05:33:36 user nova-compute[73391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)
Aug 15 05:33:36 user nova-compute[73391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:33:36 user nova-compute[73391]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 (non-flash)
Aug 15 05:33:36 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:33:36 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:33:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:36 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdfa33ed-c2d3-472a-81b4-09603758dc4e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:33:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e, portal: 172.16.0.220,3260]
Aug 15 05:33:36 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e, portal: 172.16.0.220,3260] successful.
Aug 15 05:33:36 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:33:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:36 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[88cd8cdd-c50b-4acc-a900-ff7c1f7c56a1]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:33:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:33:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:36 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef6295d-3597-45af-8f72-ebd0af563199]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:33:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)
Aug 15 05:33:36 user nova-compute[73391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)
Aug 15 05:33:36 user nova-compute[73391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:33:36 user nova-compute[73391]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 (non-flash)
Aug 15 05:33:36 user nova-compute[73391]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e (non-flash)
Aug 15 05:33:36 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:33:36 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:33:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)
Aug 15 05:33:36 user nova-compute[73391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)
Aug 15 05:33:36 user nova-compute[73391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:33:36 user nova-compute[73391]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 (non-flash)
Aug 15 05:33:36 user nova-compute[73391]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e (non-flash)
Aug 15 05:33:36 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:33:36 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:33:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:33:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 05:33:36 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 05:33:36 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 05:33:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.026s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:36 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[949ade59-0761-4ab5-9f5b-9325f51f276e]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:33:36 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:33:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LeKPNMuf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 05:33:36 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:33:36 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Took 0.85 seconds to deallocate network for instance.
Aug 15 05:33:36 user nova-compute[73391]: DEBUG nova.compute.manager [req-bcb81317-00f1-4a55-b108-57aa1e0d3922 req-4a7edfc9-19dc-4b21-95b0-4ff460b80ddc service nova] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Received event network-vif-deleted-57ecc71f-8eb7-4129-bed4-3e085ce44291 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:33:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-b7bcc0c6-5187-4516-b994-6fed938c07ca tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-b7bcc0c6-5187-4516-b994-6fed938c07ca tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:37 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-b7bcc0c6-5187-4516-b994-6fed938c07ca tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:33:37 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-b7bcc0c6-5187-4516-b994-6fed938c07ca tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:33:37 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-b7bcc0c6-5187-4516-b994-6fed938c07ca tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.368s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:37 user nova-compute[73391]: INFO nova.scheduler.client.report [None req-b7bcc0c6-5187-4516-b994-6fed938c07ca tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Deleted allocations for instance 0169df15-335e-46e6-a5c8-9deb7095bb84
Aug 15 05:33:37 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:33:37 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '26531373463313334', 'path': '/dev/sdc'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:33:37 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531373463313334', 'path': '/dev/sdc'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 05:33:37 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T05:29:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1277477436',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1277477436',id=4,image_ref='7a7ff1bb-1715-4ce4-afca-751bea2e698b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-700723771',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:29:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='88871d09f7e347a4b9104a558604f2f6',ramdisk_id='',reservation_id='r-j1g463qr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1774553789',owner_user_name='tempest-AttachVolumeShelveTestJSON-1774553789-project-member',shelved_at='2023-08-15T05:31:29.971597',shelved_host='user',shelved_image_id='7a7ff1bb-1715-4ce4-afca-751bea2e698b'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:33:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c932032fc884b14b9268d5df91d45ea',uuid=18c8138a-4efc-403f-8b42-e5080c6a51d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "bf92cfab-6648-42bd-b9f0-2a6f38562165", "address": "fa:16:3e:ba:49:5f", "network": {"id": "f67152a9-4f18-4d7f-9d3e-5e517bd46813", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-731866550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88871d09f7e347a4b9104a558604f2f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf92cfab-66", "ovs_interfaceid": "bf92cfab-6648-42bd-b9f0-2a6f38562165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:33:37 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Converting VIF {"id": "bf92cfab-6648-42bd-b9f0-2a6f38562165", "address": "fa:16:3e:ba:49:5f", "network": {"id": "f67152a9-4f18-4d7f-9d3e-5e517bd46813", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-731866550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88871d09f7e347a4b9104a558604f2f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf92cfab-66", "ovs_interfaceid": "bf92cfab-6648-42bd-b9f0-2a6f38562165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:33:37 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:49:5f,bridge_name='br-int',has_traffic_filtering=True,id=bf92cfab-6648-42bd-b9f0-2a6f38562165,network=Network(f67152a9-4f18-4d7f-9d3e-5e517bd46813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf92cfab-66') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:33:37 user nova-compute[73391]: DEBUG nova.objects.instance [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lazy-loading 'pci_devices' on Instance uuid 18c8138a-4efc-403f-8b42-e5080c6a51d3 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:33:37 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-b7bcc0c6-5187-4516-b994-6fed938c07ca tempest-TestVolumeSwap-571689350 tempest-TestVolumeSwap-571689350-project-member] Lock "0169df15-335e-46e6-a5c8-9deb7095bb84" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.504s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:37 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:33:37 user nova-compute[73391]:   <uuid>18c8138a-4efc-403f-8b42-e5080c6a51d3</uuid>
Aug 15 05:33:37 user nova-compute[73391]:   <name>instance-00000004</name>
Aug 15 05:33:37 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:33:37 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:33:37 user nova-compute[73391]:   <metadata>
Aug 15 05:33:37 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:33:37 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:33:37 user nova-compute[73391]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1277477436</nova:name>
Aug 15 05:33:37 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:33:35</nova:creationTime>
Aug 15 05:33:37 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:33:37 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:33:37 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:33:37 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:33:37 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:33:37 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:33:37 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:33:37 user nova-compute[73391]:       <nova:owner>
Aug 15 05:33:37 user nova-compute[73391]:         <nova:user uuid="4c932032fc884b14b9268d5df91d45ea">tempest-AttachVolumeShelveTestJSON-1774553789-project-member</nova:user>
Aug 15 05:33:37 user nova-compute[73391]:         <nova:project uuid="88871d09f7e347a4b9104a558604f2f6">tempest-AttachVolumeShelveTestJSON-1774553789</nova:project>
Aug 15 05:33:37 user nova-compute[73391]:       </nova:owner>
Aug 15 05:33:37 user nova-compute[73391]:       <nova:root type="image" uuid="7a7ff1bb-1715-4ce4-afca-751bea2e698b"/>
Aug 15 05:33:37 user nova-compute[73391]:       <nova:ports>
Aug 15 05:33:37 user nova-compute[73391]:         <nova:port uuid="bf92cfab-6648-42bd-b9f0-2a6f38562165">
Aug 15 05:33:37 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 05:33:37 user nova-compute[73391]:         </nova:port>
Aug 15 05:33:37 user nova-compute[73391]:       </nova:ports>
Aug 15 05:33:37 user nova-compute[73391]:     </nova:instance>
Aug 15 05:33:37 user nova-compute[73391]:   </metadata>
Aug 15 05:33:37 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:33:37 user nova-compute[73391]:     <system>
Aug 15 05:33:37 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:33:37 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:33:37 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:33:37 user nova-compute[73391]:       <entry name="serial">18c8138a-4efc-403f-8b42-e5080c6a51d3</entry>
Aug 15 05:33:37 user nova-compute[73391]:       <entry name="uuid">18c8138a-4efc-403f-8b42-e5080c6a51d3</entry>
Aug 15 05:33:37 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:33:37 user nova-compute[73391]:     </system>
Aug 15 05:33:37 user nova-compute[73391]:   </sysinfo>
Aug 15 05:33:37 user nova-compute[73391]:   <os>
Aug 15 05:33:37 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:33:37 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:33:37 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:33:37 user nova-compute[73391]:   </os>
Aug 15 05:33:37 user nova-compute[73391]:   <features>
Aug 15 05:33:37 user nova-compute[73391]:     <acpi/>
Aug 15 05:33:37 user nova-compute[73391]:     <apic/>
Aug 15 05:33:37 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:33:37 user nova-compute[73391]:   </features>
Aug 15 05:33:37 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:33:37 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:33:37 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:33:37 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:33:37 user nova-compute[73391]:   </clock>
Aug 15 05:33:37 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:33:37 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:33:37 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:33:37 user nova-compute[73391]:   </cpu>
Aug 15 05:33:37 user nova-compute[73391]:   <devices>
Aug 15 05:33:37 user nova-compute[73391]:     <disk type="file" device="disk">
Aug 15 05:33:37 user nova-compute[73391]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 05:33:37 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/18c8138a-4efc-403f-8b42-e5080c6a51d3/disk"/>
Aug 15 05:33:37 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:33:37 user nova-compute[73391]:     </disk>
Aug 15 05:33:37 user nova-compute[73391]:     <disk type="block" device="disk">
Aug 15 05:33:37 user nova-compute[73391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:33:37 user nova-compute[73391]:       <source dev="/dev/sdc"/>
Aug 15 05:33:37 user nova-compute[73391]:       <target dev="vdc" bus="virtio"/>
Aug 15 05:33:37 user nova-compute[73391]:       <serial>b4522c9a-9c99-40b7-835b-5cd15575943e</serial>
Aug 15 05:33:37 user nova-compute[73391]:     </disk>
Aug 15 05:33:37 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:33:37 user nova-compute[73391]:       <mac address="fa:16:3e:ba:49:5f"/>
Aug 15 05:33:37 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:33:37 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:33:37 user nova-compute[73391]:       <target dev="tapbf92cfab-66"/>
Aug 15 05:33:37 user nova-compute[73391]:     </interface>
Aug 15 05:33:37 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:33:37 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/18c8138a-4efc-403f-8b42-e5080c6a51d3/console.log" append="off"/>
Aug 15 05:33:37 user nova-compute[73391]:     </serial>
Aug 15 05:33:37 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:33:37 user nova-compute[73391]:     <video>
Aug 15 05:33:37 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:33:37 user nova-compute[73391]:     </video>
Aug 15 05:33:37 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:33:37 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:33:37 user nova-compute[73391]:     </rng>
Aug 15 05:33:37 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:33:37 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:33:37 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:33:37 user nova-compute[73391]:     </memballoon>
Aug 15 05:33:37 user nova-compute[73391]:   </devices>
Aug 15 05:33:37 user nova-compute[73391]: </domain>
Aug 15 05:33:37 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:33:37 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T05:29:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1277477436',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1277477436',id=4,image_ref='7a7ff1bb-1715-4ce4-afca-751bea2e698b',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-700723771',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:29:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='88871d09f7e347a4b9104a558604f2f6',ramdisk_id='',reservation_id='r-j1g463qr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1774553789',owner_user_name='tempest-AttachVolumeShelveTestJSON-1774553789-project-member',shelved_at='2023-08-15T05:31:29.971597',shelved_host='user',shelved_image_id='7a7ff1bb-1715-4ce4-afca-751bea2e698b'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:33:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c932032fc884b14b9268d5df91d45ea',uuid=18c8138a-4efc-403f-8b42-e5080c6a51d3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "bf92cfab-6648-42bd-b9f0-2a6f38562165", "address": "fa:16:3e:ba:49:5f", "network": {"id": "f67152a9-4f18-4d7f-9d3e-5e517bd46813", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-731866550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88871d09f7e347a4b9104a558604f2f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf92cfab-66", "ovs_interfaceid": "bf92cfab-6648-42bd-b9f0-2a6f38562165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:33:37 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Converting VIF {"id": "bf92cfab-6648-42bd-b9f0-2a6f38562165", "address": "fa:16:3e:ba:49:5f", "network": {"id": "f67152a9-4f18-4d7f-9d3e-5e517bd46813", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-731866550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88871d09f7e347a4b9104a558604f2f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf92cfab-66", "ovs_interfaceid": "bf92cfab-6648-42bd-b9f0-2a6f38562165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:33:37 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:49:5f,bridge_name='br-int',has_traffic_filtering=True,id=bf92cfab-6648-42bd-b9f0-2a6f38562165,network=Network(f67152a9-4f18-4d7f-9d3e-5e517bd46813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf92cfab-66') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:33:37 user nova-compute[73391]: DEBUG os_vif [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:49:5f,bridge_name='br-int',has_traffic_filtering=True,id=bf92cfab-6648-42bd-b9f0-2a6f38562165,network=Network(f67152a9-4f18-4d7f-9d3e-5e517bd46813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf92cfab-66') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:33:37 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:37 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:33:37 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:33:37 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:37 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbf92cfab-66, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:33:37 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbf92cfab-66, col_values=(('external_ids', {'iface-id': 'bf92cfab-6648-42bd-b9f0-2a6f38562165', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:49:5f', 'vm-uuid': '18c8138a-4efc-403f-8b42-e5080c6a51d3'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:33:37 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:37 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:33:37 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:37 user nova-compute[73391]: INFO os_vif [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:49:5f,bridge_name='br-int',has_traffic_filtering=True,id=bf92cfab-6648-42bd-b9f0-2a6f38562165,network=Network(f67152a9-4f18-4d7f-9d3e-5e517bd46813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf92cfab-66')
Aug 15 05:33:37 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:33:37 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:33:37 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] No VIF found with MAC fa:16:3e:ba:49:5f, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:33:37 user nova-compute[73391]: DEBUG nova.compute.manager [req-5699e536-df60-44b1-b250-86ca6987697c req-31cb2a08-dc4a-4c25-99a0-b361bba62697 service nova] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Received event network-vif-plugged-57ecc71f-8eb7-4129-bed4-3e085ce44291 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:33:37 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-5699e536-df60-44b1-b250-86ca6987697c req-31cb2a08-dc4a-4c25-99a0-b361bba62697 service nova] Acquiring lock "0169df15-335e-46e6-a5c8-9deb7095bb84-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:37 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-5699e536-df60-44b1-b250-86ca6987697c req-31cb2a08-dc4a-4c25-99a0-b361bba62697 service nova] Lock "0169df15-335e-46e6-a5c8-9deb7095bb84-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:37 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-5699e536-df60-44b1-b250-86ca6987697c req-31cb2a08-dc4a-4c25-99a0-b361bba62697 service nova] Lock "0169df15-335e-46e6-a5c8-9deb7095bb84-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:37 user nova-compute[73391]: DEBUG nova.compute.manager [req-5699e536-df60-44b1-b250-86ca6987697c req-31cb2a08-dc4a-4c25-99a0-b361bba62697 service nova] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] No waiting events found dispatching network-vif-plugged-57ecc71f-8eb7-4129-bed4-3e085ce44291 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:33:37 user nova-compute[73391]: WARNING nova.compute.manager [req-5699e536-df60-44b1-b250-86ca6987697c req-31cb2a08-dc4a-4c25-99a0-b361bba62697 service nova] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Received unexpected event network-vif-plugged-57ecc71f-8eb7-4129-bed4-3e085ce44291 for instance with vm_state deleted and task_state None.
Aug 15 05:33:38 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:38 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:38 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:38 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:39 user nova-compute[73391]: DEBUG nova.compute.manager [req-1fe7723b-81a3-4cd0-ab20-506f7c0a90c9 req-9e90b388-1377-40ee-a6af-e857c85001bf service nova] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Received event network-vif-plugged-bf92cfab-6648-42bd-b9f0-2a6f38562165 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:33:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-1fe7723b-81a3-4cd0-ab20-506f7c0a90c9 req-9e90b388-1377-40ee-a6af-e857c85001bf service nova] Acquiring lock "18c8138a-4efc-403f-8b42-e5080c6a51d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-1fe7723b-81a3-4cd0-ab20-506f7c0a90c9 req-9e90b388-1377-40ee-a6af-e857c85001bf service nova] Lock "18c8138a-4efc-403f-8b42-e5080c6a51d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-1fe7723b-81a3-4cd0-ab20-506f7c0a90c9 req-9e90b388-1377-40ee-a6af-e857c85001bf service nova] Lock "18c8138a-4efc-403f-8b42-e5080c6a51d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:39 user nova-compute[73391]: DEBUG nova.compute.manager [req-1fe7723b-81a3-4cd0-ab20-506f7c0a90c9 req-9e90b388-1377-40ee-a6af-e857c85001bf service nova] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] No waiting events found dispatching network-vif-plugged-bf92cfab-6648-42bd-b9f0-2a6f38562165 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:33:39 user nova-compute[73391]: WARNING nova.compute.manager [req-1fe7723b-81a3-4cd0-ab20-506f7c0a90c9 req-9e90b388-1377-40ee-a6af-e857c85001bf service nova] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Received unexpected event network-vif-plugged-bf92cfab-6648-42bd-b9f0-2a6f38562165 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 15 05:33:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:41 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077621.0507965, 18c8138a-4efc-403f-8b42-e5080c6a51d3 => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:33:41 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] VM Resumed (Lifecycle Event)
Aug 15 05:33:41 user nova-compute[73391]: DEBUG nova.compute.manager [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:33:41 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Guest created on hypervisor {{(pid=73391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 05:33:41 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Instance spawned successfully.
Aug 15 05:33:41 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:33:41 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:33:41 user nova-compute[73391]: DEBUG nova.compute.manager [req-7ac7696b-277f-4959-b8c6-eb766644969d req-dbbe9fa6-e343-4a0c-8b05-ecc896aa3419 service nova] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Received event network-vif-plugged-bf92cfab-6648-42bd-b9f0-2a6f38562165 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:33:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-7ac7696b-277f-4959-b8c6-eb766644969d req-dbbe9fa6-e343-4a0c-8b05-ecc896aa3419 service nova] Acquiring lock "18c8138a-4efc-403f-8b42-e5080c6a51d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-7ac7696b-277f-4959-b8c6-eb766644969d req-dbbe9fa6-e343-4a0c-8b05-ecc896aa3419 service nova] Lock "18c8138a-4efc-403f-8b42-e5080c6a51d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-7ac7696b-277f-4959-b8c6-eb766644969d req-dbbe9fa6-e343-4a0c-8b05-ecc896aa3419 service nova] Lock "18c8138a-4efc-403f-8b42-e5080c6a51d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:41 user nova-compute[73391]: DEBUG nova.compute.manager [req-7ac7696b-277f-4959-b8c6-eb766644969d req-dbbe9fa6-e343-4a0c-8b05-ecc896aa3419 service nova] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] No waiting events found dispatching network-vif-plugged-bf92cfab-6648-42bd-b9f0-2a6f38562165 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:33:41 user nova-compute[73391]: WARNING nova.compute.manager [req-7ac7696b-277f-4959-b8c6-eb766644969d req-dbbe9fa6-e343-4a0c-8b05-ecc896aa3419 service nova] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Received unexpected event network-vif-plugged-bf92cfab-6648-42bd-b9f0-2a6f38562165 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 15 05:33:41 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:33:41 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077621.0574968, 18c8138a-4efc-403f-8b42-e5080c6a51d3 => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:33:41 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] VM Started (Lifecycle Event)
Aug 15 05:33:41 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:33:41 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:33:41 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:33:41 user nova-compute[73391]: DEBUG nova.compute.manager [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:33:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-000e52d3-e558-4867-a259-46a452ee3a9a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "18c8138a-4efc-403f-8b42-e5080c6a51d3" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 24.358s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:42 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:43 user nova-compute[73391]: DEBUG nova.compute.manager [req-003999d4-a702-4c2c-9349-94ad34d8fd14 req-90158a94-0765-4fbb-90eb-ba965917f5ba service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received event network-changed-37e2378e-5659-401c-95ce-0424b61e2e1a {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:33:43 user nova-compute[73391]: DEBUG nova.compute.manager [req-003999d4-a702-4c2c-9349-94ad34d8fd14 req-90158a94-0765-4fbb-90eb-ba965917f5ba service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Refreshing instance network info cache due to event network-changed-37e2378e-5659-401c-95ce-0424b61e2e1a. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:33:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-003999d4-a702-4c2c-9349-94ad34d8fd14 req-90158a94-0765-4fbb-90eb-ba965917f5ba service nova] Acquiring lock "refresh_cache-96c5782e-9d00-4bb8-8e1d-99416bc7d556" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:33:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-003999d4-a702-4c2c-9349-94ad34d8fd14 req-90158a94-0765-4fbb-90eb-ba965917f5ba service nova] Acquired lock "refresh_cache-96c5782e-9d00-4bb8-8e1d-99416bc7d556" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:33:43 user nova-compute[73391]: DEBUG nova.network.neutron [req-003999d4-a702-4c2c-9349-94ad34d8fd14 req-90158a94-0765-4fbb-90eb-ba965917f5ba service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Refreshing network info cache for port 37e2378e-5659-401c-95ce-0424b61e2e1a {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:33:43 user nova-compute[73391]: DEBUG nova.network.neutron [req-003999d4-a702-4c2c-9349-94ad34d8fd14 req-90158a94-0765-4fbb-90eb-ba965917f5ba service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Updated VIF entry in instance network info cache for port 37e2378e-5659-401c-95ce-0424b61e2e1a. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:33:43 user nova-compute[73391]: DEBUG nova.network.neutron [req-003999d4-a702-4c2c-9349-94ad34d8fd14 req-90158a94-0765-4fbb-90eb-ba965917f5ba service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Updating instance_info_cache with network_info: [{"id": "37e2378e-5659-401c-95ce-0424b61e2e1a", "address": "fa:16:3e:7b:4f:9c", "network": {"id": "1fb1af76-f96a-4640-a09d-1bdb13e93bd6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-505156524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e2378e-56", "ovs_interfaceid": "37e2378e-5659-401c-95ce-0424b61e2e1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23d27a9f-a59d-4369-a8c2-0f09564bb78d", "address": "fa:16:3e:4a:c7:00", "network": {"id": "38d7d183-2f35-4f50-bd69-614eaf1952ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-82531103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23d27a9f-a5", "ovs_interfaceid": "23d27a9f-a59d-4369-a8c2-0f09564bb78d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "879124a9-46cd-45bb-b1a2-34cc8264cf25", "address": "fa:16:3e:4a:68:3f", "network": {"id": "38d7d183-2f35-4f50-bd69-614eaf1952ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-82531103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap879124a9-46", "ovs_interfaceid": "879124a9-46cd-45bb-b1a2-34cc8264cf25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a09443ce-b3e9-4fe7-b24a-b1c609cb2553", "address": "fa:16:3e:6a:6d:c5", "network": {"id": "38d7d183-2f35-4f50-bd69-614eaf1952ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-82531103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa09443ce-b3", "ovs_interfaceid": "a09443ce-b3e9-4fe7-b24a-b1c609cb2553", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7adbd6a6-9a65-4e61-9ff2-63351d5dfaad", "address": "fa:16:3e:b7:e9:02", "network": {"id": "38d7d183-2f35-4f50-bd69-614eaf1952ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-82531103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7adbd6a6-9a", "ovs_interfaceid": "7adbd6a6-9a65-4e61-9ff2-63351d5dfaad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ae52a22f-e13e-4da6-9561-ba679ac242b1", "address": "fa:16:3e:df:63:15", "network": {"id": "0376a3e8-17aa-47e4-afdb-fb7ba9174147", "bridge": "br-int", "label": "tempest-device-tagging-net2-1320047162", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae52a22f-e1", "ovs_interfaceid": "ae52a22f-e13e-4da6-9561-ba679ac242b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "33d14fed-6340-407f-bdf1-c858e9cf395c", "address": "fa:16:3e:f1:52:78", "network": {"id": "0376a3e8-17aa-47e4-afdb-fb7ba9174147", "bridge": "br-int", "label": "tempest-device-tagging-net2-1320047162", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33d14fed-63", "ovs_interfaceid": "33d14fed-6340-407f-bdf1-c858e9cf395c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:33:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-003999d4-a702-4c2c-9349-94ad34d8fd14 req-90158a94-0765-4fbb-90eb-ba965917f5ba service nova] Releasing lock "refresh_cache-96c5782e-9d00-4bb8-8e1d-99416bc7d556" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:33:44 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Acquiring lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Acquiring lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:45 user nova-compute[73391]: INFO nova.compute.manager [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Terminating instance
Aug 15 05:33:45 user nova-compute[73391]: DEBUG nova.compute.manager [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Start destroying the instance on the hypervisor. {{(pid=73391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 05:33:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:46 user nova-compute[73391]: DEBUG nova.compute.manager [req-422d43fb-aad3-4dff-a1b4-fc87bdf40443 req-5b9b42bb-95bf-42b7-8221-39cdda689c16 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received event network-vif-unplugged-37e2378e-5659-401c-95ce-0424b61e2e1a {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:33:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-422d43fb-aad3-4dff-a1b4-fc87bdf40443 req-5b9b42bb-95bf-42b7-8221-39cdda689c16 service nova] Acquiring lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-422d43fb-aad3-4dff-a1b4-fc87bdf40443 req-5b9b42bb-95bf-42b7-8221-39cdda689c16 service nova] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-422d43fb-aad3-4dff-a1b4-fc87bdf40443 req-5b9b42bb-95bf-42b7-8221-39cdda689c16 service nova] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:46 user nova-compute[73391]: DEBUG nova.compute.manager [req-422d43fb-aad3-4dff-a1b4-fc87bdf40443 req-5b9b42bb-95bf-42b7-8221-39cdda689c16 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] No waiting events found dispatching network-vif-unplugged-37e2378e-5659-401c-95ce-0424b61e2e1a {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:33:46 user nova-compute[73391]: DEBUG nova.compute.manager [req-422d43fb-aad3-4dff-a1b4-fc87bdf40443 req-5b9b42bb-95bf-42b7-8221-39cdda689c16 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received event network-vif-unplugged-37e2378e-5659-401c-95ce-0424b61e2e1a for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 05:33:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:46 user nova-compute[73391]: DEBUG nova.compute.manager [req-dbb63ef4-ce3b-420b-8ecc-67cbbc50bd5b req-89eb7c1d-cb0e-431f-98f3-c333c4254127 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received event network-vif-unplugged-879124a9-46cd-45bb-b1a2-34cc8264cf25 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:33:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-dbb63ef4-ce3b-420b-8ecc-67cbbc50bd5b req-89eb7c1d-cb0e-431f-98f3-c333c4254127 service nova] Acquiring lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-dbb63ef4-ce3b-420b-8ecc-67cbbc50bd5b req-89eb7c1d-cb0e-431f-98f3-c333c4254127 service nova] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-dbb63ef4-ce3b-420b-8ecc-67cbbc50bd5b req-89eb7c1d-cb0e-431f-98f3-c333c4254127 service nova] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:46 user nova-compute[73391]: DEBUG nova.compute.manager [req-dbb63ef4-ce3b-420b-8ecc-67cbbc50bd5b req-89eb7c1d-cb0e-431f-98f3-c333c4254127 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] No waiting events found dispatching network-vif-unplugged-879124a9-46cd-45bb-b1a2-34cc8264cf25 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:33:46 user nova-compute[73391]: DEBUG nova.compute.manager [req-dbb63ef4-ce3b-420b-8ecc-67cbbc50bd5b req-89eb7c1d-cb0e-431f-98f3-c333c4254127 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received event network-vif-unplugged-879124a9-46cd-45bb-b1a2-34cc8264cf25 for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 05:33:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:46 user nova-compute[73391]: DEBUG nova.compute.manager [req-e51c20dd-6ca1-4714-85d6-a483e4954e0e req-062c328b-a16e-4d62-ae2f-13bd42d563d2 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received event network-vif-unplugged-7adbd6a6-9a65-4e61-9ff2-63351d5dfaad {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:33:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e51c20dd-6ca1-4714-85d6-a483e4954e0e req-062c328b-a16e-4d62-ae2f-13bd42d563d2 service nova] Acquiring lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e51c20dd-6ca1-4714-85d6-a483e4954e0e req-062c328b-a16e-4d62-ae2f-13bd42d563d2 service nova] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e51c20dd-6ca1-4714-85d6-a483e4954e0e req-062c328b-a16e-4d62-ae2f-13bd42d563d2 service nova] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:46 user nova-compute[73391]: DEBUG nova.compute.manager [req-e51c20dd-6ca1-4714-85d6-a483e4954e0e req-062c328b-a16e-4d62-ae2f-13bd42d563d2 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] No waiting events found dispatching network-vif-unplugged-7adbd6a6-9a65-4e61-9ff2-63351d5dfaad {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:33:46 user nova-compute[73391]: DEBUG nova.compute.manager [req-e51c20dd-6ca1-4714-85d6-a483e4954e0e req-062c328b-a16e-4d62-ae2f-13bd42d563d2 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received event network-vif-unplugged-7adbd6a6-9a65-4e61-9ff2-63351d5dfaad for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 05:33:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:47 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:47 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:47 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:47 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Instance destroyed successfully.
Aug 15 05:33:47 user nova-compute[73391]: DEBUG nova.objects.instance [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Lazy-loading 'resources' on Instance uuid 96c5782e-9d00-4bb8-8e1d-99416bc7d556 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:33:47 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T05:30:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-350405470',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-350405470',id=11,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8kTpqAr2hLgWgcWYp4BVd/dgkLt1zBjg5KiL/KMWsa8lWthPbN0pIZvu1z1F8qRVBT5oG0yoSkSyH6fSrOKFgLogLPWFv1SqT9saqO+ApvBDi+D4+ywqDg/jbYLc8kJg==',key_name='tempest-keypair-129548124',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:32:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a32aa9315a244728c4a764d21e1d2c9',ramdisk_id='',reservation_id='r-8ixr7r7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-133221342',owner_user_name='tempest-TaggedBootDevicesTest_v242-133221342-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:32:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c992a66fd294e5f82aa58e5fa4058af',uuid=96c5782e-9d00-4bb8-8e1d-99416bc7d556,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "37e2378e-5659-401c-95ce-0424b61e2e1a", "address": "fa:16:3e:7b:4f:9c", "network": {"id": "1fb1af76-f96a-4640-a09d-1bdb13e93bd6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-505156524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e2378e-56", "ovs_interfaceid": "37e2378e-5659-401c-95ce-0424b61e2e1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:33:47 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Converting VIF {"id": "37e2378e-5659-401c-95ce-0424b61e2e1a", "address": "fa:16:3e:7b:4f:9c", "network": {"id": "1fb1af76-f96a-4640-a09d-1bdb13e93bd6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-505156524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e2378e-56", "ovs_interfaceid": "37e2378e-5659-401c-95ce-0424b61e2e1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:33:47 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7b:4f:9c,bridge_name='br-int',has_traffic_filtering=True,id=37e2378e-5659-401c-95ce-0424b61e2e1a,network=Network(1fb1af76-f96a-4640-a09d-1bdb13e93bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37e2378e-56') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:33:47 user nova-compute[73391]: DEBUG os_vif [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:4f:9c,bridge_name='br-int',has_traffic_filtering=True,id=37e2378e-5659-401c-95ce-0424b61e2e1a,network=Network(1fb1af76-f96a-4640-a09d-1bdb13e93bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37e2378e-56') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:33:47 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:47 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap37e2378e-56, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:33:47 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:47 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:33:47 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:47 user nova-compute[73391]: INFO os_vif [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7b:4f:9c,bridge_name='br-int',has_traffic_filtering=True,id=37e2378e-5659-401c-95ce-0424b61e2e1a,network=Network(1fb1af76-f96a-4640-a09d-1bdb13e93bd6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap37e2378e-56')
Aug 15 05:33:47 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T05:30:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-350405470',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-350405470',id=11,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8kTpqAr2hLgWgcWYp4BVd/dgkLt1zBjg5KiL/KMWsa8lWthPbN0pIZvu1z1F8qRVBT5oG0yoSkSyH6fSrOKFgLogLPWFv1SqT9saqO+ApvBDi+D4+ywqDg/jbYLc8kJg==',key_name='tempest-keypair-129548124',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:32:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a32aa9315a244728c4a764d21e1d2c9',ramdisk_id='',reservation_id='r-8ixr7r7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-133221342',owner_user_name='tempest-TaggedBootDevicesTest_v242-133221342-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:32:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c992a66fd294e5f82aa58e5fa4058af',uuid=96c5782e-9d00-4bb8-8e1d-99416bc7d556,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "23d27a9f-a59d-4369-a8c2-0f09564bb78d", "address": "fa:16:3e:4a:c7:00", "network": {"id": "38d7d183-2f35-4f50-bd69-614eaf1952ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-82531103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23d27a9f-a5", "ovs_interfaceid": "23d27a9f-a59d-4369-a8c2-0f09564bb78d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:33:47 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Converting VIF {"id": "23d27a9f-a59d-4369-a8c2-0f09564bb78d", "address": "fa:16:3e:4a:c7:00", "network": {"id": "38d7d183-2f35-4f50-bd69-614eaf1952ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-82531103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23d27a9f-a5", "ovs_interfaceid": "23d27a9f-a59d-4369-a8c2-0f09564bb78d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:33:47 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:c7:00,bridge_name='br-int',has_traffic_filtering=True,id=23d27a9f-a59d-4369-a8c2-0f09564bb78d,network=Network(38d7d183-2f35-4f50-bd69-614eaf1952ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap23d27a9f-a5') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:33:47 user nova-compute[73391]: DEBUG os_vif [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:c7:00,bridge_name='br-int',has_traffic_filtering=True,id=23d27a9f-a59d-4369-a8c2-0f09564bb78d,network=Network(38d7d183-2f35-4f50-bd69-614eaf1952ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap23d27a9f-a5') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:33:47 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:47 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap23d27a9f-a5, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:33:47 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:47 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:48 user nova-compute[73391]: INFO os_vif [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:c7:00,bridge_name='br-int',has_traffic_filtering=True,id=23d27a9f-a59d-4369-a8c2-0f09564bb78d,network=Network(38d7d183-2f35-4f50-bd69-614eaf1952ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap23d27a9f-a5')
Aug 15 05:33:48 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T05:30:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-350405470',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-350405470',id=11,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8kTpqAr2hLgWgcWYp4BVd/dgkLt1zBjg5KiL/KMWsa8lWthPbN0pIZvu1z1F8qRVBT5oG0yoSkSyH6fSrOKFgLogLPWFv1SqT9saqO+ApvBDi+D4+ywqDg/jbYLc8kJg==',key_name='tempest-keypair-129548124',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:32:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a32aa9315a244728c4a764d21e1d2c9',ramdisk_id='',reservation_id='r-8ixr7r7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-133221342',owner_user_name='tempest-TaggedBootDevicesTest_v242-133221342-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:32:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c992a66fd294e5f82aa58e5fa4058af',uuid=96c5782e-9d00-4bb8-8e1d-99416bc7d556,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "879124a9-46cd-45bb-b1a2-34cc8264cf25", "address": "fa:16:3e:4a:68:3f", "network": {"id": "38d7d183-2f35-4f50-bd69-614eaf1952ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-82531103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap879124a9-46", "ovs_interfaceid": "879124a9-46cd-45bb-b1a2-34cc8264cf25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Converting VIF {"id": "879124a9-46cd-45bb-b1a2-34cc8264cf25", "address": "fa:16:3e:4a:68:3f", "network": {"id": "38d7d183-2f35-4f50-bd69-614eaf1952ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-82531103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap879124a9-46", "ovs_interfaceid": "879124a9-46cd-45bb-b1a2-34cc8264cf25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:68:3f,bridge_name='br-int',has_traffic_filtering=True,id=879124a9-46cd-45bb-b1a2-34cc8264cf25,network=Network(38d7d183-2f35-4f50-bd69-614eaf1952ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap879124a9-46') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG os_vif [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:68:3f,bridge_name='br-int',has_traffic_filtering=True,id=879124a9-46cd-45bb-b1a2-34cc8264cf25,network=Network(38d7d183-2f35-4f50-bd69-614eaf1952ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap879124a9-46') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap879124a9-46, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:48 user nova-compute[73391]: INFO os_vif [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:68:3f,bridge_name='br-int',has_traffic_filtering=True,id=879124a9-46cd-45bb-b1a2-34cc8264cf25,network=Network(38d7d183-2f35-4f50-bd69-614eaf1952ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap879124a9-46')
Aug 15 05:33:48 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T05:30:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-350405470',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-350405470',id=11,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8kTpqAr2hLgWgcWYp4BVd/dgkLt1zBjg5KiL/KMWsa8lWthPbN0pIZvu1z1F8qRVBT5oG0yoSkSyH6fSrOKFgLogLPWFv1SqT9saqO+ApvBDi+D4+ywqDg/jbYLc8kJg==',key_name='tempest-keypair-129548124',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:32:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a32aa9315a244728c4a764d21e1d2c9',ramdisk_id='',reservation_id='r-8ixr7r7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-133221342',owner_user_name='tempest-TaggedBootDevicesTest_v242-133221342-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:32:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c992a66fd294e5f82aa58e5fa4058af',uuid=96c5782e-9d00-4bb8-8e1d-99416bc7d556,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a09443ce-b3e9-4fe7-b24a-b1c609cb2553", "address": "fa:16:3e:6a:6d:c5", "network": {"id": "38d7d183-2f35-4f50-bd69-614eaf1952ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-82531103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa09443ce-b3", "ovs_interfaceid": "a09443ce-b3e9-4fe7-b24a-b1c609cb2553", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Converting VIF {"id": "a09443ce-b3e9-4fe7-b24a-b1c609cb2553", "address": "fa:16:3e:6a:6d:c5", "network": {"id": "38d7d183-2f35-4f50-bd69-614eaf1952ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-82531103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.62", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa09443ce-b3", "ovs_interfaceid": "a09443ce-b3e9-4fe7-b24a-b1c609cb2553", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:6d:c5,bridge_name='br-int',has_traffic_filtering=True,id=a09443ce-b3e9-4fe7-b24a-b1c609cb2553,network=Network(38d7d183-2f35-4f50-bd69-614eaf1952ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa09443ce-b3') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG os_vif [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:6d:c5,bridge_name='br-int',has_traffic_filtering=True,id=a09443ce-b3e9-4fe7-b24a-b1c609cb2553,network=Network(38d7d183-2f35-4f50-bd69-614eaf1952ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa09443ce-b3') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa09443ce-b3, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:48 user nova-compute[73391]: INFO os_vif [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:6d:c5,bridge_name='br-int',has_traffic_filtering=True,id=a09443ce-b3e9-4fe7-b24a-b1c609cb2553,network=Network(38d7d183-2f35-4f50-bd69-614eaf1952ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa09443ce-b3')
Aug 15 05:33:48 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T05:30:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-350405470',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-350405470',id=11,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8kTpqAr2hLgWgcWYp4BVd/dgkLt1zBjg5KiL/KMWsa8lWthPbN0pIZvu1z1F8qRVBT5oG0yoSkSyH6fSrOKFgLogLPWFv1SqT9saqO+ApvBDi+D4+ywqDg/jbYLc8kJg==',key_name='tempest-keypair-129548124',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:32:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a32aa9315a244728c4a764d21e1d2c9',ramdisk_id='',reservation_id='r-8ixr7r7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-133221342',owner_user_name='tempest-TaggedBootDevicesTest_v242-133221342-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:32:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c992a66fd294e5f82aa58e5fa4058af',uuid=96c5782e-9d00-4bb8-8e1d-99416bc7d556,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7adbd6a6-9a65-4e61-9ff2-63351d5dfaad", "address": "fa:16:3e:b7:e9:02", "network": {"id": "38d7d183-2f35-4f50-bd69-614eaf1952ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-82531103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7adbd6a6-9a", "ovs_interfaceid": "7adbd6a6-9a65-4e61-9ff2-63351d5dfaad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Converting VIF {"id": "7adbd6a6-9a65-4e61-9ff2-63351d5dfaad", "address": "fa:16:3e:b7:e9:02", "network": {"id": "38d7d183-2f35-4f50-bd69-614eaf1952ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-82531103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7adbd6a6-9a", "ovs_interfaceid": "7adbd6a6-9a65-4e61-9ff2-63351d5dfaad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:e9:02,bridge_name='br-int',has_traffic_filtering=True,id=7adbd6a6-9a65-4e61-9ff2-63351d5dfaad,network=Network(38d7d183-2f35-4f50-bd69-614eaf1952ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7adbd6a6-9a') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG os_vif [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:e9:02,bridge_name='br-int',has_traffic_filtering=True,id=7adbd6a6-9a65-4e61-9ff2-63351d5dfaad,network=Network(38d7d183-2f35-4f50-bd69-614eaf1952ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7adbd6a6-9a') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7adbd6a6-9a, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:48 user nova-compute[73391]: INFO os_vif [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:e9:02,bridge_name='br-int',has_traffic_filtering=True,id=7adbd6a6-9a65-4e61-9ff2-63351d5dfaad,network=Network(38d7d183-2f35-4f50-bd69-614eaf1952ad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7adbd6a6-9a')
Aug 15 05:33:48 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T05:30:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-350405470',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-350405470',id=11,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8kTpqAr2hLgWgcWYp4BVd/dgkLt1zBjg5KiL/KMWsa8lWthPbN0pIZvu1z1F8qRVBT5oG0yoSkSyH6fSrOKFgLogLPWFv1SqT9saqO+ApvBDi+D4+ywqDg/jbYLc8kJg==',key_name='tempest-keypair-129548124',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:32:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a32aa9315a244728c4a764d21e1d2c9',ramdisk_id='',reservation_id='r-8ixr7r7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-133221342',owner_user_name='tempest-TaggedBootDevicesTest_v242-133221342-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:32:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c992a66fd294e5f82aa58e5fa4058af',uuid=96c5782e-9d00-4bb8-8e1d-99416bc7d556,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ae52a22f-e13e-4da6-9561-ba679ac242b1", "address": "fa:16:3e:df:63:15", "network": {"id": "0376a3e8-17aa-47e4-afdb-fb7ba9174147", "bridge": "br-int", "label": "tempest-device-tagging-net2-1320047162", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae52a22f-e1", "ovs_interfaceid": "ae52a22f-e13e-4da6-9561-ba679ac242b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Converting VIF {"id": "ae52a22f-e13e-4da6-9561-ba679ac242b1", "address": "fa:16:3e:df:63:15", "network": {"id": "0376a3e8-17aa-47e4-afdb-fb7ba9174147", "bridge": "br-int", "label": "tempest-device-tagging-net2-1320047162", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae52a22f-e1", "ovs_interfaceid": "ae52a22f-e13e-4da6-9561-ba679ac242b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:63:15,bridge_name='br-int',has_traffic_filtering=True,id=ae52a22f-e13e-4da6-9561-ba679ac242b1,network=Network(0376a3e8-17aa-47e4-afdb-fb7ba9174147),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae52a22f-e1') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG os_vif [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:63:15,bridge_name='br-int',has_traffic_filtering=True,id=ae52a22f-e13e-4da6-9561-ba679ac242b1,network=Network(0376a3e8-17aa-47e4-afdb-fb7ba9174147),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae52a22f-e1') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG nova.compute.manager [req-1890d153-2165-4165-ae00-c765fa21c2cb req-02f58286-9710-4eb2-9508-4809492306b1 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received event network-vif-plugged-37e2378e-5659-401c-95ce-0424b61e2e1a {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-1890d153-2165-4165-ae00-c765fa21c2cb req-02f58286-9710-4eb2-9508-4809492306b1 service nova] Acquiring lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-1890d153-2165-4165-ae00-c765fa21c2cb req-02f58286-9710-4eb2-9508-4809492306b1 service nova] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-1890d153-2165-4165-ae00-c765fa21c2cb req-02f58286-9710-4eb2-9508-4809492306b1 service nova] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG nova.compute.manager [req-1890d153-2165-4165-ae00-c765fa21c2cb req-02f58286-9710-4eb2-9508-4809492306b1 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] No waiting events found dispatching network-vif-plugged-37e2378e-5659-401c-95ce-0424b61e2e1a {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:33:48 user nova-compute[73391]: WARNING nova.compute.manager [req-1890d153-2165-4165-ae00-c765fa21c2cb req-02f58286-9710-4eb2-9508-4809492306b1 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received unexpected event network-vif-plugged-37e2378e-5659-401c-95ce-0424b61e2e1a for instance with vm_state active and task_state deleting.
Aug 15 05:33:48 user nova-compute[73391]: DEBUG nova.compute.manager [req-1890d153-2165-4165-ae00-c765fa21c2cb req-02f58286-9710-4eb2-9508-4809492306b1 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received event network-vif-unplugged-23d27a9f-a59d-4369-a8c2-0f09564bb78d {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-1890d153-2165-4165-ae00-c765fa21c2cb req-02f58286-9710-4eb2-9508-4809492306b1 service nova] Acquiring lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-1890d153-2165-4165-ae00-c765fa21c2cb req-02f58286-9710-4eb2-9508-4809492306b1 service nova] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-1890d153-2165-4165-ae00-c765fa21c2cb req-02f58286-9710-4eb2-9508-4809492306b1 service nova] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG nova.compute.manager [req-1890d153-2165-4165-ae00-c765fa21c2cb req-02f58286-9710-4eb2-9508-4809492306b1 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] No waiting events found dispatching network-vif-unplugged-23d27a9f-a59d-4369-a8c2-0f09564bb78d {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG nova.compute.manager [req-1890d153-2165-4165-ae00-c765fa21c2cb req-02f58286-9710-4eb2-9508-4809492306b1 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received event network-vif-unplugged-23d27a9f-a59d-4369-a8c2-0f09564bb78d for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG nova.compute.manager [req-1890d153-2165-4165-ae00-c765fa21c2cb req-02f58286-9710-4eb2-9508-4809492306b1 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received event network-vif-plugged-23d27a9f-a59d-4369-a8c2-0f09564bb78d {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-1890d153-2165-4165-ae00-c765fa21c2cb req-02f58286-9710-4eb2-9508-4809492306b1 service nova] Acquiring lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-1890d153-2165-4165-ae00-c765fa21c2cb req-02f58286-9710-4eb2-9508-4809492306b1 service nova] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-1890d153-2165-4165-ae00-c765fa21c2cb req-02f58286-9710-4eb2-9508-4809492306b1 service nova] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG nova.compute.manager [req-1890d153-2165-4165-ae00-c765fa21c2cb req-02f58286-9710-4eb2-9508-4809492306b1 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] No waiting events found dispatching network-vif-plugged-23d27a9f-a59d-4369-a8c2-0f09564bb78d {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:33:48 user nova-compute[73391]: WARNING nova.compute.manager [req-1890d153-2165-4165-ae00-c765fa21c2cb req-02f58286-9710-4eb2-9508-4809492306b1 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received unexpected event network-vif-plugged-23d27a9f-a59d-4369-a8c2-0f09564bb78d for instance with vm_state active and task_state deleting.
Aug 15 05:33:48 user nova-compute[73391]: DEBUG nova.compute.manager [req-1890d153-2165-4165-ae00-c765fa21c2cb req-02f58286-9710-4eb2-9508-4809492306b1 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received event network-vif-unplugged-a09443ce-b3e9-4fe7-b24a-b1c609cb2553 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-1890d153-2165-4165-ae00-c765fa21c2cb req-02f58286-9710-4eb2-9508-4809492306b1 service nova] Acquiring lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-1890d153-2165-4165-ae00-c765fa21c2cb req-02f58286-9710-4eb2-9508-4809492306b1 service nova] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-1890d153-2165-4165-ae00-c765fa21c2cb req-02f58286-9710-4eb2-9508-4809492306b1 service nova] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG nova.compute.manager [req-1890d153-2165-4165-ae00-c765fa21c2cb req-02f58286-9710-4eb2-9508-4809492306b1 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] No waiting events found dispatching network-vif-unplugged-a09443ce-b3e9-4fe7-b24a-b1c609cb2553 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG nova.compute.manager [req-1890d153-2165-4165-ae00-c765fa21c2cb req-02f58286-9710-4eb2-9508-4809492306b1 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received event network-vif-unplugged-a09443ce-b3e9-4fe7-b24a-b1c609cb2553 for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG nova.compute.manager [req-1890d153-2165-4165-ae00-c765fa21c2cb req-02f58286-9710-4eb2-9508-4809492306b1 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received event network-vif-plugged-a09443ce-b3e9-4fe7-b24a-b1c609cb2553 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-1890d153-2165-4165-ae00-c765fa21c2cb req-02f58286-9710-4eb2-9508-4809492306b1 service nova] Acquiring lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-1890d153-2165-4165-ae00-c765fa21c2cb req-02f58286-9710-4eb2-9508-4809492306b1 service nova] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-1890d153-2165-4165-ae00-c765fa21c2cb req-02f58286-9710-4eb2-9508-4809492306b1 service nova] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG nova.compute.manager [req-1890d153-2165-4165-ae00-c765fa21c2cb req-02f58286-9710-4eb2-9508-4809492306b1 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] No waiting events found dispatching network-vif-plugged-a09443ce-b3e9-4fe7-b24a-b1c609cb2553 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:33:48 user nova-compute[73391]: WARNING nova.compute.manager [req-1890d153-2165-4165-ae00-c765fa21c2cb req-02f58286-9710-4eb2-9508-4809492306b1 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received unexpected event network-vif-plugged-a09443ce-b3e9-4fe7-b24a-b1c609cb2553 for instance with vm_state active and task_state deleting.
Aug 15 05:33:48 user nova-compute[73391]: DEBUG nova.compute.manager [req-1890d153-2165-4165-ae00-c765fa21c2cb req-02f58286-9710-4eb2-9508-4809492306b1 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received event network-vif-unplugged-ae52a22f-e13e-4da6-9561-ba679ac242b1 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-1890d153-2165-4165-ae00-c765fa21c2cb req-02f58286-9710-4eb2-9508-4809492306b1 service nova] Acquiring lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-1890d153-2165-4165-ae00-c765fa21c2cb req-02f58286-9710-4eb2-9508-4809492306b1 service nova] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-1890d153-2165-4165-ae00-c765fa21c2cb req-02f58286-9710-4eb2-9508-4809492306b1 service nova] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG nova.compute.manager [req-1890d153-2165-4165-ae00-c765fa21c2cb req-02f58286-9710-4eb2-9508-4809492306b1 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] No waiting events found dispatching network-vif-unplugged-ae52a22f-e13e-4da6-9561-ba679ac242b1 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG nova.compute.manager [req-1890d153-2165-4165-ae00-c765fa21c2cb req-02f58286-9710-4eb2-9508-4809492306b1 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received event network-vif-unplugged-ae52a22f-e13e-4da6-9561-ba679ac242b1 for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapae52a22f-e1, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:48 user nova-compute[73391]: INFO os_vif [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:63:15,bridge_name='br-int',has_traffic_filtering=True,id=ae52a22f-e13e-4da6-9561-ba679ac242b1,network=Network(0376a3e8-17aa-47e4-afdb-fb7ba9174147),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapae52a22f-e1')
Aug 15 05:33:48 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T05:30:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-350405470',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-350405470',id=11,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM8kTpqAr2hLgWgcWYp4BVd/dgkLt1zBjg5KiL/KMWsa8lWthPbN0pIZvu1z1F8qRVBT5oG0yoSkSyH6fSrOKFgLogLPWFv1SqT9saqO+ApvBDi+D4+ywqDg/jbYLc8kJg==',key_name='tempest-keypair-129548124',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:32:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2a32aa9315a244728c4a764d21e1d2c9',ramdisk_id='',reservation_id='r-8ixr7r7o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-133221342',owner_user_name='tempest-TaggedBootDevicesTest_v242-133221342-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:32:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7c992a66fd294e5f82aa58e5fa4058af',uuid=96c5782e-9d00-4bb8-8e1d-99416bc7d556,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "33d14fed-6340-407f-bdf1-c858e9cf395c", "address": "fa:16:3e:f1:52:78", "network": {"id": "0376a3e8-17aa-47e4-afdb-fb7ba9174147", "bridge": "br-int", "label": "tempest-device-tagging-net2-1320047162", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33d14fed-63", "ovs_interfaceid": "33d14fed-6340-407f-bdf1-c858e9cf395c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Converting VIF {"id": "33d14fed-6340-407f-bdf1-c858e9cf395c", "address": "fa:16:3e:f1:52:78", "network": {"id": "0376a3e8-17aa-47e4-afdb-fb7ba9174147", "bridge": "br-int", "label": "tempest-device-tagging-net2-1320047162", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33d14fed-63", "ovs_interfaceid": "33d14fed-6340-407f-bdf1-c858e9cf395c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f1:52:78,bridge_name='br-int',has_traffic_filtering=True,id=33d14fed-6340-407f-bdf1-c858e9cf395c,network=Network(0376a3e8-17aa-47e4-afdb-fb7ba9174147),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33d14fed-63') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG os_vif [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:52:78,bridge_name='br-int',has_traffic_filtering=True,id=33d14fed-6340-407f-bdf1-c858e9cf395c,network=Network(0376a3e8-17aa-47e4-afdb-fb7ba9174147),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33d14fed-63') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap33d14fed-63, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:33:48 user nova-compute[73391]: INFO os_vif [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f1:52:78,bridge_name='br-int',has_traffic_filtering=True,id=33d14fed-6340-407f-bdf1-c858e9cf395c,network=Network(0376a3e8-17aa-47e4-afdb-fb7ba9174147),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap33d14fed-63')
Aug 15 05:33:48 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'awBbNDlJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:33:48 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:33:48 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f907b0d-f8b9-449c-ab54-fd494994fdd9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6fcbc6-3b1e-4b14-8e9e-a67dc19a0e4a]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)
Aug 15 05:33:48 user nova-compute[73391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)
Aug 15 05:33:48 user nova-compute[73391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:33:48 user nova-compute[73391]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 (non-flash)
Aug 15 05:33:48 user nova-compute[73391]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e (non-flash)
Aug 15 05:33:48 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:33:48 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 (non-flash)
Aug 15 05:33:48 user nova-compute[73391]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)
Aug 15 05:33:48 user nova-compute[73391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:33:48 user nova-compute[73391]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 (non-flash)
Aug 15 05:33:48 user nova-compute[73391]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e (non-flash)
Aug 15 05:33:48 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:33:48 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77284d7c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1'): ({'sdh'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Removing single pathed devices sdh {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[173a4619-85dc-4c42-a553-6795ae3f1fc8]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb22039-f06f-4542-80ea-be0f9ffd69c3]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Flushing IO for device /dev/sdh {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d631bb20-1944-4b8e-bbea-f8fe4cfd9cb4]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.036s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aca5994-4a21-42fd-bed4-848c85f0faed]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] SCSI volumes sdh have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc18299-a50b-4562-8e93-046564e34fae]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG nova.compute.manager [req-3b6989c7-af5b-4402-b42f-ccb87aa275c4 req-55e9e54d-393e-4d48-8957-06c440cb75e3 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received event network-vif-plugged-879124a9-46cd-45bb-b1a2-34cc8264cf25 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-3b6989c7-af5b-4402-b42f-ccb87aa275c4 req-55e9e54d-393e-4d48-8957-06c440cb75e3 service nova] Acquiring lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-3b6989c7-af5b-4402-b42f-ccb87aa275c4 req-55e9e54d-393e-4d48-8957-06c440cb75e3 service nova] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-3b6989c7-af5b-4402-b42f-ccb87aa275c4 req-55e9e54d-393e-4d48-8957-06c440cb75e3 service nova] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG nova.compute.manager [req-3b6989c7-af5b-4402-b42f-ccb87aa275c4 req-55e9e54d-393e-4d48-8957-06c440cb75e3 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] No waiting events found dispatching network-vif-plugged-879124a9-46cd-45bb-b1a2-34cc8264cf25 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:33:48 user nova-compute[73391]: WARNING nova.compute.manager [req-3b6989c7-af5b-4402-b42f-ccb87aa275c4 req-55e9e54d-393e-4d48-8957-06c440cb75e3 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received unexpected event network-vif-plugged-879124a9-46cd-45bb-b1a2-34cc8264cf25 for instance with vm_state active and task_state deleting.
Aug 15 05:33:48 user nova-compute[73391]: DEBUG nova.compute.manager [req-3b6989c7-af5b-4402-b42f-ccb87aa275c4 req-55e9e54d-393e-4d48-8957-06c440cb75e3 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received event network-vif-unplugged-33d14fed-6340-407f-bdf1-c858e9cf395c {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-3b6989c7-af5b-4402-b42f-ccb87aa275c4 req-55e9e54d-393e-4d48-8957-06c440cb75e3 service nova] Acquiring lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-3b6989c7-af5b-4402-b42f-ccb87aa275c4 req-55e9e54d-393e-4d48-8957-06c440cb75e3 service nova] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-3b6989c7-af5b-4402-b42f-ccb87aa275c4 req-55e9e54d-393e-4d48-8957-06c440cb75e3 service nova] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG nova.compute.manager [req-3b6989c7-af5b-4402-b42f-ccb87aa275c4 req-55e9e54d-393e-4d48-8957-06c440cb75e3 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] No waiting events found dispatching network-vif-unplugged-33d14fed-6340-407f-bdf1-c858e9cf395c {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG nova.compute.manager [req-3b6989c7-af5b-4402-b42f-ccb87aa275c4 req-55e9e54d-393e-4d48-8957-06c440cb75e3 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received event network-vif-unplugged-33d14fed-6340-407f-bdf1-c858e9cf395c for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG nova.compute.manager [req-3b6989c7-af5b-4402-b42f-ccb87aa275c4 req-55e9e54d-393e-4d48-8957-06c440cb75e3 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received event network-vif-plugged-33d14fed-6340-407f-bdf1-c858e9cf395c {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-3b6989c7-af5b-4402-b42f-ccb87aa275c4 req-55e9e54d-393e-4d48-8957-06c440cb75e3 service nova] Acquiring lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-3b6989c7-af5b-4402-b42f-ccb87aa275c4 req-55e9e54d-393e-4d48-8957-06c440cb75e3 service nova] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-3b6989c7-af5b-4402-b42f-ccb87aa275c4 req-55e9e54d-393e-4d48-8957-06c440cb75e3 service nova] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG nova.compute.manager [req-3b6989c7-af5b-4402-b42f-ccb87aa275c4 req-55e9e54d-393e-4d48-8957-06c440cb75e3 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] No waiting events found dispatching network-vif-plugged-33d14fed-6340-407f-bdf1-c858e9cf395c {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:33:48 user nova-compute[73391]: WARNING nova.compute.manager [req-3b6989c7-af5b-4402-b42f-ccb87aa275c4 req-55e9e54d-393e-4d48-8957-06c440cb75e3 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received unexpected event network-vif-plugged-33d14fed-6340-407f-bdf1-c858e9cf395c for instance with vm_state active and task_state deleting.
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7b0396-1012-40e1-aa06-10904b01f960]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1, portal: 172.16.0.220,3260]
Aug 15 05:33:48 user nova-compute[73391]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1, portal: 172.16.0.220,3260] successful.
Aug 15 05:33:48 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:162fea74-b991-40c2-acce-b2c6fcd5c2f1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d3a6401-9e10-47d0-b96b-746228a3a40c]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.327s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] <== disconnect_volume: return (329ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BMuDhPfR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:33:48 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:33:48 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[33868aea-094b-41e0-93a0-6b7739f5cc6f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0cc3b2-5c9d-4fa2-be2e-c31ad50ae561]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)
Aug 15 05:33:48 user nova-compute[73391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:33:48 user nova-compute[73391]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 (non-flash)
Aug 15 05:33:48 user nova-compute[73391]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e (non-flash)
Aug 15 05:33:48 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:33:48 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)
Aug 15 05:33:48 user nova-compute[73391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:33:48 user nova-compute[73391]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 (non-flash)
Aug 15 05:33:48 user nova-compute[73391]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e (non-flash)
Aug 15 05:33:48 user nova-compute[73391]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 (non-flash)
Aug 15 05:33:48 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77284944c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1'): ({'sdg'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Removing single pathed devices sdg {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5611c5e-d567-4c9b-a77d-66591138ae79]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1145db07-4924-4ea2-9fff-0705eecd588e]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Flushing IO for device /dev/sdg {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe849cb-eca2-4821-ade3-e0b256b493b6]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.058s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[349ccdf4-542f-4de2-aaea-613f5883f3ef]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] SCSI volumes sdg have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG nova.compute.manager [req-bc86a2da-e578-4bff-a314-2f17879fedec req-60411eb2-e22d-44b6-bd49-e695cd413c6a service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received event network-vif-plugged-7adbd6a6-9a65-4e61-9ff2-63351d5dfaad {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-bc86a2da-e578-4bff-a314-2f17879fedec req-60411eb2-e22d-44b6-bd49-e695cd413c6a service nova] Acquiring lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-bc86a2da-e578-4bff-a314-2f17879fedec req-60411eb2-e22d-44b6-bd49-e695cd413c6a service nova] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-bc86a2da-e578-4bff-a314-2f17879fedec req-60411eb2-e22d-44b6-bd49-e695cd413c6a service nova] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG nova.compute.manager [req-bc86a2da-e578-4bff-a314-2f17879fedec req-60411eb2-e22d-44b6-bd49-e695cd413c6a service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] No waiting events found dispatching network-vif-plugged-7adbd6a6-9a65-4e61-9ff2-63351d5dfaad {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:33:48 user nova-compute[73391]: WARNING nova.compute.manager [req-bc86a2da-e578-4bff-a314-2f17879fedec req-60411eb2-e22d-44b6-bd49-e695cd413c6a service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received unexpected event network-vif-plugged-7adbd6a6-9a65-4e61-9ff2-63351d5dfaad for instance with vm_state active and task_state deleting.
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0befa1dd-0aaa-421a-9bcd-ee5b4516a5ad]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[488d6a14-7ee7-42dd-a572-454fb14999e9]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1, portal: 172.16.0.220,3260]
Aug 15 05:33:48 user nova-compute[73391]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1, portal: 172.16.0.220,3260] successful.
Aug 15 05:33:48 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:326d5b7a-2a67-4d44-a918-a390fd8d5bb1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4589e7ad-95cc-4ca1-9aed-83043337a8bc]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] <== disconnect_volume: return (353ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wydCbFrj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:33:48 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:33:48 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[16d27a5f-adb5-4283-82dc-428efc77ee2f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce133f12-f802-4cef-83aa-209b85ad111e]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)
Aug 15 05:33:48 user nova-compute[73391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:33:48 user nova-compute[73391]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 (non-flash)
Aug 15 05:33:48 user nova-compute[73391]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e (non-flash)
Aug 15 05:33:48 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 (non-flash)
Aug 15 05:33:48 user nova-compute[73391]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:33:48 user nova-compute[73391]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 (non-flash)
Aug 15 05:33:48 user nova-compute[73391]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e (non-flash)
Aug 15 05:33:48 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77482d81f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518'): ({'sdi'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Removing single pathed devices sdi {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 05:33:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:49 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:49 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[74fe9ba7-b84c-4f46-af82-fe69ee32cb4e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:33:49 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:49 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:49 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:49 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[030dc01b-be35-4d42-8c56-90ce02b433c0]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:33:49 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Flushing IO for device /dev/sdi {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 05:33:49 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:49 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:49 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[71eb3c5c-51c6-4784-8bb1-102b405f1955]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:33:49 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 05:33:49 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:49 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.044s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:49 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0056a565-1abb-44b9-b02c-eacc45c3cb57]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:33:49 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 05:33:49 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] SCSI volumes sdi have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 05:33:49 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 05:33:49 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:49 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:49 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1256a3f-5dad-44d7-87aa-4dcda4b0db2e]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:33:49 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:33:49 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:49 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:49 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c20e09f-cb11-44c3-ab22-3742304ca421]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:33:49 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518, portal: 172.16.0.220,3260]
Aug 15 05:33:49 user nova-compute[73391]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518, portal: 172.16.0.220,3260] successful.
Aug 15 05:33:49 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:33:49 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:49 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:644f40f9-9fcf-4fa6-908e-d1c315ad9518 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:49 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4668c80-e7cd-4507-a65b-2f395ddd1ab0]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:33:49 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:33:49 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:33:49 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] <== disconnect_volume: return (295ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:33:49 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 05:33:49 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Deleting instance files /opt/stack/data/nova/instances/96c5782e-9d00-4bb8-8e1d-99416bc7d556_del
Aug 15 05:33:49 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Deletion of /opt/stack/data/nova/instances/96c5782e-9d00-4bb8-8e1d-99416bc7d556_del complete
Aug 15 05:33:49 user nova-compute[73391]: INFO nova.compute.manager [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Took 3.62 seconds to destroy the instance on the hypervisor.
Aug 15 05:33:49 user nova-compute[73391]: DEBUG oslo.service.loopingcall [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 05:33:49 user nova-compute[73391]: DEBUG nova.compute.manager [-] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Deallocating network for instance {{(pid=73391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 05:33:49 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] deallocate_for_instance() {{(pid=73391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 05:33:50 user nova-compute[73391]: DEBUG nova.compute.manager [req-42229bf3-487e-4275-aadc-b0ab3830d0c9 req-6211ef87-c586-431d-9ac9-8f90bae2dc91 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received event network-vif-plugged-ae52a22f-e13e-4da6-9561-ba679ac242b1 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:33:50 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-42229bf3-487e-4275-aadc-b0ab3830d0c9 req-6211ef87-c586-431d-9ac9-8f90bae2dc91 service nova] Acquiring lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:50 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-42229bf3-487e-4275-aadc-b0ab3830d0c9 req-6211ef87-c586-431d-9ac9-8f90bae2dc91 service nova] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:50 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-42229bf3-487e-4275-aadc-b0ab3830d0c9 req-6211ef87-c586-431d-9ac9-8f90bae2dc91 service nova] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:50 user nova-compute[73391]: DEBUG nova.compute.manager [req-42229bf3-487e-4275-aadc-b0ab3830d0c9 req-6211ef87-c586-431d-9ac9-8f90bae2dc91 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] No waiting events found dispatching network-vif-plugged-ae52a22f-e13e-4da6-9561-ba679ac242b1 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:33:50 user nova-compute[73391]: WARNING nova.compute.manager [req-42229bf3-487e-4275-aadc-b0ab3830d0c9 req-6211ef87-c586-431d-9ac9-8f90bae2dc91 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received unexpected event network-vif-plugged-ae52a22f-e13e-4da6-9561-ba679ac242b1 for instance with vm_state active and task_state deleting.
Aug 15 05:33:50 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692077615.7257438, 0169df15-335e-46e6-a5c8-9deb7095bb84 => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:33:50 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] VM Stopped (Lifecycle Event)
Aug 15 05:33:50 user nova-compute[73391]: DEBUG nova.compute.manager [None req-fa9c9ecd-c1b9-4238-b59d-f38af9d7428b None None] [instance: 0169df15-335e-46e6-a5c8-9deb7095bb84] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:33:52 user nova-compute[73391]: DEBUG nova.compute.manager [req-ef1b0530-15dc-449a-80af-768addf7ccde req-b80388e9-019d-4795-ba5a-9f9c72fdb7d0 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received event network-vif-deleted-a09443ce-b3e9-4fe7-b24a-b1c609cb2553 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:33:52 user nova-compute[73391]: INFO nova.compute.manager [req-ef1b0530-15dc-449a-80af-768addf7ccde req-b80388e9-019d-4795-ba5a-9f9c72fdb7d0 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Neutron deleted interface a09443ce-b3e9-4fe7-b24a-b1c609cb2553; detaching it from the instance and deleting it from the info cache
Aug 15 05:33:52 user nova-compute[73391]: DEBUG nova.network.neutron [req-ef1b0530-15dc-449a-80af-768addf7ccde req-b80388e9-019d-4795-ba5a-9f9c72fdb7d0 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Updating instance_info_cache with network_info: [{"id": "37e2378e-5659-401c-95ce-0424b61e2e1a", "address": "fa:16:3e:7b:4f:9c", "network": {"id": "1fb1af76-f96a-4640-a09d-1bdb13e93bd6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-505156524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e2378e-56", "ovs_interfaceid": "37e2378e-5659-401c-95ce-0424b61e2e1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23d27a9f-a59d-4369-a8c2-0f09564bb78d", "address": "fa:16:3e:4a:c7:00", "network": {"id": "38d7d183-2f35-4f50-bd69-614eaf1952ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-82531103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23d27a9f-a5", "ovs_interfaceid": "23d27a9f-a59d-4369-a8c2-0f09564bb78d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "879124a9-46cd-45bb-b1a2-34cc8264cf25", "address": "fa:16:3e:4a:68:3f", "network": {"id": "38d7d183-2f35-4f50-bd69-614eaf1952ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-82531103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap879124a9-46", "ovs_interfaceid": "879124a9-46cd-45bb-b1a2-34cc8264cf25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7adbd6a6-9a65-4e61-9ff2-63351d5dfaad", "address": "fa:16:3e:b7:e9:02", "network": {"id": "38d7d183-2f35-4f50-bd69-614eaf1952ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-82531103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.247", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7adbd6a6-9a", "ovs_interfaceid": "7adbd6a6-9a65-4e61-9ff2-63351d5dfaad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ae52a22f-e13e-4da6-9561-ba679ac242b1", "address": "fa:16:3e:df:63:15", "network": {"id": "0376a3e8-17aa-47e4-afdb-fb7ba9174147", "bridge": "br-int", "label": "tempest-device-tagging-net2-1320047162", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae52a22f-e1", "ovs_interfaceid": "ae52a22f-e13e-4da6-9561-ba679ac242b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "33d14fed-6340-407f-bdf1-c858e9cf395c", "address": "fa:16:3e:f1:52:78", "network": {"id": "0376a3e8-17aa-47e4-afdb-fb7ba9174147", "bridge": "br-int", "label": "tempest-device-tagging-net2-1320047162", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33d14fed-63", "ovs_interfaceid": "33d14fed-6340-407f-bdf1-c858e9cf395c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:33:52 user nova-compute[73391]: DEBUG nova.compute.manager [req-ef1b0530-15dc-449a-80af-768addf7ccde req-b80388e9-019d-4795-ba5a-9f9c72fdb7d0 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Detach interface failed, port_id=a09443ce-b3e9-4fe7-b24a-b1c609cb2553, reason: Instance 96c5782e-9d00-4bb8-8e1d-99416bc7d556 could not be found. {{(pid=73391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 05:33:52 user nova-compute[73391]: DEBUG nova.compute.manager [req-ef1b0530-15dc-449a-80af-768addf7ccde req-b80388e9-019d-4795-ba5a-9f9c72fdb7d0 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received event network-vif-deleted-7adbd6a6-9a65-4e61-9ff2-63351d5dfaad {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:33:52 user nova-compute[73391]: INFO nova.compute.manager [req-ef1b0530-15dc-449a-80af-768addf7ccde req-b80388e9-019d-4795-ba5a-9f9c72fdb7d0 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Neutron deleted interface 7adbd6a6-9a65-4e61-9ff2-63351d5dfaad; detaching it from the instance and deleting it from the info cache
Aug 15 05:33:52 user nova-compute[73391]: DEBUG nova.network.neutron [req-ef1b0530-15dc-449a-80af-768addf7ccde req-b80388e9-019d-4795-ba5a-9f9c72fdb7d0 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Updating instance_info_cache with network_info: [{"id": "37e2378e-5659-401c-95ce-0424b61e2e1a", "address": "fa:16:3e:7b:4f:9c", "network": {"id": "1fb1af76-f96a-4640-a09d-1bdb13e93bd6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-505156524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e2378e-56", "ovs_interfaceid": "37e2378e-5659-401c-95ce-0424b61e2e1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23d27a9f-a59d-4369-a8c2-0f09564bb78d", "address": "fa:16:3e:4a:c7:00", "network": {"id": "38d7d183-2f35-4f50-bd69-614eaf1952ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-82531103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23d27a9f-a5", "ovs_interfaceid": "23d27a9f-a59d-4369-a8c2-0f09564bb78d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "879124a9-46cd-45bb-b1a2-34cc8264cf25", "address": "fa:16:3e:4a:68:3f", "network": {"id": "38d7d183-2f35-4f50-bd69-614eaf1952ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-82531103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap879124a9-46", "ovs_interfaceid": "879124a9-46cd-45bb-b1a2-34cc8264cf25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ae52a22f-e13e-4da6-9561-ba679ac242b1", "address": "fa:16:3e:df:63:15", "network": {"id": "0376a3e8-17aa-47e4-afdb-fb7ba9174147", "bridge": "br-int", "label": "tempest-device-tagging-net2-1320047162", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae52a22f-e1", "ovs_interfaceid": "ae52a22f-e13e-4da6-9561-ba679ac242b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "33d14fed-6340-407f-bdf1-c858e9cf395c", "address": "fa:16:3e:f1:52:78", "network": {"id": "0376a3e8-17aa-47e4-afdb-fb7ba9174147", "bridge": "br-int", "label": "tempest-device-tagging-net2-1320047162", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap33d14fed-63", "ovs_interfaceid": "33d14fed-6340-407f-bdf1-c858e9cf395c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:33:52 user nova-compute[73391]: DEBUG nova.compute.manager [req-ef1b0530-15dc-449a-80af-768addf7ccde req-b80388e9-019d-4795-ba5a-9f9c72fdb7d0 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Detach interface failed, port_id=7adbd6a6-9a65-4e61-9ff2-63351d5dfaad, reason: Instance 96c5782e-9d00-4bb8-8e1d-99416bc7d556 could not be found. {{(pid=73391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 05:33:52 user nova-compute[73391]: DEBUG nova.compute.manager [req-ef1b0530-15dc-449a-80af-768addf7ccde req-b80388e9-019d-4795-ba5a-9f9c72fdb7d0 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received event network-vif-deleted-33d14fed-6340-407f-bdf1-c858e9cf395c {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:33:52 user nova-compute[73391]: INFO nova.compute.manager [req-ef1b0530-15dc-449a-80af-768addf7ccde req-b80388e9-019d-4795-ba5a-9f9c72fdb7d0 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Neutron deleted interface 33d14fed-6340-407f-bdf1-c858e9cf395c; detaching it from the instance and deleting it from the info cache
Aug 15 05:33:52 user nova-compute[73391]: DEBUG nova.network.neutron [req-ef1b0530-15dc-449a-80af-768addf7ccde req-b80388e9-019d-4795-ba5a-9f9c72fdb7d0 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Updating instance_info_cache with network_info: [{"id": "37e2378e-5659-401c-95ce-0424b61e2e1a", "address": "fa:16:3e:7b:4f:9c", "network": {"id": "1fb1af76-f96a-4640-a09d-1bdb13e93bd6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-505156524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e2378e-56", "ovs_interfaceid": "37e2378e-5659-401c-95ce-0424b61e2e1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23d27a9f-a59d-4369-a8c2-0f09564bb78d", "address": "fa:16:3e:4a:c7:00", "network": {"id": "38d7d183-2f35-4f50-bd69-614eaf1952ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-82531103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23d27a9f-a5", "ovs_interfaceid": "23d27a9f-a59d-4369-a8c2-0f09564bb78d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "879124a9-46cd-45bb-b1a2-34cc8264cf25", "address": "fa:16:3e:4a:68:3f", "network": {"id": "38d7d183-2f35-4f50-bd69-614eaf1952ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-82531103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap879124a9-46", "ovs_interfaceid": "879124a9-46cd-45bb-b1a2-34cc8264cf25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ae52a22f-e13e-4da6-9561-ba679ac242b1", "address": "fa:16:3e:df:63:15", "network": {"id": "0376a3e8-17aa-47e4-afdb-fb7ba9174147", "bridge": "br-int", "label": "tempest-device-tagging-net2-1320047162", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapae52a22f-e1", "ovs_interfaceid": "ae52a22f-e13e-4da6-9561-ba679ac242b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:33:52 user nova-compute[73391]: DEBUG nova.compute.manager [req-ef1b0530-15dc-449a-80af-768addf7ccde req-b80388e9-019d-4795-ba5a-9f9c72fdb7d0 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Detach interface failed, port_id=33d14fed-6340-407f-bdf1-c858e9cf395c, reason: Instance 96c5782e-9d00-4bb8-8e1d-99416bc7d556 could not be found. {{(pid=73391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 05:33:52 user nova-compute[73391]: DEBUG nova.compute.manager [req-ef1b0530-15dc-449a-80af-768addf7ccde req-b80388e9-019d-4795-ba5a-9f9c72fdb7d0 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received event network-vif-deleted-ae52a22f-e13e-4da6-9561-ba679ac242b1 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:33:52 user nova-compute[73391]: INFO nova.compute.manager [req-ef1b0530-15dc-449a-80af-768addf7ccde req-b80388e9-019d-4795-ba5a-9f9c72fdb7d0 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Neutron deleted interface ae52a22f-e13e-4da6-9561-ba679ac242b1; detaching it from the instance and deleting it from the info cache
Aug 15 05:33:52 user nova-compute[73391]: DEBUG nova.network.neutron [req-ef1b0530-15dc-449a-80af-768addf7ccde req-b80388e9-019d-4795-ba5a-9f9c72fdb7d0 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Updating instance_info_cache with network_info: [{"id": "37e2378e-5659-401c-95ce-0424b61e2e1a", "address": "fa:16:3e:7b:4f:9c", "network": {"id": "1fb1af76-f96a-4640-a09d-1bdb13e93bd6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-505156524-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.249", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap37e2378e-56", "ovs_interfaceid": "37e2378e-5659-401c-95ce-0424b61e2e1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "23d27a9f-a59d-4369-a8c2-0f09564bb78d", "address": "fa:16:3e:4a:c7:00", "network": {"id": "38d7d183-2f35-4f50-bd69-614eaf1952ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-82531103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.154", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23d27a9f-a5", "ovs_interfaceid": "23d27a9f-a59d-4369-a8c2-0f09564bb78d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "879124a9-46cd-45bb-b1a2-34cc8264cf25", "address": "fa:16:3e:4a:68:3f", "network": {"id": "38d7d183-2f35-4f50-bd69-614eaf1952ad", "bridge": "br-int", "label": "tempest-device-tagging-net1-82531103", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.27", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "2a32aa9315a244728c4a764d21e1d2c9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap879124a9-46", "ovs_interfaceid": "879124a9-46cd-45bb-b1a2-34cc8264cf25", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:33:52 user nova-compute[73391]: DEBUG nova.compute.manager [req-ef1b0530-15dc-449a-80af-768addf7ccde req-b80388e9-019d-4795-ba5a-9f9c72fdb7d0 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Detach interface failed, port_id=ae52a22f-e13e-4da6-9561-ba679ac242b1, reason: Instance 96c5782e-9d00-4bb8-8e1d-99416bc7d556 could not be found. {{(pid=73391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 05:33:52 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:33:52 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Took 3.49 seconds to deallocate network for instance.
Aug 15 05:33:53 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:54 user nova-compute[73391]: DEBUG nova.compute.manager [req-ae929171-9d16-4e60-af71-40bc17bd7c4d req-1ca62272-6eee-46c3-b244-28e9689ea053 service nova] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Received event network-vif-deleted-37e2378e-5659-401c-95ce-0424b61e2e1a {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:33:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:56 user nova-compute[73391]: INFO nova.compute.manager [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Rescuing
Aug 15 05:33:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquiring lock "refresh_cache-6358e825-5705-45d6-86b6-3aacfa5a9bbb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:33:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquired lock "refresh_cache-6358e825-5705-45d6-86b6-3aacfa5a9bbb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:33:56 user nova-compute[73391]: DEBUG nova.network.neutron [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:33:57 user nova-compute[73391]: DEBUG nova.network.neutron [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Updating instance_info_cache with network_info: [{"id": "3b77e3e1-84f9-470a-b684-e8bdc4996c68", "address": "fa:16:3e:68:b6:f9", "network": {"id": "70d88082-aea7-48bb-abb4-d77d264aaf01", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b9acbe11654053bb905e7c92558a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b77e3e1-84", "ovs_interfaceid": "3b77e3e1-84f9-470a-b684-e8bdc4996c68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:33:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Releasing lock "refresh_cache-6358e825-5705-45d6-86b6-3aacfa5a9bbb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:33:57 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:57 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:57 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:57 user nova-compute[73391]: DEBUG nova.compute.manager [req-836972f3-9269-4e92-8f9a-2cb6913135c4 req-5ca20720-f28c-40f2-b2ec-a135853ee374 service nova] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Received event network-vif-unplugged-3b77e3e1-84f9-470a-b684-e8bdc4996c68 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:33:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-836972f3-9269-4e92-8f9a-2cb6913135c4 req-5ca20720-f28c-40f2-b2ec-a135853ee374 service nova] Acquiring lock "6358e825-5705-45d6-86b6-3aacfa5a9bbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-836972f3-9269-4e92-8f9a-2cb6913135c4 req-5ca20720-f28c-40f2-b2ec-a135853ee374 service nova] Lock "6358e825-5705-45d6-86b6-3aacfa5a9bbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-836972f3-9269-4e92-8f9a-2cb6913135c4 req-5ca20720-f28c-40f2-b2ec-a135853ee374 service nova] Lock "6358e825-5705-45d6-86b6-3aacfa5a9bbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:57 user nova-compute[73391]: DEBUG nova.compute.manager [req-836972f3-9269-4e92-8f9a-2cb6913135c4 req-5ca20720-f28c-40f2-b2ec-a135853ee374 service nova] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] No waiting events found dispatching network-vif-unplugged-3b77e3e1-84f9-470a-b684-e8bdc4996c68 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:33:57 user nova-compute[73391]: WARNING nova.compute.manager [req-836972f3-9269-4e92-8f9a-2cb6913135c4 req-5ca20720-f28c-40f2-b2ec-a135853ee374 service nova] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Received unexpected event network-vif-unplugged-3b77e3e1-84f9-470a-b684-e8bdc4996c68 for instance with vm_state active and task_state rescuing.
Aug 15 05:33:57 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:57 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Instance destroyed successfully.
Aug 15 05:33:57 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Attempting a stable device rescue
Aug 15 05:33:57 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73391) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 15 05:33:57 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Instance directory exists: not creating {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 05:33:57 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Creating image(s)
Aug 15 05:33:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquiring lock "/opt/stack/data/nova/instances/6358e825-5705-45d6-86b6-3aacfa5a9bbb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "/opt/stack/data/nova/instances/6358e825-5705-45d6-86b6-3aacfa5a9bbb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "/opt/stack/data/nova/instances/6358e825-5705-45d6-86b6-3aacfa5a9bbb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:57 user nova-compute[73391]: DEBUG nova.objects.instance [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6358e825-5705-45d6-86b6-3aacfa5a9bbb {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:33:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquiring lock "fb1d1e756870131589138eba11abef5fde0e83cc" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "fb1d1e756870131589138eba11abef5fde0e83cc" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.003s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb1d1e756870131589138eba11abef5fde0e83cc.part --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:33:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:33:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb1d1e756870131589138eba11abef5fde0e83cc.part --force-share --output=json" returned: 0 in 0.256s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:59 user nova-compute[73391]: DEBUG nova.virt.images [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] c38ddeff-86ea-48bc-acb0-4e87b704a319 was qcow2, converting to raw {{(pid=73391) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 05:33:59 user nova-compute[73391]: DEBUG nova.privsep.utils [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73391) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 05:33:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fb1d1e756870131589138eba11abef5fde0e83cc.part /opt/stack/data/nova/instances/_base/fb1d1e756870131589138eba11abef5fde0e83cc.converted {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/fb1d1e756870131589138eba11abef5fde0e83cc.part /opt/stack/data/nova/instances/_base/fb1d1e756870131589138eba11abef5fde0e83cc.converted" returned: 0 in 0.178s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb1d1e756870131589138eba11abef5fde0e83cc.converted --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb1d1e756870131589138eba11abef5fde0e83cc.converted --force-share --output=json" returned: 0 in 0.211s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "fb1d1e756870131589138eba11abef5fde0e83cc" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.646s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquiring lock "fb1d1e756870131589138eba11abef5fde0e83cc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "fb1d1e756870131589138eba11abef5fde0e83cc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb1d1e756870131589138eba11abef5fde0e83cc --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:59 user nova-compute[73391]: DEBUG nova.compute.manager [req-3c9bfaba-a50b-49d4-a636-e97d8d2eb6e9 req-8da748f8-348b-41bd-bf23-abff8040e82d service nova] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Received event network-vif-plugged-3b77e3e1-84f9-470a-b684-e8bdc4996c68 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:33:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-3c9bfaba-a50b-49d4-a636-e97d8d2eb6e9 req-8da748f8-348b-41bd-bf23-abff8040e82d service nova] Acquiring lock "6358e825-5705-45d6-86b6-3aacfa5a9bbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:33:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-3c9bfaba-a50b-49d4-a636-e97d8d2eb6e9 req-8da748f8-348b-41bd-bf23-abff8040e82d service nova] Lock "6358e825-5705-45d6-86b6-3aacfa5a9bbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:33:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-3c9bfaba-a50b-49d4-a636-e97d8d2eb6e9 req-8da748f8-348b-41bd-bf23-abff8040e82d service nova] Lock "6358e825-5705-45d6-86b6-3aacfa5a9bbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:59 user nova-compute[73391]: DEBUG nova.compute.manager [req-3c9bfaba-a50b-49d4-a636-e97d8d2eb6e9 req-8da748f8-348b-41bd-bf23-abff8040e82d service nova] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] No waiting events found dispatching network-vif-plugged-3b77e3e1-84f9-470a-b684-e8bdc4996c68 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:33:59 user nova-compute[73391]: WARNING nova.compute.manager [req-3c9bfaba-a50b-49d4-a636-e97d8d2eb6e9 req-8da748f8-348b-41bd-bf23-abff8040e82d service nova] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Received unexpected event network-vif-plugged-3b77e3e1-84f9-470a-b684-e8bdc4996c68 for instance with vm_state active and task_state rescuing.
Aug 15 05:33:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/fb1d1e756870131589138eba11abef5fde0e83cc --force-share --output=json" returned: 0 in 0.189s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb1d1e756870131589138eba11abef5fde0e83cc,backing_fmt=raw /opt/stack/data/nova/instances/6358e825-5705-45d6-86b6-3aacfa5a9bbb/disk.rescue {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:33:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/fb1d1e756870131589138eba11abef5fde0e83cc,backing_fmt=raw /opt/stack/data/nova/instances/6358e825-5705-45d6-86b6-3aacfa5a9bbb/disk.rescue" returned: 0 in 0.058s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:33:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "fb1d1e756870131589138eba11abef5fde0e83cc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:33:59 user nova-compute[73391]: DEBUG nova.objects.instance [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lazy-loading 'migration_context' on Instance uuid 6358e825-5705-45d6-86b6-3aacfa5a9bbb {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:33:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Created local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 05:33:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Start _get_guest_xml network_info=[{"id": "3b77e3e1-84f9-470a-b684-e8bdc4996c68", "address": "fa:16:3e:68:b6:f9", "network": {"id": "70d88082-aea7-48bb-abb4-d77d264aaf01", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "vif_mac": "fa:16:3e:68:b6:f9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b9acbe11654053bb905e7c92558a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b77e3e1-84", "ovs_interfaceid": "3b77e3e1-84f9-470a-b684-e8bdc4996c68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'c38ddeff-86ea-48bc-acb0-4e87b704a319', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yNsuhABc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '6358e825-5705-45d6-86b6-3aacfa5a9bbb', 'attached_at': '', 'detached_at': '', 'volume_id': '80371ba5-8b71-45bc-b67d-43676d63163e', 'serial': '80371ba5-8b71-45bc-b67d-43676d63163e'}, 'attachment_id': '068a15d7-3013-4b34-a615-fd36d5b1d5a4', 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:33:59 user nova-compute[73391]: DEBUG nova.objects.instance [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lazy-loading 'resources' on Instance uuid 6358e825-5705-45d6-86b6-3aacfa5a9bbb {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:33:59 user nova-compute[73391]: DEBUG nova.objects.instance [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lazy-loading 'numa_topology' on Instance uuid 6358e825-5705-45d6-86b6-3aacfa5a9bbb {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:33:59 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:33:59 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:33:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:33:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:33:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:33:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:33:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:33:59 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:33:59 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:33:59 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:33:59 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:33:59 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:33:59 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:33:59 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:33:59 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:33:59 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:33:59 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:33:59 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:33:59 user nova-compute[73391]: DEBUG nova.objects.instance [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6358e825-5705-45d6-86b6-3aacfa5a9bbb {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:34:00 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 05:34:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yNsuhABc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:34:00 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:34:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:34:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:34:00 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:34:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:34:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:34:00 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 05:34:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:34:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:34:00 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[101b7c00-ad7a-47ac-bac4-ace16557b24b]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = yNsuhABc\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:34:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 15 05:34:00 user nova-compute[73391]: node.name = iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e
Aug 15 05:34:00 user nova-compute[73391]: node.tpgt = -1
Aug 15 05:34:00 user nova-compute[73391]: node.startup = automatic
Aug 15 05:34:00 user nova-compute[73391]: node.leading_login = No
Aug 15 05:34:00 user nova-compute[73391]: iface.iscsi_ifacename = default
Aug 15 05:34:00 user nova-compute[73391]: iface.net_ifacename = <empty>
Aug 15 05:34:00 user nova-compute[73391]: iface.ipaddress = <empty>
Aug 15 05:34:00 user nova-compute[73391]: iface.prefix_len = 0
Aug 15 05:34:00 user nova-compute[73391]: iface.hwaddress = <empty>
Aug 15 05:34:00 user nova-compute[73391]: iface.transport_name = tcp
Aug 15 05:34:00 user nova-compute[73391]: iface.initiatorname = <empty>
Aug 15 05:34:00 user nova-compute[73391]: iface.state = <empty>
Aug 15 05:34:00 user nova-compute[73391]: iface.vlan_id = 0
Aug 15 05:34:00 user nova-compute[73391]: iface.vlan_priority = 0
Aug 15 05:34:00 user nova-compute[73391]: iface.vlan_state = <empty>
Aug 15 05:34:00 user nova-compute[73391]: iface.iface_num = 0
Aug 15 05:34:00 user nova-compute[73391]: iface.mtu = 0
Aug 15 05:34:00 user nova-compute[73391]: iface.port = 0
Aug 15 05:34:00 user nova-compute[73391]: iface.bootproto = <empty>
Aug 15 05:34:00 user nova-compute[73391]: iface.subnet_mask = <empty>
Aug 15 05:34:00 user nova-compute[73391]: iface.gateway = <empty>
Aug 15 05:34:00 user nova-compute[73391]: iface.dhcp_alt_client_id_state = <empty>
Aug 15 05:34:00 user nova-compute[73391]: iface.dhcp_alt_client_id = <empty>
Aug 15 05:34:00 user nova-compute[73391]: iface.dhcp_dns = <empty>
Aug 15 05:34:00 user nova-compute[73391]: iface.dhcp_learn_iqn = <empty>
Aug 15 05:34:00 user nova-compute[73391]: iface.dhcp_req_vendor_id_state = <empty>
Aug 15 05:34:00 user nova-compute[73391]: iface.dhcp_vendor_id_state = <empty>
Aug 15 05:34:00 user nova-compute[73391]: iface.dhcp_vendor_id = <empty>
Aug 15 05:34:00 user nova-compute[73391]: iface.dhcp_slp_da = <empty>
Aug 15 05:34:00 user nova-compute[73391]: iface.fragmentation = <empty>
Aug 15 05:34:00 user nova-compute[73391]: iface.gratuitous_arp = <empty>
Aug 15 05:34:00 user nova-compute[73391]: iface.incoming_forwarding = <empty>
Aug 15 05:34:00 user nova-compute[73391]: iface.tos_state = <empty>
Aug 15 05:34:00 user nova-compute[73391]: iface.tos = 0
Aug 15 05:34:00 user nova-compute[73391]: iface.ttl = 0
Aug 15 05:34:00 user nova-compute[73391]: iface.delayed_ack = <empty>
Aug 15 05:34:00 user nova-compute[73391]: iface.tcp_nagle = <empty>
Aug 15 05:34:00 user nova-compute[73391]: iface.tcp_wsf_state = <empty>
Aug 15 05:34:00 user nova-compute[73391]: iface.tcp_wsf = 0
Aug 15 05:34:00 user nova-compute[73391]: iface.tcp_timer_scale = 0
Aug 15 05:34:00 user nova-compute[73391]: iface.tcp_timestamp = <empty>
Aug 15 05:34:00 user nova-compute[73391]: iface.redirect = <empty>
Aug 15 05:34:00 user nova-compute[73391]: iface.def_task_mgmt_timeout = 0
Aug 15 05:34:00 user nova-compute[73391]: iface.header_digest = <empty>
Aug 15 05:34:00 user nova-compute[73391]: iface.data_digest = <empty>
Aug 15 05:34:00 user nova-compute[73391]: iface.immediate_data = <empty>
Aug 15 05:34:00 user nova-compute[73391]: iface.initial_r2t = <empty>
Aug 15 05:34:00 user nova-compute[73391]: iface.data_seq_inorder = <empty>
Aug 15 05:34:00 user nova-compute[73391]: iface.data_pdu_inorder = <empty>
Aug 15 05:34:00 user nova-compute[73391]: iface.erl = 0
Aug 15 05:34:00 user nova-compute[73391]: iface.max_receive_data_len = 0
Aug 15 05:34:00 user nova-compute[73391]: iface.first_burst_len = 0
Aug 15 05:34:00 user nova-compute[73391]: iface.max_outstanding_r2t = 0
Aug 15 05:34:00 user nova-compute[73391]: iface.max_burst_len = 0
Aug 15 05:34:00 user nova-compute[73391]: iface.chap_auth = <empty>
Aug 15 05:34:00 user nova-compute[73391]: iface.bidi_chap = <empty>
Aug 15 05:34:00 user nova-compute[73391]: iface.strict_login_compliance = <empty>
Aug 15 05:34:00 user nova-compute[73391]: iface.discovery_auth = <empty>
Aug 15 05:34:00 user nova-compute[73391]: iface.discovery_logout = <empty>
Aug 15 05:34:00 user nova-compute[73391]: node.discovery_address = <empty>
Aug 15 05:34:00 user nova-compute[73391]: node.discovery_port = 0
Aug 15 05:34:00 user nova-compute[73391]: node.discovery_type = static
Aug 15 05:34:00 user nova-compute[73391]: node.session.initial_cmdsn = 0
Aug 15 05:34:00 user nova-compute[73391]: node.session.initial_login_retry_max = 8
Aug 15 05:34:00 user nova-compute[73391]: node.session.xmit_thread_priority = -20
Aug 15 05:34:00 user nova-compute[73391]: node.session.cmds_max = 128
Aug 15 05:34:00 user nova-compute[73391]: node.session.queue_depth = 32
Aug 15 05:34:00 user nova-compute[73391]: node.session.nr_sessions = 1
Aug 15 05:34:00 user nova-compute[73391]: node.session.auth.authmethod = CHAP
Aug 15 05:34:00 user nova-compute[73391]: node.session.auth.username = yNsuhABc
Aug 15 05:34:00 user nova-compute[73391]: node.session.auth.password = ***
Aug 15 05:34:00 user nova-compute[73391]: node.session.auth.username_in = <empty>
Aug 15 05:34:00 user nova-compute[73391]: node.session.auth.password_in = <empty>
Aug 15 05:34:00 user nova-compute[73391]: node.session.auth.chap_algs = MD5
Aug 15 05:34:00 user nova-compute[73391]: node.session.timeo.replacement_timeout = 120
Aug 15 05:34:00 user nova-compute[73391]: node.session.err_timeo.abort_timeout = 15
Aug 15 05:34:00 user nova-compute[73391]: node.session.err_timeo.lu_reset_timeout = 30
Aug 15 05:34:00 user nova-compute[73391]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 15 05:34:00 user nova-compute[73391]: node.session.err_timeo.host_reset_timeout = 60
Aug 15 05:34:00 user nova-compute[73391]: node.session.iscsi.FastAbort = Yes
Aug 15 05:34:00 user nova-compute[73391]: node.session.iscsi.InitialR2T = No
Aug 15 05:34:00 user nova-compute[73391]: node.session.iscsi.ImmediateData = Yes
Aug 15 05:34:00 user nova-compute[73391]: node.session.iscsi.FirstBurstLength = 262144
Aug 15 05:34:00 user nova-compute[73391]: node.session.iscsi.MaxBurstLength = 16776192
Aug 15 05:34:00 user nova-compute[73391]: node.session.iscsi.DefaultTime2Retain = 0
Aug 15 05:34:00 user nova-compute[73391]: node.session.iscsi.DefaultTime2Wait = 2
Aug 15 05:34:00 user nova-compute[73391]: node.session.iscsi.MaxConnections = 1
Aug 15 05:34:00 user nova-compute[73391]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 15 05:34:00 user nova-compute[73391]: node.session.iscsi.ERL = 0
Aug 15 05:34:00 user nova-compute[73391]: node.session.scan = manual
Aug 15 05:34:00 user nova-compute[73391]: node.session.reopen_max = 0
Aug 15 05:34:00 user nova-compute[73391]: node.conn[0].address = 172.16.0.220
Aug 15 05:34:00 user nova-compute[73391]: node.conn[0].port = 3260
Aug 15 05:34:00 user nova-compute[73391]: node.conn[0].startup = manual
Aug 15 05:34:00 user nova-compute[73391]: node.conn[0].tcp.window_size = 524288
Aug 15 05:34:00 user nova-compute[73391]: node.conn[0].tcp.type_of_service = 0
Aug 15 05:34:00 user nova-compute[73391]: node.conn[0].timeo.logout_timeout = 15
Aug 15 05:34:00 user nova-compute[73391]: node.conn[0].timeo.login_timeout = 15
Aug 15 05:34:00 user nova-compute[73391]: node.conn[0].timeo.auth_timeout = 45
Aug 15 05:34:00 user nova-compute[73391]: node.conn[0].timeo.noop_out_interval = 5
Aug 15 05:34:00 user nova-compute[73391]: node.conn[0].timeo.noop_out_timeout = 5
Aug 15 05:34:00 user nova-compute[73391]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 15 05:34:00 user nova-compute[73391]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 15 05:34:00 user nova-compute[73391]: node.conn[0].iscsi.HeaderDigest = None
Aug 15 05:34:00 user nova-compute[73391]: node.conn[0].iscsi.DataDigest = None
Aug 15 05:34:00 user nova-compute[73391]: node.conn[0].iscsi.IFMarker = No
Aug 15 05:34:00 user nova-compute[73391]: node.conn[0].iscsi.OFMarker = No
Aug 15 05:34:00 user nova-compute[73391]: # END RECORD
Aug 15 05:34:00 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:34:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:34:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:34:00 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e97969-6970-419d-85a3-92e8dfc842e2]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:34:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:34:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:34:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:34:00 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab61790f-ed88-4bd3-a7ea-86e5f2e7aabf]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:34:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:34:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yNsuhABc {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:34:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yNsuhABc" returned: 0 in 0.024s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:34:00 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f71ded9-9cf3-4ffa-b92b-2eb927881316]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:34:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yNsuhABc'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:34:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:34:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:34:00 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[019a0964-bc3d-4b8b-9ab1-a3f4e72e5865]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:34:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:34:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:34:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:34:00 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aecd17b-eda8-4435-a6f7-b6084c8ccab6]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:34:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:34:00 user nova-compute[73391]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 (non-flash)
Aug 15 05:34:00 user nova-compute[73391]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e (non-flash)
Aug 15 05:34:00 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:34:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:34:00 user nova-compute[73391]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 (non-flash)
Aug 15 05:34:00 user nova-compute[73391]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e (non-flash)
Aug 15 05:34:00 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:34:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.159s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:34:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 05:34:00 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] HCTL ('37', '0', '0', 0) found on session 14 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 05:34:00 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 05:34:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:34:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.014s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:34:00 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c953a59-6119-433d-a762-c4eef0178843]: (4, ('0 0 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:34:00 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Searching for a device in session 14 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:34:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Connected to sdf using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yNsuhABc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 05:34:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.193s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:34:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] <== connect_volume: return (196ms) {'type': 'block', 'scsi_wwn': '26361303339663834', 'path': '/dev/sdf'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:34:00 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361303339663834', 'path': '/dev/sdf'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 05:34:00 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:32:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-668367840',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-668367840',id=12,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:32:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83b9acbe11654053bb905e7c92558a35',ramdisk_id='',reservation_id='r-t0vgeqpl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1045163116',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:32:38Z,user_data=None,user_id='887f0846cf554e12acf92a663f5ab266',uuid=6358e825-5705-45d6-86b6-3aacfa5a9bbb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b77e3e1-84f9-470a-b684-e8bdc4996c68", "address": "fa:16:3e:68:b6:f9", "network": {"id": "70d88082-aea7-48bb-abb4-d77d264aaf01", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "vif_mac": "fa:16:3e:68:b6:f9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b9acbe11654053bb905e7c92558a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b77e3e1-84", "ovs_interfaceid": "3b77e3e1-84f9-470a-b684-e8bdc4996c68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:34:00 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Converting VIF {"id": "3b77e3e1-84f9-470a-b684-e8bdc4996c68", "address": "fa:16:3e:68:b6:f9", "network": {"id": "70d88082-aea7-48bb-abb4-d77d264aaf01", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "vif_mac": "fa:16:3e:68:b6:f9"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b9acbe11654053bb905e7c92558a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b77e3e1-84", "ovs_interfaceid": "3b77e3e1-84f9-470a-b684-e8bdc4996c68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:34:00 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:b6:f9,bridge_name='br-int',has_traffic_filtering=True,id=3b77e3e1-84f9-470a-b684-e8bdc4996c68,network=Network(70d88082-aea7-48bb-abb4-d77d264aaf01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b77e3e1-84') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:34:00 user nova-compute[73391]: DEBUG nova.objects.instance [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lazy-loading 'pci_devices' on Instance uuid 6358e825-5705-45d6-86b6-3aacfa5a9bbb {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:34:00 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:34:00 user nova-compute[73391]:   <uuid>6358e825-5705-45d6-86b6-3aacfa5a9bbb</uuid>
Aug 15 05:34:00 user nova-compute[73391]:   <name>instance-0000000c</name>
Aug 15 05:34:00 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:34:00 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:34:00 user nova-compute[73391]:   <metadata>
Aug 15 05:34:00 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:34:00 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:34:00 user nova-compute[73391]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-668367840</nova:name>
Aug 15 05:34:00 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:33:59</nova:creationTime>
Aug 15 05:34:00 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:34:00 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:34:00 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:34:00 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:34:00 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:34:00 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:34:00 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:34:00 user nova-compute[73391]:       <nova:owner>
Aug 15 05:34:00 user nova-compute[73391]:         <nova:user uuid="887f0846cf554e12acf92a663f5ab266">tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member</nova:user>
Aug 15 05:34:00 user nova-compute[73391]:         <nova:project uuid="83b9acbe11654053bb905e7c92558a35">tempest-ServerBootFromVolumeStableRescueTest-1045163116</nova:project>
Aug 15 05:34:00 user nova-compute[73391]:       </nova:owner>
Aug 15 05:34:00 user nova-compute[73391]:       <nova:root type="image" uuid="191b1dad-305e-4d1c-9b15-515ec59a3278"/>
Aug 15 05:34:00 user nova-compute[73391]:       <nova:ports>
Aug 15 05:34:00 user nova-compute[73391]:         <nova:port uuid="3b77e3e1-84f9-470a-b684-e8bdc4996c68">
Aug 15 05:34:00 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 05:34:00 user nova-compute[73391]:         </nova:port>
Aug 15 05:34:00 user nova-compute[73391]:       </nova:ports>
Aug 15 05:34:00 user nova-compute[73391]:     </nova:instance>
Aug 15 05:34:00 user nova-compute[73391]:   </metadata>
Aug 15 05:34:00 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:34:00 user nova-compute[73391]:     <system>
Aug 15 05:34:00 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:34:00 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:34:00 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:34:00 user nova-compute[73391]:       <entry name="serial">6358e825-5705-45d6-86b6-3aacfa5a9bbb</entry>
Aug 15 05:34:00 user nova-compute[73391]:       <entry name="uuid">6358e825-5705-45d6-86b6-3aacfa5a9bbb</entry>
Aug 15 05:34:00 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:34:00 user nova-compute[73391]:     </system>
Aug 15 05:34:00 user nova-compute[73391]:   </sysinfo>
Aug 15 05:34:00 user nova-compute[73391]:   <os>
Aug 15 05:34:00 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:34:00 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:34:00 user nova-compute[73391]:   </os>
Aug 15 05:34:00 user nova-compute[73391]:   <features>
Aug 15 05:34:00 user nova-compute[73391]:     <acpi/>
Aug 15 05:34:00 user nova-compute[73391]:     <apic/>
Aug 15 05:34:00 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:34:00 user nova-compute[73391]:   </features>
Aug 15 05:34:00 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:34:00 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:34:00 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:34:00 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:34:00 user nova-compute[73391]:   </clock>
Aug 15 05:34:00 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:34:00 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:34:00 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:34:00 user nova-compute[73391]:   </cpu>
Aug 15 05:34:00 user nova-compute[73391]:   <devices>
Aug 15 05:34:00 user nova-compute[73391]:     <disk type="block" device="disk">
Aug 15 05:34:00 user nova-compute[73391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:34:00 user nova-compute[73391]:       <source dev="/dev/sdf"/>
Aug 15 05:34:00 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:34:00 user nova-compute[73391]:       <serial>80371ba5-8b71-45bc-b67d-43676d63163e</serial>
Aug 15 05:34:00 user nova-compute[73391]:     </disk>
Aug 15 05:34:00 user nova-compute[73391]:     <disk type="file" device="disk">
Aug 15 05:34:00 user nova-compute[73391]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 05:34:00 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/6358e825-5705-45d6-86b6-3aacfa5a9bbb/disk.rescue"/>
Aug 15 05:34:00 user nova-compute[73391]:       <target dev="vdb" bus="virtio"/>
Aug 15 05:34:00 user nova-compute[73391]:       <boot order="1"/>
Aug 15 05:34:00 user nova-compute[73391]:     </disk>
Aug 15 05:34:00 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:34:00 user nova-compute[73391]:       <mac address="fa:16:3e:68:b6:f9"/>
Aug 15 05:34:00 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:34:00 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:34:00 user nova-compute[73391]:       <target dev="tap3b77e3e1-84"/>
Aug 15 05:34:00 user nova-compute[73391]:     </interface>
Aug 15 05:34:00 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:34:00 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/6358e825-5705-45d6-86b6-3aacfa5a9bbb/console.log" append="off"/>
Aug 15 05:34:00 user nova-compute[73391]:     </serial>
Aug 15 05:34:00 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:34:00 user nova-compute[73391]:     <video>
Aug 15 05:34:00 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:34:00 user nova-compute[73391]:     </video>
Aug 15 05:34:00 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:34:00 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:34:00 user nova-compute[73391]:     </rng>
Aug 15 05:34:00 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:34:00 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:34:00 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:34:00 user nova-compute[73391]:     </memballoon>
Aug 15 05:34:00 user nova-compute[73391]:   </devices>
Aug 15 05:34:00 user nova-compute[73391]: </domain>
Aug 15 05:34:00 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:34:00 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Instance destroyed successfully.
Aug 15 05:34:00 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:34:00 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:34:00 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] No VIF found with MAC fa:16:3e:68:b6:f9, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:34:01 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:01 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:01 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:01 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:01 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:02 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:02 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:02 user nova-compute[73391]: DEBUG nova.compute.manager [req-84242f8f-dc1b-465f-9fd2-d0aa6b3f43e1 req-4859666b-08e7-4b9f-b1c6-1e567e49d0ed service nova] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Received event network-vif-plugged-3b77e3e1-84f9-470a-b684-e8bdc4996c68 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:34:02 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-84242f8f-dc1b-465f-9fd2-d0aa6b3f43e1 req-4859666b-08e7-4b9f-b1c6-1e567e49d0ed service nova] Acquiring lock "6358e825-5705-45d6-86b6-3aacfa5a9bbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:34:02 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-84242f8f-dc1b-465f-9fd2-d0aa6b3f43e1 req-4859666b-08e7-4b9f-b1c6-1e567e49d0ed service nova] Lock "6358e825-5705-45d6-86b6-3aacfa5a9bbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:34:02 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-84242f8f-dc1b-465f-9fd2-d0aa6b3f43e1 req-4859666b-08e7-4b9f-b1c6-1e567e49d0ed service nova] Lock "6358e825-5705-45d6-86b6-3aacfa5a9bbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:34:02 user nova-compute[73391]: DEBUG nova.compute.manager [req-84242f8f-dc1b-465f-9fd2-d0aa6b3f43e1 req-4859666b-08e7-4b9f-b1c6-1e567e49d0ed service nova] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] No waiting events found dispatching network-vif-plugged-3b77e3e1-84f9-470a-b684-e8bdc4996c68 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:34:02 user nova-compute[73391]: WARNING nova.compute.manager [req-84242f8f-dc1b-465f-9fd2-d0aa6b3f43e1 req-4859666b-08e7-4b9f-b1c6-1e567e49d0ed service nova] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Received unexpected event network-vif-plugged-3b77e3e1-84f9-470a-b684-e8bdc4996c68 for instance with vm_state active and task_state rescuing.
Aug 15 05:34:02 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692077627.796159, 96c5782e-9d00-4bb8-8e1d-99416bc7d556 => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:34:02 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] VM Stopped (Lifecycle Event)
Aug 15 05:34:02 user nova-compute[73391]: DEBUG nova.compute.manager [None req-e1a1f988-be77-44ce-958a-efcf9a60bf7d None None] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:34:03 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:04 user nova-compute[73391]: DEBUG nova.compute.manager [req-d36381fb-dbae-4092-bf86-3c5239b63d8d req-6381518b-f221-4b33-aec9-c3e7f4df1242 service nova] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Received event network-vif-plugged-3b77e3e1-84f9-470a-b684-e8bdc4996c68 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:34:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d36381fb-dbae-4092-bf86-3c5239b63d8d req-6381518b-f221-4b33-aec9-c3e7f4df1242 service nova] Acquiring lock "6358e825-5705-45d6-86b6-3aacfa5a9bbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:34:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d36381fb-dbae-4092-bf86-3c5239b63d8d req-6381518b-f221-4b33-aec9-c3e7f4df1242 service nova] Lock "6358e825-5705-45d6-86b6-3aacfa5a9bbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:34:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d36381fb-dbae-4092-bf86-3c5239b63d8d req-6381518b-f221-4b33-aec9-c3e7f4df1242 service nova] Lock "6358e825-5705-45d6-86b6-3aacfa5a9bbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:34:04 user nova-compute[73391]: DEBUG nova.compute.manager [req-d36381fb-dbae-4092-bf86-3c5239b63d8d req-6381518b-f221-4b33-aec9-c3e7f4df1242 service nova] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] No waiting events found dispatching network-vif-plugged-3b77e3e1-84f9-470a-b684-e8bdc4996c68 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:34:04 user nova-compute[73391]: WARNING nova.compute.manager [req-d36381fb-dbae-4092-bf86-3c5239b63d8d req-6381518b-f221-4b33-aec9-c3e7f4df1242 service nova] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Received unexpected event network-vif-plugged-3b77e3e1-84f9-470a-b684-e8bdc4996c68 for instance with vm_state active and task_state rescuing.
Aug 15 05:34:04 user nova-compute[73391]: DEBUG nova.compute.manager [None req-11658fed-c436-4752-9faa-12c306d99c4c tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:34:04 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Removed pending event for 6358e825-5705-45d6-86b6-3aacfa5a9bbb due to event {{(pid=73391) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 05:34:04 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077644.36752, 6358e825-5705-45d6-86b6-3aacfa5a9bbb => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:34:04 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] VM Resumed (Lifecycle Event)
Aug 15 05:34:04 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:34:04 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:34:04 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 15 05:34:04 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077644.3678071, 6358e825-5705-45d6-86b6-3aacfa5a9bbb => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:34:04 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] VM Started (Lifecycle Event)
Aug 15 05:34:04 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:34:04 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:34:06 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:08 user nova-compute[73391]: INFO nova.compute.manager [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] [instance: 96c5782e-9d00-4bb8-8e1d-99416bc7d556] Took 15.37 seconds to detach 3 volumes for instance.
Aug 15 05:34:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:34:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:34:08 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:34:08 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:34:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.500s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:34:08 user nova-compute[73391]: INFO nova.scheduler.client.report [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Deleted allocations for instance 96c5782e-9d00-4bb8-8e1d-99416bc7d556
Aug 15 05:34:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:09 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-1a4a4cce-57cd-40af-8417-6db1d4eff88f tempest-TaggedBootDevicesTest_v242-133221342 tempest-TaggedBootDevicesTest_v242-133221342-project-member] Lock "96c5782e-9d00-4bb8-8e1d-99416bc7d556" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 23.340s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:34:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:09 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:34:10 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:34:10 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:34:10 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:11 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:11 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:34:11 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:34:11 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:34:11 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:34:11 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Auditing locally available compute resources for user (node: user) {{(pid=73391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 05:34:11 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f88cd17-c89f-41f3-b630-8eb2c6698155/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:34:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f88cd17-c89f-41f3-b630-8eb2c6698155/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:34:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f88cd17-c89f-41f3-b630-8eb2c6698155/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:34:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f88cd17-c89f-41f3-b630-8eb2c6698155/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:34:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:34:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:34:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:34:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:34:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:34:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:34:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:34:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:34:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88847b7f-228c-4347-9091-334da8330201/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:34:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88847b7f-228c-4347-9091-334da8330201/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:34:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88847b7f-228c-4347-9091-334da8330201/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:34:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88847b7f-228c-4347-9091-334da8330201/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:34:13 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:34:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6358e825-5705-45d6-86b6-3aacfa5a9bbb/disk.rescue --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:34:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6358e825-5705-45d6-86b6-3aacfa5a9bbb/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:34:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6358e825-5705-45d6-86b6-3aacfa5a9bbb/disk.rescue --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:34:13 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6358e825-5705-45d6-86b6-3aacfa5a9bbb/disk.rescue --force-share --output=json" returned: 0 in 0.224s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:34:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b9f5970-65c5-4eff-a4bf-d18a9c916c90/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:34:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b9f5970-65c5-4eff-a4bf-d18a9c916c90/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:34:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b9f5970-65c5-4eff-a4bf-d18a9c916c90/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:34:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b9f5970-65c5-4eff-a4bf-d18a9c916c90/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:34:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:34:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad326342-29f1-4665-bc1b-7e8623751ddc/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:34:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad326342-29f1-4665-bc1b-7e8623751ddc/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:34:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad326342-29f1-4665-bc1b-7e8623751ddc/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:34:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ad326342-29f1-4665-bc1b-7e8623751ddc/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:34:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8186459b-5bcb-4b5a-b6d8-d424909614e5/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:34:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8186459b-5bcb-4b5a-b6d8-d424909614e5/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:34:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8186459b-5bcb-4b5a-b6d8-d424909614e5/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:34:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8186459b-5bcb-4b5a-b6d8-d424909614e5/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:34:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c8138a-4efc-403f-8b42-e5080c6a51d3/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:34:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c8138a-4efc-403f-8b42-e5080c6a51d3/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:34:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c8138a-4efc-403f-8b42-e5080c6a51d3/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:34:15 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c8138a-4efc-403f-8b42-e5080c6a51d3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:34:15 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:34:16 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:34:16 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:34:16 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Hypervisor/Node resource view: name=user free_ram=7094MB free_disk=25.39181900024414GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 05:34:16 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:34:16 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:34:16 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 8f08782b-f793-415e-b0d6-5caad1c3d426 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:34:16 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 6ac9d5dc-56be-402f-b9d4-3327bdfd9220 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:34:16 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 4b9f5970-65c5-4eff-a4bf-d18a9c916c90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:34:16 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 6358e825-5705-45d6-86b6-3aacfa5a9bbb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:34:16 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance ad326342-29f1-4665-bc1b-7e8623751ddc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:34:16 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance a397a3f0-9b98-4e2b-87a0-f5ff85247c11 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:34:16 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 3f88cd17-c89f-41f3-b630-8eb2c6698155 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:34:16 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 8186459b-5bcb-4b5a-b6d8-d424909614e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:34:16 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 18c8138a-4efc-403f-8b42-e5080c6a51d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:34:16 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 88847b7f-228c-4347-9091-334da8330201 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:34:16 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 05:34:16 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 05:34:16 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:34:16 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:34:16 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Compute_service record updated for user:user {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 05:34:16 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.508s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:34:17 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:17 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:17 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:34:17 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:34:17 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Starting heal instance info cache {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 05:34:17 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Didn't find any instances for network info cache update. {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 05:34:17 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:34:17 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:34:17 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:34:17 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 05:34:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:23 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Acquiring lock "131311f3-8467-461d-90eb-6a1b8a9d4f05" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:34:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Lock "131311f3-8467-461d-90eb-6a1b8a9d4f05" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:34:25 user nova-compute[73391]: DEBUG nova.compute.manager [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Starting instance... {{(pid=73391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 05:34:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:34:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:34:25 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 05:34:25 user nova-compute[73391]: INFO nova.compute.claims [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Claim successful on node user
Aug 15 05:34:26 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:34:26 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:34:26 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.404s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:34:26 user nova-compute[73391]: DEBUG nova.compute.manager [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Start building networks asynchronously for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 05:34:26 user nova-compute[73391]: DEBUG nova.compute.manager [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Allocating IP information in the background. {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 05:34:26 user nova-compute[73391]: DEBUG nova.network.neutron [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] allocate_for_instance() {{(pid=73391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 05:34:26 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Aug 15 05:34:26 user nova-compute[73391]: DEBUG nova.compute.manager [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Start building block device mappings for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 05:34:26 user nova-compute[73391]: DEBUG nova.compute.manager [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Start spawning the instance on the hypervisor. {{(pid=73391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 05:34:26 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Creating instance directory {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 05:34:26 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Creating image(s)
Aug 15 05:34:26 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Acquiring lock "/opt/stack/data/nova/instances/131311f3-8467-461d-90eb-6a1b8a9d4f05/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:34:26 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Lock "/opt/stack/data/nova/instances/131311f3-8467-461d-90eb-6a1b8a9d4f05/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:34:26 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Lock "/opt/stack/data/nova/instances/131311f3-8467-461d-90eb-6a1b8a9d4f05/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:34:26 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Acquiring lock "51a1041a69a8c2aa33dc989a0bfada8913b9657f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:34:26 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Lock "51a1041a69a8c2aa33dc989a0bfada8913b9657f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:34:27 user nova-compute[73391]: DEBUG nova.policy [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6423c74f0a6e4bb7a0e89905087c07d8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51e61f42ac594961a13ac27c982be62b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73391) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 05:34:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/51a1041a69a8c2aa33dc989a0bfada8913b9657f.part --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:34:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/51a1041a69a8c2aa33dc989a0bfada8913b9657f.part --force-share --output=json" returned: 0 in 0.461s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:34:27 user nova-compute[73391]: DEBUG nova.virt.images [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] 85823d51-6d2e-448c-86b7-79ddf588f6a3 was qcow2, converting to raw {{(pid=73391) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 05:34:27 user nova-compute[73391]: DEBUG nova.privsep.utils [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73391) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 05:34:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/51a1041a69a8c2aa33dc989a0bfada8913b9657f.part /opt/stack/data/nova/instances/_base/51a1041a69a8c2aa33dc989a0bfada8913b9657f.converted {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:34:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/51a1041a69a8c2aa33dc989a0bfada8913b9657f.part /opt/stack/data/nova/instances/_base/51a1041a69a8c2aa33dc989a0bfada8913b9657f.converted" returned: 0 in 0.347s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:34:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/51a1041a69a8c2aa33dc989a0bfada8913b9657f.converted --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:34:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/51a1041a69a8c2aa33dc989a0bfada8913b9657f.converted --force-share --output=json" returned: 0 in 0.188s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:34:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Lock "51a1041a69a8c2aa33dc989a0bfada8913b9657f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.941s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:34:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/51a1041a69a8c2aa33dc989a0bfada8913b9657f --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:34:28 user nova-compute[73391]: DEBUG nova.network.neutron [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Successfully created port: 89df1e31-ed6e-4e36-8c04-387309f0d237 {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 05:34:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/51a1041a69a8c2aa33dc989a0bfada8913b9657f --force-share --output=json" returned: 0 in 0.214s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:34:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Acquiring lock "51a1041a69a8c2aa33dc989a0bfada8913b9657f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:34:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Lock "51a1041a69a8c2aa33dc989a0bfada8913b9657f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:34:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/51a1041a69a8c2aa33dc989a0bfada8913b9657f --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:34:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/51a1041a69a8c2aa33dc989a0bfada8913b9657f --force-share --output=json" returned: 0 in 0.202s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:34:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/51a1041a69a8c2aa33dc989a0bfada8913b9657f,backing_fmt=raw /opt/stack/data/nova/instances/131311f3-8467-461d-90eb-6a1b8a9d4f05/disk 1073741824 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:34:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/51a1041a69a8c2aa33dc989a0bfada8913b9657f,backing_fmt=raw /opt/stack/data/nova/instances/131311f3-8467-461d-90eb-6a1b8a9d4f05/disk 1073741824" returned: 0 in 0.052s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:34:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Lock "51a1041a69a8c2aa33dc989a0bfada8913b9657f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:34:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/51a1041a69a8c2aa33dc989a0bfada8913b9657f --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:34:29 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:29 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/51a1041a69a8c2aa33dc989a0bfada8913b9657f --force-share --output=json" returned: 0 in 0.226s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:34:29 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Checking if we can resize image /opt/stack/data/nova/instances/131311f3-8467-461d-90eb-6a1b8a9d4f05/disk. size=1073741824 {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 05:34:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131311f3-8467-461d-90eb-6a1b8a9d4f05/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:34:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131311f3-8467-461d-90eb-6a1b8a9d4f05/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:34:29 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Cannot resize image /opt/stack/data/nova/instances/131311f3-8467-461d-90eb-6a1b8a9d4f05/disk to a smaller size. {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 05:34:29 user nova-compute[73391]: DEBUG nova.objects.instance [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Lazy-loading 'migration_context' on Instance uuid 131311f3-8467-461d-90eb-6a1b8a9d4f05 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:34:29 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Created local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 05:34:29 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Ensure instance console log exists: /opt/stack/data/nova/instances/131311f3-8467-461d-90eb-6a1b8a9d4f05/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 05:34:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:34:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:34:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:34:29 user nova-compute[73391]: DEBUG nova.network.neutron [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Successfully updated port: 89df1e31-ed6e-4e36-8c04-387309f0d237 {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:34:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Acquiring lock "refresh_cache-131311f3-8467-461d-90eb-6a1b8a9d4f05" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:34:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Acquired lock "refresh_cache-131311f3-8467-461d-90eb-6a1b8a9d4f05" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:34:29 user nova-compute[73391]: DEBUG nova.network.neutron [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:34:29 user nova-compute[73391]: DEBUG nova.network.neutron [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:34:29 user nova-compute[73391]: DEBUG nova.compute.manager [req-5a7d8589-2563-461e-ab28-6e158ca65578 req-fdcf3122-36b7-42de-901a-2f6e434f7fbd service nova] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Received event network-changed-89df1e31-ed6e-4e36-8c04-387309f0d237 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:34:29 user nova-compute[73391]: DEBUG nova.compute.manager [req-5a7d8589-2563-461e-ab28-6e158ca65578 req-fdcf3122-36b7-42de-901a-2f6e434f7fbd service nova] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Refreshing instance network info cache due to event network-changed-89df1e31-ed6e-4e36-8c04-387309f0d237. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:34:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-5a7d8589-2563-461e-ab28-6e158ca65578 req-fdcf3122-36b7-42de-901a-2f6e434f7fbd service nova] Acquiring lock "refresh_cache-131311f3-8467-461d-90eb-6a1b8a9d4f05" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:34:29 user nova-compute[73391]: DEBUG nova.network.neutron [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Updating instance_info_cache with network_info: [{"id": "89df1e31-ed6e-4e36-8c04-387309f0d237", "address": "fa:16:3e:69:fc:9e", "network": {"id": "a5904008-88c2-4e54-85d8-5d684bc08bde", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-808047519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e61f42ac594961a13ac27c982be62b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89df1e31-ed", "ovs_interfaceid": "89df1e31-ed6e-4e36-8c04-387309f0d237", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:34:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Releasing lock "refresh_cache-131311f3-8467-461d-90eb-6a1b8a9d4f05" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:34:30 user nova-compute[73391]: DEBUG nova.compute.manager [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Instance network_info: |[{"id": "89df1e31-ed6e-4e36-8c04-387309f0d237", "address": "fa:16:3e:69:fc:9e", "network": {"id": "a5904008-88c2-4e54-85d8-5d684bc08bde", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-808047519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e61f42ac594961a13ac27c982be62b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89df1e31-ed", "ovs_interfaceid": "89df1e31-ed6e-4e36-8c04-387309f0d237", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 05:34:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-5a7d8589-2563-461e-ab28-6e158ca65578 req-fdcf3122-36b7-42de-901a-2f6e434f7fbd service nova] Acquired lock "refresh_cache-131311f3-8467-461d-90eb-6a1b8a9d4f05" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:34:30 user nova-compute[73391]: DEBUG nova.network.neutron [req-5a7d8589-2563-461e-ab28-6e158ca65578 req-fdcf3122-36b7-42de-901a-2f6e434f7fbd service nova] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Refreshing network info cache for port 89df1e31-ed6e-4e36-8c04-387309f0d237 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:34:30 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Start _get_guest_xml network_info=[{"id": "89df1e31-ed6e-4e36-8c04-387309f0d237", "address": "fa:16:3e:69:fc:9e", "network": {"id": "a5904008-88c2-4e54-85d8-5d684bc08bde", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-808047519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e61f42ac594961a13ac27c982be62b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89df1e31-ed", "ovs_interfaceid": "89df1e31-ed6e-4e36-8c04-387309f0d237", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:34:21Z,direct_url=<?>,disk_format='qcow2',id=85823d51-6d2e-448c-86b7-79ddf588f6a3,min_disk=0,min_ram=0,name='',owner='a9978164ee5b4bad9f3dade5c841fdf5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:34:23Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'scsi', 'size': 0, 'device_name': '/dev/sda', 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '85823d51-6d2e-448c-86b7-79ddf588f6a3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:34:30 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:34:30 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:34:30 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:34:30 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:34:30 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:34:30 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:34:30 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:34:30 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:34:21Z,direct_url=<?>,disk_format='qcow2',id=85823d51-6d2e-448c-86b7-79ddf588f6a3,min_disk=0,min_ram=0,name='',owner='a9978164ee5b4bad9f3dade5c841fdf5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:34:23Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:34:30 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:34:30 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:34:30 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:34:30 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:34:30 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:34:30 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:34:30 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:34:30 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:34:30 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:34:30 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:34:30 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T05:34:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-344940402',display_name='tempest-AttachSCSIVolumeTestJSON-server-344940402',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-344940402',id=18,image_ref='85823d51-6d2e-448c-86b7-79ddf588f6a3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCLpYQGheUswP7FXQMzoT+9sDag+mjFS3x4LUpu1k/Qq5ve9YIlL4+PEnzTDBt9OBJmASAZSYcJaIPcV3lsCApilRyxTx87uh/GDBDDMRzDndnD0ZrImy3OT0tP1BB2bg==',key_name='tempest-keypair-1133140023',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51e61f42ac594961a13ac27c982be62b',ramdisk_id='',reservation_id='r-scx41xp9',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='85823d51-6d2e-448c-86b7-79ddf588f6a3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-228843077',owner_user_name='tempest-AttachSCSIVolumeTestJSON-228843077-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:34:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6423c74f0a6e4bb7a0e89905087c07d8',uuid=131311f3-8467-461d-90eb-6a1b8a9d4f05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89df1e31-ed6e-4e36-8c04-387309f0d237", "address": "fa:16:3e:69:fc:9e", "network": {"id": "a5904008-88c2-4e54-85d8-5d684bc08bde", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-808047519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e61f42ac594961a13ac27c982be62b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89df1e31-ed", "ovs_interfaceid": "89df1e31-ed6e-4e36-8c04-387309f0d237", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:34:30 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Converting VIF {"id": "89df1e31-ed6e-4e36-8c04-387309f0d237", "address": "fa:16:3e:69:fc:9e", "network": {"id": "a5904008-88c2-4e54-85d8-5d684bc08bde", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-808047519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e61f42ac594961a13ac27c982be62b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89df1e31-ed", "ovs_interfaceid": "89df1e31-ed6e-4e36-8c04-387309f0d237", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:34:30 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:fc:9e,bridge_name='br-int',has_traffic_filtering=True,id=89df1e31-ed6e-4e36-8c04-387309f0d237,network=Network(a5904008-88c2-4e54-85d8-5d684bc08bde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89df1e31-ed') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:34:30 user nova-compute[73391]: DEBUG nova.objects.instance [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Lazy-loading 'pci_devices' on Instance uuid 131311f3-8467-461d-90eb-6a1b8a9d4f05 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:34:30 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:34:30 user nova-compute[73391]:   <uuid>131311f3-8467-461d-90eb-6a1b8a9d4f05</uuid>
Aug 15 05:34:30 user nova-compute[73391]:   <name>instance-00000012</name>
Aug 15 05:34:30 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:34:30 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:34:30 user nova-compute[73391]:   <metadata>
Aug 15 05:34:30 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:34:30 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:34:30 user nova-compute[73391]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-344940402</nova:name>
Aug 15 05:34:30 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:34:30</nova:creationTime>
Aug 15 05:34:30 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:34:30 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:34:30 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:34:30 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:34:30 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:34:30 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:34:30 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:34:30 user nova-compute[73391]:       <nova:owner>
Aug 15 05:34:30 user nova-compute[73391]:         <nova:user uuid="6423c74f0a6e4bb7a0e89905087c07d8">tempest-AttachSCSIVolumeTestJSON-228843077-project-member</nova:user>
Aug 15 05:34:30 user nova-compute[73391]:         <nova:project uuid="51e61f42ac594961a13ac27c982be62b">tempest-AttachSCSIVolumeTestJSON-228843077</nova:project>
Aug 15 05:34:30 user nova-compute[73391]:       </nova:owner>
Aug 15 05:34:30 user nova-compute[73391]:       <nova:root type="image" uuid="85823d51-6d2e-448c-86b7-79ddf588f6a3"/>
Aug 15 05:34:30 user nova-compute[73391]:       <nova:ports>
Aug 15 05:34:30 user nova-compute[73391]:         <nova:port uuid="89df1e31-ed6e-4e36-8c04-387309f0d237">
Aug 15 05:34:30 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 15 05:34:30 user nova-compute[73391]:         </nova:port>
Aug 15 05:34:30 user nova-compute[73391]:       </nova:ports>
Aug 15 05:34:30 user nova-compute[73391]:     </nova:instance>
Aug 15 05:34:30 user nova-compute[73391]:   </metadata>
Aug 15 05:34:30 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:34:30 user nova-compute[73391]:     <system>
Aug 15 05:34:30 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:34:30 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:34:30 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:34:30 user nova-compute[73391]:       <entry name="serial">131311f3-8467-461d-90eb-6a1b8a9d4f05</entry>
Aug 15 05:34:30 user nova-compute[73391]:       <entry name="uuid">131311f3-8467-461d-90eb-6a1b8a9d4f05</entry>
Aug 15 05:34:30 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:34:30 user nova-compute[73391]:     </system>
Aug 15 05:34:30 user nova-compute[73391]:   </sysinfo>
Aug 15 05:34:30 user nova-compute[73391]:   <os>
Aug 15 05:34:30 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:34:30 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:34:30 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:34:30 user nova-compute[73391]:   </os>
Aug 15 05:34:30 user nova-compute[73391]:   <features>
Aug 15 05:34:30 user nova-compute[73391]:     <acpi/>
Aug 15 05:34:30 user nova-compute[73391]:     <apic/>
Aug 15 05:34:30 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:34:30 user nova-compute[73391]:   </features>
Aug 15 05:34:30 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:34:30 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:34:30 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:34:30 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:34:30 user nova-compute[73391]:   </clock>
Aug 15 05:34:30 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:34:30 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:34:30 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:34:30 user nova-compute[73391]:   </cpu>
Aug 15 05:34:30 user nova-compute[73391]:   <devices>
Aug 15 05:34:30 user nova-compute[73391]:     <disk type="file" device="disk">
Aug 15 05:34:30 user nova-compute[73391]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 05:34:30 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/131311f3-8467-461d-90eb-6a1b8a9d4f05/disk"/>
Aug 15 05:34:30 user nova-compute[73391]:       <target dev="sda" bus="scsi"/>
Aug 15 05:34:30 user nova-compute[73391]:       <address type="drive" controller="0" unit="0"/>
Aug 15 05:34:30 user nova-compute[73391]:     </disk>
Aug 15 05:34:30 user nova-compute[73391]:     <disk type="file" device="cdrom">
Aug 15 05:34:30 user nova-compute[73391]:       <driver name="qemu" type="raw" cache="none"/>
Aug 15 05:34:30 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/131311f3-8467-461d-90eb-6a1b8a9d4f05/disk.config"/>
Aug 15 05:34:30 user nova-compute[73391]:       <target dev="sdb" bus="scsi"/>
Aug 15 05:34:30 user nova-compute[73391]:       <address type="drive" controller="0" unit="1"/>
Aug 15 05:34:30 user nova-compute[73391]:     </disk>
Aug 15 05:34:30 user nova-compute[73391]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Aug 15 05:34:30 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:34:30 user nova-compute[73391]:       <mac address="fa:16:3e:69:fc:9e"/>
Aug 15 05:34:30 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:34:30 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:34:30 user nova-compute[73391]:       <target dev="tap89df1e31-ed"/>
Aug 15 05:34:30 user nova-compute[73391]:     </interface>
Aug 15 05:34:30 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:34:30 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/131311f3-8467-461d-90eb-6a1b8a9d4f05/console.log" append="off"/>
Aug 15 05:34:30 user nova-compute[73391]:     </serial>
Aug 15 05:34:30 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:34:30 user nova-compute[73391]:     <video>
Aug 15 05:34:30 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:34:30 user nova-compute[73391]:     </video>
Aug 15 05:34:30 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:34:30 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:34:30 user nova-compute[73391]:     </rng>
Aug 15 05:34:30 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:34:30 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:34:30 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:34:30 user nova-compute[73391]:     </memballoon>
Aug 15 05:34:30 user nova-compute[73391]:   </devices>
Aug 15 05:34:30 user nova-compute[73391]: </domain>
Aug 15 05:34:30 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:34:30 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T05:34:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-344940402',display_name='tempest-AttachSCSIVolumeTestJSON-server-344940402',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-344940402',id=18,image_ref='85823d51-6d2e-448c-86b7-79ddf588f6a3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCLpYQGheUswP7FXQMzoT+9sDag+mjFS3x4LUpu1k/Qq5ve9YIlL4+PEnzTDBt9OBJmASAZSYcJaIPcV3lsCApilRyxTx87uh/GDBDDMRzDndnD0ZrImy3OT0tP1BB2bg==',key_name='tempest-keypair-1133140023',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='51e61f42ac594961a13ac27c982be62b',ramdisk_id='',reservation_id='r-scx41xp9',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='85823d51-6d2e-448c-86b7-79ddf588f6a3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-228843077',owner_user_name='tempest-AttachSCSIVolumeTestJSON-228843077-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:34:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6423c74f0a6e4bb7a0e89905087c07d8',uuid=131311f3-8467-461d-90eb-6a1b8a9d4f05,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89df1e31-ed6e-4e36-8c04-387309f0d237", "address": "fa:16:3e:69:fc:9e", "network": {"id": "a5904008-88c2-4e54-85d8-5d684bc08bde", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-808047519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e61f42ac594961a13ac27c982be62b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89df1e31-ed", "ovs_interfaceid": "89df1e31-ed6e-4e36-8c04-387309f0d237", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:34:30 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Converting VIF {"id": "89df1e31-ed6e-4e36-8c04-387309f0d237", "address": "fa:16:3e:69:fc:9e", "network": {"id": "a5904008-88c2-4e54-85d8-5d684bc08bde", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-808047519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e61f42ac594961a13ac27c982be62b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89df1e31-ed", "ovs_interfaceid": "89df1e31-ed6e-4e36-8c04-387309f0d237", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:34:30 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:fc:9e,bridge_name='br-int',has_traffic_filtering=True,id=89df1e31-ed6e-4e36-8c04-387309f0d237,network=Network(a5904008-88c2-4e54-85d8-5d684bc08bde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89df1e31-ed') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:34:30 user nova-compute[73391]: DEBUG os_vif [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:fc:9e,bridge_name='br-int',has_traffic_filtering=True,id=89df1e31-ed6e-4e36-8c04-387309f0d237,network=Network(a5904008-88c2-4e54-85d8-5d684bc08bde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89df1e31-ed') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:34:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:34:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:34:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap89df1e31-ed, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:34:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap89df1e31-ed, col_values=(('external_ids', {'iface-id': '89df1e31-ed6e-4e36-8c04-387309f0d237', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:fc:9e', 'vm-uuid': '131311f3-8467-461d-90eb-6a1b8a9d4f05'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:34:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:34:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:30 user nova-compute[73391]: INFO os_vif [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:fc:9e,bridge_name='br-int',has_traffic_filtering=True,id=89df1e31-ed6e-4e36-8c04-387309f0d237,network=Network(a5904008-88c2-4e54-85d8-5d684bc08bde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89df1e31-ed')
Aug 15 05:34:30 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] No BDM found with device name sda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:34:30 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:34:30 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] No VIF found with MAC fa:16:3e:69:fc:9e, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:34:30 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Using config drive
Aug 15 05:34:30 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Creating config drive at /opt/stack/data/nova/instances/131311f3-8467-461d-90eb-6a1b8a9d4f05/disk.config
Aug 15 05:34:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/131311f3-8467-461d-90eb-6a1b8a9d4f05/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpmrpn4z14 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:34:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/131311f3-8467-461d-90eb-6a1b8a9d4f05/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpmrpn4z14" returned: 0 in 0.107s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:34:30 user nova-compute[73391]: DEBUG nova.network.neutron [req-5a7d8589-2563-461e-ab28-6e158ca65578 req-fdcf3122-36b7-42de-901a-2f6e434f7fbd service nova] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Updated VIF entry in instance network info cache for port 89df1e31-ed6e-4e36-8c04-387309f0d237. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:34:30 user nova-compute[73391]: DEBUG nova.network.neutron [req-5a7d8589-2563-461e-ab28-6e158ca65578 req-fdcf3122-36b7-42de-901a-2f6e434f7fbd service nova] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Updating instance_info_cache with network_info: [{"id": "89df1e31-ed6e-4e36-8c04-387309f0d237", "address": "fa:16:3e:69:fc:9e", "network": {"id": "a5904008-88c2-4e54-85d8-5d684bc08bde", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-808047519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e61f42ac594961a13ac27c982be62b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89df1e31-ed", "ovs_interfaceid": "89df1e31-ed6e-4e36-8c04-387309f0d237", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:34:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-5a7d8589-2563-461e-ab28-6e158ca65578 req-fdcf3122-36b7-42de-901a-2f6e434f7fbd service nova] Releasing lock "refresh_cache-131311f3-8467-461d-90eb-6a1b8a9d4f05" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:34:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:32 user nova-compute[73391]: DEBUG nova.compute.manager [req-7b3d2e01-4b2d-4102-8c94-63cf9dc32a9e req-ed9d5271-3b59-49bd-a937-246d1168d598 service nova] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Received event network-vif-plugged-89df1e31-ed6e-4e36-8c04-387309f0d237 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:34:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-7b3d2e01-4b2d-4102-8c94-63cf9dc32a9e req-ed9d5271-3b59-49bd-a937-246d1168d598 service nova] Acquiring lock "131311f3-8467-461d-90eb-6a1b8a9d4f05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:34:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-7b3d2e01-4b2d-4102-8c94-63cf9dc32a9e req-ed9d5271-3b59-49bd-a937-246d1168d598 service nova] Lock "131311f3-8467-461d-90eb-6a1b8a9d4f05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:34:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-7b3d2e01-4b2d-4102-8c94-63cf9dc32a9e req-ed9d5271-3b59-49bd-a937-246d1168d598 service nova] Lock "131311f3-8467-461d-90eb-6a1b8a9d4f05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:34:32 user nova-compute[73391]: DEBUG nova.compute.manager [req-7b3d2e01-4b2d-4102-8c94-63cf9dc32a9e req-ed9d5271-3b59-49bd-a937-246d1168d598 service nova] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] No waiting events found dispatching network-vif-plugged-89df1e31-ed6e-4e36-8c04-387309f0d237 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:34:32 user nova-compute[73391]: WARNING nova.compute.manager [req-7b3d2e01-4b2d-4102-8c94-63cf9dc32a9e req-ed9d5271-3b59-49bd-a937-246d1168d598 service nova] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Received unexpected event network-vif-plugged-89df1e31-ed6e-4e36-8c04-387309f0d237 for instance with vm_state building and task_state spawning.
Aug 15 05:34:32 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:32 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:32 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:34 user nova-compute[73391]: DEBUG nova.compute.manager [req-84ec02d6-087b-4a89-a24b-f6fdd8d22998 req-513d8a37-8e33-4aa8-a3c2-689023af1b9a service nova] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Received event network-vif-plugged-89df1e31-ed6e-4e36-8c04-387309f0d237 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:34:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-84ec02d6-087b-4a89-a24b-f6fdd8d22998 req-513d8a37-8e33-4aa8-a3c2-689023af1b9a service nova] Acquiring lock "131311f3-8467-461d-90eb-6a1b8a9d4f05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:34:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-84ec02d6-087b-4a89-a24b-f6fdd8d22998 req-513d8a37-8e33-4aa8-a3c2-689023af1b9a service nova] Lock "131311f3-8467-461d-90eb-6a1b8a9d4f05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:34:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-84ec02d6-087b-4a89-a24b-f6fdd8d22998 req-513d8a37-8e33-4aa8-a3c2-689023af1b9a service nova] Lock "131311f3-8467-461d-90eb-6a1b8a9d4f05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:34:34 user nova-compute[73391]: DEBUG nova.compute.manager [req-84ec02d6-087b-4a89-a24b-f6fdd8d22998 req-513d8a37-8e33-4aa8-a3c2-689023af1b9a service nova] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] No waiting events found dispatching network-vif-plugged-89df1e31-ed6e-4e36-8c04-387309f0d237 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:34:34 user nova-compute[73391]: WARNING nova.compute.manager [req-84ec02d6-087b-4a89-a24b-f6fdd8d22998 req-513d8a37-8e33-4aa8-a3c2-689023af1b9a service nova] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Received unexpected event network-vif-plugged-89df1e31-ed6e-4e36-8c04-387309f0d237 for instance with vm_state building and task_state spawning.
Aug 15 05:34:34 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077674.281953, 131311f3-8467-461d-90eb-6a1b8a9d4f05 => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:34:34 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] VM Resumed (Lifecycle Event)
Aug 15 05:34:34 user nova-compute[73391]: DEBUG nova.compute.manager [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:34:34 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Guest created on hypervisor {{(pid=73391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 05:34:34 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Instance spawned successfully.
Aug 15 05:34:34 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 05:34:34 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Found default for hw_input_bus of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:34:34 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Found default for hw_pointer_model of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:34:34 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Found default for hw_video_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:34:34 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Found default for hw_vif_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:34:34 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:34:34 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:34:34 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:34:34 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077674.2834725, 131311f3-8467-461d-90eb-6a1b8a9d4f05 => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:34:34 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] VM Started (Lifecycle Event)
Aug 15 05:34:34 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:34:34 user nova-compute[73391]: INFO nova.compute.manager [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Took 7.99 seconds to spawn the instance on the hypervisor.
Aug 15 05:34:34 user nova-compute[73391]: DEBUG nova.compute.manager [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:34:34 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:34:34 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:34:34 user nova-compute[73391]: INFO nova.compute.manager [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Took 8.79 seconds to build instance.
Aug 15 05:34:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0dfa9ac9-7beb-4e1a-9470-7359b62516e0 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Lock "131311f3-8467-461d-90eb-6a1b8a9d4f05" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.891s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:34:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:36 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:42 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:44 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:48 user nova-compute[73391]: DEBUG nova.compute.manager [req-8460d096-05b8-48a6-9491-97fd45ba8f59 req-b2c55a77-a153-4423-9402-f692e4b9c439 service nova] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Received event network-changed-f757ece4-baa7-4593-8327-d5fee9aa2d1a {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:34:48 user nova-compute[73391]: DEBUG nova.compute.manager [req-8460d096-05b8-48a6-9491-97fd45ba8f59 req-b2c55a77-a153-4423-9402-f692e4b9c439 service nova] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Refreshing instance network info cache due to event network-changed-f757ece4-baa7-4593-8327-d5fee9aa2d1a. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:34:48 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-8460d096-05b8-48a6-9491-97fd45ba8f59 req-b2c55a77-a153-4423-9402-f692e4b9c439 service nova] Acquiring lock "refresh_cache-a397a3f0-9b98-4e2b-87a0-f5ff85247c11" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:34:48 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-8460d096-05b8-48a6-9491-97fd45ba8f59 req-b2c55a77-a153-4423-9402-f692e4b9c439 service nova] Acquired lock "refresh_cache-a397a3f0-9b98-4e2b-87a0-f5ff85247c11" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:34:48 user nova-compute[73391]: DEBUG nova.network.neutron [req-8460d096-05b8-48a6-9491-97fd45ba8f59 req-b2c55a77-a153-4423-9402-f692e4b9c439 service nova] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Refreshing network info cache for port f757ece4-baa7-4593-8327-d5fee9aa2d1a {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:34:49 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:49 user nova-compute[73391]: DEBUG nova.network.neutron [req-8460d096-05b8-48a6-9491-97fd45ba8f59 req-b2c55a77-a153-4423-9402-f692e4b9c439 service nova] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Updated VIF entry in instance network info cache for port f757ece4-baa7-4593-8327-d5fee9aa2d1a. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:34:49 user nova-compute[73391]: DEBUG nova.network.neutron [req-8460d096-05b8-48a6-9491-97fd45ba8f59 req-b2c55a77-a153-4423-9402-f692e4b9c439 service nova] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Updating instance_info_cache with network_info: [{"id": "f757ece4-baa7-4593-8327-d5fee9aa2d1a", "address": "fa:16:3e:3a:0d:16", "network": {"id": "843ec1f3-c64d-4564-a801-0bee7beb4d42", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1999293789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "becd05a5b0824a208cd692d8505ea05e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf757ece4-ba", "ovs_interfaceid": "f757ece4-baa7-4593-8327-d5fee9aa2d1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:34:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-8460d096-05b8-48a6-9491-97fd45ba8f59 req-b2c55a77-a153-4423-9402-f692e4b9c439 service nova] Releasing lock "refresh_cache-a397a3f0-9b98-4e2b-87a0-f5ff85247c11" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:34:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:50 user nova-compute[73391]: INFO nova.compute.manager [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Rebuilding instance
Aug 15 05:34:50 user nova-compute[73391]: DEBUG nova.objects.instance [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Lazy-loading 'trusted_certs' on Instance uuid a397a3f0-9b98-4e2b-87a0-f5ff85247c11 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:34:50 user nova-compute[73391]: DEBUG nova.compute.manager [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:34:50 user nova-compute[73391]: DEBUG nova.objects.instance [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Lazy-loading 'pci_requests' on Instance uuid a397a3f0-9b98-4e2b-87a0-f5ff85247c11 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:34:50 user nova-compute[73391]: DEBUG nova.objects.instance [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Lazy-loading 'pci_devices' on Instance uuid a397a3f0-9b98-4e2b-87a0-f5ff85247c11 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:34:50 user nova-compute[73391]: DEBUG nova.objects.instance [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Lazy-loading 'resources' on Instance uuid a397a3f0-9b98-4e2b-87a0-f5ff85247c11 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:34:50 user nova-compute[73391]: DEBUG nova.objects.instance [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Lazy-loading 'migration_context' on Instance uuid a397a3f0-9b98-4e2b-87a0-f5ff85247c11 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:34:50 user nova-compute[73391]: DEBUG nova.objects.instance [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73391) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 15 05:34:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:50 user nova-compute[73391]: DEBUG nova.compute.manager [req-b1c512a0-db5d-4462-9cd2-1eb61c77b2a3 req-ed83d586-9273-41f3-98a5-631d098a03e9 service nova] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Received event network-vif-unplugged-f757ece4-baa7-4593-8327-d5fee9aa2d1a {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:34:50 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-b1c512a0-db5d-4462-9cd2-1eb61c77b2a3 req-ed83d586-9273-41f3-98a5-631d098a03e9 service nova] Acquiring lock "a397a3f0-9b98-4e2b-87a0-f5ff85247c11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:34:50 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-b1c512a0-db5d-4462-9cd2-1eb61c77b2a3 req-ed83d586-9273-41f3-98a5-631d098a03e9 service nova] Lock "a397a3f0-9b98-4e2b-87a0-f5ff85247c11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:34:50 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-b1c512a0-db5d-4462-9cd2-1eb61c77b2a3 req-ed83d586-9273-41f3-98a5-631d098a03e9 service nova] Lock "a397a3f0-9b98-4e2b-87a0-f5ff85247c11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:34:50 user nova-compute[73391]: DEBUG nova.compute.manager [req-b1c512a0-db5d-4462-9cd2-1eb61c77b2a3 req-ed83d586-9273-41f3-98a5-631d098a03e9 service nova] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] No waiting events found dispatching network-vif-unplugged-f757ece4-baa7-4593-8327-d5fee9aa2d1a {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:34:50 user nova-compute[73391]: WARNING nova.compute.manager [req-b1c512a0-db5d-4462-9cd2-1eb61c77b2a3 req-ed83d586-9273-41f3-98a5-631d098a03e9 service nova] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Received unexpected event network-vif-unplugged-f757ece4-baa7-4593-8327-d5fee9aa2d1a for instance with vm_state active and task_state rebuilding.
Aug 15 05:34:51 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Instance destroyed successfully.
Aug 15 05:34:51 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Instance destroyed successfully.
Aug 15 05:34:51 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:32:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1829220431',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-841273858',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNMgzXt9NjJohzQsGOG93ZxUTCjCzFBUN3Hf/vy9X7YUPJocPJVAdKrq1py25dd1+bQ6l0tu0hELDJB6TYYQgn1ARXbmD5JV7v4zuJ4KXoVbpP6mpPq+PpiOI9xbMnkxzg==',key_name='tempest-keypair-283788561',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:33:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='becd05a5b0824a208cd692d8505ea05e',ramdisk_id='',reservation_id='r-qxjdyr3i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1258386635',owner_user_name='tempest-ServerActionsV293TestJSON-1258386635-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:34:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f78657dfe187469faa75e7210792871b',uuid=a397a3f0-9b98-4e2b-87a0-f5ff85247c11,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f757ece4-baa7-4593-8327-d5fee9aa2d1a", "address": "fa:16:3e:3a:0d:16", "network": {"id": "843ec1f3-c64d-4564-a801-0bee7beb4d42", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1999293789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "becd05a5b0824a208cd692d8505ea05e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf757ece4-ba", "ovs_interfaceid": "f757ece4-baa7-4593-8327-d5fee9aa2d1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Converting VIF {"id": "f757ece4-baa7-4593-8327-d5fee9aa2d1a", "address": "fa:16:3e:3a:0d:16", "network": {"id": "843ec1f3-c64d-4564-a801-0bee7beb4d42", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1999293789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "becd05a5b0824a208cd692d8505ea05e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf757ece4-ba", "ovs_interfaceid": "f757ece4-baa7-4593-8327-d5fee9aa2d1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:0d:16,bridge_name='br-int',has_traffic_filtering=True,id=f757ece4-baa7-4593-8327-d5fee9aa2d1a,network=Network(843ec1f3-c64d-4564-a801-0bee7beb4d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf757ece4-ba') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG os_vif [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:0d:16,bridge_name='br-int',has_traffic_filtering=True,id=f757ece4-baa7-4593-8327-d5fee9aa2d1a,network=Network(843ec1f3-c64d-4564-a801-0bee7beb4d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf757ece4-ba') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf757ece4-ba, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:51 user nova-compute[73391]: INFO os_vif [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:0d:16,bridge_name='br-int',has_traffic_filtering=True,id=f757ece4-baa7-4593-8327-d5fee9aa2d1a,network=Network(843ec1f3-c64d-4564-a801-0bee7beb4d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf757ece4-ba')
Aug 15 05:34:51 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NXzhsQRV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:34:51 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 05:34:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3aa851-c018-43e7-ad40-8053652d5f0c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf80510e-7cc8-474d-82b1-2ce0fd0f6668]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:34:51 user nova-compute[73391]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 (non-flash)
Aug 15 05:34:51 user nova-compute[73391]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e (non-flash)
Aug 15 05:34:51 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:34:51 user nova-compute[73391]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 (non-flash)
Aug 15 05:34:51 user nova-compute[73391]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e (non-flash)
Aug 15 05:34:51 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77482d9630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52'): ({'sdb'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Removing single pathed devices sdb {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d99ba41c-0e18-4725-9226-752cba5cd887]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c047ed-7406-4b01-b280-10ca22eb4cb0]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Flushing IO for device /dev/sdb {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa56f29-0e24-4697-98c2-6f8bf8dc7e1d]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1683526e-2eaf-46b2-96af-0b28ae62b0c5]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] SCSI volumes sdb have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO581e86e0-4de99fab18ec6507', '/dev/disk/by-id/scsi-23464653939666162', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_581e86e0') {{(pid=84527) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1673fb07-b2a5-42ec-9518-939ac2ff60af]: (4, None) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b72c0c-0f81-4147-97ba-7da504f1afad]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[28980c34-b7ee-4720-bd92-a59f4b096a77]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52, portal: 172.16.0.220,3260]
Aug 15 05:34:51 user nova-compute[73391]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52, portal: 172.16.0.220,3260] successful.
Aug 15 05:34:51 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[294fe186-6ce1-4684-a587-19accb0f0ed0]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] <== disconnect_volume: return (337ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 05:34:51 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Deleting instance files /opt/stack/data/nova/instances/a397a3f0-9b98-4e2b-87a0-f5ff85247c11_del
Aug 15 05:34:51 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Deletion of /opt/stack/data/nova/instances/a397a3f0-9b98-4e2b-87a0-f5ff85247c11_del complete
Aug 15 05:34:51 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance a397a3f0-9b98-4e2b-87a0-f5ff85247c11 could not be found.
Aug 15 05:34:51 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NXzhsQRV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:34:51 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 05:34:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[70910579-813c-4198-b1bc-41c836a7826f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[429e9922-95ed-4e1c-be95-2e016e9c4930]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:34:51 user nova-compute[73391]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e (non-flash)
Aug 15 05:34:51 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:34:51 user nova-compute[73391]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e (non-flash)
Aug 15 05:34:51 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77284b7370>, {}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Disconnecting from: [] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.061s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] <== disconnect_volume: return (63ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:34:51 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 05:34:52 user nova-compute[73391]: DEBUG nova.compute.manager [req-c8c5fb54-e42e-4280-a75c-f2d929b6b048 req-0c79af21-c0a4-4678-9aee-acb2a6179ce0 service nova] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Received event network-vif-plugged-f757ece4-baa7-4593-8327-d5fee9aa2d1a {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:34:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-c8c5fb54-e42e-4280-a75c-f2d929b6b048 req-0c79af21-c0a4-4678-9aee-acb2a6179ce0 service nova] Acquiring lock "a397a3f0-9b98-4e2b-87a0-f5ff85247c11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:34:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-c8c5fb54-e42e-4280-a75c-f2d929b6b048 req-0c79af21-c0a4-4678-9aee-acb2a6179ce0 service nova] Lock "a397a3f0-9b98-4e2b-87a0-f5ff85247c11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:34:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-c8c5fb54-e42e-4280-a75c-f2d929b6b048 req-0c79af21-c0a4-4678-9aee-acb2a6179ce0 service nova] Lock "a397a3f0-9b98-4e2b-87a0-f5ff85247c11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:34:52 user nova-compute[73391]: DEBUG nova.compute.manager [req-c8c5fb54-e42e-4280-a75c-f2d929b6b048 req-0c79af21-c0a4-4678-9aee-acb2a6179ce0 service nova] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] No waiting events found dispatching network-vif-plugged-f757ece4-baa7-4593-8327-d5fee9aa2d1a {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:34:52 user nova-compute[73391]: WARNING nova.compute.manager [req-c8c5fb54-e42e-4280-a75c-f2d929b6b048 req-0c79af21-c0a4-4678-9aee-acb2a6179ce0 service nova] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Received unexpected event network-vif-plugged-f757ece4-baa7-4593-8327-d5fee9aa2d1a for instance with vm_state active and task_state rebuilding.
Aug 15 05:34:52 user nova-compute[73391]: DEBUG nova.compute.manager [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Preparing to wait for external event volume-reimaged-c9c0ff64-aff4-4c9a-b939-400975c79c52 {{(pid=73391) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Aug 15 05:34:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Acquiring lock "a397a3f0-9b98-4e2b-87a0-f5ff85247c11-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:34:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Lock "a397a3f0-9b98-4e2b-87a0-f5ff85247c11-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:34:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Lock "a397a3f0-9b98-4e2b-87a0-f5ff85247c11-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:34:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8d8fc8f0-175e-4b82-ba72-ae07a59bb034 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Acquiring lock "ad326342-29f1-4665-bc1b-7e8623751ddc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:34:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8d8fc8f0-175e-4b82-ba72-ae07a59bb034 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Lock "ad326342-29f1-4665-bc1b-7e8623751ddc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:34:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8d8fc8f0-175e-4b82-ba72-ae07a59bb034 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Acquiring lock "ad326342-29f1-4665-bc1b-7e8623751ddc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:34:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8d8fc8f0-175e-4b82-ba72-ae07a59bb034 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Lock "ad326342-29f1-4665-bc1b-7e8623751ddc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:34:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8d8fc8f0-175e-4b82-ba72-ae07a59bb034 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Lock "ad326342-29f1-4665-bc1b-7e8623751ddc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:34:58 user nova-compute[73391]: INFO nova.compute.manager [None req-8d8fc8f0-175e-4b82-ba72-ae07a59bb034 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Terminating instance
Aug 15 05:34:58 user nova-compute[73391]: DEBUG nova.compute.manager [None req-8d8fc8f0-175e-4b82-ba72-ae07a59bb034 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Start destroying the instance on the hypervisor. {{(pid=73391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 05:34:58 user nova-compute[73391]: DEBUG nova.compute.manager [req-b31f043c-9377-47b2-bade-f1004ee5184d req-cccbf65f-3267-4e5a-b6f4-7efb0f601ee3 service nova] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Received event network-changed-b00ad802-7ef5-4555-9a1b-7083cdd1c288 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:34:58 user nova-compute[73391]: DEBUG nova.compute.manager [req-b31f043c-9377-47b2-bade-f1004ee5184d req-cccbf65f-3267-4e5a-b6f4-7efb0f601ee3 service nova] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Refreshing instance network info cache due to event network-changed-b00ad802-7ef5-4555-9a1b-7083cdd1c288. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:34:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-b31f043c-9377-47b2-bade-f1004ee5184d req-cccbf65f-3267-4e5a-b6f4-7efb0f601ee3 service nova] Acquiring lock "refresh_cache-3f88cd17-c89f-41f3-b630-8eb2c6698155" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:34:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-b31f043c-9377-47b2-bade-f1004ee5184d req-cccbf65f-3267-4e5a-b6f4-7efb0f601ee3 service nova] Acquired lock "refresh_cache-3f88cd17-c89f-41f3-b630-8eb2c6698155" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:34:58 user nova-compute[73391]: DEBUG nova.network.neutron [req-b31f043c-9377-47b2-bade-f1004ee5184d req-cccbf65f-3267-4e5a-b6f4-7efb0f601ee3 service nova] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Refreshing network info cache for port b00ad802-7ef5-4555-9a1b-7083cdd1c288 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:34:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:59 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Instance destroyed successfully.
Aug 15 05:34:59 user nova-compute[73391]: DEBUG nova.objects.instance [None req-8d8fc8f0-175e-4b82-ba72-ae07a59bb034 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Lazy-loading 'resources' on Instance uuid ad326342-29f1-4665-bc1b-7e8623751ddc {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:34:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-8d8fc8f0-175e-4b82-ba72-ae07a59bb034 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:32:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-506140877',display_name='tempest-VolumesAdminNegativeTest-server-506140877',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-506140877',id=13,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:32:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d2058584e624e869bf316e4cee4d669',ramdisk_id='',reservation_id='r-r68vp03g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1183783318',owner_user_name='tempest-VolumesAdminNegativeTest-1183783318-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:32:58Z,user_data=None,user_id='1ec3b8ac7ed748b49325a372f164f931',uuid=ad326342-29f1-4665-bc1b-7e8623751ddc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5385666-bfb5-4bc5-89eb-011bf055eefd", "address": "fa:16:3e:61:5c:ad", "network": {"id": "f69631d8-9da0-4c6d-8530-e8c455942703", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-108520740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d2058584e624e869bf316e4cee4d669", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5385666-bf", "ovs_interfaceid": "f5385666-bfb5-4bc5-89eb-011bf055eefd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:34:59 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-8d8fc8f0-175e-4b82-ba72-ae07a59bb034 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Converting VIF {"id": "f5385666-bfb5-4bc5-89eb-011bf055eefd", "address": "fa:16:3e:61:5c:ad", "network": {"id": "f69631d8-9da0-4c6d-8530-e8c455942703", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-108520740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d2058584e624e869bf316e4cee4d669", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5385666-bf", "ovs_interfaceid": "f5385666-bfb5-4bc5-89eb-011bf055eefd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:34:59 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-8d8fc8f0-175e-4b82-ba72-ae07a59bb034 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:61:5c:ad,bridge_name='br-int',has_traffic_filtering=True,id=f5385666-bfb5-4bc5-89eb-011bf055eefd,network=Network(f69631d8-9da0-4c6d-8530-e8c455942703),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5385666-bf') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:34:59 user nova-compute[73391]: DEBUG os_vif [None req-8d8fc8f0-175e-4b82-ba72-ae07a59bb034 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:5c:ad,bridge_name='br-int',has_traffic_filtering=True,id=f5385666-bfb5-4bc5-89eb-011bf055eefd,network=Network(f69631d8-9da0-4c6d-8530-e8c455942703),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5385666-bf') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:34:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5385666-bf, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:34:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:34:59 user nova-compute[73391]: INFO os_vif [None req-8d8fc8f0-175e-4b82-ba72-ae07a59bb034 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:61:5c:ad,bridge_name='br-int',has_traffic_filtering=True,id=f5385666-bfb5-4bc5-89eb-011bf055eefd,network=Network(f69631d8-9da0-4c6d-8530-e8c455942703),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5385666-bf')
Aug 15 05:34:59 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-8d8fc8f0-175e-4b82-ba72-ae07a59bb034 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Deleting instance files /opt/stack/data/nova/instances/ad326342-29f1-4665-bc1b-7e8623751ddc_del
Aug 15 05:34:59 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-8d8fc8f0-175e-4b82-ba72-ae07a59bb034 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Deletion of /opt/stack/data/nova/instances/ad326342-29f1-4665-bc1b-7e8623751ddc_del complete
Aug 15 05:34:59 user nova-compute[73391]: INFO nova.compute.manager [None req-8d8fc8f0-175e-4b82-ba72-ae07a59bb034 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 15 05:34:59 user nova-compute[73391]: DEBUG oslo.service.loopingcall [None req-8d8fc8f0-175e-4b82-ba72-ae07a59bb034 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 05:34:59 user nova-compute[73391]: DEBUG nova.compute.manager [-] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Deallocating network for instance {{(pid=73391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 05:34:59 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] deallocate_for_instance() {{(pid=73391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 05:34:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:34:59 user nova-compute[73391]: DEBUG nova.network.neutron [req-b31f043c-9377-47b2-bade-f1004ee5184d req-cccbf65f-3267-4e5a-b6f4-7efb0f601ee3 service nova] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Updated VIF entry in instance network info cache for port b00ad802-7ef5-4555-9a1b-7083cdd1c288. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:34:59 user nova-compute[73391]: DEBUG nova.network.neutron [req-b31f043c-9377-47b2-bade-f1004ee5184d req-cccbf65f-3267-4e5a-b6f4-7efb0f601ee3 service nova] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Updating instance_info_cache with network_info: [{"id": "b00ad802-7ef5-4555-9a1b-7083cdd1c288", "address": "fa:16:3e:62:a5:85", "network": {"id": "85e580e2-7f57-4ac1-87b1-9c805fdcb43f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-949359526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "136ca1d3267b476db6dde10db3f21e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00ad802-7e", "ovs_interfaceid": "b00ad802-7ef5-4555-9a1b-7083cdd1c288", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:34:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-b31f043c-9377-47b2-bade-f1004ee5184d req-cccbf65f-3267-4e5a-b6f4-7efb0f601ee3 service nova] Releasing lock "refresh_cache-3f88cd17-c89f-41f3-b630-8eb2c6698155" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:35:00 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:35:00 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Took 0.80 seconds to deallocate network for instance.
Aug 15 05:35:00 user nova-compute[73391]: DEBUG nova.compute.manager [req-41eb2f67-865e-4eb9-9041-ddade50c262e req-204f08ac-6c27-4708-83a1-843188bc2958 service nova] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Received event network-vif-deleted-f5385666-bfb5-4bc5-89eb-011bf055eefd {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:35:00 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8d8fc8f0-175e-4b82-ba72-ae07a59bb034 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:00 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8d8fc8f0-175e-4b82-ba72-ae07a59bb034 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:00 user nova-compute[73391]: DEBUG nova.compute.manager [req-862143ee-a2d9-442b-8ea6-12c1cbef6883 req-c29877fd-f7b5-4017-b0f7-152523190bee service nova] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Received event network-vif-unplugged-f5385666-bfb5-4bc5-89eb-011bf055eefd {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:35:00 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-862143ee-a2d9-442b-8ea6-12c1cbef6883 req-c29877fd-f7b5-4017-b0f7-152523190bee service nova] Acquiring lock "ad326342-29f1-4665-bc1b-7e8623751ddc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:00 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-862143ee-a2d9-442b-8ea6-12c1cbef6883 req-c29877fd-f7b5-4017-b0f7-152523190bee service nova] Lock "ad326342-29f1-4665-bc1b-7e8623751ddc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:00 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-862143ee-a2d9-442b-8ea6-12c1cbef6883 req-c29877fd-f7b5-4017-b0f7-152523190bee service nova] Lock "ad326342-29f1-4665-bc1b-7e8623751ddc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:00 user nova-compute[73391]: DEBUG nova.compute.manager [req-862143ee-a2d9-442b-8ea6-12c1cbef6883 req-c29877fd-f7b5-4017-b0f7-152523190bee service nova] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] No waiting events found dispatching network-vif-unplugged-f5385666-bfb5-4bc5-89eb-011bf055eefd {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:35:00 user nova-compute[73391]: WARNING nova.compute.manager [req-862143ee-a2d9-442b-8ea6-12c1cbef6883 req-c29877fd-f7b5-4017-b0f7-152523190bee service nova] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Received unexpected event network-vif-unplugged-f5385666-bfb5-4bc5-89eb-011bf055eefd for instance with vm_state deleted and task_state None.
Aug 15 05:35:00 user nova-compute[73391]: DEBUG nova.compute.manager [req-862143ee-a2d9-442b-8ea6-12c1cbef6883 req-c29877fd-f7b5-4017-b0f7-152523190bee service nova] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Received event network-vif-plugged-f5385666-bfb5-4bc5-89eb-011bf055eefd {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:35:00 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-862143ee-a2d9-442b-8ea6-12c1cbef6883 req-c29877fd-f7b5-4017-b0f7-152523190bee service nova] Acquiring lock "ad326342-29f1-4665-bc1b-7e8623751ddc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:00 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-862143ee-a2d9-442b-8ea6-12c1cbef6883 req-c29877fd-f7b5-4017-b0f7-152523190bee service nova] Lock "ad326342-29f1-4665-bc1b-7e8623751ddc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:00 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-862143ee-a2d9-442b-8ea6-12c1cbef6883 req-c29877fd-f7b5-4017-b0f7-152523190bee service nova] Lock "ad326342-29f1-4665-bc1b-7e8623751ddc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:00 user nova-compute[73391]: DEBUG nova.compute.manager [req-862143ee-a2d9-442b-8ea6-12c1cbef6883 req-c29877fd-f7b5-4017-b0f7-152523190bee service nova] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] No waiting events found dispatching network-vif-plugged-f5385666-bfb5-4bc5-89eb-011bf055eefd {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:35:00 user nova-compute[73391]: WARNING nova.compute.manager [req-862143ee-a2d9-442b-8ea6-12c1cbef6883 req-c29877fd-f7b5-4017-b0f7-152523190bee service nova] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Received unexpected event network-vif-plugged-f5385666-bfb5-4bc5-89eb-011bf055eefd for instance with vm_state deleted and task_state None.
Aug 15 05:35:01 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-8d8fc8f0-175e-4b82-ba72-ae07a59bb034 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:35:01 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-8d8fc8f0-175e-4b82-ba72-ae07a59bb034 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:35:01 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8d8fc8f0-175e-4b82-ba72-ae07a59bb034 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.468s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:01 user nova-compute[73391]: INFO nova.scheduler.client.report [None req-8d8fc8f0-175e-4b82-ba72-ae07a59bb034 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Deleted allocations for instance ad326342-29f1-4665-bc1b-7e8623751ddc
Aug 15 05:35:01 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8d8fc8f0-175e-4b82-ba72-ae07a59bb034 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Lock "ad326342-29f1-4665-bc1b-7e8623751ddc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.441s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:03 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-63654e90-7d3b-4c54-8ae3-68f1f6c4d7d1 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Acquiring lock "3f88cd17-c89f-41f3-b630-8eb2c6698155" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-63654e90-7d3b-4c54-8ae3-68f1f6c4d7d1 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "3f88cd17-c89f-41f3-b630-8eb2c6698155" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:04 user nova-compute[73391]: DEBUG nova.objects.instance [None req-63654e90-7d3b-4c54-8ae3-68f1f6c4d7d1 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lazy-loading 'flavor' on Instance uuid 3f88cd17-c89f-41f3-b630-8eb2c6698155 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:35:04 user nova-compute[73391]: DEBUG nova.compute.manager [req-71b3a2b3-4be6-4f8b-8b8e-d7bbfa106d0a req-28149765-d1c8-4eee-822e-6abbe10d119a service nova] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Received event network-changed-de932b15-d8c8-4714-80c0-c9eedeb26588 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:35:04 user nova-compute[73391]: DEBUG nova.compute.manager [req-71b3a2b3-4be6-4f8b-8b8e-d7bbfa106d0a req-28149765-d1c8-4eee-822e-6abbe10d119a service nova] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Refreshing instance network info cache due to event network-changed-de932b15-d8c8-4714-80c0-c9eedeb26588. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:35:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-71b3a2b3-4be6-4f8b-8b8e-d7bbfa106d0a req-28149765-d1c8-4eee-822e-6abbe10d119a service nova] Acquiring lock "refresh_cache-8186459b-5bcb-4b5a-b6d8-d424909614e5" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:35:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-71b3a2b3-4be6-4f8b-8b8e-d7bbfa106d0a req-28149765-d1c8-4eee-822e-6abbe10d119a service nova] Acquired lock "refresh_cache-8186459b-5bcb-4b5a-b6d8-d424909614e5" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:35:04 user nova-compute[73391]: DEBUG nova.network.neutron [req-71b3a2b3-4be6-4f8b-8b8e-d7bbfa106d0a req-28149765-d1c8-4eee-822e-6abbe10d119a service nova] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Refreshing network info cache for port de932b15-d8c8-4714-80c0-c9eedeb26588 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:35:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-63654e90-7d3b-4c54-8ae3-68f1f6c4d7d1 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "3f88cd17-c89f-41f3-b630-8eb2c6698155" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.074s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-63654e90-7d3b-4c54-8ae3-68f1f6c4d7d1 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Acquiring lock "3f88cd17-c89f-41f3-b630-8eb2c6698155" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-63654e90-7d3b-4c54-8ae3-68f1f6c4d7d1 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "3f88cd17-c89f-41f3-b630-8eb2c6698155" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:04 user nova-compute[73391]: INFO nova.compute.manager [None req-63654e90-7d3b-4c54-8ae3-68f1f6c4d7d1 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Attaching volume de921de5-3166-4a82-9601-1a080b0e15d7 to /dev/vdb
Aug 15 05:35:04 user nova-compute[73391]: DEBUG os_brick.utils [None req-63654e90-7d3b-4c54-8ae3-68f1f6c4d7d1 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:35:04 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:04 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:04 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ed6240-ffb3-4c76-b751-e48b46556bfa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:04 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:04 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:04 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a7cc16-6833-4ff2-87ba-a9ff7e82ffe5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:04 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:04 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:04 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6e145f-a2b0-4260-a77b-5fedbcc33c3c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:04 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c68cc4-e334-4239-8a6a-01ff864fdb28]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:04 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-63654e90-7d3b-4c54-8ae3-68f1f6c4d7d1 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:04 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-63654e90-7d3b-4c54-8ae3-68f1f6c4d7d1 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:35:04 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-63654e90-7d3b-4c54-8ae3-68f1f6c4d7d1 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 05:35:04 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:04 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:35:04 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 05:35:04 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7aa755-353d-4352-8662-bccfb0d2a57c]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:04 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-63654e90-7d3b-4c54-8ae3-68f1f6c4d7d1 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 05:35:04 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-63654e90-7d3b-4c54-8ae3-68f1f6c4d7d1 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 05:35:04 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-63654e90-7d3b-4c54-8ae3-68f1f6c4d7d1 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 05:35:04 user nova-compute[73391]: DEBUG os_brick.utils [None req-63654e90-7d3b-4c54-8ae3-68f1f6c4d7d1 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:35:04 user nova-compute[73391]: DEBUG nova.virt.block_device [None req-63654e90-7d3b-4c54-8ae3-68f1f6c4d7d1 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Updating existing volume attachment record: fe4b5cdf-7043-4cd1-aeda-7ff089c40cd4 {{(pid=73391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 05:35:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-41293594-1e7d-4c4c-a301-4f3179166b22 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquiring lock "8186459b-5bcb-4b5a-b6d8-d424909614e5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-41293594-1e7d-4c4c-a301-4f3179166b22 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "8186459b-5bcb-4b5a-b6d8-d424909614e5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:04 user nova-compute[73391]: DEBUG nova.objects.instance [None req-41293594-1e7d-4c4c-a301-4f3179166b22 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lazy-loading 'flavor' on Instance uuid 8186459b-5bcb-4b5a-b6d8-d424909614e5 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:35:04 user nova-compute[73391]: DEBUG nova.network.neutron [req-71b3a2b3-4be6-4f8b-8b8e-d7bbfa106d0a req-28149765-d1c8-4eee-822e-6abbe10d119a service nova] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Updated VIF entry in instance network info cache for port de932b15-d8c8-4714-80c0-c9eedeb26588. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:35:04 user nova-compute[73391]: DEBUG nova.network.neutron [req-71b3a2b3-4be6-4f8b-8b8e-d7bbfa106d0a req-28149765-d1c8-4eee-822e-6abbe10d119a service nova] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Updating instance_info_cache with network_info: [{"id": "de932b15-d8c8-4714-80c0-c9eedeb26588", "address": "fa:16:3e:17:55:32", "network": {"id": "610f78de-5741-4743-815d-d12ba05f8000", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1518164868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b01853a82243369bd71dc0dbedb5d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde932b15-d8", "ovs_interfaceid": "de932b15-d8c8-4714-80c0-c9eedeb26588", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:35:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-71b3a2b3-4be6-4f8b-8b8e-d7bbfa106d0a req-28149765-d1c8-4eee-822e-6abbe10d119a service nova] Releasing lock "refresh_cache-8186459b-5bcb-4b5a-b6d8-d424909614e5" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:35:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-41293594-1e7d-4c4c-a301-4f3179166b22 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "8186459b-5bcb-4b5a-b6d8-d424909614e5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-41293594-1e7d-4c4c-a301-4f3179166b22 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquiring lock "8186459b-5bcb-4b5a-b6d8-d424909614e5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-41293594-1e7d-4c4c-a301-4f3179166b22 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "8186459b-5bcb-4b5a-b6d8-d424909614e5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:04 user nova-compute[73391]: INFO nova.compute.manager [None req-41293594-1e7d-4c4c-a301-4f3179166b22 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Attaching volume f933c0cc-dfab-44c4-b973-2f75a10fdaa5 to /dev/vdb
Aug 15 05:35:05 user nova-compute[73391]: DEBUG os_brick.utils [None req-41293594-1e7d-4c4c-a301-4f3179166b22 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:35:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:05 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4329039a-4301-4f62-a6a8-33ee80f47efa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:05 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1089df34-00df-4c94-ab23-953d9b44d981]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:05 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c97507-cca7-438d-9077-17ae3052d6b2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:05 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0a5c43-78af-45b6-ba40-57f43aba17ae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-41293594-1e7d-4c4c-a301-4f3179166b22 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-41293594-1e7d-4c4c-a301-4f3179166b22 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:35:05 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-41293594-1e7d-4c4c-a301-4f3179166b22 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 05:35:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:35:05 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 05:35:05 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bcc3d51-b9ce-4de4-8938-28aa0a169bfe]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:05 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-41293594-1e7d-4c4c-a301-4f3179166b22 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 05:35:05 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-41293594-1e7d-4c4c-a301-4f3179166b22 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 05:35:05 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-41293594-1e7d-4c4c-a301-4f3179166b22 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 05:35:05 user nova-compute[73391]: DEBUG os_brick.utils [None req-41293594-1e7d-4c4c-a301-4f3179166b22 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:35:05 user nova-compute[73391]: DEBUG nova.virt.block_device [None req-41293594-1e7d-4c4c-a301-4f3179166b22 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Updating existing volume attachment record: 40067133-aab7-4bc7-b316-99909affe540 {{(pid=73391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 05:35:06 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692077691.142889, a397a3f0-9b98-4e2b-87a0-f5ff85247c11 => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:35:06 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] VM Stopped (Lifecycle Event)
Aug 15 05:35:06 user nova-compute[73391]: DEBUG nova.compute.manager [None req-52f28216-1c9e-4aa1-bbdb-34aefd3064dc None None] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:35:06 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7cf8a021-2acc-419f-b2a3-9fa4af59b22a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Acquiring lock "18c8138a-4efc-403f-8b42-e5080c6a51d3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7cf8a021-2acc-419f-b2a3-9fa4af59b22a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "18c8138a-4efc-403f-8b42-e5080c6a51d3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:08 user nova-compute[73391]: INFO nova.compute.manager [None req-7cf8a021-2acc-419f-b2a3-9fa4af59b22a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Detaching volume b4522c9a-9c99-40b7-835b-5cd15575943e
Aug 15 05:35:08 user nova-compute[73391]: INFO nova.virt.block_device [None req-7cf8a021-2acc-419f-b2a3-9fa4af59b22a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Attempting to driver detach volume b4522c9a-9c99-40b7-835b-5cd15575943e from mountpoint /dev/vdc
Aug 15 05:35:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-7cf8a021-2acc-419f-b2a3-9fa4af59b22a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Attempting to detach device vdc from instance 18c8138a-4efc-403f-8b42-e5080c6a51d3 from the persistent domain config. {{(pid=73391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 05:35:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-7cf8a021-2acc-419f-b2a3-9fa4af59b22a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 05:35:08 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:35:08 user nova-compute[73391]:   <source dev="/dev/sdc"/>
Aug 15 05:35:08 user nova-compute[73391]:   <target dev="vdc" bus="virtio"/>
Aug 15 05:35:08 user nova-compute[73391]:   <serial>b4522c9a-9c99-40b7-835b-5cd15575943e</serial>
Aug 15 05:35:08 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 05:35:08 user nova-compute[73391]: </disk>
Aug 15 05:35:08 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 05:35:08 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-7cf8a021-2acc-419f-b2a3-9fa4af59b22a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Successfully detached device vdc from instance 18c8138a-4efc-403f-8b42-e5080c6a51d3 from the persistent domain config.
Aug 15 05:35:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-7cf8a021-2acc-419f-b2a3-9fa4af59b22a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 18c8138a-4efc-403f-8b42-e5080c6a51d3 from the live domain config. {{(pid=73391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 05:35:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-7cf8a021-2acc-419f-b2a3-9fa4af59b22a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 05:35:08 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:35:08 user nova-compute[73391]:   <source dev="/dev/sdc"/>
Aug 15 05:35:08 user nova-compute[73391]:   <target dev="vdc" bus="virtio"/>
Aug 15 05:35:08 user nova-compute[73391]:   <serial>b4522c9a-9c99-40b7-835b-5cd15575943e</serial>
Aug 15 05:35:08 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 05:35:08 user nova-compute[73391]: </disk>
Aug 15 05:35:08 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 05:35:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Received event <DeviceRemovedEvent: 1692077708.8949056, 18c8138a-4efc-403f-8b42-e5080c6a51d3 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73391) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 05:35:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-7cf8a021-2acc-419f-b2a3-9fa4af59b22a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 18c8138a-4efc-403f-8b42-e5080c6a51d3 {{(pid=73391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 05:35:08 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-7cf8a021-2acc-419f-b2a3-9fa4af59b22a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Successfully detached device vdc from instance 18c8138a-4efc-403f-8b42-e5080c6a51d3 from the live domain config.
Aug 15 05:35:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7cf8a021-2acc-419f-b2a3-9fa4af59b22a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 05:35:08 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cf8a021-2acc-419f-b2a3-9fa4af59b22a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LeKPNMuf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:35:08 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-7cf8a021-2acc-419f-b2a3-9fa4af59b22a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:35:08 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-7cf8a021-2acc-419f-b2a3-9fa4af59b22a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:35:08 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-7cf8a021-2acc-419f-b2a3-9fa4af59b22a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:35:08 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cf8a021-2acc-419f-b2a3-9fa4af59b22a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 05:35:08 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:08 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:08 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c2b4696-c21f-4478-b368-56eb6d511a34]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:08 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:08 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:08 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9917c1b6-7cfb-425a-ad63-ed5c99548165]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:08 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cf8a021-2acc-419f-b2a3-9fa4af59b22a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:35:08 user nova-compute[73391]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e (non-flash)
Aug 15 05:35:08 user nova-compute[73391]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 (non-flash)
Aug 15 05:35:08 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:35:08 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cf8a021-2acc-419f-b2a3-9fa4af59b22a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:35:08 user nova-compute[73391]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e (non-flash)
Aug 15 05:35:08 user nova-compute[73391]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 (non-flash)
Aug 15 05:35:08 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:35:08 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cf8a021-2acc-419f-b2a3-9fa4af59b22a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77284c7d90>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e'): ({'sdc'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 05:35:08 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-7cf8a021-2acc-419f-b2a3-9fa4af59b22a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Removing single pathed devices sdc {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 05:35:08 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:09 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c9488f-a985-4d1d-90c0-54d80f2b316c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:09 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c62227e-8a2d-4716-b2cc-2cadde34ce00]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:09 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-7cf8a021-2acc-419f-b2a3-9fa4af59b22a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Flushing IO for device /dev/sdc {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 05:35:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:09 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22cec11-3088-4ecc-aea5-c23dc0cfcd6c]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:09 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-7cf8a021-2acc-419f-b2a3-9fa4af59b22a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 05:35:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:09 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c02c9a9-5741-4554-82a5-6131796ec3d9]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:09 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-7cf8a021-2acc-419f-b2a3-9fa4af59b22a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 05:35:09 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-7cf8a021-2acc-419f-b2a3-9fa4af59b22a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] SCSI volumes sdc have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 05:35:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cf8a021-2acc-419f-b2a3-9fa4af59b22a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 05:35:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:09 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[022570e6-5b86-4bf3-8e43-e2c237a74a94]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cf8a021-2acc-419f-b2a3-9fa4af59b22a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:35:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:09 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2881f34f-c34e-4134-b536-b26ea0be1fe9]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cf8a021-2acc-419f-b2a3-9fa4af59b22a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e, portal: 172.16.0.220,3260]
Aug 15 05:35:09 user nova-compute[73391]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e, portal: 172.16.0.220,3260] successful.
Aug 15 05:35:09 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:35:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b4522c9a-9c99-40b7-835b-5cd15575943e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:09 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec51294c-38cf-46c2-8fdb-9234811f182a]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cf8a021-2acc-419f-b2a3-9fa4af59b22a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:35:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-7cf8a021-2acc-419f-b2a3-9fa4af59b22a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:35:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cf8a021-2acc-419f-b2a3-9fa4af59b22a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] <== disconnect_volume: return (357ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:35:09 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7cf8a021-2acc-419f-b2a3-9fa4af59b22a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 05:35:09 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:35:09 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Cleaning up deleted instances {{(pid=73391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 05:35:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:09 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] There are 0 instances to clean {{(pid=73391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 05:35:09 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:35:10 user nova-compute[73391]: DEBUG nova.objects.instance [None req-7cf8a021-2acc-419f-b2a3-9fa4af59b22a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lazy-loading 'flavor' on Instance uuid 18c8138a-4efc-403f-8b42-e5080c6a51d3 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:35:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7cf8a021-2acc-419f-b2a3-9fa4af59b22a tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "18c8138a-4efc-403f-8b42-e5080c6a51d3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.139s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:10 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:35:10 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:35:10 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:11 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:35:11 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:35:11 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:11 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:11 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:11 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Auditing locally available compute resources for user (node: user) {{(pid=73391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 05:35:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f88cd17-c89f-41f3-b630-8eb2c6698155/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f88cd17-c89f-41f3-b630-8eb2c6698155/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f88cd17-c89f-41f3-b630-8eb2c6698155/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:12 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f88cd17-c89f-41f3-b630-8eb2c6698155/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131311f3-8467-461d-90eb-6a1b8a9d4f05/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131311f3-8467-461d-90eb-6a1b8a9d4f05/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131311f3-8467-461d-90eb-6a1b8a9d4f05/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131311f3-8467-461d-90eb-6a1b8a9d4f05/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88847b7f-228c-4347-9091-334da8330201/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88847b7f-228c-4347-9091-334da8330201/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88847b7f-228c-4347-9091-334da8330201/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/88847b7f-228c-4347-9091-334da8330201/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:35:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6358e825-5705-45d6-86b6-3aacfa5a9bbb/disk.rescue --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:14 user nova-compute[73391]: DEBUG nova.compute.manager [req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 req-8e73025f-0f8c-4097-8d56-e3de56d67ebb service nova] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Received event volume-reimaged-c9c0ff64-aff4-4c9a-b939-400975c79c52 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:35:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 req-8e73025f-0f8c-4097-8d56-e3de56d67ebb service nova] Acquiring lock "a397a3f0-9b98-4e2b-87a0-f5ff85247c11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 req-8e73025f-0f8c-4097-8d56-e3de56d67ebb service nova] Lock "a397a3f0-9b98-4e2b-87a0-f5ff85247c11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 req-8e73025f-0f8c-4097-8d56-e3de56d67ebb service nova] Lock "a397a3f0-9b98-4e2b-87a0-f5ff85247c11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:14 user nova-compute[73391]: DEBUG nova.compute.manager [req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 req-8e73025f-0f8c-4097-8d56-e3de56d67ebb service nova] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Processing event volume-reimaged-c9c0ff64-aff4-4c9a-b939-400975c79c52 {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Aug 15 05:35:14 user nova-compute[73391]: DEBUG nova.compute.manager [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Instance event wait completed in 21 seconds for volume-reimaged {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:35:14 user nova-compute[73391]: INFO nova.virt.block_device [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Booting with volume c9c0ff64-aff4-4c9a-b939-400975c79c52 at /dev/vda
Aug 15 05:35:14 user nova-compute[73391]: DEBUG os_brick.utils [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:35:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6358e825-5705-45d6-86b6-3aacfa5a9bbb/disk.rescue --force-share --output=json" returned: 0 in 0.280s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6358e825-5705-45d6-86b6-3aacfa5a9bbb/disk.rescue --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:14 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be49d1a-dd6e-488d-ab00-32aaf016a123]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:14 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4f0342-aed5-4774-8e3b-0c3a18044153]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:14 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2ff09b-6169-4cd7-bd77-0348475c57fa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:14 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2376f8c4-b72c-4ef6-9833-4b9365365968]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:35:14 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692077699.654353, ad326342-29f1-4665-bc1b-7e8623751ddc => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:35:14 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] VM Stopped (Lifecycle Event)
Aug 15 05:35:14 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 05:35:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:35:14 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 05:35:14 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e20e201-4353-467b-9da3-dceca777e721]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:14 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 05:35:14 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 05:35:14 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 05:35:14 user nova-compute[73391]: DEBUG os_brick.utils [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] <== get_connector_properties: return (206ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:35:14 user nova-compute[73391]: DEBUG nova.virt.block_device [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Updating existing volume attachment record: 04dc7ce3-d7c7-41cc-97a7-beaa9c0103aa {{(pid=73391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 05:35:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:14 user nova-compute[73391]: DEBUG nova.compute.manager [None req-fe05c8e9-e166-438f-ab9e-3d442090f67f None None] [instance: ad326342-29f1-4665-bc1b-7e8623751ddc] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:35:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6358e825-5705-45d6-86b6-3aacfa5a9bbb/disk.rescue --force-share --output=json" returned: 0 in 0.239s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b9f5970-65c5-4eff-a4bf-d18a9c916c90/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b9f5970-65c5-4eff-a4bf-d18a9c916c90/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b9f5970-65c5-4eff-a4bf-d18a9c916c90/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b9f5970-65c5-4eff-a4bf-d18a9c916c90/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8186459b-5bcb-4b5a-b6d8-d424909614e5/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:15 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8186459b-5bcb-4b5a-b6d8-d424909614e5/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8186459b-5bcb-4b5a-b6d8-d424909614e5/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8186459b-5bcb-4b5a-b6d8-d424909614e5/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c8138a-4efc-403f-8b42-e5080c6a51d3/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c8138a-4efc-403f-8b42-e5080c6a51d3/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c8138a-4efc-403f-8b42-e5080c6a51d3/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/18c8138a-4efc-403f-8b42-e5080c6a51d3/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63654e90-7d3b-4c54-8ae3-68f1f6c4d7d1 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-63654e90-7d3b-4c54-8ae3-68f1f6c4d7d1 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cTFlYoKQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:35:16 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-63654e90-7d3b-4c54-8ae3-68f1f6c4d7d1 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:35:16 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-63654e90-7d3b-4c54-8ae3-68f1f6c4d7d1 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-63654e90-7d3b-4c54-8ae3-68f1f6c4d7d1 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:35:16 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-63654e90-7d3b-4c54-8ae3-68f1f6c4d7d1 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:35:16 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-63654e90-7d3b-4c54-8ae3-68f1f6c4d7d1 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-63654e90-7d3b-4c54-8ae3-68f1f6c4d7d1 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:35:16 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-63654e90-7d3b-4c54-8ae3-68f1f6c4d7d1 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 05:35:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7 -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc00f96-cfc9-4f49-8355-f03feede214a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-63654e90-7d3b-4c54-8ae3-68f1f6c4d7d1 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 05:35:16 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7 -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[472c549f-96ca-49d9-a222-962b2f7982d9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-63654e90-7d3b-4c54-8ae3-68f1f6c4d7d1 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7] added
Aug 15 05:35:16 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41293594-1e7d-4c4c-a301-4f3179166b22 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-41293594-1e7d-4c4c-a301-4f3179166b22 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WQdVNZAL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:35:16 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-41293594-1e7d-4c4c-a301-4f3179166b22 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:35:16 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-41293594-1e7d-4c4c-a301-4f3179166b22 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:35:16 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:35:16 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:35:16 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Hypervisor/Node resource view: name=user free_ram=7267MB free_disk=25.292556762695312GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1979c9f-e33a-4b48-bada-0a1b67d5b10a]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-63654e90-7d3b-4c54-8ae3-68f1f6c4d7d1 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[966221c0-9336-44bb-9587-db99ab2e3adf]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-63654e90-7d3b-4c54-8ae3-68f1f6c4d7d1 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cTFlYoKQ {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cTFlYoKQ" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0f5fa92-5445-4e18-a594-c6d0a86e21a0]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-63654e90-7d3b-4c54-8ae3-68f1f6c4d7d1 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cTFlYoKQ'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2486de5d-66c2-4371-912e-91ef56d05299]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-63654e90-7d3b-4c54-8ae3-68f1f6c4d7d1 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[09dee539-df1a-4e46-9932-3dde37fe103f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-63654e90-7d3b-4c54-8ae3-68f1f6c4d7d1 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:35:16 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-63654e90-7d3b-4c54-8ae3-68f1f6c4d7d1 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:35:16 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7 -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ca559e6-30f5-4a8f-935b-8dc317a8f1ce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-63654e90-7d3b-4c54-8ae3-68f1f6c4d7d1 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7, portal: 172.16.0.220,3260]
Aug 15 05:35:16 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7, portal: 172.16.0.220,3260] successful.
Aug 15 05:35:16 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[34938006-027d-4f5f-90e0-a75c78188a03]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-63654e90-7d3b-4c54-8ae3-68f1f6c4d7d1 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1051f8f-e32e-4be5-9aad-bc0136ed1dd9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-63654e90-7d3b-4c54-8ae3-68f1f6c4d7d1 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:35:16 user nova-compute[73391]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7 (non-flash)
Aug 15 05:35:16 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-63654e90-7d3b-4c54-8ae3-68f1f6c4d7d1 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:35:16 user nova-compute[73391]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7 (non-flash)
Aug 15 05:35:16 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-63654e90-7d3b-4c54-8ae3-68f1f6c4d7d1 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.827s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-63654e90-7d3b-4c54-8ae3-68f1f6c4d7d1 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-63654e90-7d3b-4c54-8ae3-68f1f6c4d7d1 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-63654e90-7d3b-4c54-8ae3-68f1f6c4d7d1 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5920ef-f8e5-41a7-bb23-9fddb76e56c9]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-63654e90-7d3b-4c54-8ae3-68f1f6c4d7d1 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-63654e90-7d3b-4c54-8ae3-68f1f6c4d7d1 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cTFlYoKQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 8f08782b-f793-415e-b0d6-5caad1c3d426 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 6ac9d5dc-56be-402f-b9d4-3327bdfd9220 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 4b9f5970-65c5-4eff-a4bf-d18a9c916c90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 6358e825-5705-45d6-86b6-3aacfa5a9bbb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance a397a3f0-9b98-4e2b-87a0-f5ff85247c11 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 3f88cd17-c89f-41f3-b630-8eb2c6698155 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 8186459b-5bcb-4b5a-b6d8-d424909614e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 18c8138a-4efc-403f-8b42-e5080c6a51d3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 88847b7f-228c-4347-9091-334da8330201 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 131311f3-8467-461d-90eb-6a1b8a9d4f05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 05:35:16 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 05:35:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f63728f2-3f3c-4ebc-b621-ee48626749f9 tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Acquiring lock "88847b7f-228c-4347-9091-334da8330201" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f63728f2-3f3c-4ebc-b621-ee48626749f9 tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Lock "88847b7f-228c-4347-9091-334da8330201" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f63728f2-3f3c-4ebc-b621-ee48626749f9 tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Acquiring lock "88847b7f-228c-4347-9091-334da8330201-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f63728f2-3f3c-4ebc-b621-ee48626749f9 tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Lock "88847b7f-228c-4347-9091-334da8330201-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f63728f2-3f3c-4ebc-b621-ee48626749f9 tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Lock "88847b7f-228c-4347-9091-334da8330201-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:17 user nova-compute[73391]: INFO nova.compute.manager [None req-f63728f2-3f3c-4ebc-b621-ee48626749f9 tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 88847b7f-228c-4347-9091-334da8330201] Terminating instance
Aug 15 05:35:17 user nova-compute[73391]: DEBUG nova.compute.manager [None req-f63728f2-3f3c-4ebc-b621-ee48626749f9 tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 88847b7f-228c-4347-9091-334da8330201] Start destroying the instance on the hypervisor. {{(pid=73391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 05:35:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Acquiring lock "64232f69-e64b-4d8d-a029-9d97679ff632" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Lock "64232f69-e64b-4d8d-a029-9d97679ff632" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:17 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:17 user nova-compute[73391]: DEBUG nova.compute.manager [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Starting instance... {{(pid=73391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 05:35:17 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:17 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:17 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:17 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:35:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:17 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:35:17 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Compute_service record updated for user:user {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 05:35:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.790s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.059s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:17 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 05:35:17 user nova-compute[73391]: INFO nova.compute.claims [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Claim successful on node user
Aug 15 05:35:17 user nova-compute[73391]: DEBUG nova.compute.manager [req-6b08c904-53d0-4d1b-a2a6-521fd09666e5 req-3ce2c4a6-a7d9-4692-abe2-ca7445185342 service nova] [instance: 88847b7f-228c-4347-9091-334da8330201] Received event network-vif-unplugged-8b6c87eb-382f-46f3-a3bd-c771022c8768 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:35:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-6b08c904-53d0-4d1b-a2a6-521fd09666e5 req-3ce2c4a6-a7d9-4692-abe2-ca7445185342 service nova] Acquiring lock "88847b7f-228c-4347-9091-334da8330201-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-6b08c904-53d0-4d1b-a2a6-521fd09666e5 req-3ce2c4a6-a7d9-4692-abe2-ca7445185342 service nova] Lock "88847b7f-228c-4347-9091-334da8330201-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-6b08c904-53d0-4d1b-a2a6-521fd09666e5 req-3ce2c4a6-a7d9-4692-abe2-ca7445185342 service nova] Lock "88847b7f-228c-4347-9091-334da8330201-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:17 user nova-compute[73391]: DEBUG nova.compute.manager [req-6b08c904-53d0-4d1b-a2a6-521fd09666e5 req-3ce2c4a6-a7d9-4692-abe2-ca7445185342 service nova] [instance: 88847b7f-228c-4347-9091-334da8330201] No waiting events found dispatching network-vif-unplugged-8b6c87eb-382f-46f3-a3bd-c771022c8768 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:35:17 user nova-compute[73391]: DEBUG nova.compute.manager [req-6b08c904-53d0-4d1b-a2a6-521fd09666e5 req-3ce2c4a6-a7d9-4692-abe2-ca7445185342 service nova] [instance: 88847b7f-228c-4347-9091-334da8330201] Received event network-vif-unplugged-8b6c87eb-382f-46f3-a3bd-c771022c8768 for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 05:35:17 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 88847b7f-228c-4347-9091-334da8330201] Instance destroyed successfully.
Aug 15 05:35:17 user nova-compute[73391]: DEBUG nova.objects.instance [None req-f63728f2-3f3c-4ebc-b621-ee48626749f9 tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Lazy-loading 'resources' on Instance uuid 88847b7f-228c-4347-9091-334da8330201 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:35:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-f63728f2-3f3c-4ebc-b621-ee48626749f9 tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:33:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1078306014',display_name='tempest-VolumesActionsTest-instance-1078306014',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1078306014',id=17,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:33:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='628ed773a4de409084f7b3930d8c4dce',ramdisk_id='',reservation_id='r-34h1y72q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-2132169708',owner_user_name='tempest-VolumesActionsTest-2132169708-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:33:33Z,user_data=None,user_id='1cf057edc97f43aa9281ecc44885adaa',uuid=88847b7f-228c-4347-9091-334da8330201,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b6c87eb-382f-46f3-a3bd-c771022c8768", "address": "fa:16:3e:f9:f8:57", "network": {"id": "2a2a0416-9965-47d3-976b-28e0e0b3340a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-179068040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628ed773a4de409084f7b3930d8c4dce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b6c87eb-38", "ovs_interfaceid": "8b6c87eb-382f-46f3-a3bd-c771022c8768", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:35:17 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-f63728f2-3f3c-4ebc-b621-ee48626749f9 tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Converting VIF {"id": "8b6c87eb-382f-46f3-a3bd-c771022c8768", "address": "fa:16:3e:f9:f8:57", "network": {"id": "2a2a0416-9965-47d3-976b-28e0e0b3340a", "bridge": "br-int", "label": "tempest-VolumesActionsTest-179068040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "628ed773a4de409084f7b3930d8c4dce", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b6c87eb-38", "ovs_interfaceid": "8b6c87eb-382f-46f3-a3bd-c771022c8768", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:35:17 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-f63728f2-3f3c-4ebc-b621-ee48626749f9 tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:f8:57,bridge_name='br-int',has_traffic_filtering=True,id=8b6c87eb-382f-46f3-a3bd-c771022c8768,network=Network(2a2a0416-9965-47d3-976b-28e0e0b3340a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b6c87eb-38') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:35:17 user nova-compute[73391]: DEBUG os_vif [None req-f63728f2-3f3c-4ebc-b621-ee48626749f9 tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:f8:57,bridge_name='br-int',has_traffic_filtering=True,id=8b6c87eb-382f-46f3-a3bd-c771022c8768,network=Network(2a2a0416-9965-47d3-976b-28e0e0b3340a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b6c87eb-38') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:35:17 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:17 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b6c87eb-38, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:35:17 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:17 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:17 user nova-compute[73391]: INFO os_vif [None req-f63728f2-3f3c-4ebc-b621-ee48626749f9 tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:f8:57,bridge_name='br-int',has_traffic_filtering=True,id=8b6c87eb-382f-46f3-a3bd-c771022c8768,network=Network(2a2a0416-9965-47d3-976b-28e0e0b3340a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b6c87eb-38')
Aug 15 05:35:17 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-f63728f2-3f3c-4ebc-b621-ee48626749f9 tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 88847b7f-228c-4347-9091-334da8330201] Deleting instance files /opt/stack/data/nova/instances/88847b7f-228c-4347-9091-334da8330201_del
Aug 15 05:35:17 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-f63728f2-3f3c-4ebc-b621-ee48626749f9 tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 88847b7f-228c-4347-9091-334da8330201] Deletion of /opt/stack/data/nova/instances/88847b7f-228c-4347-9091-334da8330201_del complete
Aug 15 05:35:17 user nova-compute[73391]: INFO nova.compute.manager [None req-f63728f2-3f3c-4ebc-b621-ee48626749f9 tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] [instance: 88847b7f-228c-4347-9091-334da8330201] Took 0.66 seconds to destroy the instance on the hypervisor.
Aug 15 05:35:17 user nova-compute[73391]: DEBUG oslo.service.loopingcall [None req-f63728f2-3f3c-4ebc-b621-ee48626749f9 tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 05:35:17 user nova-compute[73391]: DEBUG nova.compute.manager [-] [instance: 88847b7f-228c-4347-9091-334da8330201] Deallocating network for instance {{(pid=73391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 05:35:17 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: 88847b7f-228c-4347-9091-334da8330201] deallocate_for_instance() {{(pid=73391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 05:35:17 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:35:17 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:35:17 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-63654e90-7d3b-4c54-8ae3-68f1f6c4d7d1 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.870s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:35:17 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-63654e90-7d3b-4c54-8ae3-68f1f6c4d7d1 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] <== connect_volume: return (1873ms) {'type': 'block', 'scsi_wwn': '23538306666386636', 'path': '/dev/sdb'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:35:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-63654e90-7d3b-4c54-8ae3-68f1f6c4d7d1 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538306666386636', 'path': '/dev/sdb'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 05:35:17 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-41293594-1e7d-4c4c-a301-4f3179166b22 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.324s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:35:17 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-41293594-1e7d-4c4c-a301-4f3179166b22 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:35:17 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-41293594-1e7d-4c4c-a301-4f3179166b22 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:35:17 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-41293594-1e7d-4c4c-a301-4f3179166b22 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:35:17 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-41293594-1e7d-4c4c-a301-4f3179166b22 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 05:35:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:17 user nova-compute[73391]: DEBUG nova.objects.instance [None req-63654e90-7d3b-4c54-8ae3-68f1f6c4d7d1 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lazy-loading 'flavor' on Instance uuid 3f88cd17-c89f-41f3-b630-8eb2c6698155 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:35:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.555s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:17 user nova-compute[73391]: DEBUG nova.compute.manager [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Start building networks asynchronously for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 05:35:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:17 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b493231-456e-4ad2-b3b1-93994966fe6f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:17 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-41293594-1e7d-4c4c-a301-4f3179166b22 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 05:35:17 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:35:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-63654e90-7d3b-4c54-8ae3-68f1f6c4d7d1 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 05:35:17 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:35:17 user nova-compute[73391]:   <source dev="/dev/sdb"/>
Aug 15 05:35:17 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:35:17 user nova-compute[73391]:   <serial>de921de5-3166-4a82-9601-1a080b0e15d7</serial>
Aug 15 05:35:17 user nova-compute[73391]: </disk>
Aug 15 05:35:17 user nova-compute[73391]:  {{(pid=73391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 05:35:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:18 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1091d150-dac9-4dfa-9397-b3c94b854427]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:18 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-41293594-1e7d-4c4c-a301-4f3179166b22 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5] added
Aug 15 05:35:18 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:35:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:18 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e695714-8eb3-416d-95c3-2c67a7c24b6e]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:18 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-41293594-1e7d-4c4c-a301-4f3179166b22 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:35:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:18 user nova-compute[73391]: DEBUG nova.compute.manager [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Allocating IP information in the background. {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 05:35:18 user nova-compute[73391]: DEBUG nova.network.neutron [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] allocate_for_instance() {{(pid=73391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 05:35:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:18 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ba99c1-d127-4a1f-bdab-9585dcda239a]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:18 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-41293594-1e7d-4c4c-a301-4f3179166b22 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:35:18 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 05:35:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WQdVNZAL {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:18 user nova-compute[73391]: DEBUG nova.compute.manager [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Start building block device mappings for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 05:35:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WQdVNZAL" returned: 0 in 0.027s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:18 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1e34fc-5f6d-4b27-8c8d-63c7e0c890d1]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:18 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-41293594-1e7d-4c4c-a301-4f3179166b22 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WQdVNZAL'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:35:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:18 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae61d2a-2697-4b57-9b3f-1e269d5ae242]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:18 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-41293594-1e7d-4c4c-a301-4f3179166b22 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:35:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:18 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f678399-bf05-41cf-b42e-28ab99d5943e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:18 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-41293594-1e7d-4c4c-a301-4f3179166b22 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:35:18 user nova-compute[73391]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7 (non-flash)
Aug 15 05:35:18 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:35:18 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-41293594-1e7d-4c4c-a301-4f3179166b22 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:35:18 user nova-compute[73391]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7 (non-flash)
Aug 15 05:35:18 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:35:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:18 user nova-compute[73391]: DEBUG nova.compute.manager [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Start spawning the instance on the hypervisor. {{(pid=73391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 05:35:18 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Creating instance directory {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 05:35:18 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Creating image(s)
Aug 15 05:35:18 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Acquiring lock "/opt/stack/data/nova/instances/64232f69-e64b-4d8d-a029-9d97679ff632/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:18 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Lock "/opt/stack/data/nova/instances/64232f69-e64b-4d8d-a029-9d97679ff632/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:18 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Lock "/opt/stack/data/nova/instances/64232f69-e64b-4d8d-a029-9d97679ff632/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:18 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd8b03e-d1c8-4fff-a38a-78f8fa343811]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:18 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-41293594-1e7d-4c4c-a301-4f3179166b22 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5, portal: 172.16.0.220,3260]
Aug 15 05:35:18 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5, portal: 172.16.0.220,3260] successful.
Aug 15 05:35:18 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:35:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:18 user nova-compute[73391]: DEBUG nova.policy [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f10b83354cdc4f5bacfbba835f1b7688', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6621f507eee48adbf6c5f390add9ed8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73391) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 05:35:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:18 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3cb8110-7507-497b-9d66-744653ed0b32]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:18 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-41293594-1e7d-4c4c-a301-4f3179166b22 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:35:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:18 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e513ec2-30b5-4ce0-aacf-53683e6e865a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:18 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-41293594-1e7d-4c4c-a301-4f3179166b22 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:35:18 user nova-compute[73391]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7 (non-flash)
Aug 15 05:35:18 user nova-compute[73391]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)
Aug 15 05:35:18 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:35:18 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-41293594-1e7d-4c4c-a301-4f3179166b22 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:35:18 user nova-compute[73391]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7 (non-flash)
Aug 15 05:35:18 user nova-compute[73391]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)
Aug 15 05:35:18 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-41293594-1e7d-4c4c-a301-4f3179166b22 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.388s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-41293594-1e7d-4c4c-a301-4f3179166b22 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-41293594-1e7d-4c4c-a301-4f3179166b22 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] HCTL ('34', '-', '-', 0) found on session 20 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-41293594-1e7d-4c4c-a301-4f3179166b22 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ee9fa2-704a-4a1d-a527-32bc1942d145]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-41293594-1e7d-4c4c-a301-4f3179166b22 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: None {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.208s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Acquiring lock "999b315ba87151d8252d543312ae7790e7e1583b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-63654e90-7d3b-4c54-8ae3-68f1f6c4d7d1 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-63654e90-7d3b-4c54-8ae3-68f1f6c4d7d1 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-63654e90-7d3b-4c54-8ae3-68f1f6c4d7d1 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] No VIF found with MAC fa:16:3e:62:a5:85, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.193s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/64232f69-e64b-4d8d-a029-9d97679ff632/disk 1073741824 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/64232f69-e64b-4d8d-a029-9d97679ff632/disk 1073741824" returned: 0 in 0.488s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.684s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.178s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Checking if we can resize image /opt/stack/data/nova/instances/64232f69-e64b-4d8d-a029-9d97679ff632/disk. size=1073741824 {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64232f69-e64b-4d8d-a029-9d97679ff632/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-41293594-1e7d-4c4c-a301-4f3179166b22 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Searching for a device in session 20 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-41293594-1e7d-4c4c-a301-4f3179166b22 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WQdVNZAL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-41293594-1e7d-4c4c-a301-4f3179166b22 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.435s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-41293594-1e7d-4c4c-a301-4f3179166b22 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] <== connect_volume: return (2760ms) {'type': 'block', 'scsi_wwn': '23236336334656130', 'path': '/dev/sdc'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41293594-1e7d-4c4c-a301-4f3179166b22 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236336334656130', 'path': '/dev/sdc'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG nova.compute.manager [req-a88b07eb-1243-45b1-bd0c-910a05591dda req-f0ac31e2-6b28-459c-bbd0-9ff35053ea10 service nova] [instance: 88847b7f-228c-4347-9091-334da8330201] Received event network-vif-deleted-8b6c87eb-382f-46f3-a3bd-c771022c8768 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:35:19 user nova-compute[73391]: INFO nova.compute.manager [req-a88b07eb-1243-45b1-bd0c-910a05591dda req-f0ac31e2-6b28-459c-bbd0-9ff35053ea10 service nova] [instance: 88847b7f-228c-4347-9091-334da8330201] Neutron deleted interface 8b6c87eb-382f-46f3-a3bd-c771022c8768; detaching it from the instance and deleting it from the info cache
Aug 15 05:35:19 user nova-compute[73391]: DEBUG nova.network.neutron [req-a88b07eb-1243-45b1-bd0c-910a05591dda req-f0ac31e2-6b28-459c-bbd0-9ff35053ea10 service nova] [instance: 88847b7f-228c-4347-9091-334da8330201] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG nova.objects.instance [None req-41293594-1e7d-4c4c-a301-4f3179166b22 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lazy-loading 'flavor' on Instance uuid 8186459b-5bcb-4b5a-b6d8-d424909614e5 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Starting heal instance info cache {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Rebuilding the list of instances to heal {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: 88847b7f-228c-4347-9091-334da8330201] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 88847b7f-228c-4347-9091-334da8330201] Skipping network cache update for instance because it is being deleted. {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9859}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Skipping network cache update for instance because it is Building. {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 15 05:35:19 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 88847b7f-228c-4347-9091-334da8330201] Took 1.66 seconds to deallocate network for instance.
Aug 15 05:35:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64232f69-e64b-4d8d-a029-9d97679ff632/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Cannot resize image /opt/stack/data/nova/instances/64232f69-e64b-4d8d-a029-9d97679ff632/disk to a smaller size. {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG nova.objects.instance [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Lazy-loading 'migration_context' on Instance uuid 64232f69-e64b-4d8d-a029-9d97679ff632 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-41293594-1e7d-4c4c-a301-4f3179166b22 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 05:35:19 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:35:19 user nova-compute[73391]:   <source dev="/dev/sdc"/>
Aug 15 05:35:19 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:35:19 user nova-compute[73391]:   <serial>f933c0cc-dfab-44c4-b973-2f75a10fdaa5</serial>
Aug 15 05:35:19 user nova-compute[73391]: </disk>
Aug 15 05:35:19 user nova-compute[73391]:  {{(pid=73391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG nova.compute.manager [req-a88b07eb-1243-45b1-bd0c-910a05591dda req-f0ac31e2-6b28-459c-bbd0-9ff35053ea10 service nova] [instance: 88847b7f-228c-4347-9091-334da8330201] Detach interface failed, port_id=8b6c87eb-382f-46f3-a3bd-c771022c8768, reason: Instance 88847b7f-228c-4347-9091-334da8330201 could not be found. {{(pid=73391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Created local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Ensure instance console log exists: /opt/stack/data/nova/instances/64232f69-e64b-4d8d-a029-9d97679ff632/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-63654e90-7d3b-4c54-8ae3-68f1f6c4d7d1 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "3f88cd17-c89f-41f3-b630-8eb2c6698155" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.177s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "refresh_cache-8f08782b-f793-415e-b0d6-5caad1c3d426" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquired lock "refresh_cache-8f08782b-f793-415e-b0d6-5caad1c3d426" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Forcefully refreshing network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG nova.objects.instance [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lazy-loading 'info_cache' on Instance uuid 8f08782b-f793-415e-b0d6-5caad1c3d426 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f63728f2-3f3c-4ebc-b621-ee48626749f9 tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f63728f2-3f3c-4ebc-b621-ee48626749f9 tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG nova.compute.manager [req-9551a66e-a3d5-4444-b6f0-0f3269a07f96 req-ab89162c-d9d0-48d4-82b4-6246a1d10d4b service nova] [instance: 88847b7f-228c-4347-9091-334da8330201] Received event network-vif-plugged-8b6c87eb-382f-46f3-a3bd-c771022c8768 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-9551a66e-a3d5-4444-b6f0-0f3269a07f96 req-ab89162c-d9d0-48d4-82b4-6246a1d10d4b service nova] Acquiring lock "88847b7f-228c-4347-9091-334da8330201-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-9551a66e-a3d5-4444-b6f0-0f3269a07f96 req-ab89162c-d9d0-48d4-82b4-6246a1d10d4b service nova] Lock "88847b7f-228c-4347-9091-334da8330201-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-9551a66e-a3d5-4444-b6f0-0f3269a07f96 req-ab89162c-d9d0-48d4-82b4-6246a1d10d4b service nova] Lock "88847b7f-228c-4347-9091-334da8330201-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG nova.compute.manager [req-9551a66e-a3d5-4444-b6f0-0f3269a07f96 req-ab89162c-d9d0-48d4-82b4-6246a1d10d4b service nova] [instance: 88847b7f-228c-4347-9091-334da8330201] No waiting events found dispatching network-vif-plugged-8b6c87eb-382f-46f3-a3bd-c771022c8768 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:35:19 user nova-compute[73391]: WARNING nova.compute.manager [req-9551a66e-a3d5-4444-b6f0-0f3269a07f96 req-ab89162c-d9d0-48d4-82b4-6246a1d10d4b service nova] [instance: 88847b7f-228c-4347-9091-334da8330201] Received unexpected event network-vif-plugged-8b6c87eb-382f-46f3-a3bd-c771022c8768 for instance with vm_state active and task_state deleting.
Aug 15 05:35:19 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-41293594-1e7d-4c4c-a301-4f3179166b22 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-41293594-1e7d-4c4c-a301-4f3179166b22 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:35:19 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-41293594-1e7d-4c4c-a301-4f3179166b22 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] No VIF found with MAC fa:16:3e:17:55:32, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:35:20 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-f63728f2-3f3c-4ebc-b621-ee48626749f9 tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:35:20 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-f63728f2-3f3c-4ebc-b621-ee48626749f9 tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:35:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-41293594-1e7d-4c4c-a301-4f3179166b22 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "8186459b-5bcb-4b5a-b6d8-d424909614e5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.188s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f63728f2-3f3c-4ebc-b621-ee48626749f9 tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.546s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:20 user nova-compute[73391]: DEBUG nova.network.neutron [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Successfully created port: b15f644f-a86c-46f9-a3d2-eb71bf66ad74 {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 05:35:20 user nova-compute[73391]: INFO nova.scheduler.client.report [None req-f63728f2-3f3c-4ebc-b621-ee48626749f9 tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Deleted allocations for instance 88847b7f-228c-4347-9091-334da8330201
Aug 15 05:35:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f63728f2-3f3c-4ebc-b621-ee48626749f9 tempest-VolumesActionsTest-2132169708 tempest-VolumesActionsTest-2132169708-project-member] Lock "88847b7f-228c-4347-9091-334da8330201" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.161s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:20 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Updating instance_info_cache with network_info: [{"id": "13c5a27d-b6c3-424b-a876-068d047fad28", "address": "fa:16:3e:61:0b:53", "network": {"id": "70d88082-aea7-48bb-abb4-d77d264aaf01", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b9acbe11654053bb905e7c92558a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c5a27d-b6", "ovs_interfaceid": "13c5a27d-b6c3-424b-a876-068d047fad28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:35:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Releasing lock "refresh_cache-8f08782b-f793-415e-b0d6-5caad1c3d426" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:35:20 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Updated the network info_cache for instance {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 05:35:20 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:35:20 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:35:20 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:35:20 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 05:35:20 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:35:20 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73391) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 05:35:21 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:21 user nova-compute[73391]: DEBUG nova.network.neutron [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Successfully updated port: b15f644f-a86c-46f9-a3d2-eb71bf66ad74 {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:35:21 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Acquiring lock "refresh_cache-64232f69-e64b-4d8d-a029-9d97679ff632" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:35:21 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Acquired lock "refresh_cache-64232f69-e64b-4d8d-a029-9d97679ff632" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:35:21 user nova-compute[73391]: DEBUG nova.network.neutron [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:35:21 user nova-compute[73391]: DEBUG nova.network.neutron [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:35:21 user nova-compute[73391]: DEBUG nova.compute.manager [req-76965e8c-5705-4341-a997-8b67947d8f7a req-0f5eb131-f01d-476d-a6be-7d6aeb1a7cb0 service nova] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Received event network-changed-b15f644f-a86c-46f9-a3d2-eb71bf66ad74 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:35:21 user nova-compute[73391]: DEBUG nova.compute.manager [req-76965e8c-5705-4341-a997-8b67947d8f7a req-0f5eb131-f01d-476d-a6be-7d6aeb1a7cb0 service nova] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Refreshing instance network info cache due to event network-changed-b15f644f-a86c-46f9-a3d2-eb71bf66ad74. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:35:21 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-76965e8c-5705-4341-a997-8b67947d8f7a req-0f5eb131-f01d-476d-a6be-7d6aeb1a7cb0 service nova] Acquiring lock "refresh_cache-64232f69-e64b-4d8d-a029-9d97679ff632" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:35:22 user nova-compute[73391]: DEBUG nova.network.neutron [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Updating instance_info_cache with network_info: [{"id": "b15f644f-a86c-46f9-a3d2-eb71bf66ad74", "address": "fa:16:3e:ad:f2:4d", "network": {"id": "20a0f634-b48d-4605-b66d-93e8b42c7d2d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-937086989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6621f507eee48adbf6c5f390add9ed8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb15f644f-a8", "ovs_interfaceid": "b15f644f-a86c-46f9-a3d2-eb71bf66ad74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:35:22 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Releasing lock "refresh_cache-64232f69-e64b-4d8d-a029-9d97679ff632" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:35:22 user nova-compute[73391]: DEBUG nova.compute.manager [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Instance network_info: |[{"id": "b15f644f-a86c-46f9-a3d2-eb71bf66ad74", "address": "fa:16:3e:ad:f2:4d", "network": {"id": "20a0f634-b48d-4605-b66d-93e8b42c7d2d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-937086989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6621f507eee48adbf6c5f390add9ed8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb15f644f-a8", "ovs_interfaceid": "b15f644f-a86c-46f9-a3d2-eb71bf66ad74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 05:35:22 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-76965e8c-5705-4341-a997-8b67947d8f7a req-0f5eb131-f01d-476d-a6be-7d6aeb1a7cb0 service nova] Acquired lock "refresh_cache-64232f69-e64b-4d8d-a029-9d97679ff632" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:35:22 user nova-compute[73391]: DEBUG nova.network.neutron [req-76965e8c-5705-4341-a997-8b67947d8f7a req-0f5eb131-f01d-476d-a6be-7d6aeb1a7cb0 service nova] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Refreshing network info cache for port b15f644f-a86c-46f9-a3d2-eb71bf66ad74 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:35:22 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Start _get_guest_xml network_info=[{"id": "b15f644f-a86c-46f9-a3d2-eb71bf66ad74", "address": "fa:16:3e:ad:f2:4d", "network": {"id": "20a0f634-b48d-4605-b66d-93e8b42c7d2d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-937086989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6621f507eee48adbf6c5f390add9ed8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb15f644f-a8", "ovs_interfaceid": "b15f644f-a86c-46f9-a3d2-eb71bf66ad74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '191b1dad-305e-4d1c-9b15-515ec59a3278'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:35:22 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:35:22 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:35:22 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:35:22 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:35:22 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:35:22 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:35:22 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:35:22 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:35:22 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:35:22 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:35:22 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:35:22 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:35:22 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:35:22 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:35:22 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:35:22 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:35:22 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:35:22 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:35:22 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:35:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-870241489',display_name='tempest-VolumesActionsTest-instance-870241489',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-870241489',id=19,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6621f507eee48adbf6c5f390add9ed8',ramdisk_id='',reservation_id='r-nb6qk900',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-702121303',owner_user_name='tempest-VolumesActionsTest-702121303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:35:18Z,user_data=None,user_id='f10b83354cdc4f5bacfbba835f1b7688',uuid=64232f69-e64b-4d8d-a029-9d97679ff632,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b15f644f-a86c-46f9-a3d2-eb71bf66ad74", "address": "fa:16:3e:ad:f2:4d", "network": {"id": "20a0f634-b48d-4605-b66d-93e8b42c7d2d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-937086989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6621f507eee48adbf6c5f390add9ed8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb15f644f-a8", "ovs_interfaceid": "b15f644f-a86c-46f9-a3d2-eb71bf66ad74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:35:22 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Converting VIF {"id": "b15f644f-a86c-46f9-a3d2-eb71bf66ad74", "address": "fa:16:3e:ad:f2:4d", "network": {"id": "20a0f634-b48d-4605-b66d-93e8b42c7d2d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-937086989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6621f507eee48adbf6c5f390add9ed8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb15f644f-a8", "ovs_interfaceid": "b15f644f-a86c-46f9-a3d2-eb71bf66ad74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:35:22 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:f2:4d,bridge_name='br-int',has_traffic_filtering=True,id=b15f644f-a86c-46f9-a3d2-eb71bf66ad74,network=Network(20a0f634-b48d-4605-b66d-93e8b42c7d2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb15f644f-a8') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:35:22 user nova-compute[73391]: DEBUG nova.objects.instance [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Lazy-loading 'pci_devices' on Instance uuid 64232f69-e64b-4d8d-a029-9d97679ff632 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:35:22 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:35:22 user nova-compute[73391]:   <uuid>64232f69-e64b-4d8d-a029-9d97679ff632</uuid>
Aug 15 05:35:22 user nova-compute[73391]:   <name>instance-00000013</name>
Aug 15 05:35:22 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:35:22 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:35:22 user nova-compute[73391]:   <metadata>
Aug 15 05:35:22 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:35:22 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:35:22 user nova-compute[73391]:       <nova:name>tempest-VolumesActionsTest-instance-870241489</nova:name>
Aug 15 05:35:22 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:35:22</nova:creationTime>
Aug 15 05:35:22 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:35:22 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:35:22 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:35:22 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:35:22 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:35:22 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:35:22 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:35:22 user nova-compute[73391]:       <nova:owner>
Aug 15 05:35:22 user nova-compute[73391]:         <nova:user uuid="f10b83354cdc4f5bacfbba835f1b7688">tempest-VolumesActionsTest-702121303-project-member</nova:user>
Aug 15 05:35:22 user nova-compute[73391]:         <nova:project uuid="a6621f507eee48adbf6c5f390add9ed8">tempest-VolumesActionsTest-702121303</nova:project>
Aug 15 05:35:22 user nova-compute[73391]:       </nova:owner>
Aug 15 05:35:22 user nova-compute[73391]:       <nova:root type="image" uuid="191b1dad-305e-4d1c-9b15-515ec59a3278"/>
Aug 15 05:35:22 user nova-compute[73391]:       <nova:ports>
Aug 15 05:35:22 user nova-compute[73391]:         <nova:port uuid="b15f644f-a86c-46f9-a3d2-eb71bf66ad74">
Aug 15 05:35:22 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 05:35:22 user nova-compute[73391]:         </nova:port>
Aug 15 05:35:22 user nova-compute[73391]:       </nova:ports>
Aug 15 05:35:22 user nova-compute[73391]:     </nova:instance>
Aug 15 05:35:22 user nova-compute[73391]:   </metadata>
Aug 15 05:35:22 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:35:22 user nova-compute[73391]:     <system>
Aug 15 05:35:22 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:35:22 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:35:22 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:35:22 user nova-compute[73391]:       <entry name="serial">64232f69-e64b-4d8d-a029-9d97679ff632</entry>
Aug 15 05:35:22 user nova-compute[73391]:       <entry name="uuid">64232f69-e64b-4d8d-a029-9d97679ff632</entry>
Aug 15 05:35:22 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:35:22 user nova-compute[73391]:     </system>
Aug 15 05:35:22 user nova-compute[73391]:   </sysinfo>
Aug 15 05:35:22 user nova-compute[73391]:   <os>
Aug 15 05:35:22 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:35:22 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:35:22 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:35:22 user nova-compute[73391]:   </os>
Aug 15 05:35:22 user nova-compute[73391]:   <features>
Aug 15 05:35:22 user nova-compute[73391]:     <acpi/>
Aug 15 05:35:22 user nova-compute[73391]:     <apic/>
Aug 15 05:35:22 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:35:22 user nova-compute[73391]:   </features>
Aug 15 05:35:22 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:35:22 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:35:22 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:35:22 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:35:22 user nova-compute[73391]:   </clock>
Aug 15 05:35:22 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:35:22 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:35:22 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:35:22 user nova-compute[73391]:   </cpu>
Aug 15 05:35:22 user nova-compute[73391]:   <devices>
Aug 15 05:35:22 user nova-compute[73391]:     <disk type="file" device="disk">
Aug 15 05:35:22 user nova-compute[73391]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 05:35:22 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/64232f69-e64b-4d8d-a029-9d97679ff632/disk"/>
Aug 15 05:35:22 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:35:22 user nova-compute[73391]:     </disk>
Aug 15 05:35:22 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:35:22 user nova-compute[73391]:       <mac address="fa:16:3e:ad:f2:4d"/>
Aug 15 05:35:22 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:35:22 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:35:22 user nova-compute[73391]:       <target dev="tapb15f644f-a8"/>
Aug 15 05:35:22 user nova-compute[73391]:     </interface>
Aug 15 05:35:22 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:35:22 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/64232f69-e64b-4d8d-a029-9d97679ff632/console.log" append="off"/>
Aug 15 05:35:22 user nova-compute[73391]:     </serial>
Aug 15 05:35:22 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:35:22 user nova-compute[73391]:     <video>
Aug 15 05:35:22 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:35:22 user nova-compute[73391]:     </video>
Aug 15 05:35:22 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:35:22 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:35:22 user nova-compute[73391]:     </rng>
Aug 15 05:35:22 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:35:22 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:35:22 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:35:22 user nova-compute[73391]:     </memballoon>
Aug 15 05:35:22 user nova-compute[73391]:   </devices>
Aug 15 05:35:22 user nova-compute[73391]: </domain>
Aug 15 05:35:22 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:35:22 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:35:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-870241489',display_name='tempest-VolumesActionsTest-instance-870241489',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-870241489',id=19,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6621f507eee48adbf6c5f390add9ed8',ramdisk_id='',reservation_id='r-nb6qk900',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-702121303',owner_user_name='tempest-VolumesActionsTest-702121303-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:35:18Z,user_data=None,user_id='f10b83354cdc4f5bacfbba835f1b7688',uuid=64232f69-e64b-4d8d-a029-9d97679ff632,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b15f644f-a86c-46f9-a3d2-eb71bf66ad74", "address": "fa:16:3e:ad:f2:4d", "network": {"id": "20a0f634-b48d-4605-b66d-93e8b42c7d2d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-937086989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6621f507eee48adbf6c5f390add9ed8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb15f644f-a8", "ovs_interfaceid": "b15f644f-a86c-46f9-a3d2-eb71bf66ad74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:35:22 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Converting VIF {"id": "b15f644f-a86c-46f9-a3d2-eb71bf66ad74", "address": "fa:16:3e:ad:f2:4d", "network": {"id": "20a0f634-b48d-4605-b66d-93e8b42c7d2d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-937086989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6621f507eee48adbf6c5f390add9ed8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb15f644f-a8", "ovs_interfaceid": "b15f644f-a86c-46f9-a3d2-eb71bf66ad74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:35:22 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:f2:4d,bridge_name='br-int',has_traffic_filtering=True,id=b15f644f-a86c-46f9-a3d2-eb71bf66ad74,network=Network(20a0f634-b48d-4605-b66d-93e8b42c7d2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb15f644f-a8') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:35:22 user nova-compute[73391]: DEBUG os_vif [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:f2:4d,bridge_name='br-int',has_traffic_filtering=True,id=b15f644f-a86c-46f9-a3d2-eb71bf66ad74,network=Network(20a0f634-b48d-4605-b66d-93e8b42c7d2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb15f644f-a8') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:35:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:35:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:35:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb15f644f-a8, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:35:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb15f644f-a8, col_values=(('external_ids', {'iface-id': 'b15f644f-a86c-46f9-a3d2-eb71bf66ad74', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:f2:4d', 'vm-uuid': '64232f69-e64b-4d8d-a029-9d97679ff632'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:35:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:35:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:22 user nova-compute[73391]: INFO os_vif [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:f2:4d,bridge_name='br-int',has_traffic_filtering=True,id=b15f644f-a86c-46f9-a3d2-eb71bf66ad74,network=Network(20a0f634-b48d-4605-b66d-93e8b42c7d2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb15f644f-a8')
Aug 15 05:35:22 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:35:22 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] No VIF found with MAC fa:16:3e:ad:f2:4d, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:35:22 user nova-compute[73391]: INFO nova.compute.manager [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Rebuilding instance
Aug 15 05:35:22 user nova-compute[73391]: DEBUG nova.objects.instance [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8186459b-5bcb-4b5a-b6d8-d424909614e5 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:35:22 user nova-compute[73391]: DEBUG nova.compute.manager [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:35:22 user nova-compute[73391]: DEBUG nova.objects.instance [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lazy-loading 'pci_requests' on Instance uuid 8186459b-5bcb-4b5a-b6d8-d424909614e5 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:35:22 user nova-compute[73391]: DEBUG nova.objects.instance [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lazy-loading 'pci_devices' on Instance uuid 8186459b-5bcb-4b5a-b6d8-d424909614e5 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:35:22 user nova-compute[73391]: DEBUG nova.objects.instance [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lazy-loading 'resources' on Instance uuid 8186459b-5bcb-4b5a-b6d8-d424909614e5 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:35:22 user nova-compute[73391]: DEBUG nova.network.neutron [req-76965e8c-5705-4341-a997-8b67947d8f7a req-0f5eb131-f01d-476d-a6be-7d6aeb1a7cb0 service nova] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Updated VIF entry in instance network info cache for port b15f644f-a86c-46f9-a3d2-eb71bf66ad74. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:35:22 user nova-compute[73391]: DEBUG nova.network.neutron [req-76965e8c-5705-4341-a997-8b67947d8f7a req-0f5eb131-f01d-476d-a6be-7d6aeb1a7cb0 service nova] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Updating instance_info_cache with network_info: [{"id": "b15f644f-a86c-46f9-a3d2-eb71bf66ad74", "address": "fa:16:3e:ad:f2:4d", "network": {"id": "20a0f634-b48d-4605-b66d-93e8b42c7d2d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-937086989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6621f507eee48adbf6c5f390add9ed8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb15f644f-a8", "ovs_interfaceid": "b15f644f-a86c-46f9-a3d2-eb71bf66ad74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:35:22 user nova-compute[73391]: DEBUG nova.objects.instance [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lazy-loading 'migration_context' on Instance uuid 8186459b-5bcb-4b5a-b6d8-d424909614e5 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:35:22 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-76965e8c-5705-4341-a997-8b67947d8f7a req-0f5eb131-f01d-476d-a6be-7d6aeb1a7cb0 service nova] Releasing lock "refresh_cache-64232f69-e64b-4d8d-a029-9d97679ff632" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:35:22 user nova-compute[73391]: DEBUG nova.objects.instance [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73391) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 15 05:35:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:23 user nova-compute[73391]: DEBUG nova.compute.manager [req-1c031cef-4f56-4609-aa6c-6f780c605d96 req-e48800e1-2f39-4fca-9224-d2180fc38204 service nova] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Received event network-vif-unplugged-de932b15-d8c8-4714-80c0-c9eedeb26588 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:35:23 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-1c031cef-4f56-4609-aa6c-6f780c605d96 req-e48800e1-2f39-4fca-9224-d2180fc38204 service nova] Acquiring lock "8186459b-5bcb-4b5a-b6d8-d424909614e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:23 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-1c031cef-4f56-4609-aa6c-6f780c605d96 req-e48800e1-2f39-4fca-9224-d2180fc38204 service nova] Lock "8186459b-5bcb-4b5a-b6d8-d424909614e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:23 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-1c031cef-4f56-4609-aa6c-6f780c605d96 req-e48800e1-2f39-4fca-9224-d2180fc38204 service nova] Lock "8186459b-5bcb-4b5a-b6d8-d424909614e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:23 user nova-compute[73391]: DEBUG nova.compute.manager [req-1c031cef-4f56-4609-aa6c-6f780c605d96 req-e48800e1-2f39-4fca-9224-d2180fc38204 service nova] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] No waiting events found dispatching network-vif-unplugged-de932b15-d8c8-4714-80c0-c9eedeb26588 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:35:23 user nova-compute[73391]: WARNING nova.compute.manager [req-1c031cef-4f56-4609-aa6c-6f780c605d96 req-e48800e1-2f39-4fca-9224-d2180fc38204 service nova] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Received unexpected event network-vif-unplugged-de932b15-d8c8-4714-80c0-c9eedeb26588 for instance with vm_state active and task_state rebuilding.
Aug 15 05:35:23 user nova-compute[73391]: DEBUG nova.compute.manager [req-1c031cef-4f56-4609-aa6c-6f780c605d96 req-e48800e1-2f39-4fca-9224-d2180fc38204 service nova] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Received event network-vif-plugged-de932b15-d8c8-4714-80c0-c9eedeb26588 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:35:23 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-1c031cef-4f56-4609-aa6c-6f780c605d96 req-e48800e1-2f39-4fca-9224-d2180fc38204 service nova] Acquiring lock "8186459b-5bcb-4b5a-b6d8-d424909614e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:23 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-1c031cef-4f56-4609-aa6c-6f780c605d96 req-e48800e1-2f39-4fca-9224-d2180fc38204 service nova] Lock "8186459b-5bcb-4b5a-b6d8-d424909614e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:23 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-1c031cef-4f56-4609-aa6c-6f780c605d96 req-e48800e1-2f39-4fca-9224-d2180fc38204 service nova] Lock "8186459b-5bcb-4b5a-b6d8-d424909614e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:23 user nova-compute[73391]: DEBUG nova.compute.manager [req-1c031cef-4f56-4609-aa6c-6f780c605d96 req-e48800e1-2f39-4fca-9224-d2180fc38204 service nova] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] No waiting events found dispatching network-vif-plugged-de932b15-d8c8-4714-80c0-c9eedeb26588 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:35:23 user nova-compute[73391]: WARNING nova.compute.manager [req-1c031cef-4f56-4609-aa6c-6f780c605d96 req-e48800e1-2f39-4fca-9224-d2180fc38204 service nova] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Received unexpected event network-vif-plugged-de932b15-d8c8-4714-80c0-c9eedeb26588 for instance with vm_state active and task_state rebuilding.
Aug 15 05:35:23 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:23 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Instance destroyed successfully.
Aug 15 05:35:23 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:23 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:23 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:24 user nova-compute[73391]: INFO nova.compute.manager [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Detaching volume f933c0cc-dfab-44c4-b973-2f75a10fdaa5
Aug 15 05:35:24 user nova-compute[73391]: INFO nova.virt.block_device [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Attempting to driver detach volume f933c0cc-dfab-44c4-b973-2f75a10fdaa5 from mountpoint /dev/vdb
Aug 15 05:35:24 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Attempting to detach device vdb from instance 8186459b-5bcb-4b5a-b6d8-d424909614e5 from the persistent domain config. {{(pid=73391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 05:35:24 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 05:35:24 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:35:24 user nova-compute[73391]:   <source dev="/dev/sdc"/>
Aug 15 05:35:24 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:35:24 user nova-compute[73391]:   <serial>f933c0cc-dfab-44c4-b973-2f75a10fdaa5</serial>
Aug 15 05:35:24 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 05:35:24 user nova-compute[73391]: </disk>
Aug 15 05:35:24 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 05:35:24 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Successfully detached device vdb from instance 8186459b-5bcb-4b5a-b6d8-d424909614e5 from the persistent domain config.
Aug 15 05:35:24 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 05:35:24 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WQdVNZAL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:35:24 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 05:35:24 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:35:24 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:35:24 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 05:35:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:24 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[98351be0-2dba-40ed-9f2e-93a5fce06e6f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:24 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b68151b-9ad8-487f-9816-31f1b3ab9fd0]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:24 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:35:24 user nova-compute[73391]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7 (non-flash)
Aug 15 05:35:24 user nova-compute[73391]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)
Aug 15 05:35:24 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:35:24 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:35:24 user nova-compute[73391]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7 (non-flash)
Aug 15 05:35:24 user nova-compute[73391]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)
Aug 15 05:35:24 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:35:24 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77284c51b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5'): ({'sdc'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 05:35:24 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Removing single pathed devices sdc {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 05:35:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:24 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e7441f-1cb3-42d6-882e-1764acb4b4fa]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:24 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f8071b-e3ed-4e61-bfa9-87583318cda9]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:24 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Flushing IO for device /dev/sdc {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 05:35:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:24 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19cba39-60c8-45b4-924e-567bfb12fe7b]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:24 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 05:35:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:24 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7564eeb8-e84a-415d-93fe-0c2f7a5969d4]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:24 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 05:35:24 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] SCSI volumes sdc have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 05:35:24 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 05:35:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:24 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[02adb810-2e13-48fd-9272-efcac5d6f660]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:24 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:35:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.093s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:24 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a256b0-c1c8-4363-875f-708ba56bb8f9]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:24 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5, portal: 172.16.0.220,3260]
Aug 15 05:35:24 user nova-compute[73391]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5, portal: 172.16.0.220,3260] successful.
Aug 15 05:35:24 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:35:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:24 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9589b4e-4af1-4a49-94dc-ac5cedcadb4b]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:24 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:35:24 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:35:24 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] <== disconnect_volume: return (355ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:35:24 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 05:35:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:25 user nova-compute[73391]: DEBUG nova.compute.manager [req-30f69631-f768-40c0-8977-3c6ba35d4a7e req-718a0cfe-3499-4cf9-b179-b80e204ce2be service nova] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Received event network-vif-plugged-b15f644f-a86c-46f9-a3d2-eb71bf66ad74 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:35:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-30f69631-f768-40c0-8977-3c6ba35d4a7e req-718a0cfe-3499-4cf9-b179-b80e204ce2be service nova] Acquiring lock "64232f69-e64b-4d8d-a029-9d97679ff632-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-30f69631-f768-40c0-8977-3c6ba35d4a7e req-718a0cfe-3499-4cf9-b179-b80e204ce2be service nova] Lock "64232f69-e64b-4d8d-a029-9d97679ff632-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-30f69631-f768-40c0-8977-3c6ba35d4a7e req-718a0cfe-3499-4cf9-b179-b80e204ce2be service nova] Lock "64232f69-e64b-4d8d-a029-9d97679ff632-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:25 user nova-compute[73391]: DEBUG nova.compute.manager [req-30f69631-f768-40c0-8977-3c6ba35d4a7e req-718a0cfe-3499-4cf9-b179-b80e204ce2be service nova] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] No waiting events found dispatching network-vif-plugged-b15f644f-a86c-46f9-a3d2-eb71bf66ad74 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:35:25 user nova-compute[73391]: WARNING nova.compute.manager [req-30f69631-f768-40c0-8977-3c6ba35d4a7e req-718a0cfe-3499-4cf9-b179-b80e204ce2be service nova] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Received unexpected event network-vif-plugged-b15f644f-a86c-46f9-a3d2-eb71bf66ad74 for instance with vm_state building and task_state spawning.
Aug 15 05:35:25 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Instance destroyed successfully.
Aug 15 05:35:25 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:33:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-812806078',display_name='tempest-ServerActionsTestOtherA-server-1346081936',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-812806078',id=16,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKQF8c52xIn/tpah2OQeeTlaAc50/7SkZ/oBXCnKk+8uX+Qv1Jri1CC3w4ewMsF9mvYSfBkgG+AekpaXFdh8jEXOjDMtbaHzPVlN2+XlP9ua4WN7/3eKAFOiv304VYf4sQ==',key_name='tempest-keypair-393045208',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:33:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='60b01853a82243369bd71dc0dbedb5d6',ramdisk_id='',reservation_id='r-u8d1c087',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1927429987',owner_user_name='tempest-ServerActionsTestOtherA-1927429987-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:35:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='124dcfde552147e2978970386274c70a',uuid=8186459b-5bcb-4b5a-b6d8-d424909614e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de932b15-d8c8-4714-80c0-c9eedeb26588", "address": "fa:16:3e:17:55:32", "network": {"id": "610f78de-5741-4743-815d-d12ba05f8000", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1518164868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b01853a82243369bd71dc0dbedb5d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde932b15-d8", "ovs_interfaceid": "de932b15-d8c8-4714-80c0-c9eedeb26588", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:35:25 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Converting VIF {"id": "de932b15-d8c8-4714-80c0-c9eedeb26588", "address": "fa:16:3e:17:55:32", "network": {"id": "610f78de-5741-4743-815d-d12ba05f8000", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1518164868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b01853a82243369bd71dc0dbedb5d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde932b15-d8", "ovs_interfaceid": "de932b15-d8c8-4714-80c0-c9eedeb26588", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:35:25 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:55:32,bridge_name='br-int',has_traffic_filtering=True,id=de932b15-d8c8-4714-80c0-c9eedeb26588,network=Network(610f78de-5741-4743-815d-d12ba05f8000),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde932b15-d8') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:35:25 user nova-compute[73391]: DEBUG os_vif [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:55:32,bridge_name='br-int',has_traffic_filtering=True,id=de932b15-d8c8-4714-80c0-c9eedeb26588,network=Network(610f78de-5741-4743-815d-d12ba05f8000),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde932b15-d8') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:35:25 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:25 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapde932b15-d8, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:35:25 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:25 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:35:25 user nova-compute[73391]: INFO os_vif [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:55:32,bridge_name='br-int',has_traffic_filtering=True,id=de932b15-d8c8-4714-80c0-c9eedeb26588,network=Network(610f78de-5741-4743-815d-d12ba05f8000),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde932b15-d8')
Aug 15 05:35:25 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 05:35:25 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WQdVNZAL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:35:25 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 05:35:25 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:35:25 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:35:25 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 05:35:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:25 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9976c836-cdf6-477e-8d06-92eb9f9c9cd1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:25 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4645a2ef-5a11-4dc8-ad7f-b801aa17c9fc]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:25 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:35:25 user nova-compute[73391]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7 (non-flash)
Aug 15 05:35:25 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:35:25 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:35:25 user nova-compute[73391]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7 (non-flash)
Aug 15 05:35:25 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:35:25 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f772833f250>, {}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 05:35:25 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Disconnecting from: [] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 05:35:25 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.067s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:35:25 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] <== disconnect_volume: return (69ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:35:25 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 05:35:25 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Deleting instance files /opt/stack/data/nova/instances/8186459b-5bcb-4b5a-b6d8-d424909614e5_del
Aug 15 05:35:25 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Deletion of /opt/stack/data/nova/instances/8186459b-5bcb-4b5a-b6d8-d424909614e5_del complete
Aug 15 05:35:25 user nova-compute[73391]: INFO nova.virt.block_device [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Booting with volume f933c0cc-dfab-44c4-b973-2f75a10fdaa5 at /dev/vdb
Aug 15 05:35:26 user nova-compute[73391]: DEBUG os_brick.utils [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7063aa61-73bd-4f7d-92a9-b43104496259]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5ed312-4eb2-4b7a-af40-71931fc9b104]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[54364af8-e002-4792-bbe7-22def8fd2a5c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bedd2067-651a-45ed-a964-72064fead5be]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:35:26 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 05:35:26 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d993567-975f-4253-bb7d-65503b9d17bd]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG os_brick.utils [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG nova.virt.block_device [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Updating existing volume attachment record: c4dde1f5-806b-430a-b508-12013ec2c757 {{(pid=73391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Creating instance directory {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 05:35:26 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Creating image(s)
Aug 15 05:35:26 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Did not create local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Ensure instance console log exists: /opt/stack/data/nova/instances/a397a3f0-9b98-4e2b-87a0-f5ff85247c11/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Start _get_guest_xml network_info=[{"id": "f757ece4-baa7-4593-8327-d5fee9aa2d1a", "address": "fa:16:3e:3a:0d:16", "network": {"id": "843ec1f3-c64d-4564-a801-0bee7beb4d42", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1999293789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "becd05a5b0824a208cd692d8505ea05e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf757ece4-ba", "ovs_interfaceid": "f757ece4-baa7-4593-8327-d5fee9aa2d1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NXzhsQRV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a397a3f0-9b98-4e2b-87a0-f5ff85247c11', 'attached_at': '', 'detached_at': '', 'volume_id': 'c9c0ff64-aff4-4c9a-b939-400975c79c52', 'serial': 'c9c0ff64-aff4-4c9a-b939-400975c79c52'}, 'attachment_id': '04dc7ce3-d7c7-41cc-97a7-beaa9c0103aa', 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'volume_type': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077726.7354393, 64232f69-e64b-4d8d-a029-9d97679ff632 => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:35:26 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] VM Resumed (Lifecycle Event)
Aug 15 05:35:26 user nova-compute[73391]: DEBUG nova.compute.manager [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Guest created on hypervisor {{(pid=73391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 05:35:26 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 15 05:35:26 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 15 05:35:26 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:35:26 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Instance spawned successfully.
Aug 15 05:35:26 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG nova.objects.instance [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Lazy-loading 'vcpu_model' on Instance uuid a397a3f0-9b98-4e2b-87a0-f5ff85247c11 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Found default for hw_cdrom_bus of ide {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Found default for hw_disk_bus of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Found default for hw_input_bus of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Found default for hw_pointer_model of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Found default for hw_video_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Found default for hw_vif_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NXzhsQRV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:35:26 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 05:35:26 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:35:26 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 05:35:26 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:35:26 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 05:35:26 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:35:26 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077726.7523568, 64232f69-e64b-4d8d-a029-9d97679ff632 => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:35:26 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] VM Started (Lifecycle Event)
Aug 15 05:35:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[03bbe71f-e55a-471f-8a34-bb80cbe75dea]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 05:35:26 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf333a6-67c5-447a-8aae-0eecd3aafdbc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52] added
Aug 15 05:35:26 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:26 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:35:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[647ca412-4895-4904-826a-9fa2c38567be]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:35:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:27 user nova-compute[73391]: INFO nova.compute.manager [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Took 8.80 seconds to spawn the instance on the hypervisor.
Aug 15 05:35:27 user nova-compute[73391]: DEBUG nova.compute.manager [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:35:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.043s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:27 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a52e42d-d1ba-48b5-8bf5-7d4dff7d30f0]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:27 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:35:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NXzhsQRV {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NXzhsQRV" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:27 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9c9096-aa28-4cc5-9df9-68062d76abf3]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:27 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NXzhsQRV'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:35:27 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:27 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d021ddfe-5d7d-40b4-9afd-862d20f6f988]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:27 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:35:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:27 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[978c2e34-0ea4-4f27-a199-ae0b2e9eeebe]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:27 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:35:27 user nova-compute[73391]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7 (non-flash)
Aug 15 05:35:27 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:35:27 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:35:27 user nova-compute[73391]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7 (non-flash)
Aug 15 05:35:27 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:35:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:27 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:27 user nova-compute[73391]: INFO nova.compute.manager [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Took 9.79 seconds to build instance.
Aug 15 05:35:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-dc29e424-687e-46cf-9849-13c6247ceeac tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Lock "64232f69-e64b-4d8d-a029-9d97679ff632" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.937s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:27 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[40f45949-ca0b-44a4-a197-3c68c422a501]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:27 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52, portal: 172.16.0.220,3260]
Aug 15 05:35:27 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52, portal: 172.16.0.220,3260] successful.
Aug 15 05:35:27 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:35:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:27 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23e1e4f-abeb-4ce2-aa1f-3c273d5ae227]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:27 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:35:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:27 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[33aed2fe-0f6c-4f69-a2e0-a47e1e26047e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:27 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:35:27 user nova-compute[73391]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7 (non-flash)
Aug 15 05:35:27 user nova-compute[73391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 (non-flash)
Aug 15 05:35:27 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:35:27 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:35:27 user nova-compute[73391]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7 (non-flash)
Aug 15 05:35:27 user nova-compute[73391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 (non-flash)
Aug 15 05:35:27 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:35:27 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.384s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:35:27 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 05:35:27 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] HCTL ('34', '-', '-', 0) found on session 21 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 05:35:27 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 05:35:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:27 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea7959a-cb2f-48c1-bc3c-874a2d78f19e]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:27 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: None {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:35:27 user nova-compute[73391]: DEBUG nova.compute.manager [req-caf6e84f-add3-4a3f-bff2-75f183ecbcc2 req-83059aca-e1a7-447f-b00d-2c723886369c service nova] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Received event network-vif-plugged-b15f644f-a86c-46f9-a3d2-eb71bf66ad74 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:35:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-caf6e84f-add3-4a3f-bff2-75f183ecbcc2 req-83059aca-e1a7-447f-b00d-2c723886369c service nova] Acquiring lock "64232f69-e64b-4d8d-a029-9d97679ff632-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-caf6e84f-add3-4a3f-bff2-75f183ecbcc2 req-83059aca-e1a7-447f-b00d-2c723886369c service nova] Lock "64232f69-e64b-4d8d-a029-9d97679ff632-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-caf6e84f-add3-4a3f-bff2-75f183ecbcc2 req-83059aca-e1a7-447f-b00d-2c723886369c service nova] Lock "64232f69-e64b-4d8d-a029-9d97679ff632-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:27 user nova-compute[73391]: DEBUG nova.compute.manager [req-caf6e84f-add3-4a3f-bff2-75f183ecbcc2 req-83059aca-e1a7-447f-b00d-2c723886369c service nova] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] No waiting events found dispatching network-vif-plugged-b15f644f-a86c-46f9-a3d2-eb71bf66ad74 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:35:27 user nova-compute[73391]: WARNING nova.compute.manager [req-caf6e84f-add3-4a3f-bff2-75f183ecbcc2 req-83059aca-e1a7-447f-b00d-2c723886369c service nova] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Received unexpected event network-vif-plugged-b15f644f-a86c-46f9-a3d2-eb71bf66ad74 for instance with vm_state active and task_state None.
Aug 15 05:35:28 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:35:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NXzhsQRV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 05:35:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.415s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:35:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] <== connect_volume: return (1417ms) {'type': 'block', 'scsi_wwn': '23464653939666162', 'path': '/dev/sdc'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:35:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23464653939666162', 'path': '/dev/sdc'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 05:35:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T05:32:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1829220431',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-841273858',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNMgzXt9NjJohzQsGOG93ZxUTCjCzFBUN3Hf/vy9X7YUPJocPJVAdKrq1py25dd1+bQ6l0tu0hELDJB6TYYQgn1ARXbmD5JV7v4zuJ4KXoVbpP6mpPq+PpiOI9xbMnkxzg==',key_name='tempest-keypair-283788561',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:33:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='becd05a5b0824a208cd692d8505ea05e',ramdisk_id='',reservation_id='r-qxjdyr3i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1258386635',owner_user_name='tempest-ServerActionsV293TestJSON-1258386635-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:35:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f78657dfe187469faa75e7210792871b',uuid=a397a3f0-9b98-4e2b-87a0-f5ff85247c11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f757ece4-baa7-4593-8327-d5fee9aa2d1a", "address": "fa:16:3e:3a:0d:16", "network": {"id": "843ec1f3-c64d-4564-a801-0bee7beb4d42", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1999293789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "becd05a5b0824a208cd692d8505ea05e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf757ece4-ba", "ovs_interfaceid": "f757ece4-baa7-4593-8327-d5fee9aa2d1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:35:28 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Converting VIF {"id": "f757ece4-baa7-4593-8327-d5fee9aa2d1a", "address": "fa:16:3e:3a:0d:16", "network": {"id": "843ec1f3-c64d-4564-a801-0bee7beb4d42", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1999293789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "becd05a5b0824a208cd692d8505ea05e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf757ece4-ba", "ovs_interfaceid": "f757ece4-baa7-4593-8327-d5fee9aa2d1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:35:28 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:0d:16,bridge_name='br-int',has_traffic_filtering=True,id=f757ece4-baa7-4593-8327-d5fee9aa2d1a,network=Network(843ec1f3-c64d-4564-a801-0bee7beb4d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf757ece4-ba') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:35:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:35:28 user nova-compute[73391]:   <uuid>a397a3f0-9b98-4e2b-87a0-f5ff85247c11</uuid>
Aug 15 05:35:28 user nova-compute[73391]:   <name>instance-0000000e</name>
Aug 15 05:35:28 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:35:28 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:35:28 user nova-compute[73391]:   <metadata>
Aug 15 05:35:28 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:35:28 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:35:28 user nova-compute[73391]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1829220431</nova:name>
Aug 15 05:35:28 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:35:26</nova:creationTime>
Aug 15 05:35:28 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:35:28 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:35:28 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:35:28 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:35:28 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:35:28 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:35:28 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:35:28 user nova-compute[73391]:       <nova:owner>
Aug 15 05:35:28 user nova-compute[73391]:         <nova:user uuid="f78657dfe187469faa75e7210792871b">tempest-ServerActionsV293TestJSON-1258386635-project-member</nova:user>
Aug 15 05:35:28 user nova-compute[73391]:         <nova:project uuid="becd05a5b0824a208cd692d8505ea05e">tempest-ServerActionsV293TestJSON-1258386635</nova:project>
Aug 15 05:35:28 user nova-compute[73391]:       </nova:owner>
Aug 15 05:35:28 user nova-compute[73391]:       <nova:ports>
Aug 15 05:35:28 user nova-compute[73391]:         <nova:port uuid="f757ece4-baa7-4593-8327-d5fee9aa2d1a">
Aug 15 05:35:28 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 15 05:35:28 user nova-compute[73391]:         </nova:port>
Aug 15 05:35:28 user nova-compute[73391]:       </nova:ports>
Aug 15 05:35:28 user nova-compute[73391]:     </nova:instance>
Aug 15 05:35:28 user nova-compute[73391]:   </metadata>
Aug 15 05:35:28 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:35:28 user nova-compute[73391]:     <system>
Aug 15 05:35:28 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:35:28 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:35:28 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:35:28 user nova-compute[73391]:       <entry name="serial">a397a3f0-9b98-4e2b-87a0-f5ff85247c11</entry>
Aug 15 05:35:28 user nova-compute[73391]:       <entry name="uuid">a397a3f0-9b98-4e2b-87a0-f5ff85247c11</entry>
Aug 15 05:35:28 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:35:28 user nova-compute[73391]:     </system>
Aug 15 05:35:28 user nova-compute[73391]:   </sysinfo>
Aug 15 05:35:28 user nova-compute[73391]:   <os>
Aug 15 05:35:28 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:35:28 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:35:28 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:35:28 user nova-compute[73391]:   </os>
Aug 15 05:35:28 user nova-compute[73391]:   <features>
Aug 15 05:35:28 user nova-compute[73391]:     <acpi/>
Aug 15 05:35:28 user nova-compute[73391]:     <apic/>
Aug 15 05:35:28 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:35:28 user nova-compute[73391]:   </features>
Aug 15 05:35:28 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:35:28 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:35:28 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:35:28 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:35:28 user nova-compute[73391]:   </clock>
Aug 15 05:35:28 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:35:28 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:35:28 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:35:28 user nova-compute[73391]:   </cpu>
Aug 15 05:35:28 user nova-compute[73391]:   <devices>
Aug 15 05:35:28 user nova-compute[73391]:     <disk type="block" device="disk">
Aug 15 05:35:28 user nova-compute[73391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:35:28 user nova-compute[73391]:       <source dev="/dev/sdc"/>
Aug 15 05:35:28 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:35:28 user nova-compute[73391]:       <serial>c9c0ff64-aff4-4c9a-b939-400975c79c52</serial>
Aug 15 05:35:28 user nova-compute[73391]:     </disk>
Aug 15 05:35:28 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:35:28 user nova-compute[73391]:       <mac address="fa:16:3e:3a:0d:16"/>
Aug 15 05:35:28 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:35:28 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:35:28 user nova-compute[73391]:       <target dev="tapf757ece4-ba"/>
Aug 15 05:35:28 user nova-compute[73391]:     </interface>
Aug 15 05:35:28 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:35:28 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/a397a3f0-9b98-4e2b-87a0-f5ff85247c11/console.log" append="off"/>
Aug 15 05:35:28 user nova-compute[73391]:     </serial>
Aug 15 05:35:28 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:35:28 user nova-compute[73391]:     <video>
Aug 15 05:35:28 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:35:28 user nova-compute[73391]:     </video>
Aug 15 05:35:28 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:35:28 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:35:28 user nova-compute[73391]:     </rng>
Aug 15 05:35:28 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:35:28 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:35:28 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:35:28 user nova-compute[73391]:     </memballoon>
Aug 15 05:35:28 user nova-compute[73391]:   </devices>
Aug 15 05:35:28 user nova-compute[73391]: </domain>
Aug 15 05:35:28 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:35:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T05:32:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1829220431',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-841273858',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNMgzXt9NjJohzQsGOG93ZxUTCjCzFBUN3Hf/vy9X7YUPJocPJVAdKrq1py25dd1+bQ6l0tu0hELDJB6TYYQgn1ARXbmD5JV7v4zuJ4KXoVbpP6mpPq+PpiOI9xbMnkxzg==',key_name='tempest-keypair-283788561',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:33:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='becd05a5b0824a208cd692d8505ea05e',ramdisk_id='',reservation_id='r-qxjdyr3i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1258386635',owner_user_name='tempest-ServerActionsV293TestJSON-1258386635-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:35:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f78657dfe187469faa75e7210792871b',uuid=a397a3f0-9b98-4e2b-87a0-f5ff85247c11,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f757ece4-baa7-4593-8327-d5fee9aa2d1a", "address": "fa:16:3e:3a:0d:16", "network": {"id": "843ec1f3-c64d-4564-a801-0bee7beb4d42", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1999293789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "becd05a5b0824a208cd692d8505ea05e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf757ece4-ba", "ovs_interfaceid": "f757ece4-baa7-4593-8327-d5fee9aa2d1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:35:28 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Converting VIF {"id": "f757ece4-baa7-4593-8327-d5fee9aa2d1a", "address": "fa:16:3e:3a:0d:16", "network": {"id": "843ec1f3-c64d-4564-a801-0bee7beb4d42", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1999293789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "becd05a5b0824a208cd692d8505ea05e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf757ece4-ba", "ovs_interfaceid": "f757ece4-baa7-4593-8327-d5fee9aa2d1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:35:28 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:0d:16,bridge_name='br-int',has_traffic_filtering=True,id=f757ece4-baa7-4593-8327-d5fee9aa2d1a,network=Network(843ec1f3-c64d-4564-a801-0bee7beb4d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf757ece4-ba') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:35:28 user nova-compute[73391]: DEBUG os_vif [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:0d:16,bridge_name='br-int',has_traffic_filtering=True,id=f757ece4-baa7-4593-8327-d5fee9aa2d1a,network=Network(843ec1f3-c64d-4564-a801-0bee7beb4d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf757ece4-ba') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:35:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:35:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:35:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf757ece4-ba, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:35:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf757ece4-ba, col_values=(('external_ids', {'iface-id': 'f757ece4-baa7-4593-8327-d5fee9aa2d1a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:0d:16', 'vm-uuid': 'a397a3f0-9b98-4e2b-87a0-f5ff85247c11'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:35:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:35:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:28 user nova-compute[73391]: INFO os_vif [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:0d:16,bridge_name='br-int',has_traffic_filtering=True,id=f757ece4-baa7-4593-8327-d5fee9aa2d1a,network=Network(843ec1f3-c64d-4564-a801-0bee7beb4d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf757ece4-ba')
Aug 15 05:35:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:35:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] No VIF found with MAC fa:16:3e:3a:0d:16, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:35:29 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:29 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:30 user nova-compute[73391]: DEBUG nova.compute.manager [req-c9335cda-3acb-47f6-8d03-a962f6187cc0 req-08a2cc46-a0b5-41d4-a8ac-70eb4a868990 service nova] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Received event network-vif-plugged-f757ece4-baa7-4593-8327-d5fee9aa2d1a {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:35:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-c9335cda-3acb-47f6-8d03-a962f6187cc0 req-08a2cc46-a0b5-41d4-a8ac-70eb4a868990 service nova] Acquiring lock "a397a3f0-9b98-4e2b-87a0-f5ff85247c11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-c9335cda-3acb-47f6-8d03-a962f6187cc0 req-08a2cc46-a0b5-41d4-a8ac-70eb4a868990 service nova] Lock "a397a3f0-9b98-4e2b-87a0-f5ff85247c11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-c9335cda-3acb-47f6-8d03-a962f6187cc0 req-08a2cc46-a0b5-41d4-a8ac-70eb4a868990 service nova] Lock "a397a3f0-9b98-4e2b-87a0-f5ff85247c11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:30 user nova-compute[73391]: DEBUG nova.compute.manager [req-c9335cda-3acb-47f6-8d03-a962f6187cc0 req-08a2cc46-a0b5-41d4-a8ac-70eb4a868990 service nova] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] No waiting events found dispatching network-vif-plugged-f757ece4-baa7-4593-8327-d5fee9aa2d1a {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:35:30 user nova-compute[73391]: WARNING nova.compute.manager [req-c9335cda-3acb-47f6-8d03-a962f6187cc0 req-08a2cc46-a0b5-41d4-a8ac-70eb4a868990 service nova] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Received unexpected event network-vif-plugged-f757ece4-baa7-4593-8327-d5fee9aa2d1a for instance with vm_state active and task_state rebuild_spawning.
Aug 15 05:35:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Acquiring lock "fee43642-30e8-451b-919c-aca4cd4c3f81" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "fee43642-30e8-451b-919c-aca4cd4c3f81" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:31 user nova-compute[73391]: DEBUG nova.compute.manager [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Starting instance... {{(pid=73391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 05:35:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:31 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 05:35:31 user nova-compute[73391]: INFO nova.compute.claims [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Claim successful on node user
Aug 15 05:35:31 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:35:31 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:35:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.520s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:31 user nova-compute[73391]: DEBUG nova.compute.manager [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Start building networks asynchronously for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 05:35:31 user nova-compute[73391]: DEBUG nova.compute.manager [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Allocating IP information in the background. {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 05:35:31 user nova-compute[73391]: DEBUG nova.network.neutron [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] allocate_for_instance() {{(pid=73391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 05:35:31 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 05:35:31 user nova-compute[73391]: DEBUG nova.compute.manager [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Start building block device mappings for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 05:35:32 user nova-compute[73391]: DEBUG nova.compute.manager [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Start spawning the instance on the hypervisor. {{(pid=73391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 05:35:32 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Creating instance directory {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 05:35:32 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Creating image(s)
Aug 15 05:35:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Acquiring lock "/opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "/opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "/opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:32 user nova-compute[73391]: DEBUG nova.policy [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '02352e5b84f04d0e9975b8b8e5594b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f88922b3c294aea9efa3d80909a171a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73391) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 05:35:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.240s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Acquiring lock "999b315ba87151d8252d543312ae7790e7e1583b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:32 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077732.4762707, a397a3f0-9b98-4e2b-87a0-f5ff85247c11 => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:35:32 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] VM Resumed (Lifecycle Event)
Aug 15 05:35:32 user nova-compute[73391]: DEBUG nova.compute.manager [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:35:32 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Guest created on hypervisor {{(pid=73391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 05:35:32 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Instance spawned successfully.
Aug 15 05:35:32 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 05:35:32 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:35:32 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:35:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.202s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk 1073741824 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:32 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 15 05:35:32 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077732.4842834, a397a3f0-9b98-4e2b-87a0-f5ff85247c11 => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:35:32 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] VM Started (Lifecycle Event)
Aug 15 05:35:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk 1073741824" returned: 0 in 0.064s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:32 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:35:32 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Found default for hw_cdrom_bus of ide {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:35:32 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Found default for hw_disk_bus of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:35:32 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Found default for hw_input_bus of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:35:32 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Found default for hw_pointer_model of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:35:32 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Found default for hw_video_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:35:32 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Found default for hw_vif_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:35:32 user nova-compute[73391]: DEBUG nova.compute.manager [req-c165880a-f115-4e57-af19-d4064fd2fd9e req-4dda9025-e28b-40ea-a13c-e0b2709ca767 service nova] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Received event network-vif-plugged-f757ece4-baa7-4593-8327-d5fee9aa2d1a {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:35:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-c165880a-f115-4e57-af19-d4064fd2fd9e req-4dda9025-e28b-40ea-a13c-e0b2709ca767 service nova] Acquiring lock "a397a3f0-9b98-4e2b-87a0-f5ff85247c11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-c165880a-f115-4e57-af19-d4064fd2fd9e req-4dda9025-e28b-40ea-a13c-e0b2709ca767 service nova] Lock "a397a3f0-9b98-4e2b-87a0-f5ff85247c11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-c165880a-f115-4e57-af19-d4064fd2fd9e req-4dda9025-e28b-40ea-a13c-e0b2709ca767 service nova] Lock "a397a3f0-9b98-4e2b-87a0-f5ff85247c11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:32 user nova-compute[73391]: DEBUG nova.compute.manager [req-c165880a-f115-4e57-af19-d4064fd2fd9e req-4dda9025-e28b-40ea-a13c-e0b2709ca767 service nova] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] No waiting events found dispatching network-vif-plugged-f757ece4-baa7-4593-8327-d5fee9aa2d1a {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:35:32 user nova-compute[73391]: WARNING nova.compute.manager [req-c165880a-f115-4e57-af19-d4064fd2fd9e req-4dda9025-e28b-40ea-a13c-e0b2709ca767 service nova] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Received unexpected event network-vif-plugged-f757ece4-baa7-4593-8327-d5fee9aa2d1a for instance with vm_state active and task_state rebuild_spawning.
Aug 15 05:35:32 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692077717.7139962, 88847b7f-228c-4347-9091-334da8330201 => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:35:32 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 88847b7f-228c-4347-9091-334da8330201] VM Stopped (Lifecycle Event)
Aug 15 05:35:32 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:35:32 user nova-compute[73391]: DEBUG nova.compute.manager [None req-de81af8b-11f8-4b87-9c08-70f09eea9299 None None] [instance: 88847b7f-228c-4347-9091-334da8330201] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:35:32 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 15 05:35:32 user nova-compute[73391]: DEBUG nova.compute.manager [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:35:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.265s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:32 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk. size=1073741824 {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 05:35:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.003s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:32 user nova-compute[73391]: DEBUG nova.objects.instance [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73391) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 15 05:35:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ea622dcb-8351-4cf2-912f-be2ef9f75ab0 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.131s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:33 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:33 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Cannot resize image /opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk to a smaller size. {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 05:35:33 user nova-compute[73391]: DEBUG nova.objects.instance [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lazy-loading 'migration_context' on Instance uuid fee43642-30e8-451b-919c-aca4cd4c3f81 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:35:33 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Created local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 05:35:33 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Ensure instance console log exists: /opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 05:35:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:33 user nova-compute[73391]: DEBUG nova.network.neutron [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Successfully created port: fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 05:35:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG nova.network.neutron [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Successfully updated port: fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Acquiring lock "refresh_cache-fee43642-30e8-451b-919c-aca4cd4c3f81" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Acquired lock "refresh_cache-fee43642-30e8-451b-919c-aca4cd4c3f81" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG nova.network.neutron [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG nova.compute.manager [req-79aefb84-798a-4325-9897-cd443a85786c req-29bbef8d-2877-47f9-838b-285405293984 service nova] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Received event network-changed-fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG nova.compute.manager [req-79aefb84-798a-4325-9897-cd443a85786c req-29bbef8d-2877-47f9-838b-285405293984 service nova] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Refreshing instance network info cache due to event network-changed-fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-79aefb84-798a-4325-9897-cd443a85786c req-29bbef8d-2877-47f9-838b-285405293984 service nova] Acquiring lock "refresh_cache-fee43642-30e8-451b-919c-aca4cd4c3f81" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG nova.network.neutron [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:35:35 user nova-compute[73391]: WARNING nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] While synchronizing instance power states, found 11 instances in the database and 9 instances on the hypervisor.
Aug 15 05:35:35 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Triggering sync for uuid 8f08782b-f793-415e-b0d6-5caad1c3d426 {{(pid=73391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Triggering sync for uuid 6ac9d5dc-56be-402f-b9d4-3327bdfd9220 {{(pid=73391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Triggering sync for uuid 18c8138a-4efc-403f-8b42-e5080c6a51d3 {{(pid=73391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Triggering sync for uuid 4b9f5970-65c5-4eff-a4bf-d18a9c916c90 {{(pid=73391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Triggering sync for uuid 6358e825-5705-45d6-86b6-3aacfa5a9bbb {{(pid=73391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Triggering sync for uuid a397a3f0-9b98-4e2b-87a0-f5ff85247c11 {{(pid=73391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Triggering sync for uuid 3f88cd17-c89f-41f3-b630-8eb2c6698155 {{(pid=73391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Triggering sync for uuid 8186459b-5bcb-4b5a-b6d8-d424909614e5 {{(pid=73391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Triggering sync for uuid 131311f3-8467-461d-90eb-6a1b8a9d4f05 {{(pid=73391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Triggering sync for uuid 64232f69-e64b-4d8d-a029-9d97679ff632 {{(pid=73391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Triggering sync for uuid fee43642-30e8-451b-919c-aca4cd4c3f81 {{(pid=73391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "8f08782b-f793-415e-b0d6-5caad1c3d426" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "8f08782b-f793-415e-b0d6-5caad1c3d426" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "6ac9d5dc-56be-402f-b9d4-3327bdfd9220" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "6ac9d5dc-56be-402f-b9d4-3327bdfd9220" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "18c8138a-4efc-403f-8b42-e5080c6a51d3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "18c8138a-4efc-403f-8b42-e5080c6a51d3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "4b9f5970-65c5-4eff-a4bf-d18a9c916c90" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "4b9f5970-65c5-4eff-a4bf-d18a9c916c90" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "6358e825-5705-45d6-86b6-3aacfa5a9bbb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "6358e825-5705-45d6-86b6-3aacfa5a9bbb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "a397a3f0-9b98-4e2b-87a0-f5ff85247c11" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "a397a3f0-9b98-4e2b-87a0-f5ff85247c11" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "3f88cd17-c89f-41f3-b630-8eb2c6698155" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "3f88cd17-c89f-41f3-b630-8eb2c6698155" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "8186459b-5bcb-4b5a-b6d8-d424909614e5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "8186459b-5bcb-4b5a-b6d8-d424909614e5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:35 user nova-compute[73391]: INFO nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] During sync_power_state the instance has a pending task (rebuild_block_device_mapping). Skip.
Aug 15 05:35:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "8186459b-5bcb-4b5a-b6d8-d424909614e5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "131311f3-8467-461d-90eb-6a1b8a9d4f05" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "131311f3-8467-461d-90eb-6a1b8a9d4f05" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "64232f69-e64b-4d8d-a029-9d97679ff632" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "64232f69-e64b-4d8d-a029-9d97679ff632" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "fee43642-30e8-451b-919c-aca4cd4c3f81" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "8f08782b-f793-415e-b0d6-5caad1c3d426" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.143s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "4b9f5970-65c5-4eff-a4bf-d18a9c916c90" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.144s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "6ac9d5dc-56be-402f-b9d4-3327bdfd9220" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.151s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "6358e825-5705-45d6-86b6-3aacfa5a9bbb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.163s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "131311f3-8467-461d-90eb-6a1b8a9d4f05" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.177s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "3f88cd17-c89f-41f3-b630-8eb2c6698155" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.197s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "18c8138a-4efc-403f-8b42-e5080c6a51d3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.226s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "64232f69-e64b-4d8d-a029-9d97679ff632" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.241s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "a397a3f0-9b98-4e2b-87a0-f5ff85247c11" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.256s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG nova.network.neutron [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Updating instance_info_cache with network_info: [{"id": "fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b", "address": "fa:16:3e:57:a8:64", "network": {"id": "c94dfbf4-6803-458e-b2c6-231298da7bc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090354282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f88922b3c294aea9efa3d80909a171a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdb4ce86-9a", "ovs_interfaceid": "fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Releasing lock "refresh_cache-fee43642-30e8-451b-919c-aca4cd4c3f81" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG nova.compute.manager [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Instance network_info: |[{"id": "fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b", "address": "fa:16:3e:57:a8:64", "network": {"id": "c94dfbf4-6803-458e-b2c6-231298da7bc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090354282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f88922b3c294aea9efa3d80909a171a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdb4ce86-9a", "ovs_interfaceid": "fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-79aefb84-798a-4325-9897-cd443a85786c req-29bbef8d-2877-47f9-838b-285405293984 service nova] Acquired lock "refresh_cache-fee43642-30e8-451b-919c-aca4cd4c3f81" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG nova.network.neutron [req-79aefb84-798a-4325-9897-cd443a85786c req-29bbef8d-2877-47f9-838b-285405293984 service nova] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Refreshing network info cache for port fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Start _get_guest_xml network_info=[{"id": "fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b", "address": "fa:16:3e:57:a8:64", "network": {"id": "c94dfbf4-6803-458e-b2c6-231298da7bc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090354282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f88922b3c294aea9efa3d80909a171a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdb4ce86-9a", "ovs_interfaceid": "fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '191b1dad-305e-4d1c-9b15-515ec59a3278'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:35:35 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:35:35 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:35:35 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:35:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1959427232',display_name='tempest-AttachVolumeTestJSON-server-1959427232',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1959427232',id=20,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8c2c+HY2uFg0muioXJ/Qd76WkrwYok3JhcRUo8JvSmW81H3Mw3KqkIDK8NtlIVnkKC4J9LmhNxEjXRZXc6sdj/CKTHFaHD2NbzzeyvSOZNMRKn7xfyQEj9gzmcW7J5qQ==',key_name='tempest-keypair-769603990',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f88922b3c294aea9efa3d80909a171a',ramdisk_id='',reservation_id='r-9kpn3uxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-629721707',owner_user_name='tempest-AttachVolumeTestJSON-629721707-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:35:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='02352e5b84f04d0e9975b8b8e5594b92',uuid=fee43642-30e8-451b-919c-aca4cd4c3f81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b", "address": "fa:16:3e:57:a8:64", "network": {"id": "c94dfbf4-6803-458e-b2c6-231298da7bc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090354282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f88922b3c294aea9efa3d80909a171a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdb4ce86-9a", "ovs_interfaceid": "fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Converting VIF {"id": "fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b", "address": "fa:16:3e:57:a8:64", "network": {"id": "c94dfbf4-6803-458e-b2c6-231298da7bc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090354282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f88922b3c294aea9efa3d80909a171a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdb4ce86-9a", "ovs_interfaceid": "fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:a8:64,bridge_name='br-int',has_traffic_filtering=True,id=fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b,network=Network(c94dfbf4-6803-458e-b2c6-231298da7bc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdb4ce86-9a') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG nova.objects.instance [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lazy-loading 'pci_devices' on Instance uuid fee43642-30e8-451b-919c-aca4cd4c3f81 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:35:35 user nova-compute[73391]:   <uuid>fee43642-30e8-451b-919c-aca4cd4c3f81</uuid>
Aug 15 05:35:35 user nova-compute[73391]:   <name>instance-00000014</name>
Aug 15 05:35:35 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:35:35 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:35:35 user nova-compute[73391]:   <metadata>
Aug 15 05:35:35 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:35:35 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:35:35 user nova-compute[73391]:       <nova:name>tempest-AttachVolumeTestJSON-server-1959427232</nova:name>
Aug 15 05:35:35 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:35:35</nova:creationTime>
Aug 15 05:35:35 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:35:35 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:35:35 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:35:35 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:35:35 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:35:35 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:35:35 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:35:35 user nova-compute[73391]:       <nova:owner>
Aug 15 05:35:35 user nova-compute[73391]:         <nova:user uuid="02352e5b84f04d0e9975b8b8e5594b92">tempest-AttachVolumeTestJSON-629721707-project-member</nova:user>
Aug 15 05:35:35 user nova-compute[73391]:         <nova:project uuid="9f88922b3c294aea9efa3d80909a171a">tempest-AttachVolumeTestJSON-629721707</nova:project>
Aug 15 05:35:35 user nova-compute[73391]:       </nova:owner>
Aug 15 05:35:35 user nova-compute[73391]:       <nova:root type="image" uuid="191b1dad-305e-4d1c-9b15-515ec59a3278"/>
Aug 15 05:35:35 user nova-compute[73391]:       <nova:ports>
Aug 15 05:35:35 user nova-compute[73391]:         <nova:port uuid="fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b">
Aug 15 05:35:35 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 05:35:35 user nova-compute[73391]:         </nova:port>
Aug 15 05:35:35 user nova-compute[73391]:       </nova:ports>
Aug 15 05:35:35 user nova-compute[73391]:     </nova:instance>
Aug 15 05:35:35 user nova-compute[73391]:   </metadata>
Aug 15 05:35:35 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:35:35 user nova-compute[73391]:     <system>
Aug 15 05:35:35 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:35:35 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:35:35 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:35:35 user nova-compute[73391]:       <entry name="serial">fee43642-30e8-451b-919c-aca4cd4c3f81</entry>
Aug 15 05:35:35 user nova-compute[73391]:       <entry name="uuid">fee43642-30e8-451b-919c-aca4cd4c3f81</entry>
Aug 15 05:35:35 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:35:35 user nova-compute[73391]:     </system>
Aug 15 05:35:35 user nova-compute[73391]:   </sysinfo>
Aug 15 05:35:35 user nova-compute[73391]:   <os>
Aug 15 05:35:35 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:35:35 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:35:35 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:35:35 user nova-compute[73391]:   </os>
Aug 15 05:35:35 user nova-compute[73391]:   <features>
Aug 15 05:35:35 user nova-compute[73391]:     <acpi/>
Aug 15 05:35:35 user nova-compute[73391]:     <apic/>
Aug 15 05:35:35 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:35:35 user nova-compute[73391]:   </features>
Aug 15 05:35:35 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:35:35 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:35:35 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:35:35 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:35:35 user nova-compute[73391]:   </clock>
Aug 15 05:35:35 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:35:35 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:35:35 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:35:35 user nova-compute[73391]:   </cpu>
Aug 15 05:35:35 user nova-compute[73391]:   <devices>
Aug 15 05:35:35 user nova-compute[73391]:     <disk type="file" device="disk">
Aug 15 05:35:35 user nova-compute[73391]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 05:35:35 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk"/>
Aug 15 05:35:35 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:35:35 user nova-compute[73391]:     </disk>
Aug 15 05:35:35 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:35:35 user nova-compute[73391]:       <mac address="fa:16:3e:57:a8:64"/>
Aug 15 05:35:35 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:35:35 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:35:35 user nova-compute[73391]:       <target dev="tapfdb4ce86-9a"/>
Aug 15 05:35:35 user nova-compute[73391]:     </interface>
Aug 15 05:35:35 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:35:35 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/console.log" append="off"/>
Aug 15 05:35:35 user nova-compute[73391]:     </serial>
Aug 15 05:35:35 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:35:35 user nova-compute[73391]:     <video>
Aug 15 05:35:35 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:35:35 user nova-compute[73391]:     </video>
Aug 15 05:35:35 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:35:35 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:35:35 user nova-compute[73391]:     </rng>
Aug 15 05:35:35 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:35:35 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:35:35 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:35:35 user nova-compute[73391]:     </memballoon>
Aug 15 05:35:35 user nova-compute[73391]:   </devices>
Aug 15 05:35:35 user nova-compute[73391]: </domain>
Aug 15 05:35:35 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:35:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1959427232',display_name='tempest-AttachVolumeTestJSON-server-1959427232',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1959427232',id=20,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8c2c+HY2uFg0muioXJ/Qd76WkrwYok3JhcRUo8JvSmW81H3Mw3KqkIDK8NtlIVnkKC4J9LmhNxEjXRZXc6sdj/CKTHFaHD2NbzzeyvSOZNMRKn7xfyQEj9gzmcW7J5qQ==',key_name='tempest-keypair-769603990',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f88922b3c294aea9efa3d80909a171a',ramdisk_id='',reservation_id='r-9kpn3uxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-629721707',owner_user_name='tempest-AttachVolumeTestJSON-629721707-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:35:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='02352e5b84f04d0e9975b8b8e5594b92',uuid=fee43642-30e8-451b-919c-aca4cd4c3f81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b", "address": "fa:16:3e:57:a8:64", "network": {"id": "c94dfbf4-6803-458e-b2c6-231298da7bc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090354282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f88922b3c294aea9efa3d80909a171a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdb4ce86-9a", "ovs_interfaceid": "fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Converting VIF {"id": "fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b", "address": "fa:16:3e:57:a8:64", "network": {"id": "c94dfbf4-6803-458e-b2c6-231298da7bc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090354282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f88922b3c294aea9efa3d80909a171a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdb4ce86-9a", "ovs_interfaceid": "fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:a8:64,bridge_name='br-int',has_traffic_filtering=True,id=fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b,network=Network(c94dfbf4-6803-458e-b2c6-231298da7bc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdb4ce86-9a') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG os_vif [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:a8:64,bridge_name='br-int',has_traffic_filtering=True,id=fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b,network=Network(c94dfbf4-6803-458e-b2c6-231298da7bc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdb4ce86-9a') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfdb4ce86-9a, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfdb4ce86-9a, col_values=(('external_ids', {'iface-id': 'fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:a8:64', 'vm-uuid': 'fee43642-30e8-451b-919c-aca4cd4c3f81'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:35 user nova-compute[73391]: INFO os_vif [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:a8:64,bridge_name='br-int',has_traffic_filtering=True,id=fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b,network=Network(c94dfbf4-6803-458e-b2c6-231298da7bc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdb4ce86-9a')
Aug 15 05:35:35 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:35:35 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] No VIF found with MAC fa:16:3e:57:a8:64, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:35:36 user nova-compute[73391]: DEBUG nova.network.neutron [req-79aefb84-798a-4325-9897-cd443a85786c req-29bbef8d-2877-47f9-838b-285405293984 service nova] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Updated VIF entry in instance network info cache for port fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:35:36 user nova-compute[73391]: DEBUG nova.network.neutron [req-79aefb84-798a-4325-9897-cd443a85786c req-29bbef8d-2877-47f9-838b-285405293984 service nova] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Updating instance_info_cache with network_info: [{"id": "fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b", "address": "fa:16:3e:57:a8:64", "network": {"id": "c94dfbf4-6803-458e-b2c6-231298da7bc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090354282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f88922b3c294aea9efa3d80909a171a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdb4ce86-9a", "ovs_interfaceid": "fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:35:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-79aefb84-798a-4325-9897-cd443a85786c req-29bbef8d-2877-47f9-838b-285405293984 service nova] Releasing lock "refresh_cache-fee43642-30e8-451b-919c-aca4cd4c3f81" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:35:36 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:37 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:37 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Creating instance directory {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 05:35:37 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Creating image(s)
Aug 15 05:35:37 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquiring lock "/opt/stack/data/nova/instances/8186459b-5bcb-4b5a-b6d8-d424909614e5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:37 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "/opt/stack/data/nova/instances/8186459b-5bcb-4b5a-b6d8-d424909614e5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:37 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "/opt/stack/data/nova/instances/8186459b-5bcb-4b5a-b6d8-d424909614e5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.186s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:37 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquiring lock "999b315ba87151d8252d543312ae7790e7e1583b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:37 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.005s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:37 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:37 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:37 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.227s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/8186459b-5bcb-4b5a-b6d8-d424909614e5/disk 1073741824 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/8186459b-5bcb-4b5a-b6d8-d424909614e5/disk 1073741824" returned: 0 in 0.098s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:37 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.334s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:37 user nova-compute[73391]: DEBUG nova.compute.manager [req-f18c5780-4211-43b9-8ffa-6f24e945f1c5 req-e16afa87-da7f-42c6-aae5-4b3401d5c497 service nova] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Received event network-vif-plugged-fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f18c5780-4211-43b9-8ffa-6f24e945f1c5 req-e16afa87-da7f-42c6-aae5-4b3401d5c497 service nova] Acquiring lock "fee43642-30e8-451b-919c-aca4cd4c3f81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f18c5780-4211-43b9-8ffa-6f24e945f1c5 req-e16afa87-da7f-42c6-aae5-4b3401d5c497 service nova] Lock "fee43642-30e8-451b-919c-aca4cd4c3f81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f18c5780-4211-43b9-8ffa-6f24e945f1c5 req-e16afa87-da7f-42c6-aae5-4b3401d5c497 service nova] Lock "fee43642-30e8-451b-919c-aca4cd4c3f81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG nova.compute.manager [req-f18c5780-4211-43b9-8ffa-6f24e945f1c5 req-e16afa87-da7f-42c6-aae5-4b3401d5c497 service nova] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] No waiting events found dispatching network-vif-plugged-fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:35:38 user nova-compute[73391]: WARNING nova.compute.manager [req-f18c5780-4211-43b9-8ffa-6f24e945f1c5 req-e16afa87-da7f-42c6-aae5-4b3401d5c497 service nova] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Received unexpected event network-vif-plugged-fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b for instance with vm_state building and task_state spawning.
Aug 15 05:35:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.218s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8186459b-5bcb-4b5a-b6d8-d424909614e5/disk. size=1073741824 {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8186459b-5bcb-4b5a-b6d8-d424909614e5/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8186459b-5bcb-4b5a-b6d8-d424909614e5/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Cannot resize image /opt/stack/data/nova/instances/8186459b-5bcb-4b5a-b6d8-d424909614e5/disk to a smaller size. {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Created local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Ensure instance console log exists: /opt/stack/data/nova/instances/8186459b-5bcb-4b5a-b6d8-d424909614e5/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Start _get_guest_xml network_info=[{"id": "de932b15-d8c8-4714-80c0-c9eedeb26588", "address": "fa:16:3e:17:55:32", "network": {"id": "610f78de-5741-4743-815d-d12ba05f8000", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1518164868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b01853a82243369bd71dc0dbedb5d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde932b15-d8", "ovs_interfaceid": "de932b15-d8c8-4714-80c0-c9eedeb26588", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '191b1dad-305e-4d1c-9b15-515ec59a3278'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WQdVNZAL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8186459b-5bcb-4b5a-b6d8-d424909614e5', 'attached_at': '', 'detached_at': '', 'volume_id': 'f933c0cc-dfab-44c4-b973-2f75a10fdaa5', 'serial': 'f933c0cc-dfab-44c4-b973-2f75a10fdaa5'}, 'attachment_id': 'c4dde1f5-806b-430a-b508-12013ec2c757', 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:35:38 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 15 05:35:38 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Aug 15 05:35:38 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG nova.objects.instance [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8186459b-5bcb-4b5a-b6d8-d424909614e5 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WQdVNZAL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:35:38 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 05:35:38 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:35:38 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Aug 15 05:35:38 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:35:38 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 05:35:38 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e295e12d-8336-49a2-9649-6326089fed67]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 05:35:38 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7b2133-b296-45c2-a3c5-0d40227614b1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5] added
Aug 15 05:35:38 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85e9ae3-1379-4c07-8df3-08804999d5bf]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[773069ff-ef93-4d70-9ce1-5cdc48abb742]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WQdVNZAL {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WQdVNZAL" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b16d95a-8338-4fe7-bca9-ee97e468643d]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WQdVNZAL'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a238a704-d9f7-4be4-ad77-f05c0cf39511]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f16c0c7-f31c-4cb9-b6c1-fbfa111bcde4]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:35:38 user nova-compute[73391]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7 (non-flash)
Aug 15 05:35:38 user nova-compute[73391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 (non-flash)
Aug 15 05:35:38 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:35:38 user nova-compute[73391]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7 (non-flash)
Aug 15 05:35:38 user nova-compute[73391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 (non-flash)
Aug 15 05:35:38 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692077723.902212, 8186459b-5bcb-4b5a-b6d8-d424909614e5 => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:35:38 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] VM Stopped (Lifecycle Event)
Aug 15 05:35:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 -p 172.16.0.220:3260 --login" returned: 0 in 0.254s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41b8230-a464-423f-a35f-4d7e32c6c2da]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5, portal: 172.16.0.220,3260]
Aug 15 05:35:38 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5, portal: 172.16.0.220,3260] successful.
Aug 15 05:35:38 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:35:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:39 user nova-compute[73391]: DEBUG nova.compute.manager [None req-5028be2c-f71d-4b21-9a99-3617fcc450e0 None None] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:35:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.040s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:39 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c3e68ba-51e0-4ffa-a8c0-18cac042bbd2]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:39 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:35:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:39 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea301981-517e-43a8-ab15-c54d3a98a05c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:39 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:35:39 user nova-compute[73391]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7 (non-flash)
Aug 15 05:35:39 user nova-compute[73391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 (non-flash)
Aug 15 05:35:39 user nova-compute[73391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)
Aug 15 05:35:39 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:35:39 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:35:39 user nova-compute[73391]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7 (non-flash)
Aug 15 05:35:39 user nova-compute[73391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 (non-flash)
Aug 15 05:35:39 user nova-compute[73391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)
Aug 15 05:35:39 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:35:39 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.577s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:35:39 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 05:35:39 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] HCTL ('35', '-', '-', 0) found on session 22 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 05:35:39 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 05:35:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.024s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:39 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae76e74e-b9f1-405f-8e6d-82ca890788ff]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:39 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Searching for a device in session 22 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:35:39 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WQdVNZAL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 05:35:39 user nova-compute[73391]: DEBUG nova.compute.manager [req-ae303d41-3fa8-4a57-94ca-526442be8b94 req-8e159d2b-fb57-4c18-a92e-0920ab54333d service nova] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Received event network-vif-plugged-fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:35:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ae303d41-3fa8-4a57-94ca-526442be8b94 req-8e159d2b-fb57-4c18-a92e-0920ab54333d service nova] Acquiring lock "fee43642-30e8-451b-919c-aca4cd4c3f81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ae303d41-3fa8-4a57-94ca-526442be8b94 req-8e159d2b-fb57-4c18-a92e-0920ab54333d service nova] Lock "fee43642-30e8-451b-919c-aca4cd4c3f81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ae303d41-3fa8-4a57-94ca-526442be8b94 req-8e159d2b-fb57-4c18-a92e-0920ab54333d service nova] Lock "fee43642-30e8-451b-919c-aca4cd4c3f81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:39 user nova-compute[73391]: DEBUG nova.compute.manager [req-ae303d41-3fa8-4a57-94ca-526442be8b94 req-8e159d2b-fb57-4c18-a92e-0920ab54333d service nova] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] No waiting events found dispatching network-vif-plugged-fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:35:39 user nova-compute[73391]: WARNING nova.compute.manager [req-ae303d41-3fa8-4a57-94ca-526442be8b94 req-8e159d2b-fb57-4c18-a92e-0920ab54333d service nova] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Received unexpected event network-vif-plugged-fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b for instance with vm_state building and task_state spawning.
Aug 15 05:35:40 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.643s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:35:40 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] <== connect_volume: return (1644ms) {'type': 'block', 'scsi_wwn': '23236336334656130', 'path': '/dev/sdd'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:35:40 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23236336334656130', 'path': '/dev/sdd'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 05:35:40 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T05:33:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-812806078',display_name='tempest-ServerActionsTestOtherA-server-1346081936',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-812806078',id=16,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKQF8c52xIn/tpah2OQeeTlaAc50/7SkZ/oBXCnKk+8uX+Qv1Jri1CC3w4ewMsF9mvYSfBkgG+AekpaXFdh8jEXOjDMtbaHzPVlN2+XlP9ua4WN7/3eKAFOiv304VYf4sQ==',key_name='tempest-keypair-393045208',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:33:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='60b01853a82243369bd71dc0dbedb5d6',ramdisk_id='',reservation_id='r-u8d1c087',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1927429987',owner_user_name='tempest-ServerActionsTestOtherA-1927429987-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:35:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='124dcfde552147e2978970386274c70a',uuid=8186459b-5bcb-4b5a-b6d8-d424909614e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de932b15-d8c8-4714-80c0-c9eedeb26588", "address": "fa:16:3e:17:55:32", "network": {"id": "610f78de-5741-4743-815d-d12ba05f8000", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1518164868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b01853a82243369bd71dc0dbedb5d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde932b15-d8", "ovs_interfaceid": "de932b15-d8c8-4714-80c0-c9eedeb26588", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:35:40 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Converting VIF {"id": "de932b15-d8c8-4714-80c0-c9eedeb26588", "address": "fa:16:3e:17:55:32", "network": {"id": "610f78de-5741-4743-815d-d12ba05f8000", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1518164868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b01853a82243369bd71dc0dbedb5d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde932b15-d8", "ovs_interfaceid": "de932b15-d8c8-4714-80c0-c9eedeb26588", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:35:40 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:55:32,bridge_name='br-int',has_traffic_filtering=True,id=de932b15-d8c8-4714-80c0-c9eedeb26588,network=Network(610f78de-5741-4743-815d-d12ba05f8000),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde932b15-d8') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:35:40 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:35:40 user nova-compute[73391]:   <uuid>8186459b-5bcb-4b5a-b6d8-d424909614e5</uuid>
Aug 15 05:35:40 user nova-compute[73391]:   <name>instance-00000010</name>
Aug 15 05:35:40 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:35:40 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:35:40 user nova-compute[73391]:   <metadata>
Aug 15 05:35:40 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:35:40 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:35:40 user nova-compute[73391]:       <nova:name>tempest-ServerActionsTestOtherA-server-1346081936</nova:name>
Aug 15 05:35:40 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:35:38</nova:creationTime>
Aug 15 05:35:40 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:35:40 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:35:40 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:35:40 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:35:40 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:35:40 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:35:40 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:35:40 user nova-compute[73391]:       <nova:owner>
Aug 15 05:35:40 user nova-compute[73391]:         <nova:user uuid="124dcfde552147e2978970386274c70a">tempest-ServerActionsTestOtherA-1927429987-project-member</nova:user>
Aug 15 05:35:40 user nova-compute[73391]:         <nova:project uuid="60b01853a82243369bd71dc0dbedb5d6">tempest-ServerActionsTestOtherA-1927429987</nova:project>
Aug 15 05:35:40 user nova-compute[73391]:       </nova:owner>
Aug 15 05:35:40 user nova-compute[73391]:       <nova:root type="image" uuid="191b1dad-305e-4d1c-9b15-515ec59a3278"/>
Aug 15 05:35:40 user nova-compute[73391]:       <nova:ports>
Aug 15 05:35:40 user nova-compute[73391]:         <nova:port uuid="de932b15-d8c8-4714-80c0-c9eedeb26588">
Aug 15 05:35:40 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 15 05:35:40 user nova-compute[73391]:         </nova:port>
Aug 15 05:35:40 user nova-compute[73391]:       </nova:ports>
Aug 15 05:35:40 user nova-compute[73391]:     </nova:instance>
Aug 15 05:35:40 user nova-compute[73391]:   </metadata>
Aug 15 05:35:40 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:35:40 user nova-compute[73391]:     <system>
Aug 15 05:35:40 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:35:40 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:35:40 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:35:40 user nova-compute[73391]:       <entry name="serial">8186459b-5bcb-4b5a-b6d8-d424909614e5</entry>
Aug 15 05:35:40 user nova-compute[73391]:       <entry name="uuid">8186459b-5bcb-4b5a-b6d8-d424909614e5</entry>
Aug 15 05:35:40 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:35:40 user nova-compute[73391]:     </system>
Aug 15 05:35:40 user nova-compute[73391]:   </sysinfo>
Aug 15 05:35:40 user nova-compute[73391]:   <os>
Aug 15 05:35:40 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:35:40 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:35:40 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:35:40 user nova-compute[73391]:   </os>
Aug 15 05:35:40 user nova-compute[73391]:   <features>
Aug 15 05:35:40 user nova-compute[73391]:     <acpi/>
Aug 15 05:35:40 user nova-compute[73391]:     <apic/>
Aug 15 05:35:40 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:35:40 user nova-compute[73391]:   </features>
Aug 15 05:35:40 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:35:40 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:35:40 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:35:40 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:35:40 user nova-compute[73391]:   </clock>
Aug 15 05:35:40 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:35:40 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:35:40 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:35:40 user nova-compute[73391]:   </cpu>
Aug 15 05:35:40 user nova-compute[73391]:   <devices>
Aug 15 05:35:40 user nova-compute[73391]:     <disk type="file" device="disk">
Aug 15 05:35:40 user nova-compute[73391]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 05:35:40 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/8186459b-5bcb-4b5a-b6d8-d424909614e5/disk"/>
Aug 15 05:35:40 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:35:40 user nova-compute[73391]:     </disk>
Aug 15 05:35:40 user nova-compute[73391]:     <disk type="block" device="disk">
Aug 15 05:35:40 user nova-compute[73391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:35:40 user nova-compute[73391]:       <source dev="/dev/sdd"/>
Aug 15 05:35:40 user nova-compute[73391]:       <target dev="vdb" bus="virtio"/>
Aug 15 05:35:40 user nova-compute[73391]:       <serial>f933c0cc-dfab-44c4-b973-2f75a10fdaa5</serial>
Aug 15 05:35:40 user nova-compute[73391]:     </disk>
Aug 15 05:35:40 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:35:40 user nova-compute[73391]:       <mac address="fa:16:3e:17:55:32"/>
Aug 15 05:35:40 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:35:40 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:35:40 user nova-compute[73391]:       <target dev="tapde932b15-d8"/>
Aug 15 05:35:40 user nova-compute[73391]:     </interface>
Aug 15 05:35:40 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:35:40 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/8186459b-5bcb-4b5a-b6d8-d424909614e5/console.log" append="off"/>
Aug 15 05:35:40 user nova-compute[73391]:     </serial>
Aug 15 05:35:40 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:35:40 user nova-compute[73391]:     <video>
Aug 15 05:35:40 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:35:40 user nova-compute[73391]:     </video>
Aug 15 05:35:40 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:35:40 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:35:40 user nova-compute[73391]:     </rng>
Aug 15 05:35:40 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:35:40 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:35:40 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:35:40 user nova-compute[73391]:     </memballoon>
Aug 15 05:35:40 user nova-compute[73391]:   </devices>
Aug 15 05:35:40 user nova-compute[73391]: </domain>
Aug 15 05:35:40 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:35:40 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T05:33:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-812806078',display_name='tempest-ServerActionsTestOtherA-server-1346081936',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-812806078',id=16,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKQF8c52xIn/tpah2OQeeTlaAc50/7SkZ/oBXCnKk+8uX+Qv1Jri1CC3w4ewMsF9mvYSfBkgG+AekpaXFdh8jEXOjDMtbaHzPVlN2+XlP9ua4WN7/3eKAFOiv304VYf4sQ==',key_name='tempest-keypair-393045208',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:33:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='60b01853a82243369bd71dc0dbedb5d6',ramdisk_id='',reservation_id='r-u8d1c087',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1927429987',owner_user_name='tempest-ServerActionsTestOtherA-1927429987-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:35:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='124dcfde552147e2978970386274c70a',uuid=8186459b-5bcb-4b5a-b6d8-d424909614e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de932b15-d8c8-4714-80c0-c9eedeb26588", "address": "fa:16:3e:17:55:32", "network": {"id": "610f78de-5741-4743-815d-d12ba05f8000", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1518164868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b01853a82243369bd71dc0dbedb5d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde932b15-d8", "ovs_interfaceid": "de932b15-d8c8-4714-80c0-c9eedeb26588", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:35:40 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Converting VIF {"id": "de932b15-d8c8-4714-80c0-c9eedeb26588", "address": "fa:16:3e:17:55:32", "network": {"id": "610f78de-5741-4743-815d-d12ba05f8000", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1518164868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b01853a82243369bd71dc0dbedb5d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde932b15-d8", "ovs_interfaceid": "de932b15-d8c8-4714-80c0-c9eedeb26588", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:35:40 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:55:32,bridge_name='br-int',has_traffic_filtering=True,id=de932b15-d8c8-4714-80c0-c9eedeb26588,network=Network(610f78de-5741-4743-815d-d12ba05f8000),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde932b15-d8') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:35:40 user nova-compute[73391]: DEBUG os_vif [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:55:32,bridge_name='br-int',has_traffic_filtering=True,id=de932b15-d8c8-4714-80c0-c9eedeb26588,network=Network(610f78de-5741-4743-815d-d12ba05f8000),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde932b15-d8') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:35:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:35:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:35:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapde932b15-d8, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:35:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapde932b15-d8, col_values=(('external_ids', {'iface-id': 'de932b15-d8c8-4714-80c0-c9eedeb26588', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:55:32', 'vm-uuid': '8186459b-5bcb-4b5a-b6d8-d424909614e5'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:35:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:35:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:40 user nova-compute[73391]: INFO os_vif [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:55:32,bridge_name='br-int',has_traffic_filtering=True,id=de932b15-d8c8-4714-80c0-c9eedeb26588,network=Network(610f78de-5741-4743-815d-d12ba05f8000),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde932b15-d8')
Aug 15 05:35:40 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:35:40 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:35:40 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] No VIF found with MAC fa:16:3e:17:55:32, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:35:40 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077740.2961395, fee43642-30e8-451b-919c-aca4cd4c3f81 => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:35:40 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] VM Resumed (Lifecycle Event)
Aug 15 05:35:40 user nova-compute[73391]: DEBUG nova.compute.manager [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:35:40 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Guest created on hypervisor {{(pid=73391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 05:35:40 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Instance spawned successfully.
Aug 15 05:35:40 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 05:35:40 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:35:40 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Found default for hw_cdrom_bus of ide {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:35:40 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Found default for hw_disk_bus of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:35:40 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Found default for hw_input_bus of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:35:40 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Found default for hw_pointer_model of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:35:40 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Found default for hw_video_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:35:40 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Found default for hw_vif_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:35:40 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:35:40 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:35:40 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077740.3024256, fee43642-30e8-451b-919c-aca4cd4c3f81 => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:35:40 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] VM Started (Lifecycle Event)
Aug 15 05:35:40 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:35:40 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:35:40 user nova-compute[73391]: INFO nova.compute.manager [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Took 8.38 seconds to spawn the instance on the hypervisor.
Aug 15 05:35:40 user nova-compute[73391]: DEBUG nova.compute.manager [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:35:40 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:35:40 user nova-compute[73391]: INFO nova.compute.manager [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Took 9.29 seconds to build instance.
Aug 15 05:35:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0bfea5a2-f72c-4f6e-8fc8-a0a6de5c0096 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "fee43642-30e8-451b-919c-aca4cd4c3f81" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.415s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "fee43642-30e8-451b-919c-aca4cd4c3f81" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 5.323s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:40 user nova-compute[73391]: INFO nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:35:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "fee43642-30e8-451b-919c-aca4cd4c3f81" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:42 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:42 user nova-compute[73391]: DEBUG nova.compute.manager [req-cba84874-8607-4536-82ad-db3b2480eab3 req-9cfa83db-cba0-46de-9c67-dafa383fa1b3 service nova] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Received event network-vif-plugged-de932b15-d8c8-4714-80c0-c9eedeb26588 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:35:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-cba84874-8607-4536-82ad-db3b2480eab3 req-9cfa83db-cba0-46de-9c67-dafa383fa1b3 service nova] Acquiring lock "8186459b-5bcb-4b5a-b6d8-d424909614e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-cba84874-8607-4536-82ad-db3b2480eab3 req-9cfa83db-cba0-46de-9c67-dafa383fa1b3 service nova] Lock "8186459b-5bcb-4b5a-b6d8-d424909614e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-cba84874-8607-4536-82ad-db3b2480eab3 req-9cfa83db-cba0-46de-9c67-dafa383fa1b3 service nova] Lock "8186459b-5bcb-4b5a-b6d8-d424909614e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:42 user nova-compute[73391]: DEBUG nova.compute.manager [req-cba84874-8607-4536-82ad-db3b2480eab3 req-9cfa83db-cba0-46de-9c67-dafa383fa1b3 service nova] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] No waiting events found dispatching network-vif-plugged-de932b15-d8c8-4714-80c0-c9eedeb26588 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:35:42 user nova-compute[73391]: WARNING nova.compute.manager [req-cba84874-8607-4536-82ad-db3b2480eab3 req-9cfa83db-cba0-46de-9c67-dafa383fa1b3 service nova] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Received unexpected event network-vif-plugged-de932b15-d8c8-4714-80c0-c9eedeb26588 for instance with vm_state active and task_state rebuild_spawning.
Aug 15 05:35:42 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:44 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:44 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077744.2785792, 8186459b-5bcb-4b5a-b6d8-d424909614e5 => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:35:44 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] VM Resumed (Lifecycle Event)
Aug 15 05:35:44 user nova-compute[73391]: DEBUG nova.compute.manager [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:35:44 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Guest created on hypervisor {{(pid=73391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 05:35:44 user nova-compute[73391]: DEBUG nova.compute.manager [req-9998f48a-5f1e-46cf-aa98-64f864d674af req-f7a80a49-c18b-464b-aa7a-85e706dc2078 service nova] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Received event network-vif-plugged-de932b15-d8c8-4714-80c0-c9eedeb26588 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:35:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-9998f48a-5f1e-46cf-aa98-64f864d674af req-f7a80a49-c18b-464b-aa7a-85e706dc2078 service nova] Acquiring lock "8186459b-5bcb-4b5a-b6d8-d424909614e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-9998f48a-5f1e-46cf-aa98-64f864d674af req-f7a80a49-c18b-464b-aa7a-85e706dc2078 service nova] Lock "8186459b-5bcb-4b5a-b6d8-d424909614e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-9998f48a-5f1e-46cf-aa98-64f864d674af req-f7a80a49-c18b-464b-aa7a-85e706dc2078 service nova] Lock "8186459b-5bcb-4b5a-b6d8-d424909614e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:44 user nova-compute[73391]: DEBUG nova.compute.manager [req-9998f48a-5f1e-46cf-aa98-64f864d674af req-f7a80a49-c18b-464b-aa7a-85e706dc2078 service nova] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] No waiting events found dispatching network-vif-plugged-de932b15-d8c8-4714-80c0-c9eedeb26588 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:35:44 user nova-compute[73391]: WARNING nova.compute.manager [req-9998f48a-5f1e-46cf-aa98-64f864d674af req-f7a80a49-c18b-464b-aa7a-85e706dc2078 service nova] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Received unexpected event network-vif-plugged-de932b15-d8c8-4714-80c0-c9eedeb26588 for instance with vm_state active and task_state rebuild_spawning.
Aug 15 05:35:44 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Instance spawned successfully.
Aug 15 05:35:44 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 05:35:44 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:35:44 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:35:44 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Found default for hw_cdrom_bus of ide {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:35:44 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Found default for hw_disk_bus of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:35:44 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Found default for hw_input_bus of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:35:44 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Found default for hw_pointer_model of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:35:44 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Found default for hw_video_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:35:44 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Found default for hw_vif_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:35:44 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 15 05:35:44 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077744.2804704, 8186459b-5bcb-4b5a-b6d8-d424909614e5 => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:35:44 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] VM Started (Lifecycle Event)
Aug 15 05:35:44 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:35:44 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:35:44 user nova-compute[73391]: DEBUG nova.compute.manager [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:35:44 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Aug 15 05:35:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:44 user nova-compute[73391]: DEBUG nova.objects.instance [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Trying to apply a migration context that does not seem to be set for this instance {{(pid=73391) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Aug 15 05:35:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f4ecda8b-a211-4b8c-a7d0-3d26ee234fb3 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.099s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:47 user nova-compute[73391]: INFO nova.compute.manager [None req-854f7e21-1029-4f93-a69e-80d74ed5889b tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Unrescuing
Aug 15 05:35:47 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-854f7e21-1029-4f93-a69e-80d74ed5889b tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquiring lock "refresh_cache-6358e825-5705-45d6-86b6-3aacfa5a9bbb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:35:47 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-854f7e21-1029-4f93-a69e-80d74ed5889b tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquired lock "refresh_cache-6358e825-5705-45d6-86b6-3aacfa5a9bbb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:35:47 user nova-compute[73391]: DEBUG nova.network.neutron [None req-854f7e21-1029-4f93-a69e-80d74ed5889b tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:35:48 user nova-compute[73391]: DEBUG nova.network.neutron [None req-854f7e21-1029-4f93-a69e-80d74ed5889b tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Updating instance_info_cache with network_info: [{"id": "3b77e3e1-84f9-470a-b684-e8bdc4996c68", "address": "fa:16:3e:68:b6:f9", "network": {"id": "70d88082-aea7-48bb-abb4-d77d264aaf01", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b9acbe11654053bb905e7c92558a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b77e3e1-84", "ovs_interfaceid": "3b77e3e1-84f9-470a-b684-e8bdc4996c68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:35:48 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-854f7e21-1029-4f93-a69e-80d74ed5889b tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Releasing lock "refresh_cache-6358e825-5705-45d6-86b6-3aacfa5a9bbb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:35:48 user nova-compute[73391]: DEBUG nova.objects.instance [None req-854f7e21-1029-4f93-a69e-80d74ed5889b tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lazy-loading 'flavor' on Instance uuid 6358e825-5705-45d6-86b6-3aacfa5a9bbb {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:35:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:48 user nova-compute[73391]: DEBUG nova.compute.manager [req-23f10a8e-c1cb-4ff3-ad70-88816ba60915 req-9d98a756-2904-4b21-b189-c82316ae68a4 service nova] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Received event network-vif-unplugged-3b77e3e1-84f9-470a-b684-e8bdc4996c68 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:35:48 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-23f10a8e-c1cb-4ff3-ad70-88816ba60915 req-9d98a756-2904-4b21-b189-c82316ae68a4 service nova] Acquiring lock "6358e825-5705-45d6-86b6-3aacfa5a9bbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:48 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-23f10a8e-c1cb-4ff3-ad70-88816ba60915 req-9d98a756-2904-4b21-b189-c82316ae68a4 service nova] Lock "6358e825-5705-45d6-86b6-3aacfa5a9bbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:48 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-23f10a8e-c1cb-4ff3-ad70-88816ba60915 req-9d98a756-2904-4b21-b189-c82316ae68a4 service nova] Lock "6358e825-5705-45d6-86b6-3aacfa5a9bbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:48 user nova-compute[73391]: DEBUG nova.compute.manager [req-23f10a8e-c1cb-4ff3-ad70-88816ba60915 req-9d98a756-2904-4b21-b189-c82316ae68a4 service nova] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] No waiting events found dispatching network-vif-unplugged-3b77e3e1-84f9-470a-b684-e8bdc4996c68 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:35:48 user nova-compute[73391]: WARNING nova.compute.manager [req-23f10a8e-c1cb-4ff3-ad70-88816ba60915 req-9d98a756-2904-4b21-b189-c82316ae68a4 service nova] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Received unexpected event network-vif-unplugged-3b77e3e1-84f9-470a-b684-e8bdc4996c68 for instance with vm_state rescued and task_state unrescuing.
Aug 15 05:35:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:48 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Instance destroyed successfully.
Aug 15 05:35:49 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:50 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3b279e4d-7119-4bdf-981d-0fd87e74ff88 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Acquiring lock "3f88cd17-c89f-41f3-b630-8eb2c6698155" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:50 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3b279e4d-7119-4bdf-981d-0fd87e74ff88 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "3f88cd17-c89f-41f3-b630-8eb2c6698155" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:50 user nova-compute[73391]: INFO nova.compute.manager [None req-3b279e4d-7119-4bdf-981d-0fd87e74ff88 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Detaching volume de921de5-3166-4a82-9601-1a080b0e15d7
Aug 15 05:35:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:50 user nova-compute[73391]: INFO nova.virt.block_device [None req-3b279e4d-7119-4bdf-981d-0fd87e74ff88 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Attempting to driver detach volume de921de5-3166-4a82-9601-1a080b0e15d7 from mountpoint /dev/vdb
Aug 15 05:35:50 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3b279e4d-7119-4bdf-981d-0fd87e74ff88 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Attempting to detach device vdb from instance 3f88cd17-c89f-41f3-b630-8eb2c6698155 from the persistent domain config. {{(pid=73391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 05:35:50 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-3b279e4d-7119-4bdf-981d-0fd87e74ff88 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 05:35:50 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:35:50 user nova-compute[73391]:   <source dev="/dev/sdb"/>
Aug 15 05:35:50 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:35:50 user nova-compute[73391]:   <serial>de921de5-3166-4a82-9601-1a080b0e15d7</serial>
Aug 15 05:35:50 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 05:35:50 user nova-compute[73391]: </disk>
Aug 15 05:35:50 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 05:35:50 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-3b279e4d-7119-4bdf-981d-0fd87e74ff88 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Successfully detached device vdb from instance 3f88cd17-c89f-41f3-b630-8eb2c6698155 from the persistent domain config.
Aug 15 05:35:50 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3b279e4d-7119-4bdf-981d-0fd87e74ff88 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3f88cd17-c89f-41f3-b630-8eb2c6698155 from the live domain config. {{(pid=73391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 05:35:50 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-3b279e4d-7119-4bdf-981d-0fd87e74ff88 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 05:35:50 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:35:50 user nova-compute[73391]:   <source dev="/dev/sdb"/>
Aug 15 05:35:50 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:35:50 user nova-compute[73391]:   <serial>de921de5-3166-4a82-9601-1a080b0e15d7</serial>
Aug 15 05:35:50 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 05:35:50 user nova-compute[73391]: </disk>
Aug 15 05:35:50 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 05:35:50 user nova-compute[73391]: DEBUG nova.compute.manager [req-88454fd8-e21f-4dfe-bb21-1cfadf1977fb req-56d08518-1d41-4524-8440-3846b3f7ed58 service nova] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Received event network-vif-plugged-3b77e3e1-84f9-470a-b684-e8bdc4996c68 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:35:50 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-88454fd8-e21f-4dfe-bb21-1cfadf1977fb req-56d08518-1d41-4524-8440-3846b3f7ed58 service nova] Acquiring lock "6358e825-5705-45d6-86b6-3aacfa5a9bbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:50 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-88454fd8-e21f-4dfe-bb21-1cfadf1977fb req-56d08518-1d41-4524-8440-3846b3f7ed58 service nova] Lock "6358e825-5705-45d6-86b6-3aacfa5a9bbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:50 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-88454fd8-e21f-4dfe-bb21-1cfadf1977fb req-56d08518-1d41-4524-8440-3846b3f7ed58 service nova] Lock "6358e825-5705-45d6-86b6-3aacfa5a9bbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:50 user nova-compute[73391]: DEBUG nova.compute.manager [req-88454fd8-e21f-4dfe-bb21-1cfadf1977fb req-56d08518-1d41-4524-8440-3846b3f7ed58 service nova] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] No waiting events found dispatching network-vif-plugged-3b77e3e1-84f9-470a-b684-e8bdc4996c68 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:35:50 user nova-compute[73391]: WARNING nova.compute.manager [req-88454fd8-e21f-4dfe-bb21-1cfadf1977fb req-56d08518-1d41-4524-8440-3846b3f7ed58 service nova] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Received unexpected event network-vif-plugged-3b77e3e1-84f9-470a-b684-e8bdc4996c68 for instance with vm_state rescued and task_state unrescuing.
Aug 15 05:35:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:51 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Received event <DeviceRemovedEvent: 1692077751.1237903, 3f88cd17-c89f-41f3-b630-8eb2c6698155 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73391) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 05:35:51 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3b279e4d-7119-4bdf-981d-0fd87e74ff88 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3f88cd17-c89f-41f3-b630-8eb2c6698155 {{(pid=73391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 05:35:51 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-3b279e4d-7119-4bdf-981d-0fd87e74ff88 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Successfully detached device vdb from instance 3f88cd17-c89f-41f3-b630-8eb2c6698155 from the live domain config.
Aug 15 05:35:51 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b279e4d-7119-4bdf-981d-0fd87e74ff88 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 05:35:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b279e4d-7119-4bdf-981d-0fd87e74ff88 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cTFlYoKQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:35:51 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-3b279e4d-7119-4bdf-981d-0fd87e74ff88 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:35:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-3b279e4d-7119-4bdf-981d-0fd87e74ff88 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:35:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-3b279e4d-7119-4bdf-981d-0fd87e74ff88 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:35:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b279e4d-7119-4bdf-981d-0fd87e74ff88 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 05:35:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:51 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[91e37bbe-7842-4971-a186-76643630909c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:51 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1c7e1c-5317-47ed-9c62-c82f30206830]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b279e4d-7119-4bdf-981d-0fd87e74ff88 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:35:51 user nova-compute[73391]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7 (non-flash)
Aug 15 05:35:51 user nova-compute[73391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 (non-flash)
Aug 15 05:35:51 user nova-compute[73391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)
Aug 15 05:35:51 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:35:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b279e4d-7119-4bdf-981d-0fd87e74ff88 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:35:51 user nova-compute[73391]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7 (non-flash)
Aug 15 05:35:51 user nova-compute[73391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 (non-flash)
Aug 15 05:35:51 user nova-compute[73391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)
Aug 15 05:35:51 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:35:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b279e4d-7119-4bdf-981d-0fd87e74ff88 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f772848dab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7'): ({'sdb'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 05:35:51 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-3b279e4d-7119-4bdf-981d-0fd87e74ff88 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Removing single pathed devices sdb {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 05:35:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:51 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5acab8a-aa71-4596-b303-a4a743bfee4c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.029s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:51 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[59271d5b-1593-490f-a622-01c1fd04f19b]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:51 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-3b279e4d-7119-4bdf-981d-0fd87e74ff88 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Flushing IO for device /dev/sdb {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 05:35:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:51 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f77916e-2b21-4b31-aa84-8fc004fedd27]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:51 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-3b279e4d-7119-4bdf-981d-0fd87e74ff88 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 05:35:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Acquiring lock "8d344530-40f9-43f0-8417-15110c6c9748" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Lock "8d344530-40f9-43f0-8417-15110c6c9748" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:51 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6f9a6c-e691-4bad-9916-3ec8147cba50]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:51 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-3b279e4d-7119-4bdf-981d-0fd87e74ff88 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 05:35:51 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-3b279e4d-7119-4bdf-981d-0fd87e74ff88 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] SCSI volumes sdb have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 05:35:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b279e4d-7119-4bdf-981d-0fd87e74ff88 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 05:35:51 user nova-compute[73391]: DEBUG nova.compute.manager [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Starting instance... {{(pid=73391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 05:35:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:51 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9af43f7-0d43-4729-8fee-8ad19fa20ee4]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b279e4d-7119-4bdf-981d-0fd87e74ff88 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:35:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7 -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:51 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d162d6f2-82de-4f6e-8472-3f72b8060cc9]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b279e4d-7119-4bdf-981d-0fd87e74ff88 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7, portal: 172.16.0.220,3260]
Aug 15 05:35:51 user nova-compute[73391]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7, portal: 172.16.0.220,3260] successful.
Aug 15 05:35:51 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:35:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7 -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:51 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 05:35:51 user nova-compute[73391]: INFO nova.compute.claims [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Claim successful on node user
Aug 15 05:35:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:de921de5-3166-4a82-9601-1a080b0e15d7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:51 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[313500fc-ab5f-409a-8545-4097cadc7851]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b279e4d-7119-4bdf-981d-0fd87e74ff88 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:35:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-3b279e4d-7119-4bdf-981d-0fd87e74ff88 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.347s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:35:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b279e4d-7119-4bdf-981d-0fd87e74ff88 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] <== disconnect_volume: return (351ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:35:51 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b279e4d-7119-4bdf-981d-0fd87e74ff88 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 05:35:51 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Refreshing inventories for resource provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 05:35:51 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Updating ProviderTree inventory for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 05:35:51 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Updating inventory in ProviderTree for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 05:35:51 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Refreshing aggregate associations for resource provider 771708bd-6a2a-4e0c-9869-46d45e6b1896, aggregates: None {{(pid=73391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 05:35:51 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Refreshing trait associations for resource provider 771708bd-6a2a-4e0c-9869-46d45e6b1896, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=73391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 05:35:52 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:35:52 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:35:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.693s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:52 user nova-compute[73391]: DEBUG nova.compute.manager [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Start building networks asynchronously for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 05:35:52 user nova-compute[73391]: DEBUG nova.compute.manager [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Allocating IP information in the background. {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 05:35:52 user nova-compute[73391]: DEBUG nova.network.neutron [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] allocate_for_instance() {{(pid=73391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 05:35:52 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 05:35:52 user nova-compute[73391]: DEBUG nova.compute.manager [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Start building block device mappings for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 05:35:52 user nova-compute[73391]: INFO nova.virt.block_device [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Booting with volume cad2c281-e6fc-4384-8628-690691c13cd4 at /dev/vda
Aug 15 05:35:52 user nova-compute[73391]: DEBUG nova.policy [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4f1326da23e34dc29d4469645af81589', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a88327b042847d5b910c53bda19976b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73391) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 05:35:52 user nova-compute[73391]: DEBUG nova.objects.instance [None req-3b279e4d-7119-4bdf-981d-0fd87e74ff88 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lazy-loading 'flavor' on Instance uuid 3f88cd17-c89f-41f3-b630-8eb2c6698155 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:35:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3b279e4d-7119-4bdf-981d-0fd87e74ff88 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "3f88cd17-c89f-41f3-b630-8eb2c6698155" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.204s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:52 user nova-compute[73391]: DEBUG os_brick.utils [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:35:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:52 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[720e55c9-61d4-4a75-8c27-3fb0b066b588]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:52 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c2a54c-67be-4d58-875f-48eb24b51107]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:35:52 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0267e3b-ed02-4a77-8d91-7d461144bac3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:52 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b2b8fa0-ff1f-4076-9406-dd49f9d1f527]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:35:52 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 05:35:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:35:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:35:52 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 05:35:52 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26c748a-924b-4325-93cd-bfffac4ed734]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:35:52 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 05:35:52 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 05:35:52 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 05:35:52 user nova-compute[73391]: DEBUG os_brick.utils [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:35:52 user nova-compute[73391]: DEBUG nova.virt.block_device [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Updating existing volume attachment record: 69fbf65f-e17c-40b1-9075-e30c0e1fbe55 {{(pid=73391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 05:35:52 user nova-compute[73391]: DEBUG nova.compute.manager [req-f7fef19c-5e80-466e-990e-c2c75f618a23 req-9dbcd0f5-cc65-435f-84a2-1630699abd0b service nova] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Received event network-vif-plugged-3b77e3e1-84f9-470a-b684-e8bdc4996c68 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:35:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f7fef19c-5e80-466e-990e-c2c75f618a23 req-9dbcd0f5-cc65-435f-84a2-1630699abd0b service nova] Acquiring lock "6358e825-5705-45d6-86b6-3aacfa5a9bbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f7fef19c-5e80-466e-990e-c2c75f618a23 req-9dbcd0f5-cc65-435f-84a2-1630699abd0b service nova] Lock "6358e825-5705-45d6-86b6-3aacfa5a9bbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f7fef19c-5e80-466e-990e-c2c75f618a23 req-9dbcd0f5-cc65-435f-84a2-1630699abd0b service nova] Lock "6358e825-5705-45d6-86b6-3aacfa5a9bbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:52 user nova-compute[73391]: DEBUG nova.compute.manager [req-f7fef19c-5e80-466e-990e-c2c75f618a23 req-9dbcd0f5-cc65-435f-84a2-1630699abd0b service nova] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] No waiting events found dispatching network-vif-plugged-3b77e3e1-84f9-470a-b684-e8bdc4996c68 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:35:52 user nova-compute[73391]: WARNING nova.compute.manager [req-f7fef19c-5e80-466e-990e-c2c75f618a23 req-9dbcd0f5-cc65-435f-84a2-1630699abd0b service nova] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Received unexpected event network-vif-plugged-3b77e3e1-84f9-470a-b684-e8bdc4996c68 for instance with vm_state rescued and task_state unrescuing.
Aug 15 05:35:52 user nova-compute[73391]: DEBUG nova.compute.manager [req-f7fef19c-5e80-466e-990e-c2c75f618a23 req-9dbcd0f5-cc65-435f-84a2-1630699abd0b service nova] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Received event network-vif-plugged-3b77e3e1-84f9-470a-b684-e8bdc4996c68 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:35:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f7fef19c-5e80-466e-990e-c2c75f618a23 req-9dbcd0f5-cc65-435f-84a2-1630699abd0b service nova] Acquiring lock "6358e825-5705-45d6-86b6-3aacfa5a9bbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f7fef19c-5e80-466e-990e-c2c75f618a23 req-9dbcd0f5-cc65-435f-84a2-1630699abd0b service nova] Lock "6358e825-5705-45d6-86b6-3aacfa5a9bbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f7fef19c-5e80-466e-990e-c2c75f618a23 req-9dbcd0f5-cc65-435f-84a2-1630699abd0b service nova] Lock "6358e825-5705-45d6-86b6-3aacfa5a9bbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:52 user nova-compute[73391]: DEBUG nova.compute.manager [req-f7fef19c-5e80-466e-990e-c2c75f618a23 req-9dbcd0f5-cc65-435f-84a2-1630699abd0b service nova] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] No waiting events found dispatching network-vif-plugged-3b77e3e1-84f9-470a-b684-e8bdc4996c68 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:35:52 user nova-compute[73391]: WARNING nova.compute.manager [req-f7fef19c-5e80-466e-990e-c2c75f618a23 req-9dbcd0f5-cc65-435f-84a2-1630699abd0b service nova] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Received unexpected event network-vif-plugged-3b77e3e1-84f9-470a-b684-e8bdc4996c68 for instance with vm_state rescued and task_state unrescuing.
Aug 15 05:35:53 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Removed pending event for 6358e825-5705-45d6-86b6-3aacfa5a9bbb due to event {{(pid=73391) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 05:35:53 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077753.1987972, 6358e825-5705-45d6-86b6-3aacfa5a9bbb => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:35:53 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] VM Resumed (Lifecycle Event)
Aug 15 05:35:53 user nova-compute[73391]: DEBUG nova.compute.manager [None req-854f7e21-1029-4f93-a69e-80d74ed5889b tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:35:53 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:35:53 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:35:53 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 15 05:35:53 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077753.2058828, 6358e825-5705-45d6-86b6-3aacfa5a9bbb => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:35:53 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] VM Started (Lifecycle Event)
Aug 15 05:35:53 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:35:53 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:35:53 user nova-compute[73391]: DEBUG nova.network.neutron [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Successfully created port: 46454c88-9007-47b1-a199-b80afdf843f1 {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 05:35:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:54 user nova-compute[73391]: DEBUG nova.network.neutron [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Successfully updated port: 46454c88-9007-47b1-a199-b80afdf843f1 {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:35:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Acquiring lock "refresh_cache-8d344530-40f9-43f0-8417-15110c6c9748" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:35:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Acquired lock "refresh_cache-8d344530-40f9-43f0-8417-15110c6c9748" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:35:54 user nova-compute[73391]: DEBUG nova.network.neutron [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:35:54 user nova-compute[73391]: DEBUG nova.compute.manager [req-759b51ca-ce63-40fd-9b7d-7cb12a64680e req-069ada3e-88be-4353-bb68-8aa007801ec4 service nova] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Received event network-changed-46454c88-9007-47b1-a199-b80afdf843f1 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:35:54 user nova-compute[73391]: DEBUG nova.compute.manager [req-759b51ca-ce63-40fd-9b7d-7cb12a64680e req-069ada3e-88be-4353-bb68-8aa007801ec4 service nova] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Refreshing instance network info cache due to event network-changed-46454c88-9007-47b1-a199-b80afdf843f1. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:35:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-759b51ca-ce63-40fd-9b7d-7cb12a64680e req-069ada3e-88be-4353-bb68-8aa007801ec4 service nova] Acquiring lock "refresh_cache-8d344530-40f9-43f0-8417-15110c6c9748" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:35:54 user nova-compute[73391]: DEBUG nova.network.neutron [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:35:54 user nova-compute[73391]: DEBUG nova.network.neutron [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Updating instance_info_cache with network_info: [{"id": "46454c88-9007-47b1-a199-b80afdf843f1", "address": "fa:16:3e:d4:7c:d2", "network": {"id": "234a8df7-8eea-44bf-ae16-0840862765d4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1326637884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a88327b042847d5b910c53bda19976b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46454c88-90", "ovs_interfaceid": "46454c88-9007-47b1-a199-b80afdf843f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:35:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Releasing lock "refresh_cache-8d344530-40f9-43f0-8417-15110c6c9748" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:35:54 user nova-compute[73391]: DEBUG nova.compute.manager [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Instance network_info: |[{"id": "46454c88-9007-47b1-a199-b80afdf843f1", "address": "fa:16:3e:d4:7c:d2", "network": {"id": "234a8df7-8eea-44bf-ae16-0840862765d4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1326637884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a88327b042847d5b910c53bda19976b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46454c88-90", "ovs_interfaceid": "46454c88-9007-47b1-a199-b80afdf843f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 05:35:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-759b51ca-ce63-40fd-9b7d-7cb12a64680e req-069ada3e-88be-4353-bb68-8aa007801ec4 service nova] Acquired lock "refresh_cache-8d344530-40f9-43f0-8417-15110c6c9748" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:35:54 user nova-compute[73391]: DEBUG nova.network.neutron [req-759b51ca-ce63-40fd-9b7d-7cb12a64680e req-069ada3e-88be-4353-bb68-8aa007801ec4 service nova] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Refreshing network info cache for port 46454c88-9007-47b1-a199-b80afdf843f1 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:35:55 user nova-compute[73391]: DEBUG nova.network.neutron [req-759b51ca-ce63-40fd-9b7d-7cb12a64680e req-069ada3e-88be-4353-bb68-8aa007801ec4 service nova] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Updated VIF entry in instance network info cache for port 46454c88-9007-47b1-a199-b80afdf843f1. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:35:55 user nova-compute[73391]: DEBUG nova.network.neutron [req-759b51ca-ce63-40fd-9b7d-7cb12a64680e req-069ada3e-88be-4353-bb68-8aa007801ec4 service nova] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Updating instance_info_cache with network_info: [{"id": "46454c88-9007-47b1-a199-b80afdf843f1", "address": "fa:16:3e:d4:7c:d2", "network": {"id": "234a8df7-8eea-44bf-ae16-0840862765d4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1326637884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a88327b042847d5b910c53bda19976b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46454c88-90", "ovs_interfaceid": "46454c88-9007-47b1-a199-b80afdf843f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:35:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-759b51ca-ce63-40fd-9b7d-7cb12a64680e req-069ada3e-88be-4353-bb68-8aa007801ec4 service nova] Releasing lock "refresh_cache-8d344530-40f9-43f0-8417-15110c6c9748" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:35:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c482dd94-3c28-4d66-9bb0-7489cbbd6416 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Acquiring lock "4b9f5970-65c5-4eff-a4bf-d18a9c916c90" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c482dd94-3c28-4d66-9bb0-7489cbbd6416 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Lock "4b9f5970-65c5-4eff-a4bf-d18a9c916c90" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c482dd94-3c28-4d66-9bb0-7489cbbd6416 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Acquiring lock "4b9f5970-65c5-4eff-a4bf-d18a9c916c90-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c482dd94-3c28-4d66-9bb0-7489cbbd6416 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Lock "4b9f5970-65c5-4eff-a4bf-d18a9c916c90-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c482dd94-3c28-4d66-9bb0-7489cbbd6416 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Lock "4b9f5970-65c5-4eff-a4bf-d18a9c916c90-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:56 user nova-compute[73391]: INFO nova.compute.manager [None req-c482dd94-3c28-4d66-9bb0-7489cbbd6416 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Terminating instance
Aug 15 05:35:56 user nova-compute[73391]: DEBUG nova.compute.manager [None req-c482dd94-3c28-4d66-9bb0-7489cbbd6416 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Start destroying the instance on the hypervisor. {{(pid=73391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 05:35:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:56 user nova-compute[73391]: DEBUG nova.compute.manager [req-94f3eb34-f2bf-4718-bc81-14d36487b20a req-068fe656-6fd0-44b9-b20f-0fdb66435cda service nova] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Received event network-vif-unplugged-a5f1c5ab-e060-450e-82ee-aa1e4b0ee019 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:35:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-94f3eb34-f2bf-4718-bc81-14d36487b20a req-068fe656-6fd0-44b9-b20f-0fdb66435cda service nova] Acquiring lock "4b9f5970-65c5-4eff-a4bf-d18a9c916c90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-94f3eb34-f2bf-4718-bc81-14d36487b20a req-068fe656-6fd0-44b9-b20f-0fdb66435cda service nova] Lock "4b9f5970-65c5-4eff-a4bf-d18a9c916c90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-94f3eb34-f2bf-4718-bc81-14d36487b20a req-068fe656-6fd0-44b9-b20f-0fdb66435cda service nova] Lock "4b9f5970-65c5-4eff-a4bf-d18a9c916c90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:56 user nova-compute[73391]: DEBUG nova.compute.manager [req-94f3eb34-f2bf-4718-bc81-14d36487b20a req-068fe656-6fd0-44b9-b20f-0fdb66435cda service nova] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] No waiting events found dispatching network-vif-unplugged-a5f1c5ab-e060-450e-82ee-aa1e4b0ee019 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:35:56 user nova-compute[73391]: DEBUG nova.compute.manager [req-94f3eb34-f2bf-4718-bc81-14d36487b20a req-068fe656-6fd0-44b9-b20f-0fdb66435cda service nova] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Received event network-vif-unplugged-a5f1c5ab-e060-450e-82ee-aa1e4b0ee019 for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 05:35:57 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Instance destroyed successfully.
Aug 15 05:35:57 user nova-compute[73391]: DEBUG nova.objects.instance [None req-c482dd94-3c28-4d66-9bb0-7489cbbd6416 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Lazy-loading 'resources' on Instance uuid 4b9f5970-65c5-4eff-a4bf-d18a9c916c90 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:35:57 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-c482dd94-3c28-4d66-9bb0-7489cbbd6416 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:29:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-970370290',display_name='tempest-VolumesAdminNegativeTest-server-970370290',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-970370290',id=5,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFoiRjTcSXoXGPSXt2dEaJ1TUHvJ1iPvsuzQhjrsR1YOhdaQJiulCl/8vOJk0v7OZvBwniIpJfz7axQVLkiI5SNTmVeph0GnKHTfvZs+VtUlSTdMOXW7raJqYhasrmIz3Q==',key_name='tempest-keypair-1763529189',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:29:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d2058584e624e869bf316e4cee4d669',ramdisk_id='',reservation_id='r-lsi795rg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1183783318',owner_user_name='tempest-VolumesAdminNegativeTest-1183783318-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:29:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1ec3b8ac7ed748b49325a372f164f931',uuid=4b9f5970-65c5-4eff-a4bf-d18a9c916c90,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a5f1c5ab-e060-450e-82ee-aa1e4b0ee019", "address": "fa:16:3e:11:2e:cb", "network": {"id": "f69631d8-9da0-4c6d-8530-e8c455942703", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-108520740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d2058584e624e869bf316e4cee4d669", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f1c5ab-e0", "ovs_interfaceid": "a5f1c5ab-e060-450e-82ee-aa1e4b0ee019", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:35:57 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-c482dd94-3c28-4d66-9bb0-7489cbbd6416 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Converting VIF {"id": "a5f1c5ab-e060-450e-82ee-aa1e4b0ee019", "address": "fa:16:3e:11:2e:cb", "network": {"id": "f69631d8-9da0-4c6d-8530-e8c455942703", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-108520740-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.144", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d2058584e624e869bf316e4cee4d669", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5f1c5ab-e0", "ovs_interfaceid": "a5f1c5ab-e060-450e-82ee-aa1e4b0ee019", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:35:57 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-c482dd94-3c28-4d66-9bb0-7489cbbd6416 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:11:2e:cb,bridge_name='br-int',has_traffic_filtering=True,id=a5f1c5ab-e060-450e-82ee-aa1e4b0ee019,network=Network(f69631d8-9da0-4c6d-8530-e8c455942703),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5f1c5ab-e0') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:35:57 user nova-compute[73391]: DEBUG os_vif [None req-c482dd94-3c28-4d66-9bb0-7489cbbd6416 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:2e:cb,bridge_name='br-int',has_traffic_filtering=True,id=a5f1c5ab-e060-450e-82ee-aa1e4b0ee019,network=Network(f69631d8-9da0-4c6d-8530-e8c455942703),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5f1c5ab-e0') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:35:57 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:57 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa5f1c5ab-e0, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:35:57 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:57 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:35:57 user nova-compute[73391]: INFO os_vif [None req-c482dd94-3c28-4d66-9bb0-7489cbbd6416 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:11:2e:cb,bridge_name='br-int',has_traffic_filtering=True,id=a5f1c5ab-e060-450e-82ee-aa1e4b0ee019,network=Network(f69631d8-9da0-4c6d-8530-e8c455942703),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5f1c5ab-e0')
Aug 15 05:35:57 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-c482dd94-3c28-4d66-9bb0-7489cbbd6416 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Deleting instance files /opt/stack/data/nova/instances/4b9f5970-65c5-4eff-a4bf-d18a9c916c90_del
Aug 15 05:35:57 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-c482dd94-3c28-4d66-9bb0-7489cbbd6416 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Deletion of /opt/stack/data/nova/instances/4b9f5970-65c5-4eff-a4bf-d18a9c916c90_del complete
Aug 15 05:35:57 user nova-compute[73391]: INFO nova.compute.manager [None req-c482dd94-3c28-4d66-9bb0-7489cbbd6416 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 15 05:35:57 user nova-compute[73391]: DEBUG oslo.service.loopingcall [None req-c482dd94-3c28-4d66-9bb0-7489cbbd6416 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 05:35:57 user nova-compute[73391]: DEBUG nova.compute.manager [-] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Deallocating network for instance {{(pid=73391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 05:35:57 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] deallocate_for_instance() {{(pid=73391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 05:35:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-15fb863b-6524-4376-9ef3-98d02fc58160 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Acquiring lock "18c8138a-4efc-403f-8b42-e5080c6a51d3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-15fb863b-6524-4376-9ef3-98d02fc58160 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "18c8138a-4efc-403f-8b42-e5080c6a51d3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.005s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-15fb863b-6524-4376-9ef3-98d02fc58160 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Acquiring lock "18c8138a-4efc-403f-8b42-e5080c6a51d3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-15fb863b-6524-4376-9ef3-98d02fc58160 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "18c8138a-4efc-403f-8b42-e5080c6a51d3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.005s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-15fb863b-6524-4376-9ef3-98d02fc58160 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "18c8138a-4efc-403f-8b42-e5080c6a51d3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:58 user nova-compute[73391]: INFO nova.compute.manager [None req-15fb863b-6524-4376-9ef3-98d02fc58160 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Terminating instance
Aug 15 05:35:58 user nova-compute[73391]: DEBUG nova.compute.manager [None req-15fb863b-6524-4376-9ef3-98d02fc58160 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Start destroying the instance on the hypervisor. {{(pid=73391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 05:35:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:58 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:35:58 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Took 1.43 seconds to deallocate network for instance.
Aug 15 05:35:58 user nova-compute[73391]: DEBUG nova.compute.manager [req-25786f55-be00-4c80-95ca-22ba20e2a729 req-15466c0c-d08c-415c-9a04-3beb342e0193 service nova] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Received event network-vif-plugged-a5f1c5ab-e060-450e-82ee-aa1e4b0ee019 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:35:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-25786f55-be00-4c80-95ca-22ba20e2a729 req-15466c0c-d08c-415c-9a04-3beb342e0193 service nova] Acquiring lock "4b9f5970-65c5-4eff-a4bf-d18a9c916c90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-25786f55-be00-4c80-95ca-22ba20e2a729 req-15466c0c-d08c-415c-9a04-3beb342e0193 service nova] Lock "4b9f5970-65c5-4eff-a4bf-d18a9c916c90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-25786f55-be00-4c80-95ca-22ba20e2a729 req-15466c0c-d08c-415c-9a04-3beb342e0193 service nova] Lock "4b9f5970-65c5-4eff-a4bf-d18a9c916c90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:58 user nova-compute[73391]: DEBUG nova.compute.manager [req-25786f55-be00-4c80-95ca-22ba20e2a729 req-15466c0c-d08c-415c-9a04-3beb342e0193 service nova] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] No waiting events found dispatching network-vif-plugged-a5f1c5ab-e060-450e-82ee-aa1e4b0ee019 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:35:58 user nova-compute[73391]: WARNING nova.compute.manager [req-25786f55-be00-4c80-95ca-22ba20e2a729 req-15466c0c-d08c-415c-9a04-3beb342e0193 service nova] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Received unexpected event network-vif-plugged-a5f1c5ab-e060-450e-82ee-aa1e4b0ee019 for instance with vm_state active and task_state deleting.
Aug 15 05:35:58 user nova-compute[73391]: DEBUG nova.compute.manager [req-25786f55-be00-4c80-95ca-22ba20e2a729 req-15466c0c-d08c-415c-9a04-3beb342e0193 service nova] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Received event network-vif-deleted-a5f1c5ab-e060-450e-82ee-aa1e4b0ee019 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:35:58 user nova-compute[73391]: INFO nova.compute.manager [req-25786f55-be00-4c80-95ca-22ba20e2a729 req-15466c0c-d08c-415c-9a04-3beb342e0193 service nova] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Neutron deleted interface a5f1c5ab-e060-450e-82ee-aa1e4b0ee019; detaching it from the instance and deleting it from the info cache
Aug 15 05:35:58 user nova-compute[73391]: DEBUG nova.network.neutron [req-25786f55-be00-4c80-95ca-22ba20e2a729 req-15466c0c-d08c-415c-9a04-3beb342e0193 service nova] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:35:58 user nova-compute[73391]: DEBUG nova.compute.manager [req-25786f55-be00-4c80-95ca-22ba20e2a729 req-15466c0c-d08c-415c-9a04-3beb342e0193 service nova] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Detach interface failed, port_id=a5f1c5ab-e060-450e-82ee-aa1e4b0ee019, reason: Instance 4b9f5970-65c5-4eff-a4bf-d18a9c916c90 could not be found. {{(pid=73391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 05:35:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c482dd94-3c28-4d66-9bb0-7489cbbd6416 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:35:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c482dd94-3c28-4d66-9bb0-7489cbbd6416 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:35:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:59 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Instance destroyed successfully.
Aug 15 05:35:59 user nova-compute[73391]: DEBUG nova.objects.instance [None req-15fb863b-6524-4376-9ef3-98d02fc58160 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lazy-loading 'resources' on Instance uuid 18c8138a-4efc-403f-8b42-e5080c6a51d3 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:35:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-15fb863b-6524-4376-9ef3-98d02fc58160 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T05:29:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1277477436',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1277477436',id=4,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+vdfT2KUhLvPzx3dX+PrdTohkqxawdWMutgX8a450R3MvuBVzacV3c2EJESUdzVmjzs1fL7ALVh4jlwXHV/wX8tRMRsuEAx2ENCOBZxjSP5MZ2JRhfupI25RQTizDxiw==',key_name='tempest-keypair-700723771',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:33:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88871d09f7e347a4b9104a558604f2f6',ramdisk_id='',reservation_id='r-j1g463qr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1774553789',owner_user_name='tempest-AttachVolumeShelveTestJSON-1774553789-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:33:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c932032fc884b14b9268d5df91d45ea',uuid=18c8138a-4efc-403f-8b42-e5080c6a51d3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bf92cfab-6648-42bd-b9f0-2a6f38562165", "address": "fa:16:3e:ba:49:5f", "network": {"id": "f67152a9-4f18-4d7f-9d3e-5e517bd46813", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-731866550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88871d09f7e347a4b9104a558604f2f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf92cfab-66", "ovs_interfaceid": "bf92cfab-6648-42bd-b9f0-2a6f38562165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:35:59 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-15fb863b-6524-4376-9ef3-98d02fc58160 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Converting VIF {"id": "bf92cfab-6648-42bd-b9f0-2a6f38562165", "address": "fa:16:3e:ba:49:5f", "network": {"id": "f67152a9-4f18-4d7f-9d3e-5e517bd46813", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-731866550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88871d09f7e347a4b9104a558604f2f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbf92cfab-66", "ovs_interfaceid": "bf92cfab-6648-42bd-b9f0-2a6f38562165", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:35:59 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-15fb863b-6524-4376-9ef3-98d02fc58160 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:49:5f,bridge_name='br-int',has_traffic_filtering=True,id=bf92cfab-6648-42bd-b9f0-2a6f38562165,network=Network(f67152a9-4f18-4d7f-9d3e-5e517bd46813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf92cfab-66') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:35:59 user nova-compute[73391]: DEBUG os_vif [None req-15fb863b-6524-4376-9ef3-98d02fc58160 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:49:5f,bridge_name='br-int',has_traffic_filtering=True,id=bf92cfab-6648-42bd-b9f0-2a6f38562165,network=Network(f67152a9-4f18-4d7f-9d3e-5e517bd46813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf92cfab-66') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:35:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbf92cfab-66, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:35:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:35:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:35:59 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-c482dd94-3c28-4d66-9bb0-7489cbbd6416 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:35:59 user nova-compute[73391]: INFO os_vif [None req-15fb863b-6524-4376-9ef3-98d02fc58160 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:49:5f,bridge_name='br-int',has_traffic_filtering=True,id=bf92cfab-6648-42bd-b9f0-2a6f38562165,network=Network(f67152a9-4f18-4d7f-9d3e-5e517bd46813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbf92cfab-66')
Aug 15 05:35:59 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-15fb863b-6524-4376-9ef3-98d02fc58160 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Deleting instance files /opt/stack/data/nova/instances/18c8138a-4efc-403f-8b42-e5080c6a51d3_del
Aug 15 05:35:59 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-15fb863b-6524-4376-9ef3-98d02fc58160 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Deletion of /opt/stack/data/nova/instances/18c8138a-4efc-403f-8b42-e5080c6a51d3_del complete
Aug 15 05:35:59 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-c482dd94-3c28-4d66-9bb0-7489cbbd6416 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:35:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c482dd94-3c28-4d66-9bb0-7489cbbd6416 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.676s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:35:59 user nova-compute[73391]: INFO nova.compute.manager [None req-15fb863b-6524-4376-9ef3-98d02fc58160 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Took 1.27 seconds to destroy the instance on the hypervisor.
Aug 15 05:35:59 user nova-compute[73391]: DEBUG oslo.service.loopingcall [None req-15fb863b-6524-4376-9ef3-98d02fc58160 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 05:35:59 user nova-compute[73391]: DEBUG nova.compute.manager [-] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Deallocating network for instance {{(pid=73391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 05:35:59 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] deallocate_for_instance() {{(pid=73391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 05:35:59 user nova-compute[73391]: INFO nova.scheduler.client.report [None req-c482dd94-3c28-4d66-9bb0-7489cbbd6416 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Deleted allocations for instance 4b9f5970-65c5-4eff-a4bf-d18a9c916c90
Aug 15 05:35:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c482dd94-3c28-4d66-9bb0-7489cbbd6416 tempest-VolumesAdminNegativeTest-1183783318 tempest-VolumesAdminNegativeTest-1183783318-project-member] Lock "4b9f5970-65c5-4eff-a4bf-d18a9c916c90" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.476s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:36:00 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:36:00 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Took 1.01 seconds to deallocate network for instance.
Aug 15 05:36:00 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-15fb863b-6524-4376-9ef3-98d02fc58160 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:36:00 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-15fb863b-6524-4376-9ef3-98d02fc58160 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:36:00 user nova-compute[73391]: DEBUG nova.compute.manager [req-942a2f08-b285-404b-8e9f-2c70ec001c9e req-a37a34f5-081d-4534-a763-bd6fabf2b8fb service nova] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Received event network-vif-unplugged-bf92cfab-6648-42bd-b9f0-2a6f38562165 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:36:00 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-942a2f08-b285-404b-8e9f-2c70ec001c9e req-a37a34f5-081d-4534-a763-bd6fabf2b8fb service nova] Acquiring lock "18c8138a-4efc-403f-8b42-e5080c6a51d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:36:00 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-942a2f08-b285-404b-8e9f-2c70ec001c9e req-a37a34f5-081d-4534-a763-bd6fabf2b8fb service nova] Lock "18c8138a-4efc-403f-8b42-e5080c6a51d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:36:00 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-942a2f08-b285-404b-8e9f-2c70ec001c9e req-a37a34f5-081d-4534-a763-bd6fabf2b8fb service nova] Lock "18c8138a-4efc-403f-8b42-e5080c6a51d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:36:00 user nova-compute[73391]: DEBUG nova.compute.manager [req-942a2f08-b285-404b-8e9f-2c70ec001c9e req-a37a34f5-081d-4534-a763-bd6fabf2b8fb service nova] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] No waiting events found dispatching network-vif-unplugged-bf92cfab-6648-42bd-b9f0-2a6f38562165 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:36:00 user nova-compute[73391]: WARNING nova.compute.manager [req-942a2f08-b285-404b-8e9f-2c70ec001c9e req-a37a34f5-081d-4534-a763-bd6fabf2b8fb service nova] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Received unexpected event network-vif-unplugged-bf92cfab-6648-42bd-b9f0-2a6f38562165 for instance with vm_state deleted and task_state None.
Aug 15 05:36:00 user nova-compute[73391]: DEBUG nova.compute.manager [req-942a2f08-b285-404b-8e9f-2c70ec001c9e req-a37a34f5-081d-4534-a763-bd6fabf2b8fb service nova] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Received event network-vif-plugged-bf92cfab-6648-42bd-b9f0-2a6f38562165 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:36:00 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-942a2f08-b285-404b-8e9f-2c70ec001c9e req-a37a34f5-081d-4534-a763-bd6fabf2b8fb service nova] Acquiring lock "18c8138a-4efc-403f-8b42-e5080c6a51d3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:36:00 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-942a2f08-b285-404b-8e9f-2c70ec001c9e req-a37a34f5-081d-4534-a763-bd6fabf2b8fb service nova] Lock "18c8138a-4efc-403f-8b42-e5080c6a51d3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:36:00 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-942a2f08-b285-404b-8e9f-2c70ec001c9e req-a37a34f5-081d-4534-a763-bd6fabf2b8fb service nova] Lock "18c8138a-4efc-403f-8b42-e5080c6a51d3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:36:00 user nova-compute[73391]: DEBUG nova.compute.manager [req-942a2f08-b285-404b-8e9f-2c70ec001c9e req-a37a34f5-081d-4534-a763-bd6fabf2b8fb service nova] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] No waiting events found dispatching network-vif-plugged-bf92cfab-6648-42bd-b9f0-2a6f38562165 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:36:00 user nova-compute[73391]: WARNING nova.compute.manager [req-942a2f08-b285-404b-8e9f-2c70ec001c9e req-a37a34f5-081d-4534-a763-bd6fabf2b8fb service nova] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Received unexpected event network-vif-plugged-bf92cfab-6648-42bd-b9f0-2a6f38562165 for instance with vm_state deleted and task_state None.
Aug 15 05:36:00 user nova-compute[73391]: DEBUG nova.compute.manager [req-942a2f08-b285-404b-8e9f-2c70ec001c9e req-a37a34f5-081d-4534-a763-bd6fabf2b8fb service nova] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Received event network-vif-deleted-bf92cfab-6648-42bd-b9f0-2a6f38562165 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:36:01 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-15fb863b-6524-4376-9ef3-98d02fc58160 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:36:01 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-15fb863b-6524-4376-9ef3-98d02fc58160 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:36:01 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-15fb863b-6524-4376-9ef3-98d02fc58160 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.405s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:36:01 user nova-compute[73391]: INFO nova.scheduler.client.report [None req-15fb863b-6524-4376-9ef3-98d02fc58160 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Deleted allocations for instance 18c8138a-4efc-403f-8b42-e5080c6a51d3
Aug 15 05:36:01 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-15fb863b-6524-4376-9ef3-98d02fc58160 tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "18c8138a-4efc-403f-8b42-e5080c6a51d3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.905s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:36:02 user nova-compute[73391]: DEBUG nova.compute.manager [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Start spawning the instance on the hypervisor. {{(pid=73391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 05:36:02 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Creating instance directory {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 05:36:02 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Creating image(s)
Aug 15 05:36:02 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Did not create local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 05:36:02 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Ensure instance console log exists: /opt/stack/data/nova/instances/8d344530-40f9-43f0-8417-15110c6c9748/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 05:36:02 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:36:02 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:36:02 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:36:02 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Start _get_guest_xml network_info=[{"id": "46454c88-9007-47b1-a199-b80afdf843f1", "address": "fa:16:3e:d4:7c:d2", "network": {"id": "234a8df7-8eea-44bf-ae16-0840862765d4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1326637884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a88327b042847d5b910c53bda19976b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46454c88-90", "ovs_interfaceid": "46454c88-9007-47b1-a199-b80afdf843f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MscvTUKS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8d344530-40f9-43f0-8417-15110c6c9748', 'attached_at': '', 'detached_at': '', 'volume_id': 'cad2c281-e6fc-4384-8628-690691c13cd4', 'serial': 'cad2c281-e6fc-4384-8628-690691c13cd4'}, 'attachment_id': '69fbf65f-e17c-40b1-9075-e30c0e1fbe55', 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'volume_type': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:36:02 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:36:02 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:36:02 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:36:02 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:36:02 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:36:02 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:36:02 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:36:02 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:36:02 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:36:02 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:36:02 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:36:02 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:36:02 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:36:02 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:36:02 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:36:02 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:36:02 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:36:02 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:36:02 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 05:36:02 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MscvTUKS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:36:02 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:36:02 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:36:02 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:36:02 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:36:02 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:36:02 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:36:02 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 05:36:02 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:02 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:02 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da9a63e-61d9-43d9-b41e-70110ba82b33]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:02 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 05:36:02 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:36:02 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:02 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:02 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[27450622-35c1-4eaa-aa77-c98790e53df7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:02 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4] added
Aug 15 05:36:02 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:36:02 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:02 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:02 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f0e479-acb5-4341-8809-7220a26d07aa]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:02 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:36:02 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:02 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:02 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39b1b55-11e1-47da-b9d0-906e2a369564]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:02 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:36:02 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MscvTUKS {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:02 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MscvTUKS" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:02 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4653cea-7e09-48f3-b491-ab7608153f9a]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:02 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MscvTUKS'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:36:02 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:02 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:02 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6209b2f-df13-484c-9903-6a39a18ed28f]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:02 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:36:02 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:02 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:02 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[12327b12-f4c6-43cc-90ca-f571c0470b80]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:02 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:36:02 user nova-compute[73391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 (non-flash)
Aug 15 05:36:02 user nova-compute[73391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)
Aug 15 05:36:02 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:36:02 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:36:02 user nova-compute[73391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 (non-flash)
Aug 15 05:36:02 user nova-compute[73391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)
Aug 15 05:36:02 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:36:02 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:03 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[208d8d94-ee7f-4538-8903-18244fb45173]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:03 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4, portal: 172.16.0.220,3260]
Aug 15 05:36:03 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4, portal: 172.16.0.220,3260] successful.
Aug 15 05:36:03 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:36:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:03 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2043bffc-aa71-4894-bf7d-e6a129025c64]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:03 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:36:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:03 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a03d18e5-1f18-4497-9263-61b462ad6d3d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:03 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:36:03 user nova-compute[73391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 (non-flash)
Aug 15 05:36:03 user nova-compute[73391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)
Aug 15 05:36:03 user nova-compute[73391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)
Aug 15 05:36:03 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:36:03 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:36:03 user nova-compute[73391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 (non-flash)
Aug 15 05:36:03 user nova-compute[73391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)
Aug 15 05:36:03 user nova-compute[73391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)
Aug 15 05:36:03 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:36:03 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:36:03 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 05:36:03 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] HCTL ('33', '-', '-', 0) found on session 23 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 05:36:03 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 05:36:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.024s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:03 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4004c9-7498-490d-a6ec-fc7d907bf656]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:03 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:36:03 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MscvTUKS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 05:36:04 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:36:04 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23864343862383734', 'path': '/dev/sdb'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:36:04 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864343862383734', 'path': '/dev/sdb'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 05:36:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:36:04 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:35:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1421040367',display_name='tempest-TestShelveInstance-server-1421040367',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1421040367',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjqGEVcAW2Uflq9MaJWAWTPNQuXGUc1NNjM/VUaxwHQAEIj+9ZU31fFYi9+U/4OgXkXULYekTILGFB+ZF6Vju2o5J0ZWcZ4A8I3Iq/WxIc0yOp+wikspXmyImZ32D3lTA==',key_name='tempest-TestShelveInstance-1898835883',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a88327b042847d5b910c53bda19976b',ramdisk_id='',reservation_id='r-092d88cq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1216370790',owner_user_name='tempest-TestShelveInstance-1216370790-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:35:52Z,user_data=None,user_id='4f1326da23e34dc29d4469645af81589',uuid=8d344530-40f9-43f0-8417-15110c6c9748,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46454c88-9007-47b1-a199-b80afdf843f1", "address": "fa:16:3e:d4:7c:d2", "network": {"id": "234a8df7-8eea-44bf-ae16-0840862765d4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1326637884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a88327b042847d5b910c53bda19976b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46454c88-90", "ovs_interfaceid": "46454c88-9007-47b1-a199-b80afdf843f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:36:04 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Converting VIF {"id": "46454c88-9007-47b1-a199-b80afdf843f1", "address": "fa:16:3e:d4:7c:d2", "network": {"id": "234a8df7-8eea-44bf-ae16-0840862765d4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1326637884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a88327b042847d5b910c53bda19976b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46454c88-90", "ovs_interfaceid": "46454c88-9007-47b1-a199-b80afdf843f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:36:04 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:7c:d2,bridge_name='br-int',has_traffic_filtering=True,id=46454c88-9007-47b1-a199-b80afdf843f1,network=Network(234a8df7-8eea-44bf-ae16-0840862765d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46454c88-90') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:36:04 user nova-compute[73391]: DEBUG nova.objects.instance [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d344530-40f9-43f0-8417-15110c6c9748 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:36:04 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:36:04 user nova-compute[73391]:   <uuid>8d344530-40f9-43f0-8417-15110c6c9748</uuid>
Aug 15 05:36:04 user nova-compute[73391]:   <name>instance-00000015</name>
Aug 15 05:36:04 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:36:04 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:36:04 user nova-compute[73391]:   <metadata>
Aug 15 05:36:04 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:36:04 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:36:04 user nova-compute[73391]:       <nova:name>tempest-TestShelveInstance-server-1421040367</nova:name>
Aug 15 05:36:04 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:36:02</nova:creationTime>
Aug 15 05:36:04 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:36:04 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:36:04 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:36:04 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:36:04 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:36:04 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:36:04 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:36:04 user nova-compute[73391]:       <nova:owner>
Aug 15 05:36:04 user nova-compute[73391]:         <nova:user uuid="4f1326da23e34dc29d4469645af81589">tempest-TestShelveInstance-1216370790-project-member</nova:user>
Aug 15 05:36:04 user nova-compute[73391]:         <nova:project uuid="8a88327b042847d5b910c53bda19976b">tempest-TestShelveInstance-1216370790</nova:project>
Aug 15 05:36:04 user nova-compute[73391]:       </nova:owner>
Aug 15 05:36:04 user nova-compute[73391]:       <nova:ports>
Aug 15 05:36:04 user nova-compute[73391]:         <nova:port uuid="46454c88-9007-47b1-a199-b80afdf843f1">
Aug 15 05:36:04 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 05:36:04 user nova-compute[73391]:         </nova:port>
Aug 15 05:36:04 user nova-compute[73391]:       </nova:ports>
Aug 15 05:36:04 user nova-compute[73391]:     </nova:instance>
Aug 15 05:36:04 user nova-compute[73391]:   </metadata>
Aug 15 05:36:04 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:36:04 user nova-compute[73391]:     <system>
Aug 15 05:36:04 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:36:04 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:36:04 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:36:04 user nova-compute[73391]:       <entry name="serial">8d344530-40f9-43f0-8417-15110c6c9748</entry>
Aug 15 05:36:04 user nova-compute[73391]:       <entry name="uuid">8d344530-40f9-43f0-8417-15110c6c9748</entry>
Aug 15 05:36:04 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:36:04 user nova-compute[73391]:     </system>
Aug 15 05:36:04 user nova-compute[73391]:   </sysinfo>
Aug 15 05:36:04 user nova-compute[73391]:   <os>
Aug 15 05:36:04 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:36:04 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:36:04 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:36:04 user nova-compute[73391]:   </os>
Aug 15 05:36:04 user nova-compute[73391]:   <features>
Aug 15 05:36:04 user nova-compute[73391]:     <acpi/>
Aug 15 05:36:04 user nova-compute[73391]:     <apic/>
Aug 15 05:36:04 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:36:04 user nova-compute[73391]:   </features>
Aug 15 05:36:04 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:36:04 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:36:04 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:36:04 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:36:04 user nova-compute[73391]:   </clock>
Aug 15 05:36:04 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:36:04 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:36:04 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:36:04 user nova-compute[73391]:   </cpu>
Aug 15 05:36:04 user nova-compute[73391]:   <devices>
Aug 15 05:36:04 user nova-compute[73391]:     <disk type="block" device="disk">
Aug 15 05:36:04 user nova-compute[73391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:36:04 user nova-compute[73391]:       <source dev="/dev/sdb"/>
Aug 15 05:36:04 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:36:04 user nova-compute[73391]:       <serial>cad2c281-e6fc-4384-8628-690691c13cd4</serial>
Aug 15 05:36:04 user nova-compute[73391]:     </disk>
Aug 15 05:36:04 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:36:04 user nova-compute[73391]:       <mac address="fa:16:3e:d4:7c:d2"/>
Aug 15 05:36:04 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:36:04 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:36:04 user nova-compute[73391]:       <target dev="tap46454c88-90"/>
Aug 15 05:36:04 user nova-compute[73391]:     </interface>
Aug 15 05:36:04 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:36:04 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/8d344530-40f9-43f0-8417-15110c6c9748/console.log" append="off"/>
Aug 15 05:36:04 user nova-compute[73391]:     </serial>
Aug 15 05:36:04 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:36:04 user nova-compute[73391]:     <video>
Aug 15 05:36:04 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:36:04 user nova-compute[73391]:     </video>
Aug 15 05:36:04 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:36:04 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:36:04 user nova-compute[73391]:     </rng>
Aug 15 05:36:04 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:36:04 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:36:04 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:36:04 user nova-compute[73391]:     </memballoon>
Aug 15 05:36:04 user nova-compute[73391]:   </devices>
Aug 15 05:36:04 user nova-compute[73391]: </domain>
Aug 15 05:36:04 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:36:04 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:35:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1421040367',display_name='tempest-TestShelveInstance-server-1421040367',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1421040367',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjqGEVcAW2Uflq9MaJWAWTPNQuXGUc1NNjM/VUaxwHQAEIj+9ZU31fFYi9+U/4OgXkXULYekTILGFB+ZF6Vju2o5J0ZWcZ4A8I3Iq/WxIc0yOp+wikspXmyImZ32D3lTA==',key_name='tempest-TestShelveInstance-1898835883',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a88327b042847d5b910c53bda19976b',ramdisk_id='',reservation_id='r-092d88cq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1216370790',owner_user_name='tempest-TestShelveInstance-1216370790-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:35:52Z,user_data=None,user_id='4f1326da23e34dc29d4469645af81589',uuid=8d344530-40f9-43f0-8417-15110c6c9748,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "46454c88-9007-47b1-a199-b80afdf843f1", "address": "fa:16:3e:d4:7c:d2", "network": {"id": "234a8df7-8eea-44bf-ae16-0840862765d4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1326637884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a88327b042847d5b910c53bda19976b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46454c88-90", "ovs_interfaceid": "46454c88-9007-47b1-a199-b80afdf843f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:36:04 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Converting VIF {"id": "46454c88-9007-47b1-a199-b80afdf843f1", "address": "fa:16:3e:d4:7c:d2", "network": {"id": "234a8df7-8eea-44bf-ae16-0840862765d4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1326637884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a88327b042847d5b910c53bda19976b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46454c88-90", "ovs_interfaceid": "46454c88-9007-47b1-a199-b80afdf843f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:36:04 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:7c:d2,bridge_name='br-int',has_traffic_filtering=True,id=46454c88-9007-47b1-a199-b80afdf843f1,network=Network(234a8df7-8eea-44bf-ae16-0840862765d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46454c88-90') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:36:04 user nova-compute[73391]: DEBUG os_vif [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:7c:d2,bridge_name='br-int',has_traffic_filtering=True,id=46454c88-9007-47b1-a199-b80afdf843f1,network=Network(234a8df7-8eea-44bf-ae16-0840862765d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46454c88-90') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:36:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:36:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:36:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:36:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:36:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap46454c88-90, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:36:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap46454c88-90, col_values=(('external_ids', {'iface-id': '46454c88-9007-47b1-a199-b80afdf843f1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:7c:d2', 'vm-uuid': '8d344530-40f9-43f0-8417-15110c6c9748'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:36:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:36:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:36:04 user nova-compute[73391]: INFO os_vif [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:7c:d2,bridge_name='br-int',has_traffic_filtering=True,id=46454c88-9007-47b1-a199-b80afdf843f1,network=Network(234a8df7-8eea-44bf-ae16-0840862765d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46454c88-90')
Aug 15 05:36:04 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:36:04 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] No VIF found with MAC fa:16:3e:d4:7c:d2, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:36:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:36:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:36:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:36:05 user nova-compute[73391]: DEBUG nova.compute.manager [req-9d6bc056-8cc9-4842-8a50-d1232f9b8481 req-ad0b4903-a43e-4646-9d5f-cfc46270456e service nova] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Received event network-vif-plugged-46454c88-9007-47b1-a199-b80afdf843f1 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:36:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-9d6bc056-8cc9-4842-8a50-d1232f9b8481 req-ad0b4903-a43e-4646-9d5f-cfc46270456e service nova] Acquiring lock "8d344530-40f9-43f0-8417-15110c6c9748-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:36:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-9d6bc056-8cc9-4842-8a50-d1232f9b8481 req-ad0b4903-a43e-4646-9d5f-cfc46270456e service nova] Lock "8d344530-40f9-43f0-8417-15110c6c9748-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:36:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-9d6bc056-8cc9-4842-8a50-d1232f9b8481 req-ad0b4903-a43e-4646-9d5f-cfc46270456e service nova] Lock "8d344530-40f9-43f0-8417-15110c6c9748-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:36:05 user nova-compute[73391]: DEBUG nova.compute.manager [req-9d6bc056-8cc9-4842-8a50-d1232f9b8481 req-ad0b4903-a43e-4646-9d5f-cfc46270456e service nova] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] No waiting events found dispatching network-vif-plugged-46454c88-9007-47b1-a199-b80afdf843f1 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:36:05 user nova-compute[73391]: WARNING nova.compute.manager [req-9d6bc056-8cc9-4842-8a50-d1232f9b8481 req-ad0b4903-a43e-4646-9d5f-cfc46270456e service nova] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Received unexpected event network-vif-plugged-46454c88-9007-47b1-a199-b80afdf843f1 for instance with vm_state building and task_state spawning.
Aug 15 05:36:06 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:36:06 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:36:06 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:36:07 user nova-compute[73391]: DEBUG nova.compute.manager [req-957f823a-9ecf-480a-896c-ed3e8f9b7e6c req-76d0a782-de4e-4579-88f1-ee10a701cc03 service nova] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Received event network-vif-plugged-46454c88-9007-47b1-a199-b80afdf843f1 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:36:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-957f823a-9ecf-480a-896c-ed3e8f9b7e6c req-76d0a782-de4e-4579-88f1-ee10a701cc03 service nova] Acquiring lock "8d344530-40f9-43f0-8417-15110c6c9748-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:36:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-957f823a-9ecf-480a-896c-ed3e8f9b7e6c req-76d0a782-de4e-4579-88f1-ee10a701cc03 service nova] Lock "8d344530-40f9-43f0-8417-15110c6c9748-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:36:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-957f823a-9ecf-480a-896c-ed3e8f9b7e6c req-76d0a782-de4e-4579-88f1-ee10a701cc03 service nova] Lock "8d344530-40f9-43f0-8417-15110c6c9748-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:36:07 user nova-compute[73391]: DEBUG nova.compute.manager [req-957f823a-9ecf-480a-896c-ed3e8f9b7e6c req-76d0a782-de4e-4579-88f1-ee10a701cc03 service nova] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] No waiting events found dispatching network-vif-plugged-46454c88-9007-47b1-a199-b80afdf843f1 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:36:07 user nova-compute[73391]: WARNING nova.compute.manager [req-957f823a-9ecf-480a-896c-ed3e8f9b7e6c req-76d0a782-de4e-4579-88f1-ee10a701cc03 service nova] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Received unexpected event network-vif-plugged-46454c88-9007-47b1-a199-b80afdf843f1 for instance with vm_state building and task_state spawning.
Aug 15 05:36:07 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077767.9270267, 8d344530-40f9-43f0-8417-15110c6c9748 => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:36:07 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] VM Resumed (Lifecycle Event)
Aug 15 05:36:07 user nova-compute[73391]: DEBUG nova.compute.manager [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:36:07 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Guest created on hypervisor {{(pid=73391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 05:36:07 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Instance spawned successfully.
Aug 15 05:36:07 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 05:36:07 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:36:07 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:36:07 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Found default for hw_cdrom_bus of ide {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:36:07 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Found default for hw_disk_bus of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:36:07 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Found default for hw_input_bus of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:36:07 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Found default for hw_pointer_model of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:36:07 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Found default for hw_video_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:36:07 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Found default for hw_vif_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:36:07 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:36:07 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077767.9313798, 8d344530-40f9-43f0-8417-15110c6c9748 => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:36:07 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] VM Started (Lifecycle Event)
Aug 15 05:36:08 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:36:08 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:36:08 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:36:08 user nova-compute[73391]: INFO nova.compute.manager [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Took 5.32 seconds to spawn the instance on the hypervisor.
Aug 15 05:36:08 user nova-compute[73391]: DEBUG nova.compute.manager [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:36:08 user nova-compute[73391]: INFO nova.compute.manager [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Took 16.70 seconds to build instance.
Aug 15 05:36:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2123fe0e-0afd-4c00-b8dc-fee62df70fdd tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Lock "8d344530-40f9-43f0-8417-15110c6c9748" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.838s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:36:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:36:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:36:11 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:36:11 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:36:12 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692077757.2552943, 4b9f5970-65c5-4eff-a4bf-d18a9c916c90 => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:36:12 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] VM Stopped (Lifecycle Event)
Aug 15 05:36:12 user nova-compute[73391]: DEBUG nova.compute.manager [None req-2ad14d13-cb85-4280-9800-faedbf834d53 None None] [instance: 4b9f5970-65c5-4eff-a4bf-d18a9c916c90] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:36:12 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:36:12 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:36:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:36:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:36:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:36:12 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Auditing locally available compute resources for user (node: user) {{(pid=73391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 05:36:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f88cd17-c89f-41f3-b630-8eb2c6698155/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f88cd17-c89f-41f3-b630-8eb2c6698155/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f88cd17-c89f-41f3-b630-8eb2c6698155/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f88cd17-c89f-41f3-b630-8eb2c6698155/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131311f3-8467-461d-90eb-6a1b8a9d4f05/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131311f3-8467-461d-90eb-6a1b8a9d4f05/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131311f3-8467-461d-90eb-6a1b8a9d4f05/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/131311f3-8467-461d-90eb-6a1b8a9d4f05/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:36:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:36:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:36:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:14 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692077759.3563497, 18c8138a-4efc-403f-8b42-e5080c6a51d3 => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:36:14 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] VM Stopped (Lifecycle Event)
Aug 15 05:36:14 user nova-compute[73391]: DEBUG nova.compute.manager [None req-1c29d9bc-4e04-431e-93a3-d0fe80648135 None None] [instance: 18c8138a-4efc-403f-8b42-e5080c6a51d3] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:36:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:36:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:36:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64232f69-e64b-4d8d-a029-9d97679ff632/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64232f69-e64b-4d8d-a029-9d97679ff632/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64232f69-e64b-4d8d-a029-9d97679ff632/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64232f69-e64b-4d8d-a029-9d97679ff632/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8186459b-5bcb-4b5a-b6d8-d424909614e5/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8186459b-5bcb-4b5a-b6d8-d424909614e5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8186459b-5bcb-4b5a-b6d8-d424909614e5/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8186459b-5bcb-4b5a-b6d8-d424909614e5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:15 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:36:16 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:36:16 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:36:16 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Hypervisor/Node resource view: name=user free_ram=7243MB free_disk=25.30823516845703GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 05:36:16 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:36:16 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:36:16 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 8f08782b-f793-415e-b0d6-5caad1c3d426 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:36:16 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 6ac9d5dc-56be-402f-b9d4-3327bdfd9220 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:36:16 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 6358e825-5705-45d6-86b6-3aacfa5a9bbb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:36:16 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance a397a3f0-9b98-4e2b-87a0-f5ff85247c11 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:36:16 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 3f88cd17-c89f-41f3-b630-8eb2c6698155 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:36:16 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 8186459b-5bcb-4b5a-b6d8-d424909614e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:36:16 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 131311f3-8467-461d-90eb-6a1b8a9d4f05 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:36:16 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 64232f69-e64b-4d8d-a029-9d97679ff632 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:36:16 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance fee43642-30e8-451b-919c-aca4cd4c3f81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:36:16 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 8d344530-40f9-43f0-8417-15110c6c9748 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:36:16 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 05:36:16 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 05:36:16 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:36:16 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:36:16 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Compute_service record updated for user:user {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 05:36:16 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.474s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:36:16 user nova-compute[73391]: DEBUG nova.compute.manager [req-4e43ef5e-3f36-4200-9cb8-08f10d81b615 req-182404f0-a755-41e1-b4e1-dc1ea683f200 service nova] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Received event network-changed-89df1e31-ed6e-4e36-8c04-387309f0d237 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:36:16 user nova-compute[73391]: DEBUG nova.compute.manager [req-4e43ef5e-3f36-4200-9cb8-08f10d81b615 req-182404f0-a755-41e1-b4e1-dc1ea683f200 service nova] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Refreshing instance network info cache due to event network-changed-89df1e31-ed6e-4e36-8c04-387309f0d237. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:36:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-4e43ef5e-3f36-4200-9cb8-08f10d81b615 req-182404f0-a755-41e1-b4e1-dc1ea683f200 service nova] Acquiring lock "refresh_cache-131311f3-8467-461d-90eb-6a1b8a9d4f05" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:36:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-4e43ef5e-3f36-4200-9cb8-08f10d81b615 req-182404f0-a755-41e1-b4e1-dc1ea683f200 service nova] Acquired lock "refresh_cache-131311f3-8467-461d-90eb-6a1b8a9d4f05" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:36:17 user nova-compute[73391]: DEBUG nova.network.neutron [req-4e43ef5e-3f36-4200-9cb8-08f10d81b615 req-182404f0-a755-41e1-b4e1-dc1ea683f200 service nova] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Refreshing network info cache for port 89df1e31-ed6e-4e36-8c04-387309f0d237 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:36:17 user nova-compute[73391]: DEBUG nova.network.neutron [req-4e43ef5e-3f36-4200-9cb8-08f10d81b615 req-182404f0-a755-41e1-b4e1-dc1ea683f200 service nova] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Updated VIF entry in instance network info cache for port 89df1e31-ed6e-4e36-8c04-387309f0d237. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:36:17 user nova-compute[73391]: DEBUG nova.network.neutron [req-4e43ef5e-3f36-4200-9cb8-08f10d81b615 req-182404f0-a755-41e1-b4e1-dc1ea683f200 service nova] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Updating instance_info_cache with network_info: [{"id": "89df1e31-ed6e-4e36-8c04-387309f0d237", "address": "fa:16:3e:69:fc:9e", "network": {"id": "a5904008-88c2-4e54-85d8-5d684bc08bde", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-808047519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e61f42ac594961a13ac27c982be62b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89df1e31-ed", "ovs_interfaceid": "89df1e31-ed6e-4e36-8c04-387309f0d237", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:36:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-4e43ef5e-3f36-4200-9cb8-08f10d81b615 req-182404f0-a755-41e1-b4e1-dc1ea683f200 service nova] Releasing lock "refresh_cache-131311f3-8467-461d-90eb-6a1b8a9d4f05" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:36:17 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:36:17 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:36:17 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Starting heal instance info cache {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 05:36:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "refresh_cache-6ac9d5dc-56be-402f-b9d4-3327bdfd9220" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:36:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquired lock "refresh_cache-6ac9d5dc-56be-402f-b9d4-3327bdfd9220" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:36:17 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Forcefully refreshing network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 05:36:18 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Updating instance_info_cache with network_info: [{"id": "9cde10e9-3186-4680-8e4d-a3bb0d8600d0", "address": "fa:16:3e:50:39:e0", "network": {"id": "610f78de-5741-4743-815d-d12ba05f8000", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1518164868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b01853a82243369bd71dc0dbedb5d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cde10e9-31", "ovs_interfaceid": "9cde10e9-3186-4680-8e4d-a3bb0d8600d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:36:18 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Releasing lock "refresh_cache-6ac9d5dc-56be-402f-b9d4-3327bdfd9220" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:36:18 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Updated the network info_cache for instance {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 05:36:18 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:36:18 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:36:18 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:36:18 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 05:36:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:36:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:36:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-211af903-0d65-47a7-b3f3-14e47ae90046 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Acquiring lock "131311f3-8467-461d-90eb-6a1b8a9d4f05" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:36:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-211af903-0d65-47a7-b3f3-14e47ae90046 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Lock "131311f3-8467-461d-90eb-6a1b8a9d4f05" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:36:20 user nova-compute[73391]: DEBUG nova.objects.instance [None req-211af903-0d65-47a7-b3f3-14e47ae90046 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Lazy-loading 'flavor' on Instance uuid 131311f3-8467-461d-90eb-6a1b8a9d4f05 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:36:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-211af903-0d65-47a7-b3f3-14e47ae90046 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Lock "131311f3-8467-461d-90eb-6a1b8a9d4f05" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:36:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-211af903-0d65-47a7-b3f3-14e47ae90046 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Acquiring lock "131311f3-8467-461d-90eb-6a1b8a9d4f05" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:36:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-211af903-0d65-47a7-b3f3-14e47ae90046 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Lock "131311f3-8467-461d-90eb-6a1b8a9d4f05" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:36:20 user nova-compute[73391]: INFO nova.compute.manager [None req-211af903-0d65-47a7-b3f3-14e47ae90046 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Attaching volume 30377772-af3b-4202-8d5b-f90fa26a31bc to /dev/sdc
Aug 15 05:36:21 user nova-compute[73391]: DEBUG os_brick.utils [None req-211af903-0d65-47a7-b3f3-14e47ae90046 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:36:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:21 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7ded1dc-c05d-4e7c-a5e7-60b234c02796]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:21 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cff2fc4-9ee2-4429-95dd-f2458a78c254]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:21 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ca62aa-11ee-49eb-87dd-39f912e440fd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:21 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a724ed-e88b-400d-bb8c-017319eb10e6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-211af903-0d65-47a7-b3f3-14e47ae90046 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-211af903-0d65-47a7-b3f3-14e47ae90046 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:36:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-211af903-0d65-47a7-b3f3-14e47ae90046 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 05:36:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:36:21 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 05:36:21 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8cc4fb-f494-49a1-90c9-bebfba38cb9e]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-211af903-0d65-47a7-b3f3-14e47ae90046 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 05:36:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-211af903-0d65-47a7-b3f3-14e47ae90046 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 05:36:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-211af903-0d65-47a7-b3f3-14e47ae90046 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 05:36:21 user nova-compute[73391]: DEBUG os_brick.utils [None req-211af903-0d65-47a7-b3f3-14e47ae90046 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:36:21 user nova-compute[73391]: DEBUG nova.virt.block_device [None req-211af903-0d65-47a7-b3f3-14e47ae90046 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Updating existing volume attachment record: 19835d4a-faa6-4b22-af2b-4767baf61c59 {{(pid=73391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 05:36:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:36:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:36:29 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:36:29 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:36:32 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-211af903-0d65-47a7-b3f3-14e47ae90046 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 05:36:32 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-211af903-0d65-47a7-b3f3-14e47ae90046 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:30377772-af3b-4202-8d5b-f90fa26a31bc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'exOnvpfL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:36:32 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-211af903-0d65-47a7-b3f3-14e47ae90046 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:36:32 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-211af903-0d65-47a7-b3f3-14e47ae90046 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:36:32 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-211af903-0d65-47a7-b3f3-14e47ae90046 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:36:32 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-211af903-0d65-47a7-b3f3-14e47ae90046 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:36:32 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-211af903-0d65-47a7-b3f3-14e47ae90046 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30377772-af3b-4202-8d5b-f90fa26a31bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:36:32 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-211af903-0d65-47a7-b3f3-14e47ae90046 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30377772-af3b-4202-8d5b-f90fa26a31bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:36:32 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-211af903-0d65-47a7-b3f3-14e47ae90046 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 05:36:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30377772-af3b-4202-8d5b-f90fa26a31bc -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30377772-af3b-4202-8d5b-f90fa26a31bc -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:32 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f4290b-1d3d-471f-b016-763087f4e0bb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:32 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-211af903-0d65-47a7-b3f3-14e47ae90046 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 05:36:32 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:36:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30377772-af3b-4202-8d5b-f90fa26a31bc -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30377772-af3b-4202-8d5b-f90fa26a31bc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:32 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6ab07a-8bdd-4d38-96b3-fac80f8ab5ac]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:30377772-af3b-4202-8d5b-f90fa26a31bc] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:32 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-211af903-0d65-47a7-b3f3-14e47ae90046 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:30377772-af3b-4202-8d5b-f90fa26a31bc] added
Aug 15 05:36:32 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:36:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30377772-af3b-4202-8d5b-f90fa26a31bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30377772-af3b-4202-8d5b-f90fa26a31bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:32 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[245ce6cd-0adb-46ea-87ad-ae127f66c10c]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:32 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-211af903-0d65-47a7-b3f3-14e47ae90046 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:36:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30377772-af3b-4202-8d5b-f90fa26a31bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30377772-af3b-4202-8d5b-f90fa26a31bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:32 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb26ca7a-d225-497a-970b-83cc85d87928]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:32 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-211af903-0d65-47a7-b3f3-14e47ae90046 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:36:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30377772-af3b-4202-8d5b-f90fa26a31bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v exOnvpfL {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30377772-af3b-4202-8d5b-f90fa26a31bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v exOnvpfL" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:32 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5ee5e0-ebfe-4a90-86d8-46bbc7c2ebba]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:32 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-211af903-0d65-47a7-b3f3-14e47ae90046 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'exOnvpfL'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:36:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30377772-af3b-4202-8d5b-f90fa26a31bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30377772-af3b-4202-8d5b-f90fa26a31bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:32 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4423c443-f2a9-456e-ab17-6517551a1dc1]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:32 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-211af903-0d65-47a7-b3f3-14e47ae90046 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:36:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:32 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[76c70353-0a8a-4548-bba9-7877e4b01bde]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b2542a-744a-4b63-a890-4ed9576671de (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:32 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-211af903-0d65-47a7-b3f3-14e47ae90046 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:36:32 user nova-compute[73391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 (non-flash)
Aug 15 05:36:32 user nova-compute[73391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)
Aug 15 05:36:32 user nova-compute[73391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)
Aug 15 05:36:32 user nova-compute[73391]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b2542a-744a-4b63-a890-4ed9576671de (non-flash)
Aug 15 05:36:32 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:36:32 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-211af903-0d65-47a7-b3f3-14e47ae90046 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:36:32 user nova-compute[73391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 (non-flash)
Aug 15 05:36:32 user nova-compute[73391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)
Aug 15 05:36:32 user nova-compute[73391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)
Aug 15 05:36:32 user nova-compute[73391]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b2542a-744a-4b63-a890-4ed9576671de (non-flash)
Aug 15 05:36:32 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:36:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30377772-af3b-4202-8d5b-f90fa26a31bc -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30377772-af3b-4202-8d5b-f90fa26a31bc -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:32 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9505daa-f196-4bd7-aea0-2cd279eab4dd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:30377772-af3b-4202-8d5b-f90fa26a31bc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:30377772-af3b-4202-8d5b-f90fa26a31bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:32 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-211af903-0d65-47a7-b3f3-14e47ae90046 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:30377772-af3b-4202-8d5b-f90fa26a31bc, portal: 172.16.0.220,3260]
Aug 15 05:36:32 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:30377772-af3b-4202-8d5b-f90fa26a31bc, portal: 172.16.0.220,3260] successful.
Aug 15 05:36:32 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:36:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30377772-af3b-4202-8d5b-f90fa26a31bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30377772-af3b-4202-8d5b-f90fa26a31bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:32 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b198e18-2533-4b76-98a2-bc16b7b1dc52]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:32 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-211af903-0d65-47a7-b3f3-14e47ae90046 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:36:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:32 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0fd844-5dc0-466a-b53e-6400cdd37fbb]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b2542a-744a-4b63-a890-4ed9576671de (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30377772-af3b-4202-8d5b-f90fa26a31bc (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:32 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-211af903-0d65-47a7-b3f3-14e47ae90046 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:36:32 user nova-compute[73391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 (non-flash)
Aug 15 05:36:32 user nova-compute[73391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)
Aug 15 05:36:32 user nova-compute[73391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)
Aug 15 05:36:32 user nova-compute[73391]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b2542a-744a-4b63-a890-4ed9576671de (non-flash)
Aug 15 05:36:32 user nova-compute[73391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30377772-af3b-4202-8d5b-f90fa26a31bc (non-flash)
Aug 15 05:36:32 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:36:32 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-211af903-0d65-47a7-b3f3-14e47ae90046 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:36:32 user nova-compute[73391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 (non-flash)
Aug 15 05:36:32 user nova-compute[73391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)
Aug 15 05:36:32 user nova-compute[73391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)
Aug 15 05:36:32 user nova-compute[73391]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b2542a-744a-4b63-a890-4ed9576671de (non-flash)
Aug 15 05:36:32 user nova-compute[73391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30377772-af3b-4202-8d5b-f90fa26a31bc (non-flash)
Aug 15 05:36:32 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:36:32 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-211af903-0d65-47a7-b3f3-14e47ae90046 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30377772-af3b-4202-8d5b-f90fa26a31bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:36:32 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-211af903-0d65-47a7-b3f3-14e47ae90046 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 05:36:32 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-211af903-0d65-47a7-b3f3-14e47ae90046 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] HCTL ('38', '-', '-', 0) found on session 25 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 05:36:32 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-211af903-0d65-47a7-b3f3-14e47ae90046 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 05:36:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:32 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c07af32-d649-44a5-a7f9-010891eebfdb]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:32 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-211af903-0d65-47a7-b3f3-14e47ae90046 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Searching for a device in session 25 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:36:32 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-211af903-0d65-47a7-b3f3-14e47ae90046 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'exOnvpfL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 05:36:33 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-211af903-0d65-47a7-b3f3-14e47ae90046 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:36:33 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-211af903-0d65-47a7-b3f3-14e47ae90046 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '26565316435666431', 'path': '/dev/sdg'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:36:33 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-211af903-0d65-47a7-b3f3-14e47ae90046 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565316435666431', 'path': '/dev/sdg'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 05:36:33 user nova-compute[73391]: DEBUG nova.objects.instance [None req-211af903-0d65-47a7-b3f3-14e47ae90046 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Lazy-loading 'flavor' on Instance uuid 131311f3-8467-461d-90eb-6a1b8a9d4f05 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:36:33 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-211af903-0d65-47a7-b3f3-14e47ae90046 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 05:36:33 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:36:33 user nova-compute[73391]:   <source dev="/dev/sdg"/>
Aug 15 05:36:33 user nova-compute[73391]:   <target dev="sdc" bus="scsi"/>
Aug 15 05:36:33 user nova-compute[73391]:   <serial>30377772-af3b-4202-8d5b-f90fa26a31bc</serial>
Aug 15 05:36:33 user nova-compute[73391]:   <address type="drive" controller="0" unit="2"/>
Aug 15 05:36:33 user nova-compute[73391]: </disk>
Aug 15 05:36:33 user nova-compute[73391]:  {{(pid=73391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 05:36:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:36:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:36:34 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-211af903-0d65-47a7-b3f3-14e47ae90046 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] No BDM found with device name sda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:36:34 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-211af903-0d65-47a7-b3f3-14e47ae90046 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] No BDM found with device name sdb, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:36:34 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-211af903-0d65-47a7-b3f3-14e47ae90046 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] No BDM found with device name sdc, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:36:34 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-211af903-0d65-47a7-b3f3-14e47ae90046 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] No VIF found with MAC fa:16:3e:69:fc:9e, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:36:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-211af903-0d65-47a7-b3f3-14e47ae90046 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Lock "131311f3-8467-461d-90eb-6a1b8a9d4f05" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.420s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:36:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7daccbea-bbb7-471c-8581-7d656b720d7a tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Acquiring lock "131311f3-8467-461d-90eb-6a1b8a9d4f05" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:36:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7daccbea-bbb7-471c-8581-7d656b720d7a tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Lock "131311f3-8467-461d-90eb-6a1b8a9d4f05" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:36:35 user nova-compute[73391]: INFO nova.compute.manager [None req-7daccbea-bbb7-471c-8581-7d656b720d7a tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Detaching volume 30377772-af3b-4202-8d5b-f90fa26a31bc
Aug 15 05:36:35 user nova-compute[73391]: INFO nova.virt.block_device [None req-7daccbea-bbb7-471c-8581-7d656b720d7a tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Attempting to driver detach volume 30377772-af3b-4202-8d5b-f90fa26a31bc from mountpoint /dev/sdc
Aug 15 05:36:35 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-7daccbea-bbb7-471c-8581-7d656b720d7a tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Attempting to detach device sdc from instance 131311f3-8467-461d-90eb-6a1b8a9d4f05 from the persistent domain config. {{(pid=73391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 05:36:35 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-7daccbea-bbb7-471c-8581-7d656b720d7a tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 05:36:35 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:36:35 user nova-compute[73391]:   <source dev="/dev/sdg"/>
Aug 15 05:36:35 user nova-compute[73391]:   <target dev="sdc" bus="scsi"/>
Aug 15 05:36:35 user nova-compute[73391]:   <serial>30377772-af3b-4202-8d5b-f90fa26a31bc</serial>
Aug 15 05:36:35 user nova-compute[73391]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 15 05:36:35 user nova-compute[73391]: </disk>
Aug 15 05:36:35 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 05:36:35 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-7daccbea-bbb7-471c-8581-7d656b720d7a tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Successfully detached device sdc from instance 131311f3-8467-461d-90eb-6a1b8a9d4f05 from the persistent domain config.
Aug 15 05:36:35 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-7daccbea-bbb7-471c-8581-7d656b720d7a tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 131311f3-8467-461d-90eb-6a1b8a9d4f05 from the live domain config. {{(pid=73391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 05:36:35 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-7daccbea-bbb7-471c-8581-7d656b720d7a tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 05:36:35 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:36:35 user nova-compute[73391]:   <source dev="/dev/sdg"/>
Aug 15 05:36:35 user nova-compute[73391]:   <target dev="sdc" bus="scsi"/>
Aug 15 05:36:35 user nova-compute[73391]:   <serial>30377772-af3b-4202-8d5b-f90fa26a31bc</serial>
Aug 15 05:36:35 user nova-compute[73391]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Aug 15 05:36:35 user nova-compute[73391]: </disk>
Aug 15 05:36:35 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 05:36:36 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-7daccbea-bbb7-471c-8581-7d656b720d7a tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 131311f3-8467-461d-90eb-6a1b8a9d4f05 {{(pid=73391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 05:36:36 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Received event <DeviceRemovedEvent: 1692077796.1155548, 131311f3-8467-461d-90eb-6a1b8a9d4f05 => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73391) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 05:36:36 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-7daccbea-bbb7-471c-8581-7d656b720d7a tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Successfully detached device sdc from instance 131311f3-8467-461d-90eb-6a1b8a9d4f05 from the live domain config.
Aug 15 05:36:36 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7daccbea-bbb7-471c-8581-7d656b720d7a tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 05:36:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daccbea-bbb7-471c-8581-7d656b720d7a tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:30377772-af3b-4202-8d5b-f90fa26a31bc'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'exOnvpfL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:36:36 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-7daccbea-bbb7-471c-8581-7d656b720d7a tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:36:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-7daccbea-bbb7-471c-8581-7d656b720d7a tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:36:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-7daccbea-bbb7-471c-8581-7d656b720d7a tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:36:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daccbea-bbb7-471c-8581-7d656b720d7a tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30377772-af3b-4202-8d5b-f90fa26a31bc', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 05:36:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:36 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5280a8d-170e-4fde-b24c-42f5623c8b82]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30377772-af3b-4202-8d5b-f90fa26a31bc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b1b2542a-744a-4b63-a890-4ed9576671de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:36 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b39a60-d6a1-4ac4-b041-f7e737ace230]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b2542a-744a-4b63-a890-4ed9576671de (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30377772-af3b-4202-8d5b-f90fa26a31bc (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daccbea-bbb7-471c-8581-7d656b720d7a tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:36:36 user nova-compute[73391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 (non-flash)
Aug 15 05:36:36 user nova-compute[73391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)
Aug 15 05:36:36 user nova-compute[73391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)
Aug 15 05:36:36 user nova-compute[73391]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b2542a-744a-4b63-a890-4ed9576671de (non-flash)
Aug 15 05:36:36 user nova-compute[73391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30377772-af3b-4202-8d5b-f90fa26a31bc (non-flash)
Aug 15 05:36:36 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:36:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daccbea-bbb7-471c-8581-7d656b720d7a tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:36:36 user nova-compute[73391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 (non-flash)
Aug 15 05:36:36 user nova-compute[73391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)
Aug 15 05:36:36 user nova-compute[73391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)
Aug 15 05:36:36 user nova-compute[73391]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b1b2542a-744a-4b63-a890-4ed9576671de (non-flash)
Aug 15 05:36:36 user nova-compute[73391]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30377772-af3b-4202-8d5b-f90fa26a31bc (non-flash)
Aug 15 05:36:36 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:36:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daccbea-bbb7-471c-8581-7d656b720d7a tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77580e2320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30377772-af3b-4202-8d5b-f90fa26a31bc'): ({'sdg'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 05:36:36 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-7daccbea-bbb7-471c-8581-7d656b720d7a tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Removing single pathed devices sdg {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 05:36:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:36 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccd7baa-7f07-4ccb-8f51-26e717435b8d]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:36 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba3be07-1ae5-449c-969c-3ab339a6c67d]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:36 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-7daccbea-bbb7-471c-8581-7d656b720d7a tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Flushing IO for device /dev/sdg {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 05:36:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.026s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:36 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[10eaa854-4916-4a7f-b4d2-8b346e498b41]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:36 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-7daccbea-bbb7-471c-8581-7d656b720d7a tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 05:36:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.032s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:36 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a29c22-4827-4237-b245-8af64e522362]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:36 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-7daccbea-bbb7-471c-8581-7d656b720d7a tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 05:36:36 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-7daccbea-bbb7-471c-8581-7d656b720d7a tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] SCSI volumes sdg have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 05:36:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daccbea-bbb7-471c-8581-7d656b720d7a tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30377772-af3b-4202-8d5b-f90fa26a31bc')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 05:36:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30377772-af3b-4202-8d5b-f90fa26a31bc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30377772-af3b-4202-8d5b-f90fa26a31bc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:36 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ae1e1a-4f99-4355-8363-122860af208f]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daccbea-bbb7-471c-8581-7d656b720d7a tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:36:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30377772-af3b-4202-8d5b-f90fa26a31bc -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30377772-af3b-4202-8d5b-f90fa26a31bc -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:36 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[420af1c8-3353-4807-a84f-383f8ab95e1c]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:30377772-af3b-4202-8d5b-f90fa26a31bc, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:30377772-af3b-4202-8d5b-f90fa26a31bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daccbea-bbb7-471c-8581-7d656b720d7a tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:30377772-af3b-4202-8d5b-f90fa26a31bc, portal: 172.16.0.220,3260]
Aug 15 05:36:36 user nova-compute[73391]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:30377772-af3b-4202-8d5b-f90fa26a31bc, portal: 172.16.0.220,3260] successful.
Aug 15 05:36:36 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:36:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30377772-af3b-4202-8d5b-f90fa26a31bc -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30377772-af3b-4202-8d5b-f90fa26a31bc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:36 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[109233ff-f971-42a8-b3f4-3ec233477ba1]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daccbea-bbb7-471c-8581-7d656b720d7a tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:36:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-7daccbea-bbb7-471c-8581-7d656b720d7a tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:36:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7daccbea-bbb7-471c-8581-7d656b720d7a tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] <== disconnect_volume: return (322ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:36:36 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7daccbea-bbb7-471c-8581-7d656b720d7a tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 05:36:37 user nova-compute[73391]: DEBUG nova.objects.instance [None req-7daccbea-bbb7-471c-8581-7d656b720d7a tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Lazy-loading 'flavor' on Instance uuid 131311f3-8467-461d-90eb-6a1b8a9d4f05 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:36:37 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7daccbea-bbb7-471c-8581-7d656b720d7a tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Lock "131311f3-8467-461d-90eb-6a1b8a9d4f05" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.820s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:36:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-9ec69a8f-225f-48b0-93d6-ffff904c4a66 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Acquiring lock "131311f3-8467-461d-90eb-6a1b8a9d4f05" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:36:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-9ec69a8f-225f-48b0-93d6-ffff904c4a66 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Lock "131311f3-8467-461d-90eb-6a1b8a9d4f05" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:36:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-9ec69a8f-225f-48b0-93d6-ffff904c4a66 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Acquiring lock "131311f3-8467-461d-90eb-6a1b8a9d4f05-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:36:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-9ec69a8f-225f-48b0-93d6-ffff904c4a66 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Lock "131311f3-8467-461d-90eb-6a1b8a9d4f05-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:36:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-9ec69a8f-225f-48b0-93d6-ffff904c4a66 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Lock "131311f3-8467-461d-90eb-6a1b8a9d4f05-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:36:38 user nova-compute[73391]: INFO nova.compute.manager [None req-9ec69a8f-225f-48b0-93d6-ffff904c4a66 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Terminating instance
Aug 15 05:36:38 user nova-compute[73391]: DEBUG nova.compute.manager [None req-9ec69a8f-225f-48b0-93d6-ffff904c4a66 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Start destroying the instance on the hypervisor. {{(pid=73391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 05:36:38 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:36:38 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:36:38 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:36:38 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:36:38 user nova-compute[73391]: DEBUG nova.compute.manager [req-58f41e5d-6352-4750-9d0b-3244977faaa6 req-1692a2b8-1462-4abd-b750-38f3202cef3c service nova] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Received event network-vif-unplugged-89df1e31-ed6e-4e36-8c04-387309f0d237 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:36:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-58f41e5d-6352-4750-9d0b-3244977faaa6 req-1692a2b8-1462-4abd-b750-38f3202cef3c service nova] Acquiring lock "131311f3-8467-461d-90eb-6a1b8a9d4f05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:36:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-58f41e5d-6352-4750-9d0b-3244977faaa6 req-1692a2b8-1462-4abd-b750-38f3202cef3c service nova] Lock "131311f3-8467-461d-90eb-6a1b8a9d4f05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:36:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-58f41e5d-6352-4750-9d0b-3244977faaa6 req-1692a2b8-1462-4abd-b750-38f3202cef3c service nova] Lock "131311f3-8467-461d-90eb-6a1b8a9d4f05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:36:38 user nova-compute[73391]: DEBUG nova.compute.manager [req-58f41e5d-6352-4750-9d0b-3244977faaa6 req-1692a2b8-1462-4abd-b750-38f3202cef3c service nova] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] No waiting events found dispatching network-vif-unplugged-89df1e31-ed6e-4e36-8c04-387309f0d237 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:36:38 user nova-compute[73391]: DEBUG nova.compute.manager [req-58f41e5d-6352-4750-9d0b-3244977faaa6 req-1692a2b8-1462-4abd-b750-38f3202cef3c service nova] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Received event network-vif-unplugged-89df1e31-ed6e-4e36-8c04-387309f0d237 for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 05:36:38 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Instance destroyed successfully.
Aug 15 05:36:38 user nova-compute[73391]: DEBUG nova.objects.instance [None req-9ec69a8f-225f-48b0-93d6-ffff904c4a66 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Lazy-loading 'resources' on Instance uuid 131311f3-8467-461d-90eb-6a1b8a9d4f05 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:36:38 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-9ec69a8f-225f-48b0-93d6-ffff904c4a66 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-08-15T05:34:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-344940402',display_name='tempest-AttachSCSIVolumeTestJSON-server-344940402',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-344940402',id=18,image_ref='85823d51-6d2e-448c-86b7-79ddf588f6a3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGCLpYQGheUswP7FXQMzoT+9sDag+mjFS3x4LUpu1k/Qq5ve9YIlL4+PEnzTDBt9OBJmASAZSYcJaIPcV3lsCApilRyxTx87uh/GDBDDMRzDndnD0ZrImy3OT0tP1BB2bg==',key_name='tempest-keypair-1133140023',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:34:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='51e61f42ac594961a13ac27c982be62b',ramdisk_id='',reservation_id='r-scx41xp9',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='85823d51-6d2e-448c-86b7-79ddf588f6a3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-228843077',owner_user_name='tempest-AttachSCSIVolumeTestJSON-228843077-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:34:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6423c74f0a6e4bb7a0e89905087c07d8',uuid=131311f3-8467-461d-90eb-6a1b8a9d4f05,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89df1e31-ed6e-4e36-8c04-387309f0d237", "address": "fa:16:3e:69:fc:9e", "network": {"id": "a5904008-88c2-4e54-85d8-5d684bc08bde", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-808047519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e61f42ac594961a13ac27c982be62b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89df1e31-ed", "ovs_interfaceid": "89df1e31-ed6e-4e36-8c04-387309f0d237", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:36:38 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-9ec69a8f-225f-48b0-93d6-ffff904c4a66 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Converting VIF {"id": "89df1e31-ed6e-4e36-8c04-387309f0d237", "address": "fa:16:3e:69:fc:9e", "network": {"id": "a5904008-88c2-4e54-85d8-5d684bc08bde", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-808047519-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.185", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "51e61f42ac594961a13ac27c982be62b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89df1e31-ed", "ovs_interfaceid": "89df1e31-ed6e-4e36-8c04-387309f0d237", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:36:38 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-9ec69a8f-225f-48b0-93d6-ffff904c4a66 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:fc:9e,bridge_name='br-int',has_traffic_filtering=True,id=89df1e31-ed6e-4e36-8c04-387309f0d237,network=Network(a5904008-88c2-4e54-85d8-5d684bc08bde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89df1e31-ed') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:36:38 user nova-compute[73391]: DEBUG os_vif [None req-9ec69a8f-225f-48b0-93d6-ffff904c4a66 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:fc:9e,bridge_name='br-int',has_traffic_filtering=True,id=89df1e31-ed6e-4e36-8c04-387309f0d237,network=Network(a5904008-88c2-4e54-85d8-5d684bc08bde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89df1e31-ed') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:36:38 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:36:38 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap89df1e31-ed, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:36:38 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:36:38 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:36:38 user nova-compute[73391]: INFO os_vif [None req-9ec69a8f-225f-48b0-93d6-ffff904c4a66 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:fc:9e,bridge_name='br-int',has_traffic_filtering=True,id=89df1e31-ed6e-4e36-8c04-387309f0d237,network=Network(a5904008-88c2-4e54-85d8-5d684bc08bde),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89df1e31-ed')
Aug 15 05:36:38 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-9ec69a8f-225f-48b0-93d6-ffff904c4a66 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Deleting instance files /opt/stack/data/nova/instances/131311f3-8467-461d-90eb-6a1b8a9d4f05_del
Aug 15 05:36:38 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-9ec69a8f-225f-48b0-93d6-ffff904c4a66 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Deletion of /opt/stack/data/nova/instances/131311f3-8467-461d-90eb-6a1b8a9d4f05_del complete
Aug 15 05:36:39 user nova-compute[73391]: INFO nova.compute.manager [None req-9ec69a8f-225f-48b0-93d6-ffff904c4a66 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 15 05:36:39 user nova-compute[73391]: DEBUG oslo.service.loopingcall [None req-9ec69a8f-225f-48b0-93d6-ffff904c4a66 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 05:36:39 user nova-compute[73391]: DEBUG nova.compute.manager [-] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Deallocating network for instance {{(pid=73391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 05:36:39 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] deallocate_for_instance() {{(pid=73391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 05:36:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:36:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:36:39 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:36:39 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Took 0.85 seconds to deallocate network for instance.
Aug 15 05:36:39 user nova-compute[73391]: DEBUG nova.compute.manager [req-c0ebf78e-c064-4a8c-9fe4-1e83689c6bae req-6b0ef24d-4db1-4598-bc40-5e7b283fe612 service nova] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Received event network-vif-deleted-89df1e31-ed6e-4e36-8c04-387309f0d237 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:36:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-9ec69a8f-225f-48b0-93d6-ffff904c4a66 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:36:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-9ec69a8f-225f-48b0-93d6-ffff904c4a66 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:36:40 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-9ec69a8f-225f-48b0-93d6-ffff904c4a66 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:36:40 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-9ec69a8f-225f-48b0-93d6-ffff904c4a66 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:36:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-9ec69a8f-225f-48b0-93d6-ffff904c4a66 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.321s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:36:40 user nova-compute[73391]: INFO nova.scheduler.client.report [None req-9ec69a8f-225f-48b0-93d6-ffff904c4a66 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Deleted allocations for instance 131311f3-8467-461d-90eb-6a1b8a9d4f05
Aug 15 05:36:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-9ec69a8f-225f-48b0-93d6-ffff904c4a66 tempest-AttachSCSIVolumeTestJSON-228843077 tempest-AttachSCSIVolumeTestJSON-228843077-project-member] Lock "131311f3-8467-461d-90eb-6a1b8a9d4f05" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.327s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:36:40 user nova-compute[73391]: DEBUG nova.compute.manager [req-71d23188-b440-476e-8220-ab927c959c65 req-12cd15ba-200c-49e9-b7d4-d265c5395ef0 service nova] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Received event network-vif-plugged-89df1e31-ed6e-4e36-8c04-387309f0d237 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:36:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-71d23188-b440-476e-8220-ab927c959c65 req-12cd15ba-200c-49e9-b7d4-d265c5395ef0 service nova] Acquiring lock "131311f3-8467-461d-90eb-6a1b8a9d4f05-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:36:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-71d23188-b440-476e-8220-ab927c959c65 req-12cd15ba-200c-49e9-b7d4-d265c5395ef0 service nova] Lock "131311f3-8467-461d-90eb-6a1b8a9d4f05-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:36:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-71d23188-b440-476e-8220-ab927c959c65 req-12cd15ba-200c-49e9-b7d4-d265c5395ef0 service nova] Lock "131311f3-8467-461d-90eb-6a1b8a9d4f05-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:36:40 user nova-compute[73391]: DEBUG nova.compute.manager [req-71d23188-b440-476e-8220-ab927c959c65 req-12cd15ba-200c-49e9-b7d4-d265c5395ef0 service nova] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] No waiting events found dispatching network-vif-plugged-89df1e31-ed6e-4e36-8c04-387309f0d237 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:36:40 user nova-compute[73391]: WARNING nova.compute.manager [req-71d23188-b440-476e-8220-ab927c959c65 req-12cd15ba-200c-49e9-b7d4-d265c5395ef0 service nova] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Received unexpected event network-vif-plugged-89df1e31-ed6e-4e36-8c04-387309f0d237 for instance with vm_state deleted and task_state None.
Aug 15 05:36:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7b2a08b7-5458-4e42-9e4b-bb7bb3441004 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Acquiring lock "a397a3f0-9b98-4e2b-87a0-f5ff85247c11" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:36:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7b2a08b7-5458-4e42-9e4b-bb7bb3441004 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Lock "a397a3f0-9b98-4e2b-87a0-f5ff85247c11" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:36:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7b2a08b7-5458-4e42-9e4b-bb7bb3441004 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Acquiring lock "a397a3f0-9b98-4e2b-87a0-f5ff85247c11-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:36:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7b2a08b7-5458-4e42-9e4b-bb7bb3441004 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Lock "a397a3f0-9b98-4e2b-87a0-f5ff85247c11-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:36:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7b2a08b7-5458-4e42-9e4b-bb7bb3441004 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Lock "a397a3f0-9b98-4e2b-87a0-f5ff85247c11-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:36:41 user nova-compute[73391]: INFO nova.compute.manager [None req-7b2a08b7-5458-4e42-9e4b-bb7bb3441004 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Terminating instance
Aug 15 05:36:41 user nova-compute[73391]: DEBUG nova.compute.manager [None req-7b2a08b7-5458-4e42-9e4b-bb7bb3441004 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Start destroying the instance on the hypervisor. {{(pid=73391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 05:36:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:36:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:36:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG nova.compute.manager [req-b196421e-8956-42df-9a35-f4e5a365c474 req-375a2d07-fc57-4faf-924a-989fef14b363 service nova] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Received event network-vif-unplugged-f757ece4-baa7-4593-8327-d5fee9aa2d1a {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-b196421e-8956-42df-9a35-f4e5a365c474 req-375a2d07-fc57-4faf-924a-989fef14b363 service nova] Acquiring lock "a397a3f0-9b98-4e2b-87a0-f5ff85247c11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-b196421e-8956-42df-9a35-f4e5a365c474 req-375a2d07-fc57-4faf-924a-989fef14b363 service nova] Lock "a397a3f0-9b98-4e2b-87a0-f5ff85247c11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-b196421e-8956-42df-9a35-f4e5a365c474 req-375a2d07-fc57-4faf-924a-989fef14b363 service nova] Lock "a397a3f0-9b98-4e2b-87a0-f5ff85247c11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG nova.compute.manager [req-b196421e-8956-42df-9a35-f4e5a365c474 req-375a2d07-fc57-4faf-924a-989fef14b363 service nova] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] No waiting events found dispatching network-vif-unplugged-f757ece4-baa7-4593-8327-d5fee9aa2d1a {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG nova.compute.manager [req-b196421e-8956-42df-9a35-f4e5a365c474 req-375a2d07-fc57-4faf-924a-989fef14b363 service nova] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Received event network-vif-unplugged-f757ece4-baa7-4593-8327-d5fee9aa2d1a for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG nova.compute.manager [req-b196421e-8956-42df-9a35-f4e5a365c474 req-375a2d07-fc57-4faf-924a-989fef14b363 service nova] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Received event network-vif-plugged-f757ece4-baa7-4593-8327-d5fee9aa2d1a {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-b196421e-8956-42df-9a35-f4e5a365c474 req-375a2d07-fc57-4faf-924a-989fef14b363 service nova] Acquiring lock "a397a3f0-9b98-4e2b-87a0-f5ff85247c11-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-b196421e-8956-42df-9a35-f4e5a365c474 req-375a2d07-fc57-4faf-924a-989fef14b363 service nova] Lock "a397a3f0-9b98-4e2b-87a0-f5ff85247c11-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-b196421e-8956-42df-9a35-f4e5a365c474 req-375a2d07-fc57-4faf-924a-989fef14b363 service nova] Lock "a397a3f0-9b98-4e2b-87a0-f5ff85247c11-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG nova.compute.manager [req-b196421e-8956-42df-9a35-f4e5a365c474 req-375a2d07-fc57-4faf-924a-989fef14b363 service nova] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] No waiting events found dispatching network-vif-plugged-f757ece4-baa7-4593-8327-d5fee9aa2d1a {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:36:42 user nova-compute[73391]: WARNING nova.compute.manager [req-b196421e-8956-42df-9a35-f4e5a365c474 req-375a2d07-fc57-4faf-924a-989fef14b363 service nova] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Received unexpected event network-vif-plugged-f757ece4-baa7-4593-8327-d5fee9aa2d1a for instance with vm_state active and task_state deleting.
Aug 15 05:36:42 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Instance destroyed successfully.
Aug 15 05:36:42 user nova-compute[73391]: DEBUG nova.objects.instance [None req-7b2a08b7-5458-4e42-9e4b-bb7bb3441004 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Lazy-loading 'resources' on Instance uuid a397a3f0-9b98-4e2b-87a0-f5ff85247c11 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-7b2a08b7-5458-4e42-9e4b-bb7bb3441004 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T05:32:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1829220431',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-841273858',id=14,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNMgzXt9NjJohzQsGOG93ZxUTCjCzFBUN3Hf/vy9X7YUPJocPJVAdKrq1py25dd1+bQ6l0tu0hELDJB6TYYQgn1ARXbmD5JV7v4zuJ4KXoVbpP6mpPq+PpiOI9xbMnkxzg==',key_name='tempest-keypair-283788561',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:35:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='becd05a5b0824a208cd692d8505ea05e',ramdisk_id='',reservation_id='r-qxjdyr3i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1258386635',owner_user_name='tempest-ServerActionsV293TestJSON-1258386635-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:35:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f78657dfe187469faa75e7210792871b',uuid=a397a3f0-9b98-4e2b-87a0-f5ff85247c11,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f757ece4-baa7-4593-8327-d5fee9aa2d1a", "address": "fa:16:3e:3a:0d:16", "network": {"id": "843ec1f3-c64d-4564-a801-0bee7beb4d42", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1999293789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "becd05a5b0824a208cd692d8505ea05e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf757ece4-ba", "ovs_interfaceid": "f757ece4-baa7-4593-8327-d5fee9aa2d1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-7b2a08b7-5458-4e42-9e4b-bb7bb3441004 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Converting VIF {"id": "f757ece4-baa7-4593-8327-d5fee9aa2d1a", "address": "fa:16:3e:3a:0d:16", "network": {"id": "843ec1f3-c64d-4564-a801-0bee7beb4d42", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1999293789-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "becd05a5b0824a208cd692d8505ea05e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf757ece4-ba", "ovs_interfaceid": "f757ece4-baa7-4593-8327-d5fee9aa2d1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-7b2a08b7-5458-4e42-9e4b-bb7bb3441004 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:0d:16,bridge_name='br-int',has_traffic_filtering=True,id=f757ece4-baa7-4593-8327-d5fee9aa2d1a,network=Network(843ec1f3-c64d-4564-a801-0bee7beb4d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf757ece4-ba') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG os_vif [None req-7b2a08b7-5458-4e42-9e4b-bb7bb3441004 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:0d:16,bridge_name='br-int',has_traffic_filtering=True,id=f757ece4-baa7-4593-8327-d5fee9aa2d1a,network=Network(843ec1f3-c64d-4564-a801-0bee7beb4d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf757ece4-ba') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf757ece4-ba, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:36:42 user nova-compute[73391]: INFO os_vif [None req-7b2a08b7-5458-4e42-9e4b-bb7bb3441004 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:0d:16,bridge_name='br-int',has_traffic_filtering=True,id=f757ece4-baa7-4593-8327-d5fee9aa2d1a,network=Network(843ec1f3-c64d-4564-a801-0bee7beb4d42),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf757ece4-ba')
Aug 15 05:36:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b2a08b7-5458-4e42-9e4b-bb7bb3441004 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2a08b7-5458-4e42-9e4b-bb7bb3441004 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NXzhsQRV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:36:42 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-7b2a08b7-5458-4e42-9e4b-bb7bb3441004 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:36:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-7b2a08b7-5458-4e42-9e4b-bb7bb3441004 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-7b2a08b7-5458-4e42-9e4b-bb7bb3441004 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2a08b7-5458-4e42-9e4b-bb7bb3441004 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe84250-42de-44a4-9391-65a76ce0cd2e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb44d898-cbe4-4689-9b2d-ca64a8331dfc]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2a08b7-5458-4e42-9e4b-bb7bb3441004 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:36:42 user nova-compute[73391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 (non-flash)
Aug 15 05:36:42 user nova-compute[73391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)
Aug 15 05:36:42 user nova-compute[73391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)
Aug 15 05:36:42 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2a08b7-5458-4e42-9e4b-bb7bb3441004 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:36:42 user nova-compute[73391]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 (non-flash)
Aug 15 05:36:42 user nova-compute[73391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)
Aug 15 05:36:42 user nova-compute[73391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)
Aug 15 05:36:42 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2a08b7-5458-4e42-9e4b-bb7bb3441004 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f772848dc60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52'): ({'sdc'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-7b2a08b7-5458-4e42-9e4b-bb7bb3441004 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Removing single pathed devices sdc {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56fcabd-feb9-4eef-9f01-e892ea393b57]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a7328e-a98f-4e57-b124-faef359d6c10]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-7b2a08b7-5458-4e42-9e4b-bb7bb3441004 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Flushing IO for device /dev/sdc {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0b8aa7-15cd-4ee0-bf99-b2872591aca7]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-7b2a08b7-5458-4e42-9e4b-bb7bb3441004 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[11ed1e87-1b42-45df-83db-0521f15d1a44]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-7b2a08b7-5458-4e42-9e4b-bb7bb3441004 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-7b2a08b7-5458-4e42-9e4b-bb7bb3441004 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] SCSI volumes sdc have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2a08b7-5458-4e42-9e4b-bb7bb3441004 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8795f7b-10af-4d99-a90f-ab03911c5f83]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2a08b7-5458-4e42-9e4b-bb7bb3441004 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a051619-7657-4f6c-a74a-ad6bbbe4005c]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2a08b7-5458-4e42-9e4b-bb7bb3441004 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52, portal: 172.16.0.220,3260]
Aug 15 05:36:42 user nova-compute[73391]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52, portal: 172.16.0.220,3260] successful.
Aug 15 05:36:42 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c9c0ff64-aff4-4c9a-b939-400975c79c52 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[686ac8dd-5136-4b7a-bd01-fa5be9ab8f2d]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:43 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2a08b7-5458-4e42-9e4b-bb7bb3441004 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:36:43 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-7b2a08b7-5458-4e42-9e4b-bb7bb3441004 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:36:43 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b2a08b7-5458-4e42-9e4b-bb7bb3441004 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] <== disconnect_volume: return (325ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:36:43 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b2a08b7-5458-4e42-9e4b-bb7bb3441004 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 05:36:43 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-7b2a08b7-5458-4e42-9e4b-bb7bb3441004 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Deleting instance files /opt/stack/data/nova/instances/a397a3f0-9b98-4e2b-87a0-f5ff85247c11_del
Aug 15 05:36:43 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-7b2a08b7-5458-4e42-9e4b-bb7bb3441004 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Deletion of /opt/stack/data/nova/instances/a397a3f0-9b98-4e2b-87a0-f5ff85247c11_del complete
Aug 15 05:36:43 user nova-compute[73391]: INFO nova.compute.manager [None req-7b2a08b7-5458-4e42-9e4b-bb7bb3441004 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Took 1.18 seconds to destroy the instance on the hypervisor.
Aug 15 05:36:43 user nova-compute[73391]: DEBUG oslo.service.loopingcall [None req-7b2a08b7-5458-4e42-9e4b-bb7bb3441004 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 05:36:43 user nova-compute[73391]: DEBUG nova.compute.manager [-] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Deallocating network for instance {{(pid=73391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 05:36:43 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] deallocate_for_instance() {{(pid=73391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 05:36:43 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:36:43 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Took 0.93 seconds to deallocate network for instance.
Aug 15 05:36:44 user nova-compute[73391]: DEBUG nova.compute.manager [req-5ba703dd-3f6d-40c5-868d-40511fc20f26 req-e48632c2-dff6-4070-a13c-885aba129661 service nova] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Received event network-vif-deleted-f757ece4-baa7-4593-8327-d5fee9aa2d1a {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:36:44 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:36:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-edede13c-3e80-4127-81dd-228841def6a5 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Acquiring lock "3f88cd17-c89f-41f3-b630-8eb2c6698155" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:36:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-edede13c-3e80-4127-81dd-228841def6a5 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "3f88cd17-c89f-41f3-b630-8eb2c6698155" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:36:44 user nova-compute[73391]: DEBUG nova.objects.instance [None req-edede13c-3e80-4127-81dd-228841def6a5 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lazy-loading 'flavor' on Instance uuid 3f88cd17-c89f-41f3-b630-8eb2c6698155 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:36:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-edede13c-3e80-4127-81dd-228841def6a5 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "3f88cd17-c89f-41f3-b630-8eb2c6698155" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:36:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-edede13c-3e80-4127-81dd-228841def6a5 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Acquiring lock "3f88cd17-c89f-41f3-b630-8eb2c6698155" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:36:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-edede13c-3e80-4127-81dd-228841def6a5 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "3f88cd17-c89f-41f3-b630-8eb2c6698155" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:36:44 user nova-compute[73391]: INFO nova.compute.manager [None req-edede13c-3e80-4127-81dd-228841def6a5 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Attaching volume 7d26da3f-7971-4b6f-a945-19c38c3406fb to /dev/vdb
Aug 15 05:36:44 user nova-compute[73391]: DEBUG os_brick.utils [None req-edede13c-3e80-4127-81dd-228841def6a5 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:36:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:44 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[56301d12-a319-4833-a84e-c130d52e2b54]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:44 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ddf389-58d6-4a08-9729-0e26a63df1ad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.047s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:44 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f21694b7-08e4-4331-bc94-6d041ebe0145]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:44 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1b62ce-7086-4680-8771-737464697909]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-edede13c-3e80-4127-81dd-228841def6a5 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-edede13c-3e80-4127-81dd-228841def6a5 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:36:44 user nova-compute[73391]: INFO nova.compute.manager [None req-7b2a08b7-5458-4e42-9e4b-bb7bb3441004 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Took 0.86 seconds to detach 1 volumes for instance.
Aug 15 05:36:44 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-edede13c-3e80-4127-81dd-228841def6a5 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 05:36:44 user nova-compute[73391]: DEBUG nova.compute.manager [None req-7b2a08b7-5458-4e42-9e4b-bb7bb3441004 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Deleting volume: c9c0ff64-aff4-4c9a-b939-400975c79c52 {{(pid=73391) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 15 05:36:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:36:44 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 05:36:44 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d186b416-22be-45b0-a14e-179d58279e7a]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:44 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-edede13c-3e80-4127-81dd-228841def6a5 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 05:36:44 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-edede13c-3e80-4127-81dd-228841def6a5 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 05:36:44 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-edede13c-3e80-4127-81dd-228841def6a5 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 05:36:44 user nova-compute[73391]: DEBUG os_brick.utils [None req-edede13c-3e80-4127-81dd-228841def6a5 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:36:44 user nova-compute[73391]: DEBUG nova.virt.block_device [None req-edede13c-3e80-4127-81dd-228841def6a5 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Updating existing volume attachment record: 70e1d8c8-7eae-46ca-96c4-a271d1a40727 {{(pid=73391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 05:36:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7b2a08b7-5458-4e42-9e4b-bb7bb3441004 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:36:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7b2a08b7-5458-4e42-9e4b-bb7bb3441004 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:36:45 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-7b2a08b7-5458-4e42-9e4b-bb7bb3441004 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:36:45 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-7b2a08b7-5458-4e42-9e4b-bb7bb3441004 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:36:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7b2a08b7-5458-4e42-9e4b-bb7bb3441004 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.384s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:36:45 user nova-compute[73391]: INFO nova.scheduler.client.report [None req-7b2a08b7-5458-4e42-9e4b-bb7bb3441004 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Deleted allocations for instance a397a3f0-9b98-4e2b-87a0-f5ff85247c11
Aug 15 05:36:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7b2a08b7-5458-4e42-9e4b-bb7bb3441004 tempest-ServerActionsV293TestJSON-1258386635 tempest-ServerActionsV293TestJSON-1258386635-project-member] Lock "a397a3f0-9b98-4e2b-87a0-f5ff85247c11" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.656s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:36:47 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:36:49 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:36:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:36:51 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:36:52 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:36:53 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Acquiring lock "ab02c376-1432-4981-9179-aeef6e647ea4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:36:53 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "ab02c376-1432-4981-9179-aeef6e647ea4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:36:53 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692077798.878643, 131311f3-8467-461d-90eb-6a1b8a9d4f05 => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:36:53 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] VM Stopped (Lifecycle Event)
Aug 15 05:36:53 user nova-compute[73391]: DEBUG nova.compute.manager [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Starting instance... {{(pid=73391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 05:36:53 user nova-compute[73391]: DEBUG nova.compute.manager [None req-223f9d67-90a5-4a59-bef9-0ba0716d4b61 None None] [instance: 131311f3-8467-461d-90eb-6a1b8a9d4f05] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:36:53 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:36:53 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:36:53 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 05:36:53 user nova-compute[73391]: INFO nova.compute.claims [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Claim successful on node user
Aug 15 05:36:54 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:36:54 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:36:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.401s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:36:54 user nova-compute[73391]: DEBUG nova.compute.manager [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Start building networks asynchronously for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 05:36:54 user nova-compute[73391]: DEBUG nova.compute.manager [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Allocating IP information in the background. {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 05:36:54 user nova-compute[73391]: DEBUG nova.network.neutron [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] allocate_for_instance() {{(pid=73391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 05:36:54 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 05:36:54 user nova-compute[73391]: DEBUG nova.compute.manager [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Start building block device mappings for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 05:36:54 user nova-compute[73391]: DEBUG nova.compute.manager [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Start spawning the instance on the hypervisor. {{(pid=73391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 05:36:54 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Creating instance directory {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 05:36:54 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Creating image(s)
Aug 15 05:36:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Acquiring lock "/opt/stack/data/nova/instances/ab02c376-1432-4981-9179-aeef6e647ea4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:36:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "/opt/stack/data/nova/instances/ab02c376-1432-4981-9179-aeef6e647ea4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:36:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "/opt/stack/data/nova/instances/ab02c376-1432-4981-9179-aeef6e647ea4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:36:54 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:54 user nova-compute[73391]: DEBUG nova.policy [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4c932032fc884b14b9268d5df91d45ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88871d09f7e347a4b9104a558604f2f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73391) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 05:36:54 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.194s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Acquiring lock "999b315ba87151d8252d543312ae7790e7e1583b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:36:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:36:54 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.204s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/ab02c376-1432-4981-9179-aeef6e647ea4/disk 1073741824 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edede13c-3e80-4127-81dd-228841def6a5 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-edede13c-3e80-4127-81dd-228841def6a5 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7d26da3f-7971-4b6f-a945-19c38c3406fb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qSXrjsFY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:36:55 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-edede13c-3e80-4127-81dd-228841def6a5 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:36:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-edede13c-3e80-4127-81dd-228841def6a5 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-edede13c-3e80-4127-81dd-228841def6a5 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:36:55 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-edede13c-3e80-4127-81dd-228841def6a5 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:36:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-edede13c-3e80-4127-81dd-228841def6a5 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d26da3f-7971-4b6f-a945-19c38c3406fb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-edede13c-3e80-4127-81dd-228841def6a5 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d26da3f-7971-4b6f-a945-19c38c3406fb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:36:55 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-edede13c-3e80-4127-81dd-228841def6a5 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 05:36:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/ab02c376-1432-4981-9179-aeef6e647ea4/disk 1073741824" returned: 0 in 0.072s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d26da3f-7971-4b6f-a945-19c38c3406fb -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d26da3f-7971-4b6f-a945-19c38c3406fb -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7510cf95-0903-46a1-814a-49cd043d51d8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-edede13c-3e80-4127-81dd-228841def6a5 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 05:36:55 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d26da3f-7971-4b6f-a945-19c38c3406fb -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d26da3f-7971-4b6f-a945-19c38c3406fb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a03e9d-7a09-4c26-9a84-bcff51e28baf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d26da3f-7971-4b6f-a945-19c38c3406fb] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-edede13c-3e80-4127-81dd-228841def6a5 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7d26da3f-7971-4b6f-a945-19c38c3406fb] added
Aug 15 05:36:55 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d26da3f-7971-4b6f-a945-19c38c3406fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d26da3f-7971-4b6f-a945-19c38c3406fb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f7ed92-6752-4fb9-a98a-c74424dbe501]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-edede13c-3e80-4127-81dd-228841def6a5 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d26da3f-7971-4b6f-a945-19c38c3406fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d26da3f-7971-4b6f-a945-19c38c3406fb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c69b25-a2f0-49d3-a4b5-125dca1c7fdc]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-edede13c-3e80-4127-81dd-228841def6a5 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d26da3f-7971-4b6f-a945-19c38c3406fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qSXrjsFY {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d26da3f-7971-4b6f-a945-19c38c3406fb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qSXrjsFY" returned: 0 in 0.026s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d358adf-3146-446b-8997-d9bd347735ae]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-edede13c-3e80-4127-81dd-228841def6a5 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qSXrjsFY'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d26da3f-7971-4b6f-a945-19c38c3406fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d26da3f-7971-4b6f-a945-19c38c3406fb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d037a5f7-c61e-45dc-8f16-ee16d825e605]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-edede13c-3e80-4127-81dd-228841def6a5 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[028a689b-9d8b-4e1a-9b24-48cc703eb83a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-edede13c-3e80-4127-81dd-228841def6a5 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:36:55 user nova-compute[73391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)
Aug 15 05:36:55 user nova-compute[73391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)
Aug 15 05:36:55 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-edede13c-3e80-4127-81dd-228841def6a5 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:36:55 user nova-compute[73391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)
Aug 15 05:36:55 user nova-compute[73391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)
Aug 15 05:36:55 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d26da3f-7971-4b6f-a945-19c38c3406fb -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.236s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ab02c376-1432-4981-9179-aeef6e647ea4/disk. size=1073741824 {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab02c376-1432-4981-9179-aeef6e647ea4/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d26da3f-7971-4b6f-a945-19c38c3406fb -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e69a3d-68f5-44f2-9e92-cd7bb0849385]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d26da3f-7971-4b6f-a945-19c38c3406fb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7d26da3f-7971-4b6f-a945-19c38c3406fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-edede13c-3e80-4127-81dd-228841def6a5 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7d26da3f-7971-4b6f-a945-19c38c3406fb, portal: 172.16.0.220,3260]
Aug 15 05:36:55 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:7d26da3f-7971-4b6f-a945-19c38c3406fb, portal: 172.16.0.220,3260] successful.
Aug 15 05:36:55 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d26da3f-7971-4b6f-a945-19c38c3406fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d26da3f-7971-4b6f-a945-19c38c3406fb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b4e276-1611-41ac-8ab0-0a6d5e964eed]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-edede13c-3e80-4127-81dd-228841def6a5 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba919399-11f2-4792-97a3-b82037048486]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d26da3f-7971-4b6f-a945-19c38c3406fb (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-edede13c-3e80-4127-81dd-228841def6a5 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:36:55 user nova-compute[73391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)
Aug 15 05:36:55 user nova-compute[73391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)
Aug 15 05:36:55 user nova-compute[73391]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d26da3f-7971-4b6f-a945-19c38c3406fb (non-flash)
Aug 15 05:36:55 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-edede13c-3e80-4127-81dd-228841def6a5 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:36:55 user nova-compute[73391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)
Aug 15 05:36:55 user nova-compute[73391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)
Aug 15 05:36:55 user nova-compute[73391]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d26da3f-7971-4b6f-a945-19c38c3406fb (non-flash)
Aug 15 05:36:55 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-edede13c-3e80-4127-81dd-228841def6a5 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7d26da3f-7971-4b6f-a945-19c38c3406fb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-edede13c-3e80-4127-81dd-228841def6a5 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-edede13c-3e80-4127-81dd-228841def6a5 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] HCTL ('34', '-', '-', 0) found on session 26 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-edede13c-3e80-4127-81dd-228841def6a5 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85126d7-037a-4694-9271-ecde817e47b4]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-edede13c-3e80-4127-81dd-228841def6a5 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Searching for a device in session 26 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-edede13c-3e80-4127-81dd-228841def6a5 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qSXrjsFY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab02c376-1432-4981-9179-aeef6e647ea4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Cannot resize image /opt/stack/data/nova/instances/ab02c376-1432-4981-9179-aeef6e647ea4/disk to a smaller size. {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG nova.objects.instance [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lazy-loading 'migration_context' on Instance uuid ab02c376-1432-4981-9179-aeef6e647ea4 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Created local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Ensure instance console log exists: /opt/stack/data/nova/instances/ab02c376-1432-4981-9179-aeef6e647ea4/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:36:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:36:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:36:56 user nova-compute[73391]: DEBUG nova.network.neutron [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Successfully created port: c1931f1c-7ef8-41c7-82f7-7ace92bb6439 {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 05:36:56 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-edede13c-3e80-4127-81dd-228841def6a5 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.396s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:36:56 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-edede13c-3e80-4127-81dd-228841def6a5 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] <== connect_volume: return (1398ms) {'type': 'block', 'scsi_wwn': '26361643965323362', 'path': '/dev/sdc'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:36:56 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-edede13c-3e80-4127-81dd-228841def6a5 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361643965323362', 'path': '/dev/sdc'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 05:36:56 user nova-compute[73391]: DEBUG nova.objects.instance [None req-edede13c-3e80-4127-81dd-228841def6a5 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lazy-loading 'flavor' on Instance uuid 3f88cd17-c89f-41f3-b630-8eb2c6698155 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:36:56 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-edede13c-3e80-4127-81dd-228841def6a5 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 05:36:56 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:36:56 user nova-compute[73391]:   <source dev="/dev/sdc"/>
Aug 15 05:36:56 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:36:56 user nova-compute[73391]:   <serial>7d26da3f-7971-4b6f-a945-19c38c3406fb</serial>
Aug 15 05:36:56 user nova-compute[73391]: </disk>
Aug 15 05:36:56 user nova-compute[73391]:  {{(pid=73391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 05:36:57 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-edede13c-3e80-4127-81dd-228841def6a5 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:36:57 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-edede13c-3e80-4127-81dd-228841def6a5 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:36:57 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-edede13c-3e80-4127-81dd-228841def6a5 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] No VIF found with MAC fa:16:3e:62:a5:85, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:36:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-edede13c-3e80-4127-81dd-228841def6a5 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "3f88cd17-c89f-41f3-b630-8eb2c6698155" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.569s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:36:57 user nova-compute[73391]: DEBUG nova.network.neutron [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Successfully updated port: c1931f1c-7ef8-41c7-82f7-7ace92bb6439 {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:36:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Acquiring lock "refresh_cache-ab02c376-1432-4981-9179-aeef6e647ea4" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:36:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Acquired lock "refresh_cache-ab02c376-1432-4981-9179-aeef6e647ea4" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:36:57 user nova-compute[73391]: DEBUG nova.network.neutron [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:36:57 user nova-compute[73391]: DEBUG nova.compute.manager [req-de0facde-a91d-4a16-9749-8abd1884423a req-88a2e08b-b140-4e70-a158-32a7a900e9d0 service nova] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Received event network-changed-c1931f1c-7ef8-41c7-82f7-7ace92bb6439 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:36:57 user nova-compute[73391]: DEBUG nova.compute.manager [req-de0facde-a91d-4a16-9749-8abd1884423a req-88a2e08b-b140-4e70-a158-32a7a900e9d0 service nova] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Refreshing instance network info cache due to event network-changed-c1931f1c-7ef8-41c7-82f7-7ace92bb6439. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:36:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-de0facde-a91d-4a16-9749-8abd1884423a req-88a2e08b-b140-4e70-a158-32a7a900e9d0 service nova] Acquiring lock "refresh_cache-ab02c376-1432-4981-9179-aeef6e647ea4" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:36:57 user nova-compute[73391]: DEBUG nova.network.neutron [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:36:57 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692077802.6340523, a397a3f0-9b98-4e2b-87a0-f5ff85247c11 => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:36:57 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] VM Stopped (Lifecycle Event)
Aug 15 05:36:57 user nova-compute[73391]: DEBUG nova.compute.manager [None req-02499165-0e9f-4021-a5e9-cdfa0320bfed None None] [instance: a397a3f0-9b98-4e2b-87a0-f5ff85247c11] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:36:57 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:36:57 user nova-compute[73391]: DEBUG nova.network.neutron [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Updating instance_info_cache with network_info: [{"id": "c1931f1c-7ef8-41c7-82f7-7ace92bb6439", "address": "fa:16:3e:67:d1:b1", "network": {"id": "f67152a9-4f18-4d7f-9d3e-5e517bd46813", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-731866550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88871d09f7e347a4b9104a558604f2f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1931f1c-7e", "ovs_interfaceid": "c1931f1c-7ef8-41c7-82f7-7ace92bb6439", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:36:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Releasing lock "refresh_cache-ab02c376-1432-4981-9179-aeef6e647ea4" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:36:57 user nova-compute[73391]: DEBUG nova.compute.manager [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Instance network_info: |[{"id": "c1931f1c-7ef8-41c7-82f7-7ace92bb6439", "address": "fa:16:3e:67:d1:b1", "network": {"id": "f67152a9-4f18-4d7f-9d3e-5e517bd46813", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-731866550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88871d09f7e347a4b9104a558604f2f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1931f1c-7e", "ovs_interfaceid": "c1931f1c-7ef8-41c7-82f7-7ace92bb6439", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 05:36:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-de0facde-a91d-4a16-9749-8abd1884423a req-88a2e08b-b140-4e70-a158-32a7a900e9d0 service nova] Acquired lock "refresh_cache-ab02c376-1432-4981-9179-aeef6e647ea4" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:36:57 user nova-compute[73391]: DEBUG nova.network.neutron [req-de0facde-a91d-4a16-9749-8abd1884423a req-88a2e08b-b140-4e70-a158-32a7a900e9d0 service nova] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Refreshing network info cache for port c1931f1c-7ef8-41c7-82f7-7ace92bb6439 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:36:57 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Start _get_guest_xml network_info=[{"id": "c1931f1c-7ef8-41c7-82f7-7ace92bb6439", "address": "fa:16:3e:67:d1:b1", "network": {"id": "f67152a9-4f18-4d7f-9d3e-5e517bd46813", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-731866550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88871d09f7e347a4b9104a558604f2f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1931f1c-7e", "ovs_interfaceid": "c1931f1c-7ef8-41c7-82f7-7ace92bb6439", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '191b1dad-305e-4d1c-9b15-515ec59a3278'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:36:57 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:36:57 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:36:57 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:36:57 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:36:57 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:36:57 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:36:57 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:36:57 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:36:57 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:36:57 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:36:57 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:36:57 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:36:57 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:36:57 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:36:57 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:36:57 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:36:57 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:36:57 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:36:57 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:36:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-698855278',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-698855278',id=22,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAk8iZa/ytOLHuspv3FTfs6UFC6O0RYBWlGatrlI1q1nEqgwdQunkTmQWSlOgo6yvb0gScc7BBUfbeQPNWDWKld+bhbPO3QCdh+0ZbdeBqDEQ+FzbSaOlaIZahbOfug2ZQ==',key_name='tempest-keypair-1906338828',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88871d09f7e347a4b9104a558604f2f6',ramdisk_id='',reservation_id='r-854lfx4v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1774553789',owner_user_name='tempest-AttachVolumeShelveTestJSON-1774553789-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:36:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c932032fc884b14b9268d5df91d45ea',uuid=ab02c376-1432-4981-9179-aeef6e647ea4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1931f1c-7ef8-41c7-82f7-7ace92bb6439", "address": "fa:16:3e:67:d1:b1", "network": {"id": "f67152a9-4f18-4d7f-9d3e-5e517bd46813", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-731866550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88871d09f7e347a4b9104a558604f2f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1931f1c-7e", "ovs_interfaceid": "c1931f1c-7ef8-41c7-82f7-7ace92bb6439", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:36:57 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Converting VIF {"id": "c1931f1c-7ef8-41c7-82f7-7ace92bb6439", "address": "fa:16:3e:67:d1:b1", "network": {"id": "f67152a9-4f18-4d7f-9d3e-5e517bd46813", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-731866550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88871d09f7e347a4b9104a558604f2f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1931f1c-7e", "ovs_interfaceid": "c1931f1c-7ef8-41c7-82f7-7ace92bb6439", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:36:57 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:d1:b1,bridge_name='br-int',has_traffic_filtering=True,id=c1931f1c-7ef8-41c7-82f7-7ace92bb6439,network=Network(f67152a9-4f18-4d7f-9d3e-5e517bd46813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1931f1c-7e') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:36:57 user nova-compute[73391]: DEBUG nova.objects.instance [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lazy-loading 'pci_devices' on Instance uuid ab02c376-1432-4981-9179-aeef6e647ea4 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:36:58 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:36:58 user nova-compute[73391]:   <uuid>ab02c376-1432-4981-9179-aeef6e647ea4</uuid>
Aug 15 05:36:58 user nova-compute[73391]:   <name>instance-00000016</name>
Aug 15 05:36:58 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:36:58 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:36:58 user nova-compute[73391]:   <metadata>
Aug 15 05:36:58 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:36:58 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:36:58 user nova-compute[73391]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-698855278</nova:name>
Aug 15 05:36:58 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:36:57</nova:creationTime>
Aug 15 05:36:58 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:36:58 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:36:58 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:36:58 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:36:58 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:36:58 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:36:58 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:36:58 user nova-compute[73391]:       <nova:owner>
Aug 15 05:36:58 user nova-compute[73391]:         <nova:user uuid="4c932032fc884b14b9268d5df91d45ea">tempest-AttachVolumeShelveTestJSON-1774553789-project-member</nova:user>
Aug 15 05:36:58 user nova-compute[73391]:         <nova:project uuid="88871d09f7e347a4b9104a558604f2f6">tempest-AttachVolumeShelveTestJSON-1774553789</nova:project>
Aug 15 05:36:58 user nova-compute[73391]:       </nova:owner>
Aug 15 05:36:58 user nova-compute[73391]:       <nova:root type="image" uuid="191b1dad-305e-4d1c-9b15-515ec59a3278"/>
Aug 15 05:36:58 user nova-compute[73391]:       <nova:ports>
Aug 15 05:36:58 user nova-compute[73391]:         <nova:port uuid="c1931f1c-7ef8-41c7-82f7-7ace92bb6439">
Aug 15 05:36:58 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 05:36:58 user nova-compute[73391]:         </nova:port>
Aug 15 05:36:58 user nova-compute[73391]:       </nova:ports>
Aug 15 05:36:58 user nova-compute[73391]:     </nova:instance>
Aug 15 05:36:58 user nova-compute[73391]:   </metadata>
Aug 15 05:36:58 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:36:58 user nova-compute[73391]:     <system>
Aug 15 05:36:58 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:36:58 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:36:58 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:36:58 user nova-compute[73391]:       <entry name="serial">ab02c376-1432-4981-9179-aeef6e647ea4</entry>
Aug 15 05:36:58 user nova-compute[73391]:       <entry name="uuid">ab02c376-1432-4981-9179-aeef6e647ea4</entry>
Aug 15 05:36:58 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:36:58 user nova-compute[73391]:     </system>
Aug 15 05:36:58 user nova-compute[73391]:   </sysinfo>
Aug 15 05:36:58 user nova-compute[73391]:   <os>
Aug 15 05:36:58 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:36:58 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:36:58 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:36:58 user nova-compute[73391]:   </os>
Aug 15 05:36:58 user nova-compute[73391]:   <features>
Aug 15 05:36:58 user nova-compute[73391]:     <acpi/>
Aug 15 05:36:58 user nova-compute[73391]:     <apic/>
Aug 15 05:36:58 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:36:58 user nova-compute[73391]:   </features>
Aug 15 05:36:58 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:36:58 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:36:58 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:36:58 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:36:58 user nova-compute[73391]:   </clock>
Aug 15 05:36:58 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:36:58 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:36:58 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:36:58 user nova-compute[73391]:   </cpu>
Aug 15 05:36:58 user nova-compute[73391]:   <devices>
Aug 15 05:36:58 user nova-compute[73391]:     <disk type="file" device="disk">
Aug 15 05:36:58 user nova-compute[73391]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 05:36:58 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/ab02c376-1432-4981-9179-aeef6e647ea4/disk"/>
Aug 15 05:36:58 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:36:58 user nova-compute[73391]:     </disk>
Aug 15 05:36:58 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:36:58 user nova-compute[73391]:       <mac address="fa:16:3e:67:d1:b1"/>
Aug 15 05:36:58 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:36:58 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:36:58 user nova-compute[73391]:       <target dev="tapc1931f1c-7e"/>
Aug 15 05:36:58 user nova-compute[73391]:     </interface>
Aug 15 05:36:58 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:36:58 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/ab02c376-1432-4981-9179-aeef6e647ea4/console.log" append="off"/>
Aug 15 05:36:58 user nova-compute[73391]:     </serial>
Aug 15 05:36:58 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:36:58 user nova-compute[73391]:     <video>
Aug 15 05:36:58 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:36:58 user nova-compute[73391]:     </video>
Aug 15 05:36:58 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:36:58 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:36:58 user nova-compute[73391]:     </rng>
Aug 15 05:36:58 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:36:58 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:36:58 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:36:58 user nova-compute[73391]:     </memballoon>
Aug 15 05:36:58 user nova-compute[73391]:   </devices>
Aug 15 05:36:58 user nova-compute[73391]: </domain>
Aug 15 05:36:58 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:36:58 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:36:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-698855278',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-698855278',id=22,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAk8iZa/ytOLHuspv3FTfs6UFC6O0RYBWlGatrlI1q1nEqgwdQunkTmQWSlOgo6yvb0gScc7BBUfbeQPNWDWKld+bhbPO3QCdh+0ZbdeBqDEQ+FzbSaOlaIZahbOfug2ZQ==',key_name='tempest-keypair-1906338828',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='88871d09f7e347a4b9104a558604f2f6',ramdisk_id='',reservation_id='r-854lfx4v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1774553789',owner_user_name='tempest-AttachVolumeShelveTestJSON-1774553789-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:36:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c932032fc884b14b9268d5df91d45ea',uuid=ab02c376-1432-4981-9179-aeef6e647ea4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c1931f1c-7ef8-41c7-82f7-7ace92bb6439", "address": "fa:16:3e:67:d1:b1", "network": {"id": "f67152a9-4f18-4d7f-9d3e-5e517bd46813", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-731866550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88871d09f7e347a4b9104a558604f2f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1931f1c-7e", "ovs_interfaceid": "c1931f1c-7ef8-41c7-82f7-7ace92bb6439", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:36:58 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Converting VIF {"id": "c1931f1c-7ef8-41c7-82f7-7ace92bb6439", "address": "fa:16:3e:67:d1:b1", "network": {"id": "f67152a9-4f18-4d7f-9d3e-5e517bd46813", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-731866550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88871d09f7e347a4b9104a558604f2f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1931f1c-7e", "ovs_interfaceid": "c1931f1c-7ef8-41c7-82f7-7ace92bb6439", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:36:58 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:d1:b1,bridge_name='br-int',has_traffic_filtering=True,id=c1931f1c-7ef8-41c7-82f7-7ace92bb6439,network=Network(f67152a9-4f18-4d7f-9d3e-5e517bd46813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1931f1c-7e') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:36:58 user nova-compute[73391]: DEBUG os_vif [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:d1:b1,bridge_name='br-int',has_traffic_filtering=True,id=c1931f1c-7ef8-41c7-82f7-7ace92bb6439,network=Network(f67152a9-4f18-4d7f-9d3e-5e517bd46813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1931f1c-7e') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:36:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:36:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:36:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:36:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:36:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc1931f1c-7e, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:36:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc1931f1c-7e, col_values=(('external_ids', {'iface-id': 'c1931f1c-7ef8-41c7-82f7-7ace92bb6439', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:d1:b1', 'vm-uuid': 'ab02c376-1432-4981-9179-aeef6e647ea4'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:36:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:36:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:36:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:36:58 user nova-compute[73391]: INFO os_vif [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:d1:b1,bridge_name='br-int',has_traffic_filtering=True,id=c1931f1c-7ef8-41c7-82f7-7ace92bb6439,network=Network(f67152a9-4f18-4d7f-9d3e-5e517bd46813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1931f1c-7e')
Aug 15 05:36:58 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:36:58 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] No VIF found with MAC fa:16:3e:67:d1:b1, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:36:58 user nova-compute[73391]: DEBUG nova.network.neutron [req-de0facde-a91d-4a16-9749-8abd1884423a req-88a2e08b-b140-4e70-a158-32a7a900e9d0 service nova] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Updated VIF entry in instance network info cache for port c1931f1c-7ef8-41c7-82f7-7ace92bb6439. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:36:58 user nova-compute[73391]: DEBUG nova.network.neutron [req-de0facde-a91d-4a16-9749-8abd1884423a req-88a2e08b-b140-4e70-a158-32a7a900e9d0 service nova] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Updating instance_info_cache with network_info: [{"id": "c1931f1c-7ef8-41c7-82f7-7ace92bb6439", "address": "fa:16:3e:67:d1:b1", "network": {"id": "f67152a9-4f18-4d7f-9d3e-5e517bd46813", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-731866550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88871d09f7e347a4b9104a558604f2f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1931f1c-7e", "ovs_interfaceid": "c1931f1c-7ef8-41c7-82f7-7ace92bb6439", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:36:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-de0facde-a91d-4a16-9749-8abd1884423a req-88a2e08b-b140-4e70-a158-32a7a900e9d0 service nova] Releasing lock "refresh_cache-ab02c376-1432-4981-9179-aeef6e647ea4" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:36:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:36:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-395a7a49-e70f-4af4-a85f-969f787dc0ca tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Acquiring lock "3f88cd17-c89f-41f3-b630-8eb2c6698155" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:36:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-395a7a49-e70f-4af4-a85f-969f787dc0ca tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "3f88cd17-c89f-41f3-b630-8eb2c6698155" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:36:59 user nova-compute[73391]: INFO nova.compute.manager [None req-395a7a49-e70f-4af4-a85f-969f787dc0ca tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Detaching volume 7d26da3f-7971-4b6f-a945-19c38c3406fb
Aug 15 05:36:59 user nova-compute[73391]: INFO nova.virt.block_device [None req-395a7a49-e70f-4af4-a85f-969f787dc0ca tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Attempting to driver detach volume 7d26da3f-7971-4b6f-a945-19c38c3406fb from mountpoint /dev/vdb
Aug 15 05:36:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-395a7a49-e70f-4af4-a85f-969f787dc0ca tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Attempting to detach device vdb from instance 3f88cd17-c89f-41f3-b630-8eb2c6698155 from the persistent domain config. {{(pid=73391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 05:36:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-395a7a49-e70f-4af4-a85f-969f787dc0ca tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 05:36:59 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:36:59 user nova-compute[73391]:   <source dev="/dev/sdc"/>
Aug 15 05:36:59 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:36:59 user nova-compute[73391]:   <serial>7d26da3f-7971-4b6f-a945-19c38c3406fb</serial>
Aug 15 05:36:59 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 05:36:59 user nova-compute[73391]: </disk>
Aug 15 05:36:59 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 05:36:59 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-395a7a49-e70f-4af4-a85f-969f787dc0ca tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Successfully detached device vdb from instance 3f88cd17-c89f-41f3-b630-8eb2c6698155 from the persistent domain config.
Aug 15 05:36:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-395a7a49-e70f-4af4-a85f-969f787dc0ca tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3f88cd17-c89f-41f3-b630-8eb2c6698155 from the live domain config. {{(pid=73391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 05:36:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-395a7a49-e70f-4af4-a85f-969f787dc0ca tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 05:36:59 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:36:59 user nova-compute[73391]:   <source dev="/dev/sdc"/>
Aug 15 05:36:59 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:36:59 user nova-compute[73391]:   <serial>7d26da3f-7971-4b6f-a945-19c38c3406fb</serial>
Aug 15 05:36:59 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 05:36:59 user nova-compute[73391]: </disk>
Aug 15 05:36:59 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 05:36:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Received event <DeviceRemovedEvent: 1692077819.824897, 3f88cd17-c89f-41f3-b630-8eb2c6698155 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73391) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 05:36:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-395a7a49-e70f-4af4-a85f-969f787dc0ca tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3f88cd17-c89f-41f3-b630-8eb2c6698155 {{(pid=73391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 05:36:59 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-395a7a49-e70f-4af4-a85f-969f787dc0ca tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Successfully detached device vdb from instance 3f88cd17-c89f-41f3-b630-8eb2c6698155 from the live domain config.
Aug 15 05:36:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-395a7a49-e70f-4af4-a85f-969f787dc0ca tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 05:36:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-395a7a49-e70f-4af4-a85f-969f787dc0ca tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:7d26da3f-7971-4b6f-a945-19c38c3406fb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qSXrjsFY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:36:59 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-395a7a49-e70f-4af4-a85f-969f787dc0ca tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:36:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-395a7a49-e70f-4af4-a85f-969f787dc0ca tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:36:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-395a7a49-e70f-4af4-a85f-969f787dc0ca tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:36:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-395a7a49-e70f-4af4-a85f-969f787dc0ca tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d26da3f-7971-4b6f-a945-19c38c3406fb', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 05:36:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:36:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:59 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[780333f2-318b-435a-a478-8e1f156717b7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7d26da3f-7971-4b6f-a945-19c38c3406fb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:36:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:36:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:59 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e70c59-8d98-4f70-bc6a-82c466496873]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d26da3f-7971-4b6f-a945-19c38c3406fb (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-395a7a49-e70f-4af4-a85f-969f787dc0ca tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:36:59 user nova-compute[73391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)
Aug 15 05:36:59 user nova-compute[73391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)
Aug 15 05:36:59 user nova-compute[73391]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d26da3f-7971-4b6f-a945-19c38c3406fb (non-flash)
Aug 15 05:36:59 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:36:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-395a7a49-e70f-4af4-a85f-969f787dc0ca tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:36:59 user nova-compute[73391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)
Aug 15 05:36:59 user nova-compute[73391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)
Aug 15 05:36:59 user nova-compute[73391]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7d26da3f-7971-4b6f-a945-19c38c3406fb (non-flash)
Aug 15 05:36:59 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:36:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-395a7a49-e70f-4af4-a85f-969f787dc0ca tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f774ccead40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d26da3f-7971-4b6f-a945-19c38c3406fb'): ({'sdc'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 05:36:59 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-395a7a49-e70f-4af4-a85f-969f787dc0ca tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Removing single pathed devices sdc {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 05:36:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:59 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d52096c-3a21-4465-b495-6463dbf3f02a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:36:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:36:59 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a99a0f4c-6dfe-4850-adca-ea803523332e]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:36:59 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-395a7a49-e70f-4af4-a85f-969f787dc0ca tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Flushing IO for device /dev/sdc {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 05:36:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:00 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3a44d2-ddfc-422e-998f-22798575d2b7]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:37:00 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-395a7a49-e70f-4af4-a85f-969f787dc0ca tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 05:37:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:00 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca2be7cc-aae2-408f-bedf-3df3121b5892]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:37:00 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-395a7a49-e70f-4af4-a85f-969f787dc0ca tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 05:37:00 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-395a7a49-e70f-4af4-a85f-969f787dc0ca tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] SCSI volumes sdc have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 05:37:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-395a7a49-e70f-4af4-a85f-969f787dc0ca tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7d26da3f-7971-4b6f-a945-19c38c3406fb')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 05:37:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d26da3f-7971-4b6f-a945-19c38c3406fb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d26da3f-7971-4b6f-a945-19c38c3406fb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.038s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:00 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad829a62-a038-4fa6-a26f-a4f1844aa019]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:37:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-395a7a49-e70f-4af4-a85f-969f787dc0ca tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:37:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d26da3f-7971-4b6f-a945-19c38c3406fb -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d26da3f-7971-4b6f-a945-19c38c3406fb -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:00 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a9387e-28c0-4b08-a0ac-fe4afd4ed976]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:7d26da3f-7971-4b6f-a945-19c38c3406fb, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:7d26da3f-7971-4b6f-a945-19c38c3406fb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:37:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-395a7a49-e70f-4af4-a85f-969f787dc0ca tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:7d26da3f-7971-4b6f-a945-19c38c3406fb, portal: 172.16.0.220,3260]
Aug 15 05:37:00 user nova-compute[73391]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:7d26da3f-7971-4b6f-a945-19c38c3406fb, portal: 172.16.0.220,3260] successful.
Aug 15 05:37:00 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:37:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7d26da3f-7971-4b6f-a945-19c38c3406fb -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:00 user nova-compute[73391]: DEBUG nova.compute.manager [req-8cbf034c-2b65-46e9-86af-e831c3a81e22 req-4ecc3148-dba9-4294-8d04-df4f885e3cae service nova] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Received event network-vif-plugged-c1931f1c-7ef8-41c7-82f7-7ace92bb6439 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:37:00 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-8cbf034c-2b65-46e9-86af-e831c3a81e22 req-4ecc3148-dba9-4294-8d04-df4f885e3cae service nova] Acquiring lock "ab02c376-1432-4981-9179-aeef6e647ea4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:37:00 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-8cbf034c-2b65-46e9-86af-e831c3a81e22 req-4ecc3148-dba9-4294-8d04-df4f885e3cae service nova] Lock "ab02c376-1432-4981-9179-aeef6e647ea4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:37:00 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-8cbf034c-2b65-46e9-86af-e831c3a81e22 req-4ecc3148-dba9-4294-8d04-df4f885e3cae service nova] Lock "ab02c376-1432-4981-9179-aeef6e647ea4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:37:00 user nova-compute[73391]: DEBUG nova.compute.manager [req-8cbf034c-2b65-46e9-86af-e831c3a81e22 req-4ecc3148-dba9-4294-8d04-df4f885e3cae service nova] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] No waiting events found dispatching network-vif-plugged-c1931f1c-7ef8-41c7-82f7-7ace92bb6439 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:37:00 user nova-compute[73391]: WARNING nova.compute.manager [req-8cbf034c-2b65-46e9-86af-e831c3a81e22 req-4ecc3148-dba9-4294-8d04-df4f885e3cae service nova] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Received unexpected event network-vif-plugged-c1931f1c-7ef8-41c7-82f7-7ace92bb6439 for instance with vm_state building and task_state spawning.
Aug 15 05:37:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7d26da3f-7971-4b6f-a945-19c38c3406fb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:00 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7805945b-7ad8-42c8-afa2-58b225510c43]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:37:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-395a7a49-e70f-4af4-a85f-969f787dc0ca tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:37:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-395a7a49-e70f-4af4-a85f-969f787dc0ca tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.394s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:37:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-395a7a49-e70f-4af4-a85f-969f787dc0ca tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] <== disconnect_volume: return (396ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:37:00 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-395a7a49-e70f-4af4-a85f-969f787dc0ca tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 05:37:00 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:00 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:00 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:01 user nova-compute[73391]: DEBUG nova.objects.instance [None req-395a7a49-e70f-4af4-a85f-969f787dc0ca tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lazy-loading 'flavor' on Instance uuid 3f88cd17-c89f-41f3-b630-8eb2c6698155 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:37:01 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-395a7a49-e70f-4af4-a85f-969f787dc0ca tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "3f88cd17-c89f-41f3-b630-8eb2c6698155" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.991s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:37:02 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077822.2197216, ab02c376-1432-4981-9179-aeef6e647ea4 => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:37:02 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] VM Resumed (Lifecycle Event)
Aug 15 05:37:02 user nova-compute[73391]: DEBUG nova.compute.manager [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:37:02 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Guest created on hypervisor {{(pid=73391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 05:37:02 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Instance spawned successfully.
Aug 15 05:37:02 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 05:37:02 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:37:02 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:37:02 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Found default for hw_cdrom_bus of ide {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:37:02 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Found default for hw_disk_bus of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:37:02 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Found default for hw_input_bus of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:37:02 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Found default for hw_pointer_model of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:37:02 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Found default for hw_video_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:37:02 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Found default for hw_vif_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:37:02 user nova-compute[73391]: DEBUG nova.compute.manager [req-af724ce1-a1e3-4815-bdef-dc97a75e705c req-7607d82b-52d4-43c5-9e49-60cf6c4c77b0 service nova] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Received event network-vif-plugged-c1931f1c-7ef8-41c7-82f7-7ace92bb6439 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:37:02 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-af724ce1-a1e3-4815-bdef-dc97a75e705c req-7607d82b-52d4-43c5-9e49-60cf6c4c77b0 service nova] Acquiring lock "ab02c376-1432-4981-9179-aeef6e647ea4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:37:02 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-af724ce1-a1e3-4815-bdef-dc97a75e705c req-7607d82b-52d4-43c5-9e49-60cf6c4c77b0 service nova] Lock "ab02c376-1432-4981-9179-aeef6e647ea4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:37:02 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-af724ce1-a1e3-4815-bdef-dc97a75e705c req-7607d82b-52d4-43c5-9e49-60cf6c4c77b0 service nova] Lock "ab02c376-1432-4981-9179-aeef6e647ea4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:37:02 user nova-compute[73391]: DEBUG nova.compute.manager [req-af724ce1-a1e3-4815-bdef-dc97a75e705c req-7607d82b-52d4-43c5-9e49-60cf6c4c77b0 service nova] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] No waiting events found dispatching network-vif-plugged-c1931f1c-7ef8-41c7-82f7-7ace92bb6439 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:37:02 user nova-compute[73391]: WARNING nova.compute.manager [req-af724ce1-a1e3-4815-bdef-dc97a75e705c req-7607d82b-52d4-43c5-9e49-60cf6c4c77b0 service nova] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Received unexpected event network-vif-plugged-c1931f1c-7ef8-41c7-82f7-7ace92bb6439 for instance with vm_state building and task_state spawning.
Aug 15 05:37:02 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:37:02 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077822.2236984, ab02c376-1432-4981-9179-aeef6e647ea4 => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:37:02 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] VM Started (Lifecycle Event)
Aug 15 05:37:02 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:37:02 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:37:02 user nova-compute[73391]: INFO nova.compute.manager [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Took 7.72 seconds to spawn the instance on the hypervisor.
Aug 15 05:37:02 user nova-compute[73391]: DEBUG nova.compute.manager [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:37:02 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:37:02 user nova-compute[73391]: INFO nova.compute.manager [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Took 8.46 seconds to build instance.
Aug 15 05:37:02 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-34ef4854-1226-481f-883f-1bf0e5bc978d tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "ab02c376-1432-4981-9179-aeef6e647ea4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.564s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:37:03 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:11 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:37:11 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:37:12 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:37:13 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:37:13 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:37:13 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:37:13 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:37:13 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:37:13 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Auditing locally available compute resources for user (node: user) {{(pid=73391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 05:37:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f88cd17-c89f-41f3-b630-8eb2c6698155/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f88cd17-c89f-41f3-b630-8eb2c6698155/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f88cd17-c89f-41f3-b630-8eb2c6698155/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f88cd17-c89f-41f3-b630-8eb2c6698155/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:37:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab02c376-1432-4981-9179-aeef6e647ea4/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab02c376-1432-4981-9179-aeef6e647ea4/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab02c376-1432-4981-9179-aeef6e647ea4/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab02c376-1432-4981-9179-aeef6e647ea4/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:15 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:37:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64232f69-e64b-4d8d-a029-9d97679ff632/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64232f69-e64b-4d8d-a029-9d97679ff632/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64232f69-e64b-4d8d-a029-9d97679ff632/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64232f69-e64b-4d8d-a029-9d97679ff632/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8186459b-5bcb-4b5a-b6d8-d424909614e5/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8186459b-5bcb-4b5a-b6d8-d424909614e5/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8186459b-5bcb-4b5a-b6d8-d424909614e5/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8186459b-5bcb-4b5a-b6d8-d424909614e5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:16 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:37:17 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:37:17 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:37:17 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Hypervisor/Node resource view: name=user free_ram=7461MB free_disk=25.32223892211914GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 05:37:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:37:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:37:17 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 8f08782b-f793-415e-b0d6-5caad1c3d426 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:37:17 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 6ac9d5dc-56be-402f-b9d4-3327bdfd9220 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:37:17 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 6358e825-5705-45d6-86b6-3aacfa5a9bbb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:37:17 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 3f88cd17-c89f-41f3-b630-8eb2c6698155 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:37:17 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 8186459b-5bcb-4b5a-b6d8-d424909614e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:37:17 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 64232f69-e64b-4d8d-a029-9d97679ff632 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:37:17 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance fee43642-30e8-451b-919c-aca4cd4c3f81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:37:17 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 8d344530-40f9-43f0-8417-15110c6c9748 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:37:17 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance ab02c376-1432-4981-9179-aeef6e647ea4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:37:17 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 05:37:17 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 05:37:17 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:37:17 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:37:17 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Compute_service record updated for user:user {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 05:37:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.414s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:37:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:18 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:37:18 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:37:18 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:37:18 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Starting heal instance info cache {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 05:37:18 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "refresh_cache-6358e825-5705-45d6-86b6-3aacfa5a9bbb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:37:18 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquired lock "refresh_cache-6358e825-5705-45d6-86b6-3aacfa5a9bbb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:37:18 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Forcefully refreshing network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 05:37:19 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Updating instance_info_cache with network_info: [{"id": "3b77e3e1-84f9-470a-b684-e8bdc4996c68", "address": "fa:16:3e:68:b6:f9", "network": {"id": "70d88082-aea7-48bb-abb4-d77d264aaf01", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b9acbe11654053bb905e7c92558a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b77e3e1-84", "ovs_interfaceid": "3b77e3e1-84f9-470a-b684-e8bdc4996c68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:37:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Releasing lock "refresh_cache-6358e825-5705-45d6-86b6-3aacfa5a9bbb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:37:19 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Updated the network info_cache for instance {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 05:37:19 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:37:19 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:37:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-88d17290-40b6-4607-8823-e6882e405c8b tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Acquiring lock "64232f69-e64b-4d8d-a029-9d97679ff632" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:37:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-88d17290-40b6-4607-8823-e6882e405c8b tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Lock "64232f69-e64b-4d8d-a029-9d97679ff632" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:37:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-88d17290-40b6-4607-8823-e6882e405c8b tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Acquiring lock "64232f69-e64b-4d8d-a029-9d97679ff632-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:37:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-88d17290-40b6-4607-8823-e6882e405c8b tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Lock "64232f69-e64b-4d8d-a029-9d97679ff632-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:37:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-88d17290-40b6-4607-8823-e6882e405c8b tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Lock "64232f69-e64b-4d8d-a029-9d97679ff632-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:37:19 user nova-compute[73391]: INFO nova.compute.manager [None req-88d17290-40b6-4607-8823-e6882e405c8b tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Terminating instance
Aug 15 05:37:19 user nova-compute[73391]: DEBUG nova.compute.manager [None req-88d17290-40b6-4607-8823-e6882e405c8b tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Start destroying the instance on the hypervisor. {{(pid=73391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 05:37:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:19 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:37:19 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 05:37:19 user nova-compute[73391]: DEBUG nova.compute.manager [req-9cdc1eb5-529a-47c0-9833-d7b875564d6d req-4ed2f396-e78e-4db9-a0a2-563ca7521079 service nova] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Received event network-vif-unplugged-b15f644f-a86c-46f9-a3d2-eb71bf66ad74 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:37:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-9cdc1eb5-529a-47c0-9833-d7b875564d6d req-4ed2f396-e78e-4db9-a0a2-563ca7521079 service nova] Acquiring lock "64232f69-e64b-4d8d-a029-9d97679ff632-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:37:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-9cdc1eb5-529a-47c0-9833-d7b875564d6d req-4ed2f396-e78e-4db9-a0a2-563ca7521079 service nova] Lock "64232f69-e64b-4d8d-a029-9d97679ff632-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:37:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-9cdc1eb5-529a-47c0-9833-d7b875564d6d req-4ed2f396-e78e-4db9-a0a2-563ca7521079 service nova] Lock "64232f69-e64b-4d8d-a029-9d97679ff632-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:37:19 user nova-compute[73391]: DEBUG nova.compute.manager [req-9cdc1eb5-529a-47c0-9833-d7b875564d6d req-4ed2f396-e78e-4db9-a0a2-563ca7521079 service nova] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] No waiting events found dispatching network-vif-unplugged-b15f644f-a86c-46f9-a3d2-eb71bf66ad74 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:37:19 user nova-compute[73391]: DEBUG nova.compute.manager [req-9cdc1eb5-529a-47c0-9833-d7b875564d6d req-4ed2f396-e78e-4db9-a0a2-563ca7521079 service nova] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Received event network-vif-unplugged-b15f644f-a86c-46f9-a3d2-eb71bf66ad74 for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 05:37:19 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Instance destroyed successfully.
Aug 15 05:37:19 user nova-compute[73391]: DEBUG nova.objects.instance [None req-88d17290-40b6-4607-8823-e6882e405c8b tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Lazy-loading 'resources' on Instance uuid 64232f69-e64b-4d8d-a029-9d97679ff632 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:37:20 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-88d17290-40b6-4607-8823-e6882e405c8b tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:35:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-870241489',display_name='tempest-VolumesActionsTest-instance-870241489',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-870241489',id=19,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:35:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a6621f507eee48adbf6c5f390add9ed8',ramdisk_id='',reservation_id='r-nb6qk900',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-702121303',owner_user_name='tempest-VolumesActionsTest-702121303-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:35:27Z,user_data=None,user_id='f10b83354cdc4f5bacfbba835f1b7688',uuid=64232f69-e64b-4d8d-a029-9d97679ff632,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b15f644f-a86c-46f9-a3d2-eb71bf66ad74", "address": "fa:16:3e:ad:f2:4d", "network": {"id": "20a0f634-b48d-4605-b66d-93e8b42c7d2d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-937086989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6621f507eee48adbf6c5f390add9ed8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb15f644f-a8", "ovs_interfaceid": "b15f644f-a86c-46f9-a3d2-eb71bf66ad74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:37:20 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-88d17290-40b6-4607-8823-e6882e405c8b tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Converting VIF {"id": "b15f644f-a86c-46f9-a3d2-eb71bf66ad74", "address": "fa:16:3e:ad:f2:4d", "network": {"id": "20a0f634-b48d-4605-b66d-93e8b42c7d2d", "bridge": "br-int", "label": "tempest-VolumesActionsTest-937086989-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6621f507eee48adbf6c5f390add9ed8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb15f644f-a8", "ovs_interfaceid": "b15f644f-a86c-46f9-a3d2-eb71bf66ad74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:37:20 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-88d17290-40b6-4607-8823-e6882e405c8b tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:f2:4d,bridge_name='br-int',has_traffic_filtering=True,id=b15f644f-a86c-46f9-a3d2-eb71bf66ad74,network=Network(20a0f634-b48d-4605-b66d-93e8b42c7d2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb15f644f-a8') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:37:20 user nova-compute[73391]: DEBUG os_vif [None req-88d17290-40b6-4607-8823-e6882e405c8b tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:f2:4d,bridge_name='br-int',has_traffic_filtering=True,id=b15f644f-a86c-46f9-a3d2-eb71bf66ad74,network=Network(20a0f634-b48d-4605-b66d-93e8b42c7d2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb15f644f-a8') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:37:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb15f644f-a8, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:37:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:37:20 user nova-compute[73391]: INFO os_vif [None req-88d17290-40b6-4607-8823-e6882e405c8b tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:f2:4d,bridge_name='br-int',has_traffic_filtering=True,id=b15f644f-a86c-46f9-a3d2-eb71bf66ad74,network=Network(20a0f634-b48d-4605-b66d-93e8b42c7d2d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb15f644f-a8')
Aug 15 05:37:20 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-88d17290-40b6-4607-8823-e6882e405c8b tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Deleting instance files /opt/stack/data/nova/instances/64232f69-e64b-4d8d-a029-9d97679ff632_del
Aug 15 05:37:20 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-88d17290-40b6-4607-8823-e6882e405c8b tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Deletion of /opt/stack/data/nova/instances/64232f69-e64b-4d8d-a029-9d97679ff632_del complete
Aug 15 05:37:20 user nova-compute[73391]: INFO nova.compute.manager [None req-88d17290-40b6-4607-8823-e6882e405c8b tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Took 0.68 seconds to destroy the instance on the hypervisor.
Aug 15 05:37:20 user nova-compute[73391]: DEBUG oslo.service.loopingcall [None req-88d17290-40b6-4607-8823-e6882e405c8b tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 05:37:20 user nova-compute[73391]: DEBUG nova.compute.manager [-] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Deallocating network for instance {{(pid=73391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 05:37:20 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] deallocate_for_instance() {{(pid=73391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 05:37:20 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:37:20 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Took 0.63 seconds to deallocate network for instance.
Aug 15 05:37:20 user nova-compute[73391]: DEBUG nova.compute.manager [req-863842e7-4c1c-418c-9386-04bae260a243 req-d874359c-07dd-4eee-9067-bd979dba40d1 service nova] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Received event network-vif-deleted-b15f644f-a86c-46f9-a3d2-eb71bf66ad74 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:37:20 user nova-compute[73391]: INFO nova.compute.manager [req-863842e7-4c1c-418c-9386-04bae260a243 req-d874359c-07dd-4eee-9067-bd979dba40d1 service nova] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Neutron deleted interface b15f644f-a86c-46f9-a3d2-eb71bf66ad74; detaching it from the instance and deleting it from the info cache
Aug 15 05:37:20 user nova-compute[73391]: DEBUG nova.network.neutron [req-863842e7-4c1c-418c-9386-04bae260a243 req-d874359c-07dd-4eee-9067-bd979dba40d1 service nova] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:37:20 user nova-compute[73391]: DEBUG nova.compute.manager [req-863842e7-4c1c-418c-9386-04bae260a243 req-d874359c-07dd-4eee-9067-bd979dba40d1 service nova] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Detach interface failed, port_id=b15f644f-a86c-46f9-a3d2-eb71bf66ad74, reason: Instance 64232f69-e64b-4d8d-a029-9d97679ff632 could not be found. {{(pid=73391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 05:37:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-88d17290-40b6-4607-8823-e6882e405c8b tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:37:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-88d17290-40b6-4607-8823-e6882e405c8b tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:37:21 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-88d17290-40b6-4607-8823-e6882e405c8b tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:37:21 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-88d17290-40b6-4607-8823-e6882e405c8b tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:37:21 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-88d17290-40b6-4607-8823-e6882e405c8b tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.306s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:37:21 user nova-compute[73391]: INFO nova.scheduler.client.report [None req-88d17290-40b6-4607-8823-e6882e405c8b tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Deleted allocations for instance 64232f69-e64b-4d8d-a029-9d97679ff632
Aug 15 05:37:21 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-88d17290-40b6-4607-8823-e6882e405c8b tempest-VolumesActionsTest-702121303 tempest-VolumesActionsTest-702121303-project-member] Lock "64232f69-e64b-4d8d-a029-9d97679ff632" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.858s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:37:21 user nova-compute[73391]: DEBUG nova.compute.manager [req-f5fac148-96ea-4cda-97fa-aa896eb1754d req-b58ecafe-8777-403c-9f23-5a06bb922bad service nova] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Received event network-vif-plugged-b15f644f-a86c-46f9-a3d2-eb71bf66ad74 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:37:21 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f5fac148-96ea-4cda-97fa-aa896eb1754d req-b58ecafe-8777-403c-9f23-5a06bb922bad service nova] Acquiring lock "64232f69-e64b-4d8d-a029-9d97679ff632-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:37:21 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f5fac148-96ea-4cda-97fa-aa896eb1754d req-b58ecafe-8777-403c-9f23-5a06bb922bad service nova] Lock "64232f69-e64b-4d8d-a029-9d97679ff632-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:37:21 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f5fac148-96ea-4cda-97fa-aa896eb1754d req-b58ecafe-8777-403c-9f23-5a06bb922bad service nova] Lock "64232f69-e64b-4d8d-a029-9d97679ff632-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:37:21 user nova-compute[73391]: DEBUG nova.compute.manager [req-f5fac148-96ea-4cda-97fa-aa896eb1754d req-b58ecafe-8777-403c-9f23-5a06bb922bad service nova] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] No waiting events found dispatching network-vif-plugged-b15f644f-a86c-46f9-a3d2-eb71bf66ad74 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:37:21 user nova-compute[73391]: WARNING nova.compute.manager [req-f5fac148-96ea-4cda-97fa-aa896eb1754d req-b58ecafe-8777-403c-9f23-5a06bb922bad service nova] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Received unexpected event network-vif-plugged-b15f644f-a86c-46f9-a3d2-eb71bf66ad74 for instance with vm_state deleted and task_state None.
Aug 15 05:37:22 user nova-compute[73391]: DEBUG nova.compute.manager [req-faa5a6c5-ebec-4926-b930-7cdc4eefbf2a req-c5d14072-c7f3-4293-9622-7c0dd2ecc581 service nova] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Received event network-changed-fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:37:22 user nova-compute[73391]: DEBUG nova.compute.manager [req-faa5a6c5-ebec-4926-b930-7cdc4eefbf2a req-c5d14072-c7f3-4293-9622-7c0dd2ecc581 service nova] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Refreshing instance network info cache due to event network-changed-fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:37:22 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-faa5a6c5-ebec-4926-b930-7cdc4eefbf2a req-c5d14072-c7f3-4293-9622-7c0dd2ecc581 service nova] Acquiring lock "refresh_cache-fee43642-30e8-451b-919c-aca4cd4c3f81" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:37:22 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-faa5a6c5-ebec-4926-b930-7cdc4eefbf2a req-c5d14072-c7f3-4293-9622-7c0dd2ecc581 service nova] Acquired lock "refresh_cache-fee43642-30e8-451b-919c-aca4cd4c3f81" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:37:22 user nova-compute[73391]: DEBUG nova.network.neutron [req-faa5a6c5-ebec-4926-b930-7cdc4eefbf2a req-c5d14072-c7f3-4293-9622-7c0dd2ecc581 service nova] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Refreshing network info cache for port fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:37:23 user nova-compute[73391]: DEBUG nova.network.neutron [req-faa5a6c5-ebec-4926-b930-7cdc4eefbf2a req-c5d14072-c7f3-4293-9622-7c0dd2ecc581 service nova] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Updated VIF entry in instance network info cache for port fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:37:23 user nova-compute[73391]: DEBUG nova.network.neutron [req-faa5a6c5-ebec-4926-b930-7cdc4eefbf2a req-c5d14072-c7f3-4293-9622-7c0dd2ecc581 service nova] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Updating instance_info_cache with network_info: [{"id": "fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b", "address": "fa:16:3e:57:a8:64", "network": {"id": "c94dfbf4-6803-458e-b2c6-231298da7bc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090354282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f88922b3c294aea9efa3d80909a171a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdb4ce86-9a", "ovs_interfaceid": "fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:37:23 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-faa5a6c5-ebec-4926-b930-7cdc4eefbf2a req-c5d14072-c7f3-4293-9622-7c0dd2ecc581 service nova] Releasing lock "refresh_cache-fee43642-30e8-451b-919c-aca4cd4c3f81" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:37:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:25 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:26 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-39aa32e7-5c28-4963-ba8e-acccb0e996e7 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Acquiring lock "fee43642-30e8-451b-919c-aca4cd4c3f81" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:37:26 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-39aa32e7-5c28-4963-ba8e-acccb0e996e7 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "fee43642-30e8-451b-919c-aca4cd4c3f81" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:37:26 user nova-compute[73391]: DEBUG nova.objects.instance [None req-39aa32e7-5c28-4963-ba8e-acccb0e996e7 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lazy-loading 'flavor' on Instance uuid fee43642-30e8-451b-919c-aca4cd4c3f81 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:37:26 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-39aa32e7-5c28-4963-ba8e-acccb0e996e7 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "fee43642-30e8-451b-919c-aca4cd4c3f81" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:37:26 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-39aa32e7-5c28-4963-ba8e-acccb0e996e7 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Acquiring lock "fee43642-30e8-451b-919c-aca4cd4c3f81" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:37:26 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-39aa32e7-5c28-4963-ba8e-acccb0e996e7 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "fee43642-30e8-451b-919c-aca4cd4c3f81" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:37:26 user nova-compute[73391]: INFO nova.compute.manager [None req-39aa32e7-5c28-4963-ba8e-acccb0e996e7 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Attaching volume 83493878-2d16-44dc-b416-c6cadb17f0cd to /dev/vdb
Aug 15 05:37:26 user nova-compute[73391]: DEBUG os_brick.utils [None req-39aa32e7-5c28-4963-ba8e-acccb0e996e7 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:37:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:26 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[075ea8cd-f968-4ccf-925a-af406bd956ea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:37:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:26 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[122372b6-9f13-4135-96c3-513010c0238c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:37:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:26 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[474140d7-9526-474f-af78-fcbc3b717af6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:37:26 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d4134d8-eb79-48e0-b98d-9d2cb3256a9d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:37:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-39aa32e7-5c28-4963-ba8e-acccb0e996e7 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-39aa32e7-5c28-4963-ba8e-acccb0e996e7 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:37:26 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-39aa32e7-5c28-4963-ba8e-acccb0e996e7 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 05:37:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:37:26 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 05:37:26 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1fa91d-8a94-493d-a90b-91e04553630b]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:37:26 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-39aa32e7-5c28-4963-ba8e-acccb0e996e7 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 05:37:26 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-39aa32e7-5c28-4963-ba8e-acccb0e996e7 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 05:37:26 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-39aa32e7-5c28-4963-ba8e-acccb0e996e7 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 05:37:26 user nova-compute[73391]: DEBUG os_brick.utils [None req-39aa32e7-5c28-4963-ba8e-acccb0e996e7 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:37:26 user nova-compute[73391]: DEBUG nova.virt.block_device [None req-39aa32e7-5c28-4963-ba8e-acccb0e996e7 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Updating existing volume attachment record: 8fb1655a-d0b7-4ade-b8c8-7fd22ccc46ae {{(pid=73391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 05:37:29 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:34 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692077839.9839349, 64232f69-e64b-4d8d-a029-9d97679ff632 => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:37:34 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] VM Stopped (Lifecycle Event)
Aug 15 05:37:35 user nova-compute[73391]: DEBUG nova.compute.manager [None req-38a1c8cd-1c13-417d-bc80-0cacdb83b6d4 None None] [instance: 64232f69-e64b-4d8d-a029-9d97679ff632] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:37:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:36 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39aa32e7-5c28-4963-ba8e-acccb0e996e7 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 05:37:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-39aa32e7-5c28-4963-ba8e-acccb0e996e7 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NlCGZfgX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:37:36 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-39aa32e7-5c28-4963-ba8e-acccb0e996e7 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:37:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-39aa32e7-5c28-4963-ba8e-acccb0e996e7 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:37:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-39aa32e7-5c28-4963-ba8e-acccb0e996e7 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:37:36 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-39aa32e7-5c28-4963-ba8e-acccb0e996e7 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:37:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-39aa32e7-5c28-4963-ba8e-acccb0e996e7 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:37:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-39aa32e7-5c28-4963-ba8e-acccb0e996e7 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:37:36 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-39aa32e7-5c28-4963-ba8e-acccb0e996e7 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 05:37:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:36 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[22469338-e02e-4cab-bba3-0c1f60676cda]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:37:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-39aa32e7-5c28-4963-ba8e-acccb0e996e7 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 05:37:36 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:37:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:36 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d902fe-912c-4837-9aef-0549cb7200df]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:37:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-39aa32e7-5c28-4963-ba8e-acccb0e996e7 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd] added
Aug 15 05:37:36 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:37:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:36 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[adaf6af8-fbdc-4095-bfa7-636238b55039]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:37:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-39aa32e7-5c28-4963-ba8e-acccb0e996e7 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:37:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.096s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:36 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4d3148-bea9-4912-a8c5-6802136eac61]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:37:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-39aa32e7-5c28-4963-ba8e-acccb0e996e7 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:37:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NlCGZfgX {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NlCGZfgX" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:36 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d30765f-a007-4175-ab54-96ad16e0836e]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:37:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-39aa32e7-5c28-4963-ba8e-acccb0e996e7 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NlCGZfgX'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:37:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:36 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7cb1090-8f74-4a24-a57c-5221ee98cf43]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:37:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-39aa32e7-5c28-4963-ba8e-acccb0e996e7 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:37:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:36 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[669dc89e-c9cb-4ed4-9bff-2f160f980504]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:37:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-39aa32e7-5c28-4963-ba8e-acccb0e996e7 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:37:36 user nova-compute[73391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)
Aug 15 05:37:36 user nova-compute[73391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)
Aug 15 05:37:36 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:37:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-39aa32e7-5c28-4963-ba8e-acccb0e996e7 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:37:36 user nova-compute[73391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)
Aug 15 05:37:36 user nova-compute[73391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)
Aug 15 05:37:36 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:37:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:36 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2c3853-6c7f-4f33-9c6c-d5158400b4ca]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:37:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-39aa32e7-5c28-4963-ba8e-acccb0e996e7 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd, portal: 172.16.0.220,3260]
Aug 15 05:37:36 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd, portal: 172.16.0.220,3260] successful.
Aug 15 05:37:36 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:37:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:36 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[66bf2dc4-3862-4b83-a1ec-11f741551490]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:37:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-39aa32e7-5c28-4963-ba8e-acccb0e996e7 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:37:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:36 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9593a7e-5ac6-44ab-98b5-e986cb24ea7d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:37:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-39aa32e7-5c28-4963-ba8e-acccb0e996e7 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:37:36 user nova-compute[73391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)
Aug 15 05:37:36 user nova-compute[73391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)
Aug 15 05:37:36 user nova-compute[73391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)
Aug 15 05:37:36 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:37:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-39aa32e7-5c28-4963-ba8e-acccb0e996e7 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:37:36 user nova-compute[73391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)
Aug 15 05:37:36 user nova-compute[73391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)
Aug 15 05:37:36 user nova-compute[73391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)
Aug 15 05:37:36 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:37:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-39aa32e7-5c28-4963-ba8e-acccb0e996e7 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.388s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:37:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-39aa32e7-5c28-4963-ba8e-acccb0e996e7 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 05:37:36 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-39aa32e7-5c28-4963-ba8e-acccb0e996e7 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] HCTL ('34', '-', '-', 0) found on session 27 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 05:37:36 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-39aa32e7-5c28-4963-ba8e-acccb0e996e7 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 05:37:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:36 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ba5573-5d35-4ef6-85bd-1702e882fbc8]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:37:36 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-39aa32e7-5c28-4963-ba8e-acccb0e996e7 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:37:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-39aa32e7-5c28-4963-ba8e-acccb0e996e7 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NlCGZfgX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 05:37:37 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:37 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-39aa32e7-5c28-4963-ba8e-acccb0e996e7 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.427s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:37:37 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-39aa32e7-5c28-4963-ba8e-acccb0e996e7 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] <== connect_volume: return (1428ms) {'type': 'block', 'scsi_wwn': '26661383139653538', 'path': '/dev/sdc'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:37:37 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-39aa32e7-5c28-4963-ba8e-acccb0e996e7 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661383139653538', 'path': '/dev/sdc'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 05:37:37 user nova-compute[73391]: DEBUG nova.objects.instance [None req-39aa32e7-5c28-4963-ba8e-acccb0e996e7 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lazy-loading 'flavor' on Instance uuid fee43642-30e8-451b-919c-aca4cd4c3f81 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:37:37 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-39aa32e7-5c28-4963-ba8e-acccb0e996e7 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 05:37:37 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:37:37 user nova-compute[73391]:   <source dev="/dev/sdc"/>
Aug 15 05:37:37 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:37:37 user nova-compute[73391]:   <serial>83493878-2d16-44dc-b416-c6cadb17f0cd</serial>
Aug 15 05:37:37 user nova-compute[73391]: </disk>
Aug 15 05:37:37 user nova-compute[73391]:  {{(pid=73391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 05:37:38 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-39aa32e7-5c28-4963-ba8e-acccb0e996e7 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:37:38 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-39aa32e7-5c28-4963-ba8e-acccb0e996e7 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:37:38 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-39aa32e7-5c28-4963-ba8e-acccb0e996e7 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] No VIF found with MAC fa:16:3e:57:a8:64, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:37:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-39aa32e7-5c28-4963-ba8e-acccb0e996e7 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "fee43642-30e8-451b-919c-aca4cd4c3f81" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.970s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:37:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e98cce1c-d4e5-4c84-8904-40e8bc886963 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Acquiring lock "fee43642-30e8-451b-919c-aca4cd4c3f81" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:37:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e98cce1c-d4e5-4c84-8904-40e8bc886963 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "fee43642-30e8-451b-919c-aca4cd4c3f81" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:37:39 user nova-compute[73391]: DEBUG nova.compute.manager [None req-e98cce1c-d4e5-4c84-8904-40e8bc886963 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:37:39 user nova-compute[73391]: DEBUG nova.compute.manager [None req-e98cce1c-d4e5-4c84-8904-40e8bc886963 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73391) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 15 05:37:39 user nova-compute[73391]: DEBUG nova.objects.instance [None req-e98cce1c-d4e5-4c84-8904-40e8bc886963 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lazy-loading 'flavor' on Instance uuid fee43642-30e8-451b-919c-aca4cd4c3f81 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:37:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquiring lock "b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:37:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:37:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:39 user nova-compute[73391]: DEBUG nova.compute.manager [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Starting instance... {{(pid=73391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 05:37:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:37:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:37:39 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 05:37:39 user nova-compute[73391]: INFO nova.compute.claims [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Claim successful on node user
Aug 15 05:37:39 user nova-compute[73391]: DEBUG nova.compute.manager [req-6f26e2c7-d24b-41e0-9f04-f056ac692947 req-332dcdd0-26e1-4034-96bc-f4f8b1c6c82d service nova] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Received event network-vif-unplugged-fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:37:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-6f26e2c7-d24b-41e0-9f04-f056ac692947 req-332dcdd0-26e1-4034-96bc-f4f8b1c6c82d service nova] Acquiring lock "fee43642-30e8-451b-919c-aca4cd4c3f81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:37:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-6f26e2c7-d24b-41e0-9f04-f056ac692947 req-332dcdd0-26e1-4034-96bc-f4f8b1c6c82d service nova] Lock "fee43642-30e8-451b-919c-aca4cd4c3f81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:37:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-6f26e2c7-d24b-41e0-9f04-f056ac692947 req-332dcdd0-26e1-4034-96bc-f4f8b1c6c82d service nova] Lock "fee43642-30e8-451b-919c-aca4cd4c3f81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:37:39 user nova-compute[73391]: DEBUG nova.compute.manager [req-6f26e2c7-d24b-41e0-9f04-f056ac692947 req-332dcdd0-26e1-4034-96bc-f4f8b1c6c82d service nova] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] No waiting events found dispatching network-vif-unplugged-fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:37:39 user nova-compute[73391]: WARNING nova.compute.manager [req-6f26e2c7-d24b-41e0-9f04-f056ac692947 req-332dcdd0-26e1-4034-96bc-f4f8b1c6c82d service nova] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Received unexpected event network-vif-unplugged-fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b for instance with vm_state active and task_state powering-off.
Aug 15 05:37:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:40 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:37:40 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Instance destroyed successfully.
Aug 15 05:37:40 user nova-compute[73391]: DEBUG nova.compute.manager [None req-e98cce1c-d4e5-4c84-8904-40e8bc886963 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:37:40 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:37:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.674s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:37:40 user nova-compute[73391]: DEBUG nova.compute.manager [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Start building networks asynchronously for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 05:37:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e98cce1c-d4e5-4c84-8904-40e8bc886963 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "fee43642-30e8-451b-919c-aca4cd4c3f81" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.029s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:37:40 user nova-compute[73391]: DEBUG nova.compute.manager [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Allocating IP information in the background. {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 05:37:40 user nova-compute[73391]: DEBUG nova.network.neutron [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] allocate_for_instance() {{(pid=73391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 05:37:40 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 05:37:40 user nova-compute[73391]: DEBUG nova.compute.manager [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Start building block device mappings for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 05:37:40 user nova-compute[73391]: DEBUG nova.policy [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '887f0846cf554e12acf92a663f5ab266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b9acbe11654053bb905e7c92558a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73391) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 05:37:40 user nova-compute[73391]: DEBUG nova.compute.manager [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Start spawning the instance on the hypervisor. {{(pid=73391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 05:37:40 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Creating instance directory {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 05:37:40 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Creating image(s)
Aug 15 05:37:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquiring lock "/opt/stack/data/nova/instances/b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:37:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "/opt/stack/data/nova/instances/b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:37:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "/opt/stack/data/nova/instances/b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:37:40 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:40 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.201s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquiring lock "999b315ba87151d8252d543312ae7790e7e1583b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:37:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:37:40 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.191s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1/disk 1073741824 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1/disk 1073741824" returned: 0 in 0.057s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:37:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.205s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:41 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1/disk. size=1073741824 {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 05:37:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:41 user nova-compute[73391]: DEBUG nova.network.neutron [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Successfully created port: 662afb36-6d3a-415d-bc25-d319b7d5cf1a {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 05:37:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:41 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Cannot resize image /opt/stack/data/nova/instances/b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1/disk to a smaller size. {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 05:37:41 user nova-compute[73391]: DEBUG nova.objects.instance [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lazy-loading 'migration_context' on Instance uuid b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:37:41 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Created local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 05:37:41 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Ensure instance console log exists: /opt/stack/data/nova/instances/b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 05:37:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:37:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:37:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:37:41 user nova-compute[73391]: DEBUG nova.compute.manager [req-ae95c07b-0469-4fed-b3cc-d1aba64591ed req-62baf53c-69b1-4ac2-83c7-26ba863330b6 service nova] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Received event network-vif-plugged-fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:37:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ae95c07b-0469-4fed-b3cc-d1aba64591ed req-62baf53c-69b1-4ac2-83c7-26ba863330b6 service nova] Acquiring lock "fee43642-30e8-451b-919c-aca4cd4c3f81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:37:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ae95c07b-0469-4fed-b3cc-d1aba64591ed req-62baf53c-69b1-4ac2-83c7-26ba863330b6 service nova] Lock "fee43642-30e8-451b-919c-aca4cd4c3f81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:37:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ae95c07b-0469-4fed-b3cc-d1aba64591ed req-62baf53c-69b1-4ac2-83c7-26ba863330b6 service nova] Lock "fee43642-30e8-451b-919c-aca4cd4c3f81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:37:41 user nova-compute[73391]: DEBUG nova.compute.manager [req-ae95c07b-0469-4fed-b3cc-d1aba64591ed req-62baf53c-69b1-4ac2-83c7-26ba863330b6 service nova] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] No waiting events found dispatching network-vif-plugged-fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:37:41 user nova-compute[73391]: WARNING nova.compute.manager [req-ae95c07b-0469-4fed-b3cc-d1aba64591ed req-62baf53c-69b1-4ac2-83c7-26ba863330b6 service nova] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Received unexpected event network-vif-plugged-fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b for instance with vm_state stopped and task_state None.
Aug 15 05:37:42 user nova-compute[73391]: DEBUG nova.network.neutron [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Successfully updated port: 662afb36-6d3a-415d-bc25-d319b7d5cf1a {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:37:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquiring lock "refresh_cache-b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:37:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquired lock "refresh_cache-b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:37:42 user nova-compute[73391]: DEBUG nova.network.neutron [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:37:42 user nova-compute[73391]: DEBUG nova.compute.manager [req-e2f6033a-f13c-4153-927a-dfed69c548b4 req-e26fd582-0084-4af8-b1a5-d2c711904f17 service nova] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Received event network-changed-662afb36-6d3a-415d-bc25-d319b7d5cf1a {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:37:42 user nova-compute[73391]: DEBUG nova.compute.manager [req-e2f6033a-f13c-4153-927a-dfed69c548b4 req-e26fd582-0084-4af8-b1a5-d2c711904f17 service nova] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Refreshing instance network info cache due to event network-changed-662afb36-6d3a-415d-bc25-d319b7d5cf1a. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:37:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e2f6033a-f13c-4153-927a-dfed69c548b4 req-e26fd582-0084-4af8-b1a5-d2c711904f17 service nova] Acquiring lock "refresh_cache-b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:37:42 user nova-compute[73391]: DEBUG nova.network.neutron [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:37:42 user nova-compute[73391]: DEBUG nova.network.neutron [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Updating instance_info_cache with network_info: [{"id": "662afb36-6d3a-415d-bc25-d319b7d5cf1a", "address": "fa:16:3e:d5:32:d3", "network": {"id": "70d88082-aea7-48bb-abb4-d77d264aaf01", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b9acbe11654053bb905e7c92558a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap662afb36-6d", "ovs_interfaceid": "662afb36-6d3a-415d-bc25-d319b7d5cf1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:37:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Releasing lock "refresh_cache-b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:37:42 user nova-compute[73391]: DEBUG nova.compute.manager [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Instance network_info: |[{"id": "662afb36-6d3a-415d-bc25-d319b7d5cf1a", "address": "fa:16:3e:d5:32:d3", "network": {"id": "70d88082-aea7-48bb-abb4-d77d264aaf01", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b9acbe11654053bb905e7c92558a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap662afb36-6d", "ovs_interfaceid": "662afb36-6d3a-415d-bc25-d319b7d5cf1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 05:37:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e2f6033a-f13c-4153-927a-dfed69c548b4 req-e26fd582-0084-4af8-b1a5-d2c711904f17 service nova] Acquired lock "refresh_cache-b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:37:42 user nova-compute[73391]: DEBUG nova.network.neutron [req-e2f6033a-f13c-4153-927a-dfed69c548b4 req-e26fd582-0084-4af8-b1a5-d2c711904f17 service nova] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Refreshing network info cache for port 662afb36-6d3a-415d-bc25-d319b7d5cf1a {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:37:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Start _get_guest_xml network_info=[{"id": "662afb36-6d3a-415d-bc25-d319b7d5cf1a", "address": "fa:16:3e:d5:32:d3", "network": {"id": "70d88082-aea7-48bb-abb4-d77d264aaf01", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b9acbe11654053bb905e7c92558a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap662afb36-6d", "ovs_interfaceid": "662afb36-6d3a-415d-bc25-d319b7d5cf1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '191b1dad-305e-4d1c-9b15-515ec59a3278'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:37:42 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:37:42 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:37:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:37:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:37:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:37:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:37:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:37:42 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:37:42 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:37:42 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:37:42 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:37:42 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:37:42 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:37:42 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:37:42 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:37:42 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:37:42 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:37:42 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:37:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:37:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2061552665',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2061552665',id=23,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83b9acbe11654053bb905e7c92558a35',ramdisk_id='',reservation_id='r-j0zhhtni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1045163116',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:37:41Z,user_data=None,user_id='887f0846cf554e12acf92a663f5ab266',uuid=b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "662afb36-6d3a-415d-bc25-d319b7d5cf1a", "address": "fa:16:3e:d5:32:d3", "network": {"id": "70d88082-aea7-48bb-abb4-d77d264aaf01", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b9acbe11654053bb905e7c92558a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap662afb36-6d", "ovs_interfaceid": "662afb36-6d3a-415d-bc25-d319b7d5cf1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:37:42 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Converting VIF {"id": "662afb36-6d3a-415d-bc25-d319b7d5cf1a", "address": "fa:16:3e:d5:32:d3", "network": {"id": "70d88082-aea7-48bb-abb4-d77d264aaf01", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b9acbe11654053bb905e7c92558a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap662afb36-6d", "ovs_interfaceid": "662afb36-6d3a-415d-bc25-d319b7d5cf1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:37:42 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:32:d3,bridge_name='br-int',has_traffic_filtering=True,id=662afb36-6d3a-415d-bc25-d319b7d5cf1a,network=Network(70d88082-aea7-48bb-abb4-d77d264aaf01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap662afb36-6d') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:37:42 user nova-compute[73391]: DEBUG nova.objects.instance [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lazy-loading 'pci_devices' on Instance uuid b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:37:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:37:42 user nova-compute[73391]:   <uuid>b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1</uuid>
Aug 15 05:37:42 user nova-compute[73391]:   <name>instance-00000017</name>
Aug 15 05:37:42 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:37:42 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:37:42 user nova-compute[73391]:   <metadata>
Aug 15 05:37:42 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:37:42 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:37:42 user nova-compute[73391]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-2061552665</nova:name>
Aug 15 05:37:42 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:37:42</nova:creationTime>
Aug 15 05:37:42 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:37:42 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:37:42 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:37:42 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:37:42 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:37:42 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:37:42 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:37:42 user nova-compute[73391]:       <nova:owner>
Aug 15 05:37:42 user nova-compute[73391]:         <nova:user uuid="887f0846cf554e12acf92a663f5ab266">tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member</nova:user>
Aug 15 05:37:42 user nova-compute[73391]:         <nova:project uuid="83b9acbe11654053bb905e7c92558a35">tempest-ServerBootFromVolumeStableRescueTest-1045163116</nova:project>
Aug 15 05:37:42 user nova-compute[73391]:       </nova:owner>
Aug 15 05:37:42 user nova-compute[73391]:       <nova:root type="image" uuid="191b1dad-305e-4d1c-9b15-515ec59a3278"/>
Aug 15 05:37:42 user nova-compute[73391]:       <nova:ports>
Aug 15 05:37:42 user nova-compute[73391]:         <nova:port uuid="662afb36-6d3a-415d-bc25-d319b7d5cf1a">
Aug 15 05:37:42 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 15 05:37:42 user nova-compute[73391]:         </nova:port>
Aug 15 05:37:42 user nova-compute[73391]:       </nova:ports>
Aug 15 05:37:42 user nova-compute[73391]:     </nova:instance>
Aug 15 05:37:42 user nova-compute[73391]:   </metadata>
Aug 15 05:37:42 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:37:42 user nova-compute[73391]:     <system>
Aug 15 05:37:42 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:37:42 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:37:42 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:37:42 user nova-compute[73391]:       <entry name="serial">b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1</entry>
Aug 15 05:37:42 user nova-compute[73391]:       <entry name="uuid">b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1</entry>
Aug 15 05:37:42 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:37:42 user nova-compute[73391]:     </system>
Aug 15 05:37:42 user nova-compute[73391]:   </sysinfo>
Aug 15 05:37:42 user nova-compute[73391]:   <os>
Aug 15 05:37:42 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:37:42 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:37:42 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:37:42 user nova-compute[73391]:   </os>
Aug 15 05:37:42 user nova-compute[73391]:   <features>
Aug 15 05:37:42 user nova-compute[73391]:     <acpi/>
Aug 15 05:37:42 user nova-compute[73391]:     <apic/>
Aug 15 05:37:42 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:37:42 user nova-compute[73391]:   </features>
Aug 15 05:37:42 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:37:42 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:37:42 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:37:42 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:37:42 user nova-compute[73391]:   </clock>
Aug 15 05:37:42 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:37:42 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:37:42 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:37:42 user nova-compute[73391]:   </cpu>
Aug 15 05:37:42 user nova-compute[73391]:   <devices>
Aug 15 05:37:42 user nova-compute[73391]:     <disk type="file" device="disk">
Aug 15 05:37:42 user nova-compute[73391]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 05:37:42 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1/disk"/>
Aug 15 05:37:42 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:37:42 user nova-compute[73391]:     </disk>
Aug 15 05:37:42 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:37:42 user nova-compute[73391]:       <mac address="fa:16:3e:d5:32:d3"/>
Aug 15 05:37:42 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:37:42 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:37:42 user nova-compute[73391]:       <target dev="tap662afb36-6d"/>
Aug 15 05:37:42 user nova-compute[73391]:     </interface>
Aug 15 05:37:42 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:37:42 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1/console.log" append="off"/>
Aug 15 05:37:42 user nova-compute[73391]:     </serial>
Aug 15 05:37:42 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:37:42 user nova-compute[73391]:     <video>
Aug 15 05:37:42 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:37:42 user nova-compute[73391]:     </video>
Aug 15 05:37:42 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:37:42 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:37:42 user nova-compute[73391]:     </rng>
Aug 15 05:37:42 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:37:42 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:37:42 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:37:42 user nova-compute[73391]:     </memballoon>
Aug 15 05:37:42 user nova-compute[73391]:   </devices>
Aug 15 05:37:42 user nova-compute[73391]: </domain>
Aug 15 05:37:42 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:37:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:37:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2061552665',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2061552665',id=23,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83b9acbe11654053bb905e7c92558a35',ramdisk_id='',reservation_id='r-j0zhhtni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1045163116',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:37:41Z,user_data=None,user_id='887f0846cf554e12acf92a663f5ab266',uuid=b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "662afb36-6d3a-415d-bc25-d319b7d5cf1a", "address": "fa:16:3e:d5:32:d3", "network": {"id": "70d88082-aea7-48bb-abb4-d77d264aaf01", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b9acbe11654053bb905e7c92558a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap662afb36-6d", "ovs_interfaceid": "662afb36-6d3a-415d-bc25-d319b7d5cf1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:37:42 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Converting VIF {"id": "662afb36-6d3a-415d-bc25-d319b7d5cf1a", "address": "fa:16:3e:d5:32:d3", "network": {"id": "70d88082-aea7-48bb-abb4-d77d264aaf01", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b9acbe11654053bb905e7c92558a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap662afb36-6d", "ovs_interfaceid": "662afb36-6d3a-415d-bc25-d319b7d5cf1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:37:42 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:32:d3,bridge_name='br-int',has_traffic_filtering=True,id=662afb36-6d3a-415d-bc25-d319b7d5cf1a,network=Network(70d88082-aea7-48bb-abb4-d77d264aaf01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap662afb36-6d') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:37:42 user nova-compute[73391]: DEBUG os_vif [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:32:d3,bridge_name='br-int',has_traffic_filtering=True,id=662afb36-6d3a-415d-bc25-d319b7d5cf1a,network=Network(70d88082-aea7-48bb-abb4-d77d264aaf01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap662afb36-6d') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:37:42 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:42 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:37:42 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:37:42 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:42 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap662afb36-6d, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:37:42 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap662afb36-6d, col_values=(('external_ids', {'iface-id': '662afb36-6d3a-415d-bc25-d319b7d5cf1a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:32:d3', 'vm-uuid': 'b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:37:42 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:42 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:37:42 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:42 user nova-compute[73391]: INFO os_vif [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:32:d3,bridge_name='br-int',has_traffic_filtering=True,id=662afb36-6d3a-415d-bc25-d319b7d5cf1a,network=Network(70d88082-aea7-48bb-abb4-d77d264aaf01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap662afb36-6d')
Aug 15 05:37:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:37:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] No VIF found with MAC fa:16:3e:d5:32:d3, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:37:42 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:43 user nova-compute[73391]: DEBUG nova.network.neutron [req-e2f6033a-f13c-4153-927a-dfed69c548b4 req-e26fd582-0084-4af8-b1a5-d2c711904f17 service nova] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Updated VIF entry in instance network info cache for port 662afb36-6d3a-415d-bc25-d319b7d5cf1a. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:37:43 user nova-compute[73391]: DEBUG nova.network.neutron [req-e2f6033a-f13c-4153-927a-dfed69c548b4 req-e26fd582-0084-4af8-b1a5-d2c711904f17 service nova] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Updating instance_info_cache with network_info: [{"id": "662afb36-6d3a-415d-bc25-d319b7d5cf1a", "address": "fa:16:3e:d5:32:d3", "network": {"id": "70d88082-aea7-48bb-abb4-d77d264aaf01", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b9acbe11654053bb905e7c92558a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap662afb36-6d", "ovs_interfaceid": "662afb36-6d3a-415d-bc25-d319b7d5cf1a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:37:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e2f6033a-f13c-4153-927a-dfed69c548b4 req-e26fd582-0084-4af8-b1a5-d2c711904f17 service nova] Releasing lock "refresh_cache-b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:37:44 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:44 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:44 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:44 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:44 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:44 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:45 user nova-compute[73391]: DEBUG nova.compute.manager [req-3505e1a9-7ca5-476c-b3e5-95c536030842 req-5aa4a782-f639-4a8c-9255-528263c95522 service nova] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Received event network-vif-plugged-662afb36-6d3a-415d-bc25-d319b7d5cf1a {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:37:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-3505e1a9-7ca5-476c-b3e5-95c536030842 req-5aa4a782-f639-4a8c-9255-528263c95522 service nova] Acquiring lock "b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:37:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-3505e1a9-7ca5-476c-b3e5-95c536030842 req-5aa4a782-f639-4a8c-9255-528263c95522 service nova] Lock "b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:37:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-3505e1a9-7ca5-476c-b3e5-95c536030842 req-5aa4a782-f639-4a8c-9255-528263c95522 service nova] Lock "b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:37:45 user nova-compute[73391]: DEBUG nova.compute.manager [req-3505e1a9-7ca5-476c-b3e5-95c536030842 req-5aa4a782-f639-4a8c-9255-528263c95522 service nova] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] No waiting events found dispatching network-vif-plugged-662afb36-6d3a-415d-bc25-d319b7d5cf1a {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:37:45 user nova-compute[73391]: WARNING nova.compute.manager [req-3505e1a9-7ca5-476c-b3e5-95c536030842 req-5aa4a782-f639-4a8c-9255-528263c95522 service nova] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Received unexpected event network-vif-plugged-662afb36-6d3a-415d-bc25-d319b7d5cf1a for instance with vm_state building and task_state spawning.
Aug 15 05:37:45 user nova-compute[73391]: DEBUG nova.compute.manager [req-8f645b81-c8a3-45cb-a20b-d88afb5949e6 req-2841c208-86fc-4734-89fb-aecb696bb8de service nova] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Received event network-changed-46454c88-9007-47b1-a199-b80afdf843f1 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:37:45 user nova-compute[73391]: DEBUG nova.compute.manager [req-8f645b81-c8a3-45cb-a20b-d88afb5949e6 req-2841c208-86fc-4734-89fb-aecb696bb8de service nova] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Refreshing instance network info cache due to event network-changed-46454c88-9007-47b1-a199-b80afdf843f1. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:37:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-8f645b81-c8a3-45cb-a20b-d88afb5949e6 req-2841c208-86fc-4734-89fb-aecb696bb8de service nova] Acquiring lock "refresh_cache-8d344530-40f9-43f0-8417-15110c6c9748" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:37:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-8f645b81-c8a3-45cb-a20b-d88afb5949e6 req-2841c208-86fc-4734-89fb-aecb696bb8de service nova] Acquired lock "refresh_cache-8d344530-40f9-43f0-8417-15110c6c9748" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:37:45 user nova-compute[73391]: DEBUG nova.network.neutron [req-8f645b81-c8a3-45cb-a20b-d88afb5949e6 req-2841c208-86fc-4734-89fb-aecb696bb8de service nova] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Refreshing network info cache for port 46454c88-9007-47b1-a199-b80afdf843f1 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:37:46 user nova-compute[73391]: DEBUG nova.network.neutron [req-8f645b81-c8a3-45cb-a20b-d88afb5949e6 req-2841c208-86fc-4734-89fb-aecb696bb8de service nova] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Updated VIF entry in instance network info cache for port 46454c88-9007-47b1-a199-b80afdf843f1. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:37:46 user nova-compute[73391]: DEBUG nova.network.neutron [req-8f645b81-c8a3-45cb-a20b-d88afb5949e6 req-2841c208-86fc-4734-89fb-aecb696bb8de service nova] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Updating instance_info_cache with network_info: [{"id": "46454c88-9007-47b1-a199-b80afdf843f1", "address": "fa:16:3e:d4:7c:d2", "network": {"id": "234a8df7-8eea-44bf-ae16-0840862765d4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1326637884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a88327b042847d5b910c53bda19976b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46454c88-90", "ovs_interfaceid": "46454c88-9007-47b1-a199-b80afdf843f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:37:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-8f645b81-c8a3-45cb-a20b-d88afb5949e6 req-2841c208-86fc-4734-89fb-aecb696bb8de service nova] Releasing lock "refresh_cache-8d344530-40f9-43f0-8417-15110c6c9748" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:37:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ec5634c4-c06f-48e4-8802-aa785bfa6941 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Acquiring lock "8d344530-40f9-43f0-8417-15110c6c9748" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:37:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ec5634c4-c06f-48e4-8802-aa785bfa6941 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Lock "8d344530-40f9-43f0-8417-15110c6c9748" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:37:46 user nova-compute[73391]: INFO nova.compute.manager [None req-ec5634c4-c06f-48e4-8802-aa785bfa6941 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Shelve offloading
Aug 15 05:37:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:46 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077866.5097551, b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1 => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:37:46 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] VM Resumed (Lifecycle Event)
Aug 15 05:37:46 user nova-compute[73391]: DEBUG nova.compute.manager [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:37:46 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Guest created on hypervisor {{(pid=73391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 05:37:46 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Instance spawned successfully.
Aug 15 05:37:46 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 05:37:46 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:37:46 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:37:46 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Found default for hw_cdrom_bus of ide {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:37:46 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Found default for hw_disk_bus of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:37:46 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Found default for hw_input_bus of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:37:46 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Found default for hw_pointer_model of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:37:46 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Found default for hw_video_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:37:46 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Found default for hw_vif_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:37:46 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:37:46 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077866.512978, b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1 => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:37:46 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] VM Started (Lifecycle Event)
Aug 15 05:37:46 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:37:46 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:37:46 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:37:46 user nova-compute[73391]: INFO nova.compute.manager [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Took 5.99 seconds to spawn the instance on the hypervisor.
Aug 15 05:37:46 user nova-compute[73391]: DEBUG nova.compute.manager [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:37:46 user nova-compute[73391]: INFO nova.compute.manager [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Took 7.07 seconds to build instance.
Aug 15 05:37:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-97672f5c-e2ee-47ed-8a8d-f151037d524f tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.202s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:37:47 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Instance destroyed successfully.
Aug 15 05:37:47 user nova-compute[73391]: DEBUG nova.compute.manager [None req-ec5634c4-c06f-48e4-8802-aa785bfa6941 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:37:47 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ec5634c4-c06f-48e4-8802-aa785bfa6941 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Acquiring lock "refresh_cache-8d344530-40f9-43f0-8417-15110c6c9748" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:37:47 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ec5634c4-c06f-48e4-8802-aa785bfa6941 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Acquired lock "refresh_cache-8d344530-40f9-43f0-8417-15110c6c9748" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:37:47 user nova-compute[73391]: DEBUG nova.network.neutron [None req-ec5634c4-c06f-48e4-8802-aa785bfa6941 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:37:47 user nova-compute[73391]: DEBUG nova.compute.manager [req-d3b2fc0a-c6c8-4a88-9bb8-ec409c1cd813 req-4dd8b666-d94d-4094-a0fb-bdbbc6c4150c service nova] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Received event network-vif-plugged-662afb36-6d3a-415d-bc25-d319b7d5cf1a {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:37:47 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d3b2fc0a-c6c8-4a88-9bb8-ec409c1cd813 req-4dd8b666-d94d-4094-a0fb-bdbbc6c4150c service nova] Acquiring lock "b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:37:47 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d3b2fc0a-c6c8-4a88-9bb8-ec409c1cd813 req-4dd8b666-d94d-4094-a0fb-bdbbc6c4150c service nova] Lock "b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:37:47 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d3b2fc0a-c6c8-4a88-9bb8-ec409c1cd813 req-4dd8b666-d94d-4094-a0fb-bdbbc6c4150c service nova] Lock "b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:37:47 user nova-compute[73391]: DEBUG nova.compute.manager [req-d3b2fc0a-c6c8-4a88-9bb8-ec409c1cd813 req-4dd8b666-d94d-4094-a0fb-bdbbc6c4150c service nova] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] No waiting events found dispatching network-vif-plugged-662afb36-6d3a-415d-bc25-d319b7d5cf1a {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:37:47 user nova-compute[73391]: WARNING nova.compute.manager [req-d3b2fc0a-c6c8-4a88-9bb8-ec409c1cd813 req-4dd8b666-d94d-4094-a0fb-bdbbc6c4150c service nova] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Received unexpected event network-vif-plugged-662afb36-6d3a-415d-bc25-d319b7d5cf1a for instance with vm_state active and task_state None.
Aug 15 05:37:47 user nova-compute[73391]: DEBUG nova.compute.manager [req-d3b2fc0a-c6c8-4a88-9bb8-ec409c1cd813 req-4dd8b666-d94d-4094-a0fb-bdbbc6c4150c service nova] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Received event network-vif-unplugged-46454c88-9007-47b1-a199-b80afdf843f1 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:37:47 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d3b2fc0a-c6c8-4a88-9bb8-ec409c1cd813 req-4dd8b666-d94d-4094-a0fb-bdbbc6c4150c service nova] Acquiring lock "8d344530-40f9-43f0-8417-15110c6c9748-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:37:47 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d3b2fc0a-c6c8-4a88-9bb8-ec409c1cd813 req-4dd8b666-d94d-4094-a0fb-bdbbc6c4150c service nova] Lock "8d344530-40f9-43f0-8417-15110c6c9748-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:37:47 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d3b2fc0a-c6c8-4a88-9bb8-ec409c1cd813 req-4dd8b666-d94d-4094-a0fb-bdbbc6c4150c service nova] Lock "8d344530-40f9-43f0-8417-15110c6c9748-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:37:47 user nova-compute[73391]: DEBUG nova.compute.manager [req-d3b2fc0a-c6c8-4a88-9bb8-ec409c1cd813 req-4dd8b666-d94d-4094-a0fb-bdbbc6c4150c service nova] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] No waiting events found dispatching network-vif-unplugged-46454c88-9007-47b1-a199-b80afdf843f1 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:37:47 user nova-compute[73391]: WARNING nova.compute.manager [req-d3b2fc0a-c6c8-4a88-9bb8-ec409c1cd813 req-4dd8b666-d94d-4094-a0fb-bdbbc6c4150c service nova] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Received unexpected event network-vif-unplugged-46454c88-9007-47b1-a199-b80afdf843f1 for instance with vm_state active and task_state shelving.
Aug 15 05:37:47 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:47 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:48 user nova-compute[73391]: DEBUG nova.network.neutron [None req-ec5634c4-c06f-48e4-8802-aa785bfa6941 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Updating instance_info_cache with network_info: [{"id": "46454c88-9007-47b1-a199-b80afdf843f1", "address": "fa:16:3e:d4:7c:d2", "network": {"id": "234a8df7-8eea-44bf-ae16-0840862765d4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1326637884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a88327b042847d5b910c53bda19976b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46454c88-90", "ovs_interfaceid": "46454c88-9007-47b1-a199-b80afdf843f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:37:48 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ec5634c4-c06f-48e4-8802-aa785bfa6941 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Releasing lock "refresh_cache-8d344530-40f9-43f0-8417-15110c6c9748" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:37:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG nova.compute.manager [req-4879a99c-09d6-4574-b02e-5da723231950 req-45b86c86-b74a-4510-86af-dd648287e15e service nova] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Received event network-vif-plugged-46454c88-9007-47b1-a199-b80afdf843f1 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-4879a99c-09d6-4574-b02e-5da723231950 req-45b86c86-b74a-4510-86af-dd648287e15e service nova] Acquiring lock "8d344530-40f9-43f0-8417-15110c6c9748-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-4879a99c-09d6-4574-b02e-5da723231950 req-45b86c86-b74a-4510-86af-dd648287e15e service nova] Lock "8d344530-40f9-43f0-8417-15110c6c9748-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-4879a99c-09d6-4574-b02e-5da723231950 req-45b86c86-b74a-4510-86af-dd648287e15e service nova] Lock "8d344530-40f9-43f0-8417-15110c6c9748-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG nova.compute.manager [req-4879a99c-09d6-4574-b02e-5da723231950 req-45b86c86-b74a-4510-86af-dd648287e15e service nova] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] No waiting events found dispatching network-vif-plugged-46454c88-9007-47b1-a199-b80afdf843f1 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:37:49 user nova-compute[73391]: WARNING nova.compute.manager [req-4879a99c-09d6-4574-b02e-5da723231950 req-45b86c86-b74a-4510-86af-dd648287e15e service nova] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Received unexpected event network-vif-plugged-46454c88-9007-47b1-a199-b80afdf843f1 for instance with vm_state active and task_state shelving.
Aug 15 05:37:49 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:49 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Instance destroyed successfully.
Aug 15 05:37:49 user nova-compute[73391]: DEBUG nova.objects.instance [None req-ec5634c4-c06f-48e4-8802-aa785bfa6941 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Lazy-loading 'resources' on Instance uuid 8d344530-40f9-43f0-8417-15110c6c9748 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-ec5634c4-c06f-48e4-8802-aa785bfa6941 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:35:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1421040367',display_name='tempest-TestShelveInstance-server-1421040367',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1421040367',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjqGEVcAW2Uflq9MaJWAWTPNQuXGUc1NNjM/VUaxwHQAEIj+9ZU31fFYi9+U/4OgXkXULYekTILGFB+ZF6Vju2o5J0ZWcZ4A8I3Iq/WxIc0yOp+wikspXmyImZ32D3lTA==',key_name='tempest-TestShelveInstance-1898835883',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:36:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8a88327b042847d5b910c53bda19976b',ramdisk_id='',reservation_id='r-092d88cq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1216370790',owner_user_name='tempest-TestShelveInstance-1216370790-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:36:08Z,user_data=None,user_id='4f1326da23e34dc29d4469645af81589',uuid=8d344530-40f9-43f0-8417-15110c6c9748,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "46454c88-9007-47b1-a199-b80afdf843f1", "address": "fa:16:3e:d4:7c:d2", "network": {"id": "234a8df7-8eea-44bf-ae16-0840862765d4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1326637884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a88327b042847d5b910c53bda19976b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46454c88-90", "ovs_interfaceid": "46454c88-9007-47b1-a199-b80afdf843f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-ec5634c4-c06f-48e4-8802-aa785bfa6941 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Converting VIF {"id": "46454c88-9007-47b1-a199-b80afdf843f1", "address": "fa:16:3e:d4:7c:d2", "network": {"id": "234a8df7-8eea-44bf-ae16-0840862765d4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1326637884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a88327b042847d5b910c53bda19976b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46454c88-90", "ovs_interfaceid": "46454c88-9007-47b1-a199-b80afdf843f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-ec5634c4-c06f-48e4-8802-aa785bfa6941 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:7c:d2,bridge_name='br-int',has_traffic_filtering=True,id=46454c88-9007-47b1-a199-b80afdf843f1,network=Network(234a8df7-8eea-44bf-ae16-0840862765d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46454c88-90') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG os_vif [None req-ec5634c4-c06f-48e4-8802-aa785bfa6941 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:7c:d2,bridge_name='br-int',has_traffic_filtering=True,id=46454c88-9007-47b1-a199-b80afdf843f1,network=Network(234a8df7-8eea-44bf-ae16-0840862765d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46454c88-90') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap46454c88-90, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG nova.compute.manager [req-49fc28fd-0318-4f45-bcd0-18c3578f6827 req-acc3b193-06eb-4cbb-bb27-13300f351cfc service nova] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Received event network-changed-46454c88-9007-47b1-a199-b80afdf843f1 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG nova.compute.manager [req-49fc28fd-0318-4f45-bcd0-18c3578f6827 req-acc3b193-06eb-4cbb-bb27-13300f351cfc service nova] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Refreshing instance network info cache due to event network-changed-46454c88-9007-47b1-a199-b80afdf843f1. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-49fc28fd-0318-4f45-bcd0-18c3578f6827 req-acc3b193-06eb-4cbb-bb27-13300f351cfc service nova] Acquiring lock "refresh_cache-8d344530-40f9-43f0-8417-15110c6c9748" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-49fc28fd-0318-4f45-bcd0-18c3578f6827 req-acc3b193-06eb-4cbb-bb27-13300f351cfc service nova] Acquired lock "refresh_cache-8d344530-40f9-43f0-8417-15110c6c9748" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG nova.network.neutron [req-49fc28fd-0318-4f45-bcd0-18c3578f6827 req-acc3b193-06eb-4cbb-bb27-13300f351cfc service nova] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Refreshing network info cache for port 46454c88-9007-47b1-a199-b80afdf843f1 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:37:49 user nova-compute[73391]: INFO os_vif [None req-ec5634c4-c06f-48e4-8802-aa785bfa6941 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:7c:d2,bridge_name='br-int',has_traffic_filtering=True,id=46454c88-9007-47b1-a199-b80afdf843f1,network=Network(234a8df7-8eea-44bf-ae16-0840862765d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46454c88-90')
Aug 15 05:37:49 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec5634c4-c06f-48e4-8802-aa785bfa6941 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5634c4-c06f-48e4-8802-aa785bfa6941 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MscvTUKS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:37:49 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-ec5634c4-c06f-48e4-8802-aa785bfa6941 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:37:49 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-ec5634c4-c06f-48e4-8802-aa785bfa6941 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-ec5634c4-c06f-48e4-8802-aa785bfa6941 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5634c4-c06f-48e4-8802-aa785bfa6941 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[032c3ac2-a3e9-40c2-8e10-32204122f840]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a741416-fd33-4612-8ddd-f1ef0010ba57]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5634c4-c06f-48e4-8802-aa785bfa6941 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:37:49 user nova-compute[73391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)
Aug 15 05:37:49 user nova-compute[73391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)
Aug 15 05:37:49 user nova-compute[73391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)
Aug 15 05:37:49 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5634c4-c06f-48e4-8802-aa785bfa6941 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:37:49 user nova-compute[73391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)
Aug 15 05:37:49 user nova-compute[73391]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)
Aug 15 05:37:49 user nova-compute[73391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)
Aug 15 05:37:49 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5634c4-c06f-48e4-8802-aa785bfa6941 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77284a04c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4'): ({'sdb'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-ec5634c4-c06f-48e4-8802-aa785bfa6941 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Removing single pathed devices sdb {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f567a93d-0f0e-48a4-a29d-49726d295e94]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.030s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee333705-1ead-47ff-82fd-3ca0c1e1ba1a]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-ec5634c4-c06f-48e4-8802-aa785bfa6941 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Flushing IO for device /dev/sdb {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b54ab9e-5b31-4671-8ea7-f15e4e084630]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-ec5634c4-c06f-48e4-8802-aa785bfa6941 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.069s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae97a8e-21d9-4496-ae66-019ca21545c2]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-ec5634c4-c06f-48e4-8802-aa785bfa6941 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-ec5634c4-c06f-48e4-8802-aa785bfa6941 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] SCSI volumes sdb have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5634c4-c06f-48e4-8802-aa785bfa6941 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.034s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[912521bd-53e7-4155-b96d-6f2b1a9de8fe]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5634c4-c06f-48e4-8802-aa785bfa6941 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.090s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b3f4b2-6112-4467-89d4-644e181c4ced]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5634c4-c06f-48e4-8802-aa785bfa6941 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4, portal: 172.16.0.220,3260]
Aug 15 05:37:49 user nova-compute[73391]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4, portal: 172.16.0.220,3260] successful.
Aug 15 05:37:49 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ddd5a8b-5160-4c20-898e-83b6c94e8f0d]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5634c4-c06f-48e4-8802-aa785bfa6941 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-ec5634c4-c06f-48e4-8802-aa785bfa6941 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.428s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ec5634c4-c06f-48e4-8802-aa785bfa6941 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] <== disconnect_volume: return (429ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:37:49 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ec5634c4-c06f-48e4-8802-aa785bfa6941 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 05:37:49 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-ec5634c4-c06f-48e4-8802-aa785bfa6941 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Deleting instance files /opt/stack/data/nova/instances/8d344530-40f9-43f0-8417-15110c6c9748_del
Aug 15 05:37:49 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-ec5634c4-c06f-48e4-8802-aa785bfa6941 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Deletion of /opt/stack/data/nova/instances/8d344530-40f9-43f0-8417-15110c6c9748_del complete
Aug 15 05:37:50 user nova-compute[73391]: DEBUG nova.network.neutron [req-49fc28fd-0318-4f45-bcd0-18c3578f6827 req-acc3b193-06eb-4cbb-bb27-13300f351cfc service nova] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Updated VIF entry in instance network info cache for port 46454c88-9007-47b1-a199-b80afdf843f1. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:37:50 user nova-compute[73391]: DEBUG nova.network.neutron [req-49fc28fd-0318-4f45-bcd0-18c3578f6827 req-acc3b193-06eb-4cbb-bb27-13300f351cfc service nova] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Updating instance_info_cache with network_info: [{"id": "46454c88-9007-47b1-a199-b80afdf843f1", "address": "fa:16:3e:d4:7c:d2", "network": {"id": "234a8df7-8eea-44bf-ae16-0840862765d4", "bridge": null, "label": "tempest-TestShelveInstance-1326637884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a88327b042847d5b910c53bda19976b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap46454c88-90", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:37:50 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-49fc28fd-0318-4f45-bcd0-18c3578f6827 req-acc3b193-06eb-4cbb-bb27-13300f351cfc service nova] Releasing lock "refresh_cache-8d344530-40f9-43f0-8417-15110c6c9748" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:37:50 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Acquiring lock "730890c6-6999-4a0f-b80c-e4745bff99ab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:37:50 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "730890c6-6999-4a0f-b80c-e4745bff99ab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:37:50 user nova-compute[73391]: DEBUG nova.compute.manager [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Starting instance... {{(pid=73391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 05:37:50 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:37:50 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:37:50 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 05:37:50 user nova-compute[73391]: INFO nova.compute.claims [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Claim successful on node user
Aug 15 05:37:51 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:37:51 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:37:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.638s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:37:51 user nova-compute[73391]: DEBUG nova.compute.manager [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Start building networks asynchronously for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 05:37:51 user nova-compute[73391]: DEBUG nova.compute.manager [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Allocating IP information in the background. {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 05:37:51 user nova-compute[73391]: DEBUG nova.network.neutron [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] allocate_for_instance() {{(pid=73391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 05:37:51 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 05:37:51 user nova-compute[73391]: DEBUG nova.compute.manager [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Start building block device mappings for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 05:37:51 user nova-compute[73391]: INFO nova.scheduler.client.report [None req-ec5634c4-c06f-48e4-8802-aa785bfa6941 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Deleted allocations for instance 8d344530-40f9-43f0-8417-15110c6c9748
Aug 15 05:37:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Acquiring lock "8ff2da51-5bfd-4cdc-8cef-330cdef93d97" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:37:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "8ff2da51-5bfd-4cdc-8cef-330cdef93d97" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:37:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ec5634c4-c06f-48e4-8802-aa785bfa6941 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:37:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ec5634c4-c06f-48e4-8802-aa785bfa6941 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:37:51 user nova-compute[73391]: DEBUG nova.objects.instance [None req-ec5634c4-c06f-48e4-8802-aa785bfa6941 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Lazy-loading 'numa_topology' on Instance uuid 8d344530-40f9-43f0-8417-15110c6c9748 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:37:51 user nova-compute[73391]: DEBUG nova.compute.manager [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Starting instance... {{(pid=73391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 05:37:51 user nova-compute[73391]: DEBUG nova.policy [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1f0f5888b8c44188a17202fad2725256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7da9448cc34b609120da564a01dba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73391) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 05:37:51 user nova-compute[73391]: DEBUG nova.compute.manager [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Start spawning the instance on the hypervisor. {{(pid=73391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 05:37:51 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Creating instance directory {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 05:37:51 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Creating image(s)
Aug 15 05:37:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Acquiring lock "/opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:37:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "/opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:37:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "/opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:37:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:37:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.247s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Acquiring lock "999b315ba87151d8252d543312ae7790e7e1583b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:37:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:37:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:52 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-ec5634c4-c06f-48e4-8802-aa785bfa6941 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:37:52 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-ec5634c4-c06f-48e4-8802-aa785bfa6941 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:37:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.236s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk 1073741824 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ec5634c4-c06f-48e4-8802-aa785bfa6941 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.631s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:37:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.424s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:37:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk 1073741824" returned: 0 in 0.076s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.316s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:37:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:52 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 05:37:52 user nova-compute[73391]: INFO nova.compute.claims [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Claim successful on node user
Aug 15 05:37:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ec5634c4-c06f-48e4-8802-aa785bfa6941 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Lock "8d344530-40f9-43f0-8417-15110c6c9748" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 6.102s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:37:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.235s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:52 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Checking if we can resize image /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk. size=1073741824 {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 05:37:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:52 user nova-compute[73391]: DEBUG nova.network.neutron [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Successfully created port: f598ee19-8c81-4cf2-a88d-8221516eb1cf {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 05:37:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:52 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Cannot resize image /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk to a smaller size. {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 05:37:52 user nova-compute[73391]: DEBUG nova.objects.instance [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lazy-loading 'migration_context' on Instance uuid 730890c6-6999-4a0f-b80c-e4745bff99ab {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:37:52 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Created local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 05:37:52 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Ensure instance console log exists: /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 05:37:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:37:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:37:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:37:52 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:37:52 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:37:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.686s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:37:52 user nova-compute[73391]: DEBUG nova.compute.manager [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Start building networks asynchronously for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 05:37:53 user nova-compute[73391]: DEBUG nova.compute.manager [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Allocating IP information in the background. {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 05:37:53 user nova-compute[73391]: DEBUG nova.network.neutron [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] allocate_for_instance() {{(pid=73391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 05:37:53 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 05:37:53 user nova-compute[73391]: DEBUG nova.compute.manager [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Start building block device mappings for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 05:37:53 user nova-compute[73391]: DEBUG nova.policy [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1f0f5888b8c44188a17202fad2725256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7da9448cc34b609120da564a01dba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73391) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 05:37:53 user nova-compute[73391]: DEBUG nova.compute.manager [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Start spawning the instance on the hypervisor. {{(pid=73391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 05:37:53 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Creating instance directory {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 05:37:53 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Creating image(s)
Aug 15 05:37:53 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Acquiring lock "/opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:37:53 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "/opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:37:53 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "/opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:37:53 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:53 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.209s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:53 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Acquiring lock "999b315ba87151d8252d543312ae7790e7e1583b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:37:53 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:37:53 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:53 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.196s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:53 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk 1073741824 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:53 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk 1073741824" returned: 0 in 0.063s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:53 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:37:53 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:53 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.191s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:53 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk. size=1073741824 {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 05:37:53 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:54 user nova-compute[73391]: DEBUG nova.network.neutron [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Successfully updated port: f598ee19-8c81-4cf2-a88d-8221516eb1cf {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:37:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Acquiring lock "refresh_cache-730890c6-6999-4a0f-b80c-e4745bff99ab" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:37:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Acquired lock "refresh_cache-730890c6-6999-4a0f-b80c-e4745bff99ab" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:37:54 user nova-compute[73391]: DEBUG nova.network.neutron [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:37:54 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:54 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Cannot resize image /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk to a smaller size. {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 05:37:54 user nova-compute[73391]: DEBUG nova.objects.instance [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lazy-loading 'migration_context' on Instance uuid 8ff2da51-5bfd-4cdc-8cef-330cdef93d97 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:37:54 user nova-compute[73391]: DEBUG nova.compute.manager [req-da83edb3-303a-4562-9c80-98c982f8b6d8 req-e862da2a-f53c-40cc-9792-1ae0f3640437 service nova] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Received event network-changed-f598ee19-8c81-4cf2-a88d-8221516eb1cf {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:37:54 user nova-compute[73391]: DEBUG nova.compute.manager [req-da83edb3-303a-4562-9c80-98c982f8b6d8 req-e862da2a-f53c-40cc-9792-1ae0f3640437 service nova] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Refreshing instance network info cache due to event network-changed-f598ee19-8c81-4cf2-a88d-8221516eb1cf. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:37:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-da83edb3-303a-4562-9c80-98c982f8b6d8 req-e862da2a-f53c-40cc-9792-1ae0f3640437 service nova] Acquiring lock "refresh_cache-730890c6-6999-4a0f-b80c-e4745bff99ab" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:37:54 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Created local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 05:37:54 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Ensure instance console log exists: /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 05:37:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:37:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:37:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:37:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:54 user nova-compute[73391]: DEBUG nova.network.neutron [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:37:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-48551824-50da-4f81-a90f-5ec232489aef tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Acquiring lock "3f88cd17-c89f-41f3-b630-8eb2c6698155" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:37:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-48551824-50da-4f81-a90f-5ec232489aef tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "3f88cd17-c89f-41f3-b630-8eb2c6698155" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:37:54 user nova-compute[73391]: DEBUG nova.objects.instance [None req-48551824-50da-4f81-a90f-5ec232489aef tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lazy-loading 'flavor' on Instance uuid 3f88cd17-c89f-41f3-b630-8eb2c6698155 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:37:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-48551824-50da-4f81-a90f-5ec232489aef tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "3f88cd17-c89f-41f3-b630-8eb2c6698155" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:37:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-48551824-50da-4f81-a90f-5ec232489aef tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Acquiring lock "3f88cd17-c89f-41f3-b630-8eb2c6698155" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:37:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-48551824-50da-4f81-a90f-5ec232489aef tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "3f88cd17-c89f-41f3-b630-8eb2c6698155" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:37:54 user nova-compute[73391]: INFO nova.compute.manager [None req-48551824-50da-4f81-a90f-5ec232489aef tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Attaching volume 994dd7cd-6516-488e-b387-aa7426329579 to /dev/vdb
Aug 15 05:37:54 user nova-compute[73391]: DEBUG os_brick.utils [None req-48551824-50da-4f81-a90f-5ec232489aef tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:37:54 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:54 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.026s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:54 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e86407-cd77-472a-9d3e-9bd108e88a54]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:37:54 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:54 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:54 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f8115a-25ae-4bdd-b114-2bd14db9a4ea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:37:54 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:54 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:54 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7928f138-27ac-415e-921d-72ad2df3b461]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:37:54 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0c2a18-2645-4c77-80fd-511d46c321e4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:37:54 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-48551824-50da-4f81-a90f-5ec232489aef tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:54 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-48551824-50da-4f81-a90f-5ec232489aef tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:37:54 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-48551824-50da-4f81-a90f-5ec232489aef tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 05:37:54 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:54 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:37:54 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 05:37:54 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d44f771-2f6d-47ea-add4-e664caf36bda]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:37:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-48551824-50da-4f81-a90f-5ec232489aef tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 05:37:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-48551824-50da-4f81-a90f-5ec232489aef tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 05:37:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-48551824-50da-4f81-a90f-5ec232489aef tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 05:37:55 user nova-compute[73391]: DEBUG os_brick.utils [None req-48551824-50da-4f81-a90f-5ec232489aef tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:37:55 user nova-compute[73391]: DEBUG nova.virt.block_device [None req-48551824-50da-4f81-a90f-5ec232489aef tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Updating existing volume attachment record: b889ccd0-02db-461e-8b6b-539163566d57 {{(pid=73391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 05:37:55 user nova-compute[73391]: DEBUG nova.network.neutron [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Successfully created port: 075b72cf-5f6f-443c-a0e1-dd3744944e5b {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 05:37:55 user nova-compute[73391]: DEBUG nova.network.neutron [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Updating instance_info_cache with network_info: [{"id": "f598ee19-8c81-4cf2-a88d-8221516eb1cf", "address": "fa:16:3e:2e:da:40", "network": {"id": "bec69c6a-b2cb-4b0a-ba6e-ae6dae099818", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7da9448cc34b609120da564a01dba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf598ee19-8c", "ovs_interfaceid": "f598ee19-8c81-4cf2-a88d-8221516eb1cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:37:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Releasing lock "refresh_cache-730890c6-6999-4a0f-b80c-e4745bff99ab" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:37:55 user nova-compute[73391]: DEBUG nova.compute.manager [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Instance network_info: |[{"id": "f598ee19-8c81-4cf2-a88d-8221516eb1cf", "address": "fa:16:3e:2e:da:40", "network": {"id": "bec69c6a-b2cb-4b0a-ba6e-ae6dae099818", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7da9448cc34b609120da564a01dba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf598ee19-8c", "ovs_interfaceid": "f598ee19-8c81-4cf2-a88d-8221516eb1cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 05:37:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-da83edb3-303a-4562-9c80-98c982f8b6d8 req-e862da2a-f53c-40cc-9792-1ae0f3640437 service nova] Acquired lock "refresh_cache-730890c6-6999-4a0f-b80c-e4745bff99ab" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:37:55 user nova-compute[73391]: DEBUG nova.network.neutron [req-da83edb3-303a-4562-9c80-98c982f8b6d8 req-e862da2a-f53c-40cc-9792-1ae0f3640437 service nova] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Refreshing network info cache for port f598ee19-8c81-4cf2-a88d-8221516eb1cf {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:37:55 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Start _get_guest_xml network_info=[{"id": "f598ee19-8c81-4cf2-a88d-8221516eb1cf", "address": "fa:16:3e:2e:da:40", "network": {"id": "bec69c6a-b2cb-4b0a-ba6e-ae6dae099818", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7da9448cc34b609120da564a01dba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf598ee19-8c", "ovs_interfaceid": "f598ee19-8c81-4cf2-a88d-8221516eb1cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '191b1dad-305e-4d1c-9b15-515ec59a3278'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:37:55 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:37:55 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:37:55 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:37:55 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:37:55 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:37:55 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:37:55 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:37:55 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:37:55 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:37:55 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:37:55 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:37:55 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:37:55 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:37:55 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:37:55 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:37:55 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:37:55 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:37:55 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:37:55 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:37:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-639325125',display_name='tempest-ServerRescueNegativeTestJSON-server-639325125',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-639325125',id=24,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a7da9448cc34b609120da564a01dba4',ramdisk_id='',reservation_id='r-u63o4wgc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1933442633',owner_user_name='tempest-ServerRescueNegativeTestJSON-1933442633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:37:52Z,user_data=None,user_id='1f0f5888b8c44188a17202fad2725256',uuid=730890c6-6999-4a0f-b80c-e4745bff99ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f598ee19-8c81-4cf2-a88d-8221516eb1cf", "address": "fa:16:3e:2e:da:40", "network": {"id": "bec69c6a-b2cb-4b0a-ba6e-ae6dae099818", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7da9448cc34b609120da564a01dba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf598ee19-8c", "ovs_interfaceid": "f598ee19-8c81-4cf2-a88d-8221516eb1cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:37:55 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Converting VIF {"id": "f598ee19-8c81-4cf2-a88d-8221516eb1cf", "address": "fa:16:3e:2e:da:40", "network": {"id": "bec69c6a-b2cb-4b0a-ba6e-ae6dae099818", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7da9448cc34b609120da564a01dba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf598ee19-8c", "ovs_interfaceid": "f598ee19-8c81-4cf2-a88d-8221516eb1cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:37:55 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:da:40,bridge_name='br-int',has_traffic_filtering=True,id=f598ee19-8c81-4cf2-a88d-8221516eb1cf,network=Network(bec69c6a-b2cb-4b0a-ba6e-ae6dae099818),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf598ee19-8c') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:37:55 user nova-compute[73391]: DEBUG nova.objects.instance [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lazy-loading 'pci_devices' on Instance uuid 730890c6-6999-4a0f-b80c-e4745bff99ab {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:37:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:55 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692077860.3017988, fee43642-30e8-451b-919c-aca4cd4c3f81 => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:37:55 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] VM Stopped (Lifecycle Event)
Aug 15 05:37:55 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:37:55 user nova-compute[73391]:   <uuid>730890c6-6999-4a0f-b80c-e4745bff99ab</uuid>
Aug 15 05:37:55 user nova-compute[73391]:   <name>instance-00000018</name>
Aug 15 05:37:55 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:37:55 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:37:55 user nova-compute[73391]:   <metadata>
Aug 15 05:37:55 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:37:55 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:37:55 user nova-compute[73391]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-639325125</nova:name>
Aug 15 05:37:55 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:37:55</nova:creationTime>
Aug 15 05:37:55 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:37:55 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:37:55 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:37:55 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:37:55 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:37:55 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:37:55 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:37:55 user nova-compute[73391]:       <nova:owner>
Aug 15 05:37:55 user nova-compute[73391]:         <nova:user uuid="1f0f5888b8c44188a17202fad2725256">tempest-ServerRescueNegativeTestJSON-1933442633-project-member</nova:user>
Aug 15 05:37:55 user nova-compute[73391]:         <nova:project uuid="5a7da9448cc34b609120da564a01dba4">tempest-ServerRescueNegativeTestJSON-1933442633</nova:project>
Aug 15 05:37:55 user nova-compute[73391]:       </nova:owner>
Aug 15 05:37:55 user nova-compute[73391]:       <nova:root type="image" uuid="191b1dad-305e-4d1c-9b15-515ec59a3278"/>
Aug 15 05:37:55 user nova-compute[73391]:       <nova:ports>
Aug 15 05:37:55 user nova-compute[73391]:         <nova:port uuid="f598ee19-8c81-4cf2-a88d-8221516eb1cf">
Aug 15 05:37:55 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 15 05:37:55 user nova-compute[73391]:         </nova:port>
Aug 15 05:37:55 user nova-compute[73391]:       </nova:ports>
Aug 15 05:37:55 user nova-compute[73391]:     </nova:instance>
Aug 15 05:37:55 user nova-compute[73391]:   </metadata>
Aug 15 05:37:55 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:37:55 user nova-compute[73391]:     <system>
Aug 15 05:37:55 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:37:55 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:37:55 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:37:55 user nova-compute[73391]:       <entry name="serial">730890c6-6999-4a0f-b80c-e4745bff99ab</entry>
Aug 15 05:37:55 user nova-compute[73391]:       <entry name="uuid">730890c6-6999-4a0f-b80c-e4745bff99ab</entry>
Aug 15 05:37:55 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:37:55 user nova-compute[73391]:     </system>
Aug 15 05:37:55 user nova-compute[73391]:   </sysinfo>
Aug 15 05:37:55 user nova-compute[73391]:   <os>
Aug 15 05:37:55 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:37:55 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:37:55 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:37:55 user nova-compute[73391]:   </os>
Aug 15 05:37:55 user nova-compute[73391]:   <features>
Aug 15 05:37:55 user nova-compute[73391]:     <acpi/>
Aug 15 05:37:55 user nova-compute[73391]:     <apic/>
Aug 15 05:37:55 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:37:55 user nova-compute[73391]:   </features>
Aug 15 05:37:55 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:37:55 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:37:55 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:37:55 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:37:55 user nova-compute[73391]:   </clock>
Aug 15 05:37:55 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:37:55 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:37:55 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:37:55 user nova-compute[73391]:   </cpu>
Aug 15 05:37:55 user nova-compute[73391]:   <devices>
Aug 15 05:37:55 user nova-compute[73391]:     <disk type="file" device="disk">
Aug 15 05:37:55 user nova-compute[73391]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 05:37:55 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk"/>
Aug 15 05:37:55 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:37:55 user nova-compute[73391]:     </disk>
Aug 15 05:37:55 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:37:55 user nova-compute[73391]:       <mac address="fa:16:3e:2e:da:40"/>
Aug 15 05:37:55 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:37:55 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:37:55 user nova-compute[73391]:       <target dev="tapf598ee19-8c"/>
Aug 15 05:37:55 user nova-compute[73391]:     </interface>
Aug 15 05:37:55 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:37:55 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/console.log" append="off"/>
Aug 15 05:37:55 user nova-compute[73391]:     </serial>
Aug 15 05:37:55 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:37:55 user nova-compute[73391]:     <video>
Aug 15 05:37:55 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:37:55 user nova-compute[73391]:     </video>
Aug 15 05:37:55 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:37:55 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:37:55 user nova-compute[73391]:     </rng>
Aug 15 05:37:55 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:37:55 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:37:55 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:37:55 user nova-compute[73391]:     </memballoon>
Aug 15 05:37:55 user nova-compute[73391]:   </devices>
Aug 15 05:37:55 user nova-compute[73391]: </domain>
Aug 15 05:37:55 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:37:55 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:37:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-639325125',display_name='tempest-ServerRescueNegativeTestJSON-server-639325125',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-639325125',id=24,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a7da9448cc34b609120da564a01dba4',ramdisk_id='',reservation_id='r-u63o4wgc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1933442633',owner_user_name='tempest-ServerRescueNegativeTestJSON-1933442633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:37:52Z,user_data=None,user_id='1f0f5888b8c44188a17202fad2725256',uuid=730890c6-6999-4a0f-b80c-e4745bff99ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f598ee19-8c81-4cf2-a88d-8221516eb1cf", "address": "fa:16:3e:2e:da:40", "network": {"id": "bec69c6a-b2cb-4b0a-ba6e-ae6dae099818", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7da9448cc34b609120da564a01dba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf598ee19-8c", "ovs_interfaceid": "f598ee19-8c81-4cf2-a88d-8221516eb1cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:37:55 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Converting VIF {"id": "f598ee19-8c81-4cf2-a88d-8221516eb1cf", "address": "fa:16:3e:2e:da:40", "network": {"id": "bec69c6a-b2cb-4b0a-ba6e-ae6dae099818", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7da9448cc34b609120da564a01dba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf598ee19-8c", "ovs_interfaceid": "f598ee19-8c81-4cf2-a88d-8221516eb1cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:37:55 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:da:40,bridge_name='br-int',has_traffic_filtering=True,id=f598ee19-8c81-4cf2-a88d-8221516eb1cf,network=Network(bec69c6a-b2cb-4b0a-ba6e-ae6dae099818),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf598ee19-8c') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:37:55 user nova-compute[73391]: DEBUG os_vif [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:da:40,bridge_name='br-int',has_traffic_filtering=True,id=f598ee19-8c81-4cf2-a88d-8221516eb1cf,network=Network(bec69c6a-b2cb-4b0a-ba6e-ae6dae099818),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf598ee19-8c') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:37:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:37:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:37:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf598ee19-8c, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:37:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf598ee19-8c, col_values=(('external_ids', {'iface-id': 'f598ee19-8c81-4cf2-a88d-8221516eb1cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:da:40', 'vm-uuid': '730890c6-6999-4a0f-b80c-e4745bff99ab'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:37:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:55 user nova-compute[73391]: DEBUG nova.compute.manager [None req-0a38da58-cb57-4e5d-961d-d21281a36850 None None] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:37:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:37:55 user nova-compute[73391]: DEBUG nova.compute.manager [None req-0a38da58-cb57-4e5d-961d-d21281a36850 None None] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:37:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:55 user nova-compute[73391]: INFO os_vif [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:da:40,bridge_name='br-int',has_traffic_filtering=True,id=f598ee19-8c81-4cf2-a88d-8221516eb1cf,network=Network(bec69c6a-b2cb-4b0a-ba6e-ae6dae099818),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf598ee19-8c')
Aug 15 05:37:55 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:37:55 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] No VIF found with MAC fa:16:3e:2e:da:40, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:37:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Acquiring lock "a1ba38e6-f0fe-408f-b1c8-f9b193531952" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:37:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Lock "a1ba38e6-f0fe-408f-b1c8-f9b193531952" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:37:55 user nova-compute[73391]: DEBUG nova.compute.manager [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Starting instance... {{(pid=73391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 05:37:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:37:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:37:56 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 05:37:56 user nova-compute[73391]: INFO nova.compute.claims [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Claim successful on node user
Aug 15 05:37:56 user nova-compute[73391]: DEBUG nova.network.neutron [req-da83edb3-303a-4562-9c80-98c982f8b6d8 req-e862da2a-f53c-40cc-9792-1ae0f3640437 service nova] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Updated VIF entry in instance network info cache for port f598ee19-8c81-4cf2-a88d-8221516eb1cf. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:37:56 user nova-compute[73391]: DEBUG nova.network.neutron [req-da83edb3-303a-4562-9c80-98c982f8b6d8 req-e862da2a-f53c-40cc-9792-1ae0f3640437 service nova] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Updating instance_info_cache with network_info: [{"id": "f598ee19-8c81-4cf2-a88d-8221516eb1cf", "address": "fa:16:3e:2e:da:40", "network": {"id": "bec69c6a-b2cb-4b0a-ba6e-ae6dae099818", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7da9448cc34b609120da564a01dba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf598ee19-8c", "ovs_interfaceid": "f598ee19-8c81-4cf2-a88d-8221516eb1cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:37:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-da83edb3-303a-4562-9c80-98c982f8b6d8 req-e862da2a-f53c-40cc-9792-1ae0f3640437 service nova] Releasing lock "refresh_cache-730890c6-6999-4a0f-b80c-e4745bff99ab" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:37:56 user nova-compute[73391]: DEBUG nova.network.neutron [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Successfully updated port: 075b72cf-5f6f-443c-a0e1-dd3744944e5b {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:37:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Acquiring lock "refresh_cache-8ff2da51-5bfd-4cdc-8cef-330cdef93d97" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:37:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Acquired lock "refresh_cache-8ff2da51-5bfd-4cdc-8cef-330cdef93d97" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:37:56 user nova-compute[73391]: DEBUG nova.network.neutron [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:37:56 user nova-compute[73391]: DEBUG nova.compute.manager [req-7510381f-40ce-4f39-92f6-fd5e34b73e29 req-23490439-7a3d-4b31-82c3-ac1508d957cf service nova] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Received event network-changed-075b72cf-5f6f-443c-a0e1-dd3744944e5b {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:37:56 user nova-compute[73391]: DEBUG nova.compute.manager [req-7510381f-40ce-4f39-92f6-fd5e34b73e29 req-23490439-7a3d-4b31-82c3-ac1508d957cf service nova] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Refreshing instance network info cache due to event network-changed-075b72cf-5f6f-443c-a0e1-dd3744944e5b. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:37:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-7510381f-40ce-4f39-92f6-fd5e34b73e29 req-23490439-7a3d-4b31-82c3-ac1508d957cf service nova] Acquiring lock "refresh_cache-8ff2da51-5bfd-4cdc-8cef-330cdef93d97" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:37:56 user nova-compute[73391]: DEBUG nova.network.neutron [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:37:56 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:37:56 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:37:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.678s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:37:56 user nova-compute[73391]: DEBUG nova.compute.manager [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Start building networks asynchronously for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 05:37:56 user nova-compute[73391]: DEBUG nova.compute.manager [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Allocating IP information in the background. {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 05:37:56 user nova-compute[73391]: DEBUG nova.network.neutron [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] allocate_for_instance() {{(pid=73391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 05:37:56 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 05:37:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:56 user nova-compute[73391]: DEBUG nova.compute.manager [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Start building block device mappings for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 05:37:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:56 user nova-compute[73391]: DEBUG nova.network.neutron [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Updating instance_info_cache with network_info: [{"id": "075b72cf-5f6f-443c-a0e1-dd3744944e5b", "address": "fa:16:3e:88:63:d4", "network": {"id": "bec69c6a-b2cb-4b0a-ba6e-ae6dae099818", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7da9448cc34b609120da564a01dba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap075b72cf-5f", "ovs_interfaceid": "075b72cf-5f6f-443c-a0e1-dd3744944e5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:37:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Releasing lock "refresh_cache-8ff2da51-5bfd-4cdc-8cef-330cdef93d97" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG nova.compute.manager [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Instance network_info: |[{"id": "075b72cf-5f6f-443c-a0e1-dd3744944e5b", "address": "fa:16:3e:88:63:d4", "network": {"id": "bec69c6a-b2cb-4b0a-ba6e-ae6dae099818", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7da9448cc34b609120da564a01dba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap075b72cf-5f", "ovs_interfaceid": "075b72cf-5f6f-443c-a0e1-dd3744944e5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-7510381f-40ce-4f39-92f6-fd5e34b73e29 req-23490439-7a3d-4b31-82c3-ac1508d957cf service nova] Acquired lock "refresh_cache-8ff2da51-5bfd-4cdc-8cef-330cdef93d97" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG nova.network.neutron [req-7510381f-40ce-4f39-92f6-fd5e34b73e29 req-23490439-7a3d-4b31-82c3-ac1508d957cf service nova] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Refreshing network info cache for port 075b72cf-5f6f-443c-a0e1-dd3744944e5b {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Start _get_guest_xml network_info=[{"id": "075b72cf-5f6f-443c-a0e1-dd3744944e5b", "address": "fa:16:3e:88:63:d4", "network": {"id": "bec69c6a-b2cb-4b0a-ba6e-ae6dae099818", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7da9448cc34b609120da564a01dba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap075b72cf-5f", "ovs_interfaceid": "075b72cf-5f6f-443c-a0e1-dd3744944e5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '191b1dad-305e-4d1c-9b15-515ec59a3278'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG nova.policy [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c20e47271ecf400eb874b5c0c46e84fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae2c2aef51304fd1b6a8ed87a7065bc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73391) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 05:37:57 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:37:57 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:37:57 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:37:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-43235834',display_name='tempest-ServerRescueNegativeTestJSON-server-43235834',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-43235834',id=25,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a7da9448cc34b609120da564a01dba4',ramdisk_id='',reservation_id='r-yhbtlwt4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1933442633',owner_user_name='tempest-ServerRescueNegativeTestJSON-1933442633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:37:53Z,user_data=None,user_id='1f0f5888b8c44188a17202fad2725256',uuid=8ff2da51-5bfd-4cdc-8cef-330cdef93d97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "075b72cf-5f6f-443c-a0e1-dd3744944e5b", "address": "fa:16:3e:88:63:d4", "network": {"id": "bec69c6a-b2cb-4b0a-ba6e-ae6dae099818", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7da9448cc34b609120da564a01dba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap075b72cf-5f", "ovs_interfaceid": "075b72cf-5f6f-443c-a0e1-dd3744944e5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Converting VIF {"id": "075b72cf-5f6f-443c-a0e1-dd3744944e5b", "address": "fa:16:3e:88:63:d4", "network": {"id": "bec69c6a-b2cb-4b0a-ba6e-ae6dae099818", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7da9448cc34b609120da564a01dba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap075b72cf-5f", "ovs_interfaceid": "075b72cf-5f6f-443c-a0e1-dd3744944e5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:63:d4,bridge_name='br-int',has_traffic_filtering=True,id=075b72cf-5f6f-443c-a0e1-dd3744944e5b,network=Network(bec69c6a-b2cb-4b0a-ba6e-ae6dae099818),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap075b72cf-5f') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG nova.objects.instance [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ff2da51-5bfd-4cdc-8cef-330cdef93d97 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG nova.compute.manager [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Start spawning the instance on the hypervisor. {{(pid=73391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Creating instance directory {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 05:37:57 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Creating image(s)
Aug 15 05:37:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Acquiring lock "/opt/stack/data/nova/instances/a1ba38e6-f0fe-408f-b1c8-f9b193531952/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Lock "/opt/stack/data/nova/instances/a1ba38e6-f0fe-408f-b1c8-f9b193531952/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Lock "/opt/stack/data/nova/instances/a1ba38e6-f0fe-408f-b1c8-f9b193531952/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:37:57 user nova-compute[73391]:   <uuid>8ff2da51-5bfd-4cdc-8cef-330cdef93d97</uuid>
Aug 15 05:37:57 user nova-compute[73391]:   <name>instance-00000019</name>
Aug 15 05:37:57 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:37:57 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:37:57 user nova-compute[73391]:   <metadata>
Aug 15 05:37:57 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:37:57 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:37:57 user nova-compute[73391]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-43235834</nova:name>
Aug 15 05:37:57 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:37:57</nova:creationTime>
Aug 15 05:37:57 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:37:57 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:37:57 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:37:57 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:37:57 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:37:57 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:37:57 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:37:57 user nova-compute[73391]:       <nova:owner>
Aug 15 05:37:57 user nova-compute[73391]:         <nova:user uuid="1f0f5888b8c44188a17202fad2725256">tempest-ServerRescueNegativeTestJSON-1933442633-project-member</nova:user>
Aug 15 05:37:57 user nova-compute[73391]:         <nova:project uuid="5a7da9448cc34b609120da564a01dba4">tempest-ServerRescueNegativeTestJSON-1933442633</nova:project>
Aug 15 05:37:57 user nova-compute[73391]:       </nova:owner>
Aug 15 05:37:57 user nova-compute[73391]:       <nova:root type="image" uuid="191b1dad-305e-4d1c-9b15-515ec59a3278"/>
Aug 15 05:37:57 user nova-compute[73391]:       <nova:ports>
Aug 15 05:37:57 user nova-compute[73391]:         <nova:port uuid="075b72cf-5f6f-443c-a0e1-dd3744944e5b">
Aug 15 05:37:57 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 15 05:37:57 user nova-compute[73391]:         </nova:port>
Aug 15 05:37:57 user nova-compute[73391]:       </nova:ports>
Aug 15 05:37:57 user nova-compute[73391]:     </nova:instance>
Aug 15 05:37:57 user nova-compute[73391]:   </metadata>
Aug 15 05:37:57 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:37:57 user nova-compute[73391]:     <system>
Aug 15 05:37:57 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:37:57 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:37:57 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:37:57 user nova-compute[73391]:       <entry name="serial">8ff2da51-5bfd-4cdc-8cef-330cdef93d97</entry>
Aug 15 05:37:57 user nova-compute[73391]:       <entry name="uuid">8ff2da51-5bfd-4cdc-8cef-330cdef93d97</entry>
Aug 15 05:37:57 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:37:57 user nova-compute[73391]:     </system>
Aug 15 05:37:57 user nova-compute[73391]:   </sysinfo>
Aug 15 05:37:57 user nova-compute[73391]:   <os>
Aug 15 05:37:57 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:37:57 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:37:57 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:37:57 user nova-compute[73391]:   </os>
Aug 15 05:37:57 user nova-compute[73391]:   <features>
Aug 15 05:37:57 user nova-compute[73391]:     <acpi/>
Aug 15 05:37:57 user nova-compute[73391]:     <apic/>
Aug 15 05:37:57 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:37:57 user nova-compute[73391]:   </features>
Aug 15 05:37:57 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:37:57 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:37:57 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:37:57 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:37:57 user nova-compute[73391]:   </clock>
Aug 15 05:37:57 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:37:57 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:37:57 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:37:57 user nova-compute[73391]:   </cpu>
Aug 15 05:37:57 user nova-compute[73391]:   <devices>
Aug 15 05:37:57 user nova-compute[73391]:     <disk type="file" device="disk">
Aug 15 05:37:57 user nova-compute[73391]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 05:37:57 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk"/>
Aug 15 05:37:57 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:37:57 user nova-compute[73391]:     </disk>
Aug 15 05:37:57 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:37:57 user nova-compute[73391]:       <mac address="fa:16:3e:88:63:d4"/>
Aug 15 05:37:57 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:37:57 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:37:57 user nova-compute[73391]:       <target dev="tap075b72cf-5f"/>
Aug 15 05:37:57 user nova-compute[73391]:     </interface>
Aug 15 05:37:57 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:37:57 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/console.log" append="off"/>
Aug 15 05:37:57 user nova-compute[73391]:     </serial>
Aug 15 05:37:57 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:37:57 user nova-compute[73391]:     <video>
Aug 15 05:37:57 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:37:57 user nova-compute[73391]:     </video>
Aug 15 05:37:57 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:37:57 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:37:57 user nova-compute[73391]:     </rng>
Aug 15 05:37:57 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:37:57 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:37:57 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:37:57 user nova-compute[73391]:     </memballoon>
Aug 15 05:37:57 user nova-compute[73391]:   </devices>
Aug 15 05:37:57 user nova-compute[73391]: </domain>
Aug 15 05:37:57 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:37:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-43235834',display_name='tempest-ServerRescueNegativeTestJSON-server-43235834',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-43235834',id=25,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a7da9448cc34b609120da564a01dba4',ramdisk_id='',reservation_id='r-yhbtlwt4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1933442633',owner_user_name='tempest-ServerRescueNegativeTestJSON-1933442633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:37:53Z,user_data=None,user_id='1f0f5888b8c44188a17202fad2725256',uuid=8ff2da51-5bfd-4cdc-8cef-330cdef93d97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "075b72cf-5f6f-443c-a0e1-dd3744944e5b", "address": "fa:16:3e:88:63:d4", "network": {"id": "bec69c6a-b2cb-4b0a-ba6e-ae6dae099818", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7da9448cc34b609120da564a01dba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap075b72cf-5f", "ovs_interfaceid": "075b72cf-5f6f-443c-a0e1-dd3744944e5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Converting VIF {"id": "075b72cf-5f6f-443c-a0e1-dd3744944e5b", "address": "fa:16:3e:88:63:d4", "network": {"id": "bec69c6a-b2cb-4b0a-ba6e-ae6dae099818", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7da9448cc34b609120da564a01dba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap075b72cf-5f", "ovs_interfaceid": "075b72cf-5f6f-443c-a0e1-dd3744944e5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:63:d4,bridge_name='br-int',has_traffic_filtering=True,id=075b72cf-5f6f-443c-a0e1-dd3744944e5b,network=Network(bec69c6a-b2cb-4b0a-ba6e-ae6dae099818),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap075b72cf-5f') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG os_vif [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:63:d4,bridge_name='br-int',has_traffic_filtering=True,id=075b72cf-5f6f-443c-a0e1-dd3744944e5b,network=Network(bec69c6a-b2cb-4b0a-ba6e-ae6dae099818),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap075b72cf-5f') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap075b72cf-5f, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap075b72cf-5f, col_values=(('external_ids', {'iface-id': '075b72cf-5f6f-443c-a0e1-dd3744944e5b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:63:d4', 'vm-uuid': '8ff2da51-5bfd-4cdc-8cef-330cdef93d97'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:57 user nova-compute[73391]: INFO os_vif [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:63:d4,bridge_name='br-int',has_traffic_filtering=True,id=075b72cf-5f6f-443c-a0e1-dd3744944e5b,network=Network(bec69c6a-b2cb-4b0a-ba6e-ae6dae099818),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap075b72cf-5f')
Aug 15 05:37:57 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] No VIF found with MAC fa:16:3e:88:63:d4, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.225s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Acquiring lock "999b315ba87151d8252d543312ae7790e7e1583b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG nova.compute.manager [req-d4cc61cf-edbd-47eb-85e3-30bbe4dded87 req-a60133d1-cc45-42af-afd2-879311370394 service nova] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Received event network-vif-plugged-f598ee19-8c81-4cf2-a88d-8221516eb1cf {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d4cc61cf-edbd-47eb-85e3-30bbe4dded87 req-a60133d1-cc45-42af-afd2-879311370394 service nova] Acquiring lock "730890c6-6999-4a0f-b80c-e4745bff99ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d4cc61cf-edbd-47eb-85e3-30bbe4dded87 req-a60133d1-cc45-42af-afd2-879311370394 service nova] Lock "730890c6-6999-4a0f-b80c-e4745bff99ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d4cc61cf-edbd-47eb-85e3-30bbe4dded87 req-a60133d1-cc45-42af-afd2-879311370394 service nova] Lock "730890c6-6999-4a0f-b80c-e4745bff99ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG nova.compute.manager [req-d4cc61cf-edbd-47eb-85e3-30bbe4dded87 req-a60133d1-cc45-42af-afd2-879311370394 service nova] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] No waiting events found dispatching network-vif-plugged-f598ee19-8c81-4cf2-a88d-8221516eb1cf {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:37:57 user nova-compute[73391]: WARNING nova.compute.manager [req-d4cc61cf-edbd-47eb-85e3-30bbe4dded87 req-a60133d1-cc45-42af-afd2-879311370394 service nova] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Received unexpected event network-vif-plugged-f598ee19-8c81-4cf2-a88d-8221516eb1cf for instance with vm_state building and task_state spawning.
Aug 15 05:37:57 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.239s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/a1ba38e6-f0fe-408f-b1c8-f9b193531952/disk 1073741824 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/a1ba38e6-f0fe-408f-b1c8-f9b193531952/disk 1073741824" returned: 0 in 0.063s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.310s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.211s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a1ba38e6-f0fe-408f-b1c8-f9b193531952/disk. size=1073741824 {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 05:37:57 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ba38e6-f0fe-408f-b1c8-f9b193531952/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:37:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ba38e6-f0fe-408f-b1c8-f9b193531952/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:37:58 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Cannot resize image /opt/stack/data/nova/instances/a1ba38e6-f0fe-408f-b1c8-f9b193531952/disk to a smaller size. {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 05:37:58 user nova-compute[73391]: DEBUG nova.objects.instance [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Lazy-loading 'migration_context' on Instance uuid a1ba38e6-f0fe-408f-b1c8-f9b193531952 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:37:58 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Created local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 05:37:58 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Ensure instance console log exists: /opt/stack/data/nova/instances/a1ba38e6-f0fe-408f-b1c8-f9b193531952/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 05:37:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:37:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:37:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:37:58 user nova-compute[73391]: DEBUG nova.network.neutron [req-7510381f-40ce-4f39-92f6-fd5e34b73e29 req-23490439-7a3d-4b31-82c3-ac1508d957cf service nova] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Updated VIF entry in instance network info cache for port 075b72cf-5f6f-443c-a0e1-dd3744944e5b. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:37:58 user nova-compute[73391]: DEBUG nova.network.neutron [req-7510381f-40ce-4f39-92f6-fd5e34b73e29 req-23490439-7a3d-4b31-82c3-ac1508d957cf service nova] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Updating instance_info_cache with network_info: [{"id": "075b72cf-5f6f-443c-a0e1-dd3744944e5b", "address": "fa:16:3e:88:63:d4", "network": {"id": "bec69c6a-b2cb-4b0a-ba6e-ae6dae099818", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7da9448cc34b609120da564a01dba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap075b72cf-5f", "ovs_interfaceid": "075b72cf-5f6f-443c-a0e1-dd3744944e5b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:37:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-7510381f-40ce-4f39-92f6-fd5e34b73e29 req-23490439-7a3d-4b31-82c3-ac1508d957cf service nova] Releasing lock "refresh_cache-8ff2da51-5bfd-4cdc-8cef-330cdef93d97" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:37:58 user nova-compute[73391]: DEBUG nova.network.neutron [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Successfully created port: 6a4219e2-c727-41cc-badf-17c70f906a78 {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 05:37:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:37:59 user nova-compute[73391]: DEBUG nova.network.neutron [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Successfully updated port: 6a4219e2-c727-41cc-badf-17c70f906a78 {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:37:59 user nova-compute[73391]: DEBUG nova.compute.manager [req-fb868db7-fb0e-40b9-997f-729a2247f98c req-98fe2a12-f2f2-407a-a0ca-9ceee96f25a4 service nova] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Received event network-changed-6a4219e2-c727-41cc-badf-17c70f906a78 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:37:59 user nova-compute[73391]: DEBUG nova.compute.manager [req-fb868db7-fb0e-40b9-997f-729a2247f98c req-98fe2a12-f2f2-407a-a0ca-9ceee96f25a4 service nova] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Refreshing instance network info cache due to event network-changed-6a4219e2-c727-41cc-badf-17c70f906a78. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:37:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-fb868db7-fb0e-40b9-997f-729a2247f98c req-98fe2a12-f2f2-407a-a0ca-9ceee96f25a4 service nova] Acquiring lock "refresh_cache-a1ba38e6-f0fe-408f-b1c8-f9b193531952" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:37:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-fb868db7-fb0e-40b9-997f-729a2247f98c req-98fe2a12-f2f2-407a-a0ca-9ceee96f25a4 service nova] Acquired lock "refresh_cache-a1ba38e6-f0fe-408f-b1c8-f9b193531952" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:37:59 user nova-compute[73391]: DEBUG nova.network.neutron [req-fb868db7-fb0e-40b9-997f-729a2247f98c req-98fe2a12-f2f2-407a-a0ca-9ceee96f25a4 service nova] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Refreshing network info cache for port 6a4219e2-c727-41cc-badf-17c70f906a78 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:37:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Acquiring lock "refresh_cache-a1ba38e6-f0fe-408f-b1c8-f9b193531952" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:37:59 user nova-compute[73391]: DEBUG nova.compute.manager [req-381ce43e-4801-41d0-b43f-846f3dae2aa0 req-81f8dca2-a00d-455e-96fc-2726b558b1c9 service nova] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Received event network-vif-plugged-f598ee19-8c81-4cf2-a88d-8221516eb1cf {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:37:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-381ce43e-4801-41d0-b43f-846f3dae2aa0 req-81f8dca2-a00d-455e-96fc-2726b558b1c9 service nova] Acquiring lock "730890c6-6999-4a0f-b80c-e4745bff99ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:37:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-381ce43e-4801-41d0-b43f-846f3dae2aa0 req-81f8dca2-a00d-455e-96fc-2726b558b1c9 service nova] Lock "730890c6-6999-4a0f-b80c-e4745bff99ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:37:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-381ce43e-4801-41d0-b43f-846f3dae2aa0 req-81f8dca2-a00d-455e-96fc-2726b558b1c9 service nova] Lock "730890c6-6999-4a0f-b80c-e4745bff99ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:37:59 user nova-compute[73391]: DEBUG nova.compute.manager [req-381ce43e-4801-41d0-b43f-846f3dae2aa0 req-81f8dca2-a00d-455e-96fc-2726b558b1c9 service nova] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] No waiting events found dispatching network-vif-plugged-f598ee19-8c81-4cf2-a88d-8221516eb1cf {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:37:59 user nova-compute[73391]: WARNING nova.compute.manager [req-381ce43e-4801-41d0-b43f-846f3dae2aa0 req-81f8dca2-a00d-455e-96fc-2726b558b1c9 service nova] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Received unexpected event network-vif-plugged-f598ee19-8c81-4cf2-a88d-8221516eb1cf for instance with vm_state building and task_state spawning.
Aug 15 05:37:59 user nova-compute[73391]: DEBUG nova.compute.manager [req-381ce43e-4801-41d0-b43f-846f3dae2aa0 req-81f8dca2-a00d-455e-96fc-2726b558b1c9 service nova] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Received event network-vif-plugged-075b72cf-5f6f-443c-a0e1-dd3744944e5b {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:37:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-381ce43e-4801-41d0-b43f-846f3dae2aa0 req-81f8dca2-a00d-455e-96fc-2726b558b1c9 service nova] Acquiring lock "8ff2da51-5bfd-4cdc-8cef-330cdef93d97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:37:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-381ce43e-4801-41d0-b43f-846f3dae2aa0 req-81f8dca2-a00d-455e-96fc-2726b558b1c9 service nova] Lock "8ff2da51-5bfd-4cdc-8cef-330cdef93d97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:37:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-381ce43e-4801-41d0-b43f-846f3dae2aa0 req-81f8dca2-a00d-455e-96fc-2726b558b1c9 service nova] Lock "8ff2da51-5bfd-4cdc-8cef-330cdef93d97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:37:59 user nova-compute[73391]: DEBUG nova.compute.manager [req-381ce43e-4801-41d0-b43f-846f3dae2aa0 req-81f8dca2-a00d-455e-96fc-2726b558b1c9 service nova] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] No waiting events found dispatching network-vif-plugged-075b72cf-5f6f-443c-a0e1-dd3744944e5b {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:37:59 user nova-compute[73391]: WARNING nova.compute.manager [req-381ce43e-4801-41d0-b43f-846f3dae2aa0 req-81f8dca2-a00d-455e-96fc-2726b558b1c9 service nova] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Received unexpected event network-vif-plugged-075b72cf-5f6f-443c-a0e1-dd3744944e5b for instance with vm_state building and task_state spawning.
Aug 15 05:37:59 user nova-compute[73391]: DEBUG nova.compute.manager [req-381ce43e-4801-41d0-b43f-846f3dae2aa0 req-81f8dca2-a00d-455e-96fc-2726b558b1c9 service nova] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Received event network-vif-plugged-075b72cf-5f6f-443c-a0e1-dd3744944e5b {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:37:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-381ce43e-4801-41d0-b43f-846f3dae2aa0 req-81f8dca2-a00d-455e-96fc-2726b558b1c9 service nova] Acquiring lock "8ff2da51-5bfd-4cdc-8cef-330cdef93d97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:37:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-381ce43e-4801-41d0-b43f-846f3dae2aa0 req-81f8dca2-a00d-455e-96fc-2726b558b1c9 service nova] Lock "8ff2da51-5bfd-4cdc-8cef-330cdef93d97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:37:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-381ce43e-4801-41d0-b43f-846f3dae2aa0 req-81f8dca2-a00d-455e-96fc-2726b558b1c9 service nova] Lock "8ff2da51-5bfd-4cdc-8cef-330cdef93d97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:37:59 user nova-compute[73391]: DEBUG nova.compute.manager [req-381ce43e-4801-41d0-b43f-846f3dae2aa0 req-81f8dca2-a00d-455e-96fc-2726b558b1c9 service nova] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] No waiting events found dispatching network-vif-plugged-075b72cf-5f6f-443c-a0e1-dd3744944e5b {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:37:59 user nova-compute[73391]: WARNING nova.compute.manager [req-381ce43e-4801-41d0-b43f-846f3dae2aa0 req-81f8dca2-a00d-455e-96fc-2726b558b1c9 service nova] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Received unexpected event network-vif-plugged-075b72cf-5f6f-443c-a0e1-dd3744944e5b for instance with vm_state building and task_state spawning.
Aug 15 05:37:59 user nova-compute[73391]: DEBUG nova.network.neutron [req-fb868db7-fb0e-40b9-997f-729a2247f98c req-98fe2a12-f2f2-407a-a0ca-9ceee96f25a4 service nova] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:38:00 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077880.3613605, 730890c6-6999-4a0f-b80c-e4745bff99ab => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:38:00 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] VM Resumed (Lifecycle Event)
Aug 15 05:38:00 user nova-compute[73391]: DEBUG nova.compute.manager [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:38:00 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Guest created on hypervisor {{(pid=73391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 05:38:00 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Instance spawned successfully.
Aug 15 05:38:00 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 05:38:00 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:38:00 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Found default for hw_cdrom_bus of ide {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:38:00 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Found default for hw_disk_bus of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:38:00 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Found default for hw_input_bus of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:38:00 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Found default for hw_pointer_model of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:38:00 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Found default for hw_video_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:38:00 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Found default for hw_vif_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:38:00 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:38:00 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:38:00 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077880.3632839, 730890c6-6999-4a0f-b80c-e4745bff99ab => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:38:00 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] VM Started (Lifecycle Event)
Aug 15 05:38:00 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:38:00 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:38:00 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:38:00 user nova-compute[73391]: DEBUG nova.network.neutron [req-fb868db7-fb0e-40b9-997f-729a2247f98c req-98fe2a12-f2f2-407a-a0ca-9ceee96f25a4 service nova] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:38:00 user nova-compute[73391]: INFO nova.compute.manager [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Took 8.92 seconds to spawn the instance on the hypervisor.
Aug 15 05:38:00 user nova-compute[73391]: DEBUG nova.compute.manager [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:38:00 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-fb868db7-fb0e-40b9-997f-729a2247f98c req-98fe2a12-f2f2-407a-a0ca-9ceee96f25a4 service nova] Releasing lock "refresh_cache-a1ba38e6-f0fe-408f-b1c8-f9b193531952" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:38:00 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Acquired lock "refresh_cache-a1ba38e6-f0fe-408f-b1c8-f9b193531952" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:38:00 user nova-compute[73391]: DEBUG nova.network.neutron [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:38:00 user nova-compute[73391]: DEBUG nova.network.neutron [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:38:00 user nova-compute[73391]: INFO nova.compute.manager [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Took 10.09 seconds to build instance.
Aug 15 05:38:00 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-39592da9-65a8-467b-bb0a-385c891f8ba2 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "730890c6-6999-4a0f-b80c-e4745bff99ab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.237s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:38:01 user nova-compute[73391]: DEBUG nova.network.neutron [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Updating instance_info_cache with network_info: [{"id": "6a4219e2-c727-41cc-badf-17c70f906a78", "address": "fa:16:3e:7a:2e:c4", "network": {"id": "2474e5aa-a909-4c0a-b8b0-0a1f31a80aa0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-824802028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae2c2aef51304fd1b6a8ed87a7065bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a4219e2-c7", "ovs_interfaceid": "6a4219e2-c727-41cc-badf-17c70f906a78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:38:01 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Releasing lock "refresh_cache-a1ba38e6-f0fe-408f-b1c8-f9b193531952" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:38:01 user nova-compute[73391]: DEBUG nova.compute.manager [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Instance network_info: |[{"id": "6a4219e2-c727-41cc-badf-17c70f906a78", "address": "fa:16:3e:7a:2e:c4", "network": {"id": "2474e5aa-a909-4c0a-b8b0-0a1f31a80aa0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-824802028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae2c2aef51304fd1b6a8ed87a7065bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a4219e2-c7", "ovs_interfaceid": "6a4219e2-c727-41cc-badf-17c70f906a78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 05:38:01 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Start _get_guest_xml network_info=[{"id": "6a4219e2-c727-41cc-badf-17c70f906a78", "address": "fa:16:3e:7a:2e:c4", "network": {"id": "2474e5aa-a909-4c0a-b8b0-0a1f31a80aa0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-824802028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae2c2aef51304fd1b6a8ed87a7065bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a4219e2-c7", "ovs_interfaceid": "6a4219e2-c727-41cc-badf-17c70f906a78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '191b1dad-305e-4d1c-9b15-515ec59a3278'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:38:01 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:38:01 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:38:01 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:38:01 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:38:01 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:38:01 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:38:01 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:38:01 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:38:01 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:38:01 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:38:01 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:38:01 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:38:01 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:38:01 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:38:01 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:38:01 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:38:01 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:38:01 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:38:01 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:37:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1618686331',display_name='tempest-TestServerVolumeAttachmentScenario-server-1618686331',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1618686331',id=26,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA0i9/ljlk97TqnAbCvpaUUTPmOP+TxyUHIOv0mAXgoxNTvd7yqa/Qp2bWzTnr6HTqMjC/eu1eBk++uGp+OzWTZGWhTAiF0R/jFBpljD2Du+ry45uwnMEMwk+fiZgvBkbg==',key_name='tempest-keypair-647505883',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae2c2aef51304fd1b6a8ed87a7065bc5',ramdisk_id='',reservation_id='r-v9ln0n06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1770423001',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1770423001-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:37:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c20e47271ecf400eb874b5c0c46e84fd',uuid=a1ba38e6-f0fe-408f-b1c8-f9b193531952,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a4219e2-c727-41cc-badf-17c70f906a78", "address": "fa:16:3e:7a:2e:c4", "network": {"id": "2474e5aa-a909-4c0a-b8b0-0a1f31a80aa0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-824802028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae2c2aef51304fd1b6a8ed87a7065bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a4219e2-c7", "ovs_interfaceid": "6a4219e2-c727-41cc-badf-17c70f906a78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:38:01 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Converting VIF {"id": "6a4219e2-c727-41cc-badf-17c70f906a78", "address": "fa:16:3e:7a:2e:c4", "network": {"id": "2474e5aa-a909-4c0a-b8b0-0a1f31a80aa0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-824802028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae2c2aef51304fd1b6a8ed87a7065bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a4219e2-c7", "ovs_interfaceid": "6a4219e2-c727-41cc-badf-17c70f906a78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:38:01 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:2e:c4,bridge_name='br-int',has_traffic_filtering=True,id=6a4219e2-c727-41cc-badf-17c70f906a78,network=Network(2474e5aa-a909-4c0a-b8b0-0a1f31a80aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a4219e2-c7') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:38:01 user nova-compute[73391]: DEBUG nova.objects.instance [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Lazy-loading 'pci_devices' on Instance uuid a1ba38e6-f0fe-408f-b1c8-f9b193531952 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:38:01 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077881.3639104, 8ff2da51-5bfd-4cdc-8cef-330cdef93d97 => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:38:01 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] VM Resumed (Lifecycle Event)
Aug 15 05:38:01 user nova-compute[73391]: DEBUG nova.compute.manager [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:38:01 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Guest created on hypervisor {{(pid=73391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 05:38:01 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:38:01 user nova-compute[73391]:   <uuid>a1ba38e6-f0fe-408f-b1c8-f9b193531952</uuid>
Aug 15 05:38:01 user nova-compute[73391]:   <name>instance-0000001a</name>
Aug 15 05:38:01 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:38:01 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:38:01 user nova-compute[73391]:   <metadata>
Aug 15 05:38:01 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:38:01 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:38:01 user nova-compute[73391]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1618686331</nova:name>
Aug 15 05:38:01 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:38:01</nova:creationTime>
Aug 15 05:38:01 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:38:01 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:38:01 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:38:01 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:38:01 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:38:01 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:38:01 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:38:01 user nova-compute[73391]:       <nova:owner>
Aug 15 05:38:01 user nova-compute[73391]:         <nova:user uuid="c20e47271ecf400eb874b5c0c46e84fd">tempest-TestServerVolumeAttachmentScenario-1770423001-project-member</nova:user>
Aug 15 05:38:01 user nova-compute[73391]:         <nova:project uuid="ae2c2aef51304fd1b6a8ed87a7065bc5">tempest-TestServerVolumeAttachmentScenario-1770423001</nova:project>
Aug 15 05:38:01 user nova-compute[73391]:       </nova:owner>
Aug 15 05:38:01 user nova-compute[73391]:       <nova:root type="image" uuid="191b1dad-305e-4d1c-9b15-515ec59a3278"/>
Aug 15 05:38:01 user nova-compute[73391]:       <nova:ports>
Aug 15 05:38:01 user nova-compute[73391]:         <nova:port uuid="6a4219e2-c727-41cc-badf-17c70f906a78">
Aug 15 05:38:01 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 05:38:01 user nova-compute[73391]:         </nova:port>
Aug 15 05:38:01 user nova-compute[73391]:       </nova:ports>
Aug 15 05:38:01 user nova-compute[73391]:     </nova:instance>
Aug 15 05:38:01 user nova-compute[73391]:   </metadata>
Aug 15 05:38:01 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:38:01 user nova-compute[73391]:     <system>
Aug 15 05:38:01 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:38:01 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:38:01 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:38:01 user nova-compute[73391]:       <entry name="serial">a1ba38e6-f0fe-408f-b1c8-f9b193531952</entry>
Aug 15 05:38:01 user nova-compute[73391]:       <entry name="uuid">a1ba38e6-f0fe-408f-b1c8-f9b193531952</entry>
Aug 15 05:38:01 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:38:01 user nova-compute[73391]:     </system>
Aug 15 05:38:01 user nova-compute[73391]:   </sysinfo>
Aug 15 05:38:01 user nova-compute[73391]:   <os>
Aug 15 05:38:01 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:38:01 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:38:01 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:38:01 user nova-compute[73391]:   </os>
Aug 15 05:38:01 user nova-compute[73391]:   <features>
Aug 15 05:38:01 user nova-compute[73391]:     <acpi/>
Aug 15 05:38:01 user nova-compute[73391]:     <apic/>
Aug 15 05:38:01 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:38:01 user nova-compute[73391]:   </features>
Aug 15 05:38:01 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:38:01 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:38:01 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:38:01 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:38:01 user nova-compute[73391]:   </clock>
Aug 15 05:38:01 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:38:01 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:38:01 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:38:01 user nova-compute[73391]:   </cpu>
Aug 15 05:38:01 user nova-compute[73391]:   <devices>
Aug 15 05:38:01 user nova-compute[73391]:     <disk type="file" device="disk">
Aug 15 05:38:01 user nova-compute[73391]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 05:38:01 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/a1ba38e6-f0fe-408f-b1c8-f9b193531952/disk"/>
Aug 15 05:38:01 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:38:01 user nova-compute[73391]:     </disk>
Aug 15 05:38:01 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:38:01 user nova-compute[73391]:       <mac address="fa:16:3e:7a:2e:c4"/>
Aug 15 05:38:01 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:38:01 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:38:01 user nova-compute[73391]:       <target dev="tap6a4219e2-c7"/>
Aug 15 05:38:01 user nova-compute[73391]:     </interface>
Aug 15 05:38:01 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:38:01 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/a1ba38e6-f0fe-408f-b1c8-f9b193531952/console.log" append="off"/>
Aug 15 05:38:01 user nova-compute[73391]:     </serial>
Aug 15 05:38:01 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:38:01 user nova-compute[73391]:     <video>
Aug 15 05:38:01 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:38:01 user nova-compute[73391]:     </video>
Aug 15 05:38:01 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:38:01 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:38:01 user nova-compute[73391]:     </rng>
Aug 15 05:38:01 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:38:01 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:38:01 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:38:01 user nova-compute[73391]:     </memballoon>
Aug 15 05:38:01 user nova-compute[73391]:   </devices>
Aug 15 05:38:01 user nova-compute[73391]: </domain>
Aug 15 05:38:01 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:38:01 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:37:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1618686331',display_name='tempest-TestServerVolumeAttachmentScenario-server-1618686331',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1618686331',id=26,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA0i9/ljlk97TqnAbCvpaUUTPmOP+TxyUHIOv0mAXgoxNTvd7yqa/Qp2bWzTnr6HTqMjC/eu1eBk++uGp+OzWTZGWhTAiF0R/jFBpljD2Du+ry45uwnMEMwk+fiZgvBkbg==',key_name='tempest-keypair-647505883',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae2c2aef51304fd1b6a8ed87a7065bc5',ramdisk_id='',reservation_id='r-v9ln0n06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1770423001',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1770423001-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:37:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c20e47271ecf400eb874b5c0c46e84fd',uuid=a1ba38e6-f0fe-408f-b1c8-f9b193531952,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a4219e2-c727-41cc-badf-17c70f906a78", "address": "fa:16:3e:7a:2e:c4", "network": {"id": "2474e5aa-a909-4c0a-b8b0-0a1f31a80aa0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-824802028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae2c2aef51304fd1b6a8ed87a7065bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a4219e2-c7", "ovs_interfaceid": "6a4219e2-c727-41cc-badf-17c70f906a78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:38:01 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Converting VIF {"id": "6a4219e2-c727-41cc-badf-17c70f906a78", "address": "fa:16:3e:7a:2e:c4", "network": {"id": "2474e5aa-a909-4c0a-b8b0-0a1f31a80aa0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-824802028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae2c2aef51304fd1b6a8ed87a7065bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a4219e2-c7", "ovs_interfaceid": "6a4219e2-c727-41cc-badf-17c70f906a78", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:38:01 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:2e:c4,bridge_name='br-int',has_traffic_filtering=True,id=6a4219e2-c727-41cc-badf-17c70f906a78,network=Network(2474e5aa-a909-4c0a-b8b0-0a1f31a80aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a4219e2-c7') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:38:01 user nova-compute[73391]: DEBUG os_vif [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:2e:c4,bridge_name='br-int',has_traffic_filtering=True,id=6a4219e2-c727-41cc-badf-17c70f906a78,network=Network(2474e5aa-a909-4c0a-b8b0-0a1f31a80aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a4219e2-c7') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:38:01 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:38:01 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:38:01 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:38:01 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Instance spawned successfully.
Aug 15 05:38:01 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:38:01 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 05:38:01 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:38:01 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a4219e2-c7, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:38:01 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap6a4219e2-c7, col_values=(('external_ids', {'iface-id': '6a4219e2-c727-41cc-badf-17c70f906a78', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:2e:c4', 'vm-uuid': 'a1ba38e6-f0fe-408f-b1c8-f9b193531952'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:38:01 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:38:01 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:38:01 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:38:01 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Found default for hw_cdrom_bus of ide {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:38:01 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Found default for hw_disk_bus of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:38:01 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Found default for hw_input_bus of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:38:01 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Found default for hw_pointer_model of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:38:01 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Found default for hw_video_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:38:01 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Found default for hw_vif_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:38:01 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:38:01 user nova-compute[73391]: INFO os_vif [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:2e:c4,bridge_name='br-int',has_traffic_filtering=True,id=6a4219e2-c727-41cc-badf-17c70f906a78,network=Network(2474e5aa-a909-4c0a-b8b0-0a1f31a80aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a4219e2-c7')
Aug 15 05:38:01 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:38:01 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077881.3641715, 8ff2da51-5bfd-4cdc-8cef-330cdef93d97 => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:38:01 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] VM Started (Lifecycle Event)
Aug 15 05:38:01 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:38:01 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:38:01 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:38:01 user nova-compute[73391]: INFO nova.compute.manager [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Took 8.33 seconds to spawn the instance on the hypervisor.
Aug 15 05:38:01 user nova-compute[73391]: DEBUG nova.compute.manager [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:38:01 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:38:01 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] No VIF found with MAC fa:16:3e:7a:2e:c4, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:38:01 user nova-compute[73391]: INFO nova.compute.manager [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Took 9.88 seconds to build instance.
Aug 15 05:38:01 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-184fa2f4-b4fc-49dd-af03-c52876a9ecfe tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "8ff2da51-5bfd-4cdc-8cef-330cdef93d97" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.085s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:38:02 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692077867.0580397, 8d344530-40f9-43f0-8417-15110c6c9748 => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:38:02 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] VM Stopped (Lifecycle Event)
Aug 15 05:38:02 user nova-compute[73391]: DEBUG nova.compute.manager [None req-152e2919-4958-4ba2-bfcc-c037ec01fb2f None None] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:38:03 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:38:03 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:38:03 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:38:03 user nova-compute[73391]: DEBUG nova.compute.manager [req-eb6980bf-613c-4f9a-9821-83260d5f5d04 req-d8f8f83b-2edb-4b18-9c36-d996bf83559d service nova] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Received event network-vif-plugged-6a4219e2-c727-41cc-badf-17c70f906a78 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:38:03 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-eb6980bf-613c-4f9a-9821-83260d5f5d04 req-d8f8f83b-2edb-4b18-9c36-d996bf83559d service nova] Acquiring lock "a1ba38e6-f0fe-408f-b1c8-f9b193531952-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:38:03 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-eb6980bf-613c-4f9a-9821-83260d5f5d04 req-d8f8f83b-2edb-4b18-9c36-d996bf83559d service nova] Lock "a1ba38e6-f0fe-408f-b1c8-f9b193531952-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:38:03 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-eb6980bf-613c-4f9a-9821-83260d5f5d04 req-d8f8f83b-2edb-4b18-9c36-d996bf83559d service nova] Lock "a1ba38e6-f0fe-408f-b1c8-f9b193531952-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:38:03 user nova-compute[73391]: DEBUG nova.compute.manager [req-eb6980bf-613c-4f9a-9821-83260d5f5d04 req-d8f8f83b-2edb-4b18-9c36-d996bf83559d service nova] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] No waiting events found dispatching network-vif-plugged-6a4219e2-c727-41cc-badf-17c70f906a78 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:38:03 user nova-compute[73391]: WARNING nova.compute.manager [req-eb6980bf-613c-4f9a-9821-83260d5f5d04 req-d8f8f83b-2edb-4b18-9c36-d996bf83559d service nova] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Received unexpected event network-vif-plugged-6a4219e2-c727-41cc-badf-17c70f906a78 for instance with vm_state building and task_state spawning.
Aug 15 05:38:03 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:38:03 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:38:03 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:38:03 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:38:03 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:38:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:38:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:38:05 user nova-compute[73391]: DEBUG nova.compute.manager [req-000ac742-f3b7-4cfa-a24d-c55428d1117e req-5e1abef4-4c77-461d-8007-5c3fabfb53e4 service nova] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Received event network-vif-plugged-6a4219e2-c727-41cc-badf-17c70f906a78 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:38:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-000ac742-f3b7-4cfa-a24d-c55428d1117e req-5e1abef4-4c77-461d-8007-5c3fabfb53e4 service nova] Acquiring lock "a1ba38e6-f0fe-408f-b1c8-f9b193531952-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:38:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-000ac742-f3b7-4cfa-a24d-c55428d1117e req-5e1abef4-4c77-461d-8007-5c3fabfb53e4 service nova] Lock "a1ba38e6-f0fe-408f-b1c8-f9b193531952-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:38:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-000ac742-f3b7-4cfa-a24d-c55428d1117e req-5e1abef4-4c77-461d-8007-5c3fabfb53e4 service nova] Lock "a1ba38e6-f0fe-408f-b1c8-f9b193531952-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:38:05 user nova-compute[73391]: DEBUG nova.compute.manager [req-000ac742-f3b7-4cfa-a24d-c55428d1117e req-5e1abef4-4c77-461d-8007-5c3fabfb53e4 service nova] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] No waiting events found dispatching network-vif-plugged-6a4219e2-c727-41cc-badf-17c70f906a78 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:38:05 user nova-compute[73391]: WARNING nova.compute.manager [req-000ac742-f3b7-4cfa-a24d-c55428d1117e req-5e1abef4-4c77-461d-8007-5c3fabfb53e4 service nova] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Received unexpected event network-vif-plugged-6a4219e2-c727-41cc-badf-17c70f906a78 for instance with vm_state building and task_state spawning.
Aug 15 05:38:05 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077885.6833515, a1ba38e6-f0fe-408f-b1c8-f9b193531952 => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:38:05 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] VM Resumed (Lifecycle Event)
Aug 15 05:38:05 user nova-compute[73391]: DEBUG nova.compute.manager [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:38:05 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Guest created on hypervisor {{(pid=73391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 05:38:05 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Instance spawned successfully.
Aug 15 05:38:05 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 05:38:05 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:38:05 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:38:05 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Found default for hw_cdrom_bus of ide {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:38:05 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Found default for hw_disk_bus of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:38:05 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Found default for hw_input_bus of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:38:05 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Found default for hw_pointer_model of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:38:05 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Found default for hw_video_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:38:05 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Found default for hw_vif_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:38:05 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:38:05 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077885.6847749, a1ba38e6-f0fe-408f-b1c8-f9b193531952 => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:38:05 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] VM Started (Lifecycle Event)
Aug 15 05:38:05 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:38:05 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:38:05 user nova-compute[73391]: INFO nova.compute.manager [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Took 8.77 seconds to spawn the instance on the hypervisor.
Aug 15 05:38:05 user nova-compute[73391]: DEBUG nova.compute.manager [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:38:05 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:38:06 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48551824-50da-4f81-a90f-5ec232489aef tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 05:38:06 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-48551824-50da-4f81-a90f-5ec232489aef tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:994dd7cd-6516-488e-b387-aa7426329579'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NjaJSQyp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:38:06 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-48551824-50da-4f81-a90f-5ec232489aef tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:38:06 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-48551824-50da-4f81-a90f-5ec232489aef tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:38:06 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-48551824-50da-4f81-a90f-5ec232489aef tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:38:06 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-48551824-50da-4f81-a90f-5ec232489aef tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:38:06 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-48551824-50da-4f81-a90f-5ec232489aef tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:994dd7cd-6516-488e-b387-aa7426329579" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:38:06 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-48551824-50da-4f81-a90f-5ec232489aef tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:994dd7cd-6516-488e-b387-aa7426329579" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:38:06 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-48551824-50da-4f81-a90f-5ec232489aef tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 05:38:06 user nova-compute[73391]: INFO nova.compute.manager [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Took 9.97 seconds to build instance.
Aug 15 05:38:06 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:994dd7cd-6516-488e-b387-aa7426329579 -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:38:06 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d2cbe398-91e1-4762-9ed5-8b45d19bdf09 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Lock "a1ba38e6-f0fe-408f-b1c8-f9b193531952" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.121s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:38:06 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:994dd7cd-6516-488e-b387-aa7426329579 -p 172.16.0.220:3260" returned: 21 in 0.032s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:38:06 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1cac1fa-f59c-4c26-b41a-90e9f16c0b82]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:38:06 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-48551824-50da-4f81-a90f-5ec232489aef tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 05:38:06 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:38:06 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:994dd7cd-6516-488e-b387-aa7426329579 -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:38:06 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:994dd7cd-6516-488e-b387-aa7426329579 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:38:06 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce7243f-4973-4813-ae60-c1ce83920e70]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:994dd7cd-6516-488e-b387-aa7426329579] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:38:06 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-48551824-50da-4f81-a90f-5ec232489aef tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:994dd7cd-6516-488e-b387-aa7426329579] added
Aug 15 05:38:06 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:38:06 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:994dd7cd-6516-488e-b387-aa7426329579 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:38:06 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:994dd7cd-6516-488e-b387-aa7426329579 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:38:06 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f34fe6-4d3a-418b-9a6b-6161459b5d67]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:38:06 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-48551824-50da-4f81-a90f-5ec232489aef tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:38:06 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:994dd7cd-6516-488e-b387-aa7426329579 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:38:06 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:994dd7cd-6516-488e-b387-aa7426329579 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:38:06 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95c5f67-71e8-4b07-93c5-cc399a68fa2d]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:38:06 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-48551824-50da-4f81-a90f-5ec232489aef tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:38:06 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:994dd7cd-6516-488e-b387-aa7426329579 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NjaJSQyp {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:38:06 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:994dd7cd-6516-488e-b387-aa7426329579 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NjaJSQyp" returned: 0 in 0.032s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:38:06 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c3d63f-c0e4-4a25-b964-2464ef41a42c]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:38:06 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-48551824-50da-4f81-a90f-5ec232489aef tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NjaJSQyp'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:38:06 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:994dd7cd-6516-488e-b387-aa7426329579 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:38:06 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:994dd7cd-6516-488e-b387-aa7426329579 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:38:06 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35b8a77-1e85-4edd-aca4-13cbb92513fe]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:38:06 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-48551824-50da-4f81-a90f-5ec232489aef tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:38:06 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:38:06 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:38:06 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4bdc27-8b22-4263-9860-c69a28034684]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:38:06 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-48551824-50da-4f81-a90f-5ec232489aef tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:38:06 user nova-compute[73391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)
Aug 15 05:38:06 user nova-compute[73391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)
Aug 15 05:38:06 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:38:06 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-48551824-50da-4f81-a90f-5ec232489aef tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:38:06 user nova-compute[73391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)
Aug 15 05:38:06 user nova-compute[73391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)
Aug 15 05:38:06 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:38:06 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:994dd7cd-6516-488e-b387-aa7426329579 -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:38:06 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:994dd7cd-6516-488e-b387-aa7426329579 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:38:06 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8adad09-1bf4-482c-8d50-6401927c113a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:994dd7cd-6516-488e-b387-aa7426329579, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:994dd7cd-6516-488e-b387-aa7426329579, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:38:06 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-48551824-50da-4f81-a90f-5ec232489aef tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:994dd7cd-6516-488e-b387-aa7426329579, portal: 172.16.0.220,3260]
Aug 15 05:38:06 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:994dd7cd-6516-488e-b387-aa7426329579, portal: 172.16.0.220,3260] successful.
Aug 15 05:38:06 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:38:06 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:994dd7cd-6516-488e-b387-aa7426329579 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:38:06 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:994dd7cd-6516-488e-b387-aa7426329579 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:38:06 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[10fa852c-4f0b-4ed5-a5ab-c7a76603de83]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:38:06 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-48551824-50da-4f81-a90f-5ec232489aef tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:38:06 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:38:06 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:38:06 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee90134-750c-4386-a49b-b055471e0c41]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:994dd7cd-6516-488e-b387-aa7426329579 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:38:06 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-48551824-50da-4f81-a90f-5ec232489aef tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:38:06 user nova-compute[73391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)
Aug 15 05:38:06 user nova-compute[73391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)
Aug 15 05:38:06 user nova-compute[73391]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:994dd7cd-6516-488e-b387-aa7426329579 (non-flash)
Aug 15 05:38:06 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:38:06 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-48551824-50da-4f81-a90f-5ec232489aef tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:38:06 user nova-compute[73391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)
Aug 15 05:38:06 user nova-compute[73391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)
Aug 15 05:38:06 user nova-compute[73391]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:994dd7cd-6516-488e-b387-aa7426329579 (non-flash)
Aug 15 05:38:06 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:38:06 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-48551824-50da-4f81-a90f-5ec232489aef tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:994dd7cd-6516-488e-b387-aa7426329579" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.399s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:38:06 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-48551824-50da-4f81-a90f-5ec232489aef tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 05:38:06 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-48551824-50da-4f81-a90f-5ec232489aef tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 05:38:06 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-48551824-50da-4f81-a90f-5ec232489aef tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 05:38:06 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:38:06 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:38:06 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:38:06 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9fa523-9ecd-4aa6-ad45-6611781c09ef]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:38:06 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-48551824-50da-4f81-a90f-5ec232489aef tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: None {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:38:07 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-48551824-50da-4f81-a90f-5ec232489aef tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:38:07 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-48551824-50da-4f81-a90f-5ec232489aef tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NjaJSQyp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 05:38:07 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-48551824-50da-4f81-a90f-5ec232489aef tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.442s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:38:07 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-48551824-50da-4f81-a90f-5ec232489aef tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] <== connect_volume: return (1445ms) {'type': 'block', 'scsi_wwn': '23334636537343237', 'path': '/dev/sdb'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:38:07 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48551824-50da-4f81-a90f-5ec232489aef tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334636537343237', 'path': '/dev/sdb'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 05:38:07 user nova-compute[73391]: DEBUG nova.objects.instance [None req-48551824-50da-4f81-a90f-5ec232489aef tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lazy-loading 'flavor' on Instance uuid 3f88cd17-c89f-41f3-b630-8eb2c6698155 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:38:07 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-48551824-50da-4f81-a90f-5ec232489aef tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 05:38:07 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:38:07 user nova-compute[73391]:   <source dev="/dev/sdb"/>
Aug 15 05:38:07 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:38:07 user nova-compute[73391]:   <serial>994dd7cd-6516-488e-b387-aa7426329579</serial>
Aug 15 05:38:07 user nova-compute[73391]: </disk>
Aug 15 05:38:07 user nova-compute[73391]:  {{(pid=73391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 05:38:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-48551824-50da-4f81-a90f-5ec232489aef tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:38:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-48551824-50da-4f81-a90f-5ec232489aef tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:38:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-48551824-50da-4f81-a90f-5ec232489aef tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] No VIF found with MAC fa:16:3e:62:a5:85, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:38:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-48551824-50da-4f81-a90f-5ec232489aef tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "3f88cd17-c89f-41f3-b630-8eb2c6698155" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.566s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:38:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:38:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:38:11 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3f5e9d89-c0c8-43d9-8757-7287cc172046 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Acquiring lock "3f88cd17-c89f-41f3-b630-8eb2c6698155" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:38:11 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3f5e9d89-c0c8-43d9-8757-7287cc172046 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "3f88cd17-c89f-41f3-b630-8eb2c6698155" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:38:11 user nova-compute[73391]: INFO nova.compute.manager [None req-3f5e9d89-c0c8-43d9-8757-7287cc172046 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Detaching volume 994dd7cd-6516-488e-b387-aa7426329579
Aug 15 05:38:11 user nova-compute[73391]: INFO nova.virt.block_device [None req-3f5e9d89-c0c8-43d9-8757-7287cc172046 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Attempting to driver detach volume 994dd7cd-6516-488e-b387-aa7426329579 from mountpoint /dev/vdb
Aug 15 05:38:11 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3f5e9d89-c0c8-43d9-8757-7287cc172046 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Attempting to detach device vdb from instance 3f88cd17-c89f-41f3-b630-8eb2c6698155 from the persistent domain config. {{(pid=73391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 05:38:11 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-3f5e9d89-c0c8-43d9-8757-7287cc172046 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 05:38:11 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:38:11 user nova-compute[73391]:   <source dev="/dev/sdb"/>
Aug 15 05:38:11 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:38:11 user nova-compute[73391]:   <serial>994dd7cd-6516-488e-b387-aa7426329579</serial>
Aug 15 05:38:11 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 05:38:11 user nova-compute[73391]: </disk>
Aug 15 05:38:11 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 05:38:11 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-3f5e9d89-c0c8-43d9-8757-7287cc172046 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Successfully detached device vdb from instance 3f88cd17-c89f-41f3-b630-8eb2c6698155 from the persistent domain config.
Aug 15 05:38:11 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3f5e9d89-c0c8-43d9-8757-7287cc172046 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3f88cd17-c89f-41f3-b630-8eb2c6698155 from the live domain config. {{(pid=73391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 05:38:11 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-3f5e9d89-c0c8-43d9-8757-7287cc172046 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 05:38:11 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:38:11 user nova-compute[73391]:   <source dev="/dev/sdb"/>
Aug 15 05:38:11 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:38:11 user nova-compute[73391]:   <serial>994dd7cd-6516-488e-b387-aa7426329579</serial>
Aug 15 05:38:11 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 05:38:11 user nova-compute[73391]: </disk>
Aug 15 05:38:11 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 05:38:11 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:38:11 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Received event <DeviceRemovedEvent: 1692077891.732102, 3f88cd17-c89f-41f3-b630-8eb2c6698155 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73391) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 05:38:11 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3f5e9d89-c0c8-43d9-8757-7287cc172046 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3f88cd17-c89f-41f3-b630-8eb2c6698155 {{(pid=73391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 05:38:11 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-3f5e9d89-c0c8-43d9-8757-7287cc172046 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Successfully detached device vdb from instance 3f88cd17-c89f-41f3-b630-8eb2c6698155 from the live domain config.
Aug 15 05:38:11 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f5e9d89-c0c8-43d9-8757-7287cc172046 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 05:38:11 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5e9d89-c0c8-43d9-8757-7287cc172046 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:994dd7cd-6516-488e-b387-aa7426329579'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NjaJSQyp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:38:11 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-3f5e9d89-c0c8-43d9-8757-7287cc172046 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:38:11 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-3f5e9d89-c0c8-43d9-8757-7287cc172046 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:38:11 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-3f5e9d89-c0c8-43d9-8757-7287cc172046 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:38:11 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5e9d89-c0c8-43d9-8757-7287cc172046 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:994dd7cd-6516-488e-b387-aa7426329579', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 05:38:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:38:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:38:11 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfe60ae-d3a1-40fa-a13b-3e15ea31fec2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:994dd7cd-6516-488e-b387-aa7426329579\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:38:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:38:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.069s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:38:11 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a04317-4d8d-49bd-9f94-a5a2e6c56d0f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:994dd7cd-6516-488e-b387-aa7426329579 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:38:11 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5e9d89-c0c8-43d9-8757-7287cc172046 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:38:11 user nova-compute[73391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)
Aug 15 05:38:11 user nova-compute[73391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)
Aug 15 05:38:11 user nova-compute[73391]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:994dd7cd-6516-488e-b387-aa7426329579 (non-flash)
Aug 15 05:38:11 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:38:11 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5e9d89-c0c8-43d9-8757-7287cc172046 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:38:11 user nova-compute[73391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)
Aug 15 05:38:11 user nova-compute[73391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)
Aug 15 05:38:11 user nova-compute[73391]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:994dd7cd-6516-488e-b387-aa7426329579 (non-flash)
Aug 15 05:38:11 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:38:11 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5e9d89-c0c8-43d9-8757-7287cc172046 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77284975b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:994dd7cd-6516-488e-b387-aa7426329579'): ({'sdb'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 05:38:11 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-3f5e9d89-c0c8-43d9-8757-7287cc172046 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Removing single pathed devices sdb {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 05:38:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:38:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:38:11 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1018448d-8ab7-466e-b9a9-cea6b1e84905]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:38:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:38:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:38:11 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f444c746-4682-4179-994d-e5eb09536caa]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:38:11 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-3f5e9d89-c0c8-43d9-8757-7287cc172046 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Flushing IO for device /dev/sdb {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 05:38:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:38:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:38:11 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e7fc9b-6de9-499f-9dee-43ffad2784b4]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:38:11 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-3f5e9d89-c0c8-43d9-8757-7287cc172046 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 05:38:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:38:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:38:11 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d8686c-c4f9-48ed-a8f5-71b128a5a44b]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:38:11 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-3f5e9d89-c0c8-43d9-8757-7287cc172046 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 05:38:11 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-3f5e9d89-c0c8-43d9-8757-7287cc172046 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] SCSI volumes sdb have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 05:38:11 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5e9d89-c0c8-43d9-8757-7287cc172046 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:994dd7cd-6516-488e-b387-aa7426329579')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 05:38:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:994dd7cd-6516-488e-b387-aa7426329579 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:38:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:994dd7cd-6516-488e-b387-aa7426329579 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:38:12 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b460f8c2-1923-4393-991d-9f27ccae8ac8]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:38:12 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5e9d89-c0c8-43d9-8757-7287cc172046 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:38:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:994dd7cd-6516-488e-b387-aa7426329579 -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:38:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:994dd7cd-6516-488e-b387-aa7426329579 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:38:12 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ba7bf8-78bc-43cc-9189-d585e6d172df]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:994dd7cd-6516-488e-b387-aa7426329579, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:994dd7cd-6516-488e-b387-aa7426329579, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:38:12 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5e9d89-c0c8-43d9-8757-7287cc172046 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:994dd7cd-6516-488e-b387-aa7426329579, portal: 172.16.0.220,3260]
Aug 15 05:38:12 user nova-compute[73391]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:994dd7cd-6516-488e-b387-aa7426329579, portal: 172.16.0.220,3260] successful.
Aug 15 05:38:12 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:38:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:994dd7cd-6516-488e-b387-aa7426329579 -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:38:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:994dd7cd-6516-488e-b387-aa7426329579 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:38:12 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71c5d1e-4877-4ccf-84ce-323a447f9985]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:38:12 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5e9d89-c0c8-43d9-8757-7287cc172046 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:38:12 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-3f5e9d89-c0c8-43d9-8757-7287cc172046 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:38:12 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f5e9d89-c0c8-43d9-8757-7287cc172046 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] <== disconnect_volume: return (375ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:38:12 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f5e9d89-c0c8-43d9-8757-7287cc172046 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 05:38:12 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:38:12 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:38:12 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:38:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Acquiring lock "8991b32e-6c4b-4c66-a320-e734061f49ee" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:38:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lock "8991b32e-6c4b-4c66-a320-e734061f49ee" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:38:12 user nova-compute[73391]: DEBUG nova.compute.manager [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Starting instance... {{(pid=73391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 05:38:13 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:38:13 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:38:13 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 05:38:13 user nova-compute[73391]: INFO nova.compute.claims [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Claim successful on node user
Aug 15 05:38:13 user nova-compute[73391]: DEBUG nova.objects.instance [None req-3f5e9d89-c0c8-43d9-8757-7287cc172046 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lazy-loading 'flavor' on Instance uuid 3f88cd17-c89f-41f3-b630-8eb2c6698155 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:38:13 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3f5e9d89-c0c8-43d9-8757-7287cc172046 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "3f88cd17-c89f-41f3-b630-8eb2c6698155" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.054s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:38:13 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:38:13 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:38:13 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.553s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:38:13 user nova-compute[73391]: DEBUG nova.compute.manager [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Start building networks asynchronously for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 05:38:13 user nova-compute[73391]: DEBUG nova.compute.manager [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Allocating IP information in the background. {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 05:38:13 user nova-compute[73391]: DEBUG nova.network.neutron [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] allocate_for_instance() {{(pid=73391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 05:38:13 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 05:38:13 user nova-compute[73391]: DEBUG nova.compute.manager [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Start building block device mappings for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 05:38:13 user nova-compute[73391]: DEBUG nova.policy [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b43158637026445496cc0030b6ce49a2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '666428ad8c2f4f9cadcd180e498223f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73391) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 05:38:13 user nova-compute[73391]: DEBUG nova.compute.manager [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Start spawning the instance on the hypervisor. {{(pid=73391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 05:38:13 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Creating instance directory {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 05:38:13 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Creating image(s)
Aug 15 05:38:13 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Acquiring lock "/opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:38:13 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lock "/opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:38:13 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lock "/opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:38:13 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:38:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.207s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:38:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Acquiring lock "999b315ba87151d8252d543312ae7790e7e1583b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:38:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:38:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:38:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:38:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.196s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:38:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/disk 1073741824 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:38:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-76f3235e-bfb2-4ede-8b9e-ea5f9fdaa15c tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquiring lock "8186459b-5bcb-4b5a-b6d8-d424909614e5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:38:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-76f3235e-bfb2-4ede-8b9e-ea5f9fdaa15c tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "8186459b-5bcb-4b5a-b6d8-d424909614e5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.003s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:38:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/disk 1073741824" returned: 0 in 0.060s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:38:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:38:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:38:14 user nova-compute[73391]: INFO nova.compute.manager [None req-76f3235e-bfb2-4ede-8b9e-ea5f9fdaa15c tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Detaching volume f933c0cc-dfab-44c4-b973-2f75a10fdaa5
Aug 15 05:38:14 user nova-compute[73391]: INFO nova.virt.block_device [None req-76f3235e-bfb2-4ede-8b9e-ea5f9fdaa15c tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Attempting to driver detach volume f933c0cc-dfab-44c4-b973-2f75a10fdaa5 from mountpoint /dev/vdb
Aug 15 05:38:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-76f3235e-bfb2-4ede-8b9e-ea5f9fdaa15c tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Attempting to detach device vdb from instance 8186459b-5bcb-4b5a-b6d8-d424909614e5 from the persistent domain config. {{(pid=73391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 05:38:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-76f3235e-bfb2-4ede-8b9e-ea5f9fdaa15c tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 05:38:14 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:38:14 user nova-compute[73391]:   <source dev="/dev/sdd"/>
Aug 15 05:38:14 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:38:14 user nova-compute[73391]:   <serial>f933c0cc-dfab-44c4-b973-2f75a10fdaa5</serial>
Aug 15 05:38:14 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 05:38:14 user nova-compute[73391]: </disk>
Aug 15 05:38:14 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 05:38:14 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-76f3235e-bfb2-4ede-8b9e-ea5f9fdaa15c tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Successfully detached device vdb from instance 8186459b-5bcb-4b5a-b6d8-d424909614e5 from the persistent domain config.
Aug 15 05:38:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-76f3235e-bfb2-4ede-8b9e-ea5f9fdaa15c tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8186459b-5bcb-4b5a-b6d8-d424909614e5 from the live domain config. {{(pid=73391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 05:38:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-76f3235e-bfb2-4ede-8b9e-ea5f9fdaa15c tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 05:38:14 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:38:14 user nova-compute[73391]:   <source dev="/dev/sdd"/>
Aug 15 05:38:14 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:38:14 user nova-compute[73391]:   <serial>f933c0cc-dfab-44c4-b973-2f75a10fdaa5</serial>
Aug 15 05:38:14 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 05:38:14 user nova-compute[73391]: </disk>
Aug 15 05:38:14 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 05:38:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.198s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:38:14 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/disk. size=1073741824 {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 05:38:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:38:14 user nova-compute[73391]: DEBUG nova.network.neutron [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Successfully created port: 3e0cb01d-a82e-44d3-b8dd-723819ec6ffa {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 05:38:14 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:38:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:38:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:38:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:38:14 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Auditing locally available compute resources for user (node: user) {{(pid=73391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 05:38:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:38:14 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Cannot resize image /opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/disk to a smaller size. {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 05:38:14 user nova-compute[73391]: DEBUG nova.objects.instance [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lazy-loading 'migration_context' on Instance uuid 8991b32e-6c4b-4c66-a320-e734061f49ee {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:38:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Created local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 05:38:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Ensure instance console log exists: /opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 05:38:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:38:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:38:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:38:15 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Received event <DeviceRemovedEvent: 1692077895.099899, 8186459b-5bcb-4b5a-b6d8-d424909614e5 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73391) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 05:38:15 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-76f3235e-bfb2-4ede-8b9e-ea5f9fdaa15c tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8186459b-5bcb-4b5a-b6d8-d424909614e5 {{(pid=73391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 05:38:15 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-76f3235e-bfb2-4ede-8b9e-ea5f9fdaa15c tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Successfully detached device vdb from instance 8186459b-5bcb-4b5a-b6d8-d424909614e5 from the live domain config.
Aug 15 05:38:15 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76f3235e-bfb2-4ede-8b9e-ea5f9fdaa15c tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 05:38:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f3235e-bfb2-4ede-8b9e-ea5f9fdaa15c tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WQdVNZAL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:38:15 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-76f3235e-bfb2-4ede-8b9e-ea5f9fdaa15c tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:38:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-76f3235e-bfb2-4ede-8b9e-ea5f9fdaa15c tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:38:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-76f3235e-bfb2-4ede-8b9e-ea5f9fdaa15c tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:38:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f3235e-bfb2-4ede-8b9e-ea5f9fdaa15c tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 05:38:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:38:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:38:15 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b32314-87fe-489f-ae19-dbba25b33d06]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:38:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:38:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:38:15 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0118e6-da82-40db-9f1d-5530fd4a91c9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:38:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f3235e-bfb2-4ede-8b9e-ea5f9fdaa15c tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:38:15 user nova-compute[73391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)
Aug 15 05:38:15 user nova-compute[73391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)
Aug 15 05:38:15 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:38:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f3235e-bfb2-4ede-8b9e-ea5f9fdaa15c tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:38:15 user nova-compute[73391]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 (non-flash)
Aug 15 05:38:15 user nova-compute[73391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)
Aug 15 05:38:15 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:38:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f3235e-bfb2-4ede-8b9e-ea5f9fdaa15c tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77484c6560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5'): ({'sdd'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 05:38:15 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-76f3235e-bfb2-4ede-8b9e-ea5f9fdaa15c tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Removing single pathed devices sdd {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 05:38:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:38:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:38:15 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[52aa6ba5-717a-40a2-b566-705a9d28008a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:38:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:38:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:38:15 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b70fa5-1e12-4e71-8dfb-6f945f8895f5]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:38:15 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-76f3235e-bfb2-4ede-8b9e-ea5f9fdaa15c tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Flushing IO for device /dev/sdd {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 05:38:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:38:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:38:15 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[808b60df-6f71-4a44-ab19-553fba3bd08b]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:38:15 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-76f3235e-bfb2-4ede-8b9e-ea5f9fdaa15c tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 05:38:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:38:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:38:15 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ffc2e6-449d-4a3f-943b-4c054ebec2e9]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:38:15 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-76f3235e-bfb2-4ede-8b9e-ea5f9fdaa15c tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 05:38:15 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-76f3235e-bfb2-4ede-8b9e-ea5f9fdaa15c tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] SCSI volumes sdd have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 05:38:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f3235e-bfb2-4ede-8b9e-ea5f9fdaa15c tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 05:38:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:38:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:38:15 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[329241ba-6b42-4bc6-b8c2-2029cdf239ab]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:38:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f3235e-bfb2-4ede-8b9e-ea5f9fdaa15c tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:38:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:38:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f88cd17-c89f-41f3-b630-8eb2c6698155/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:38:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.147s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:38:15 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d13dfa-aacc-43cc-ad43-a8efe2ed968e]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:38:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f3235e-bfb2-4ede-8b9e-ea5f9fdaa15c tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5, portal: 172.16.0.220,3260]
Aug 15 05:38:15 user nova-compute[73391]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5, portal: 172.16.0.220,3260] successful.
Aug 15 05:38:15 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:38:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:38:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f933c0cc-dfab-44c4-b973-2f75a10fdaa5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.124s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:38:15 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf4776f-b336-4e23-ba75-e496773d4452]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:38:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f3235e-bfb2-4ede-8b9e-ea5f9fdaa15c tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:38:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-76f3235e-bfb2-4ede-8b9e-ea5f9fdaa15c tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.568s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:38:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-76f3235e-bfb2-4ede-8b9e-ea5f9fdaa15c tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] <== disconnect_volume: return (571ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:38:15 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76f3235e-bfb2-4ede-8b9e-ea5f9fdaa15c tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 05:38:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f88cd17-c89f-41f3-b630-8eb2c6698155/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:38:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f88cd17-c89f-41f3-b630-8eb2c6698155/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:38:15 user nova-compute[73391]: DEBUG nova.network.neutron [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Successfully updated port: 3e0cb01d-a82e-44d3-b8dd-723819ec6ffa {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:38:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f88cd17-c89f-41f3-b630-8eb2c6698155/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Acquiring lock "refresh_cache-8991b32e-6c4b-4c66-a320-e734061f49ee" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Acquired lock "refresh_cache-8991b32e-6c4b-4c66-a320-e734061f49ee" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG nova.network.neutron [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG nova.compute.manager [req-f81ddecf-9a1b-41f9-a049-ead9128ec115 req-f0eb288c-0131-4078-9bc9-ff1685d2619e service nova] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Received event network-changed-3e0cb01d-a82e-44d3-b8dd-723819ec6ffa {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG nova.compute.manager [req-f81ddecf-9a1b-41f9-a049-ead9128ec115 req-f0eb288c-0131-4078-9bc9-ff1685d2619e service nova] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Refreshing instance network info cache due to event network-changed-3e0cb01d-a82e-44d3-b8dd-723819ec6ffa. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f81ddecf-9a1b-41f9-a049-ead9128ec115 req-f0eb288c-0131-4078-9bc9-ff1685d2619e service nova] Acquiring lock "refresh_cache-8991b32e-6c4b-4c66-a320-e734061f49ee" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG nova.network.neutron [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG nova.network.neutron [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Updating instance_info_cache with network_info: [{"id": "3e0cb01d-a82e-44d3-b8dd-723819ec6ffa", "address": "fa:16:3e:89:dc:93", "network": {"id": "11023df3-666d-44e5-955d-cc1fbde6972e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1848872765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "666428ad8c2f4f9cadcd180e498223f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0cb01d-a8", "ovs_interfaceid": "3e0cb01d-a82e-44d3-b8dd-723819ec6ffa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Releasing lock "refresh_cache-8991b32e-6c4b-4c66-a320-e734061f49ee" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG nova.compute.manager [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Instance network_info: |[{"id": "3e0cb01d-a82e-44d3-b8dd-723819ec6ffa", "address": "fa:16:3e:89:dc:93", "network": {"id": "11023df3-666d-44e5-955d-cc1fbde6972e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1848872765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "666428ad8c2f4f9cadcd180e498223f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0cb01d-a8", "ovs_interfaceid": "3e0cb01d-a82e-44d3-b8dd-723819ec6ffa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f81ddecf-9a1b-41f9-a049-ead9128ec115 req-f0eb288c-0131-4078-9bc9-ff1685d2619e service nova] Acquired lock "refresh_cache-8991b32e-6c4b-4c66-a320-e734061f49ee" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG nova.network.neutron [req-f81ddecf-9a1b-41f9-a049-ead9128ec115 req-f0eb288c-0131-4078-9bc9-ff1685d2619e service nova] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Refreshing network info cache for port 3e0cb01d-a82e-44d3-b8dd-723819ec6ffa {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Start _get_guest_xml network_info=[{"id": "3e0cb01d-a82e-44d3-b8dd-723819ec6ffa", "address": "fa:16:3e:89:dc:93", "network": {"id": "11023df3-666d-44e5-955d-cc1fbde6972e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1848872765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "666428ad8c2f4f9cadcd180e498223f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0cb01d-a8", "ovs_interfaceid": "3e0cb01d-a82e-44d3-b8dd-723819ec6ffa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '191b1dad-305e-4d1c-9b15-515ec59a3278'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:38:16 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:38:16 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:38:16 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:38:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-845602872',display_name='tempest-ServerActionsTestOtherB-server-845602872',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-845602872',id=27,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCi9vkvcVQEbXmigHztv9LlDFuCnimhR/vNlP8kykjc1U9WtN+KwlQqW0CDVIHXojOPVLOC+TJRapzFB5aO8vw7udjudZbg8fWCON+jsBrd+VE/0PuYaOBBV7W22/iAKjg==',key_name='tempest-keypair-1001766799',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='666428ad8c2f4f9cadcd180e498223f7',ramdisk_id='',reservation_id='r-sady4pim',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-762584882',owner_user_name='tempest-ServerActionsTestOtherB-762584882-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:38:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b43158637026445496cc0030b6ce49a2',uuid=8991b32e-6c4b-4c66-a320-e734061f49ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e0cb01d-a82e-44d3-b8dd-723819ec6ffa", "address": "fa:16:3e:89:dc:93", "network": {"id": "11023df3-666d-44e5-955d-cc1fbde6972e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1848872765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "666428ad8c2f4f9cadcd180e498223f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0cb01d-a8", "ovs_interfaceid": "3e0cb01d-a82e-44d3-b8dd-723819ec6ffa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Converting VIF {"id": "3e0cb01d-a82e-44d3-b8dd-723819ec6ffa", "address": "fa:16:3e:89:dc:93", "network": {"id": "11023df3-666d-44e5-955d-cc1fbde6972e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1848872765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "666428ad8c2f4f9cadcd180e498223f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0cb01d-a8", "ovs_interfaceid": "3e0cb01d-a82e-44d3-b8dd-723819ec6ffa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:dc:93,bridge_name='br-int',has_traffic_filtering=True,id=3e0cb01d-a82e-44d3-b8dd-723819ec6ffa,network=Network(11023df3-666d-44e5-955d-cc1fbde6972e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e0cb01d-a8') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG nova.objects.instance [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lazy-loading 'pci_devices' on Instance uuid 8991b32e-6c4b-4c66-a320-e734061f49ee {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:38:16 user nova-compute[73391]:   <uuid>8991b32e-6c4b-4c66-a320-e734061f49ee</uuid>
Aug 15 05:38:16 user nova-compute[73391]:   <name>instance-0000001b</name>
Aug 15 05:38:16 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:38:16 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:38:16 user nova-compute[73391]:   <metadata>
Aug 15 05:38:16 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:38:16 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:38:16 user nova-compute[73391]:       <nova:name>tempest-ServerActionsTestOtherB-server-845602872</nova:name>
Aug 15 05:38:16 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:38:16</nova:creationTime>
Aug 15 05:38:16 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:38:16 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:38:16 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:38:16 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:38:16 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:38:16 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:38:16 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:38:16 user nova-compute[73391]:       <nova:owner>
Aug 15 05:38:16 user nova-compute[73391]:         <nova:user uuid="b43158637026445496cc0030b6ce49a2">tempest-ServerActionsTestOtherB-762584882-project-member</nova:user>
Aug 15 05:38:16 user nova-compute[73391]:         <nova:project uuid="666428ad8c2f4f9cadcd180e498223f7">tempest-ServerActionsTestOtherB-762584882</nova:project>
Aug 15 05:38:16 user nova-compute[73391]:       </nova:owner>
Aug 15 05:38:16 user nova-compute[73391]:       <nova:root type="image" uuid="191b1dad-305e-4d1c-9b15-515ec59a3278"/>
Aug 15 05:38:16 user nova-compute[73391]:       <nova:ports>
Aug 15 05:38:16 user nova-compute[73391]:         <nova:port uuid="3e0cb01d-a82e-44d3-b8dd-723819ec6ffa">
Aug 15 05:38:16 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 15 05:38:16 user nova-compute[73391]:         </nova:port>
Aug 15 05:38:16 user nova-compute[73391]:       </nova:ports>
Aug 15 05:38:16 user nova-compute[73391]:     </nova:instance>
Aug 15 05:38:16 user nova-compute[73391]:   </metadata>
Aug 15 05:38:16 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:38:16 user nova-compute[73391]:     <system>
Aug 15 05:38:16 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:38:16 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:38:16 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:38:16 user nova-compute[73391]:       <entry name="serial">8991b32e-6c4b-4c66-a320-e734061f49ee</entry>
Aug 15 05:38:16 user nova-compute[73391]:       <entry name="uuid">8991b32e-6c4b-4c66-a320-e734061f49ee</entry>
Aug 15 05:38:16 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:38:16 user nova-compute[73391]:     </system>
Aug 15 05:38:16 user nova-compute[73391]:   </sysinfo>
Aug 15 05:38:16 user nova-compute[73391]:   <os>
Aug 15 05:38:16 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:38:16 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:38:16 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:38:16 user nova-compute[73391]:   </os>
Aug 15 05:38:16 user nova-compute[73391]:   <features>
Aug 15 05:38:16 user nova-compute[73391]:     <acpi/>
Aug 15 05:38:16 user nova-compute[73391]:     <apic/>
Aug 15 05:38:16 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:38:16 user nova-compute[73391]:   </features>
Aug 15 05:38:16 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:38:16 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:38:16 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:38:16 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:38:16 user nova-compute[73391]:   </clock>
Aug 15 05:38:16 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:38:16 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:38:16 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:38:16 user nova-compute[73391]:   </cpu>
Aug 15 05:38:16 user nova-compute[73391]:   <devices>
Aug 15 05:38:16 user nova-compute[73391]:     <disk type="file" device="disk">
Aug 15 05:38:16 user nova-compute[73391]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 05:38:16 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/disk"/>
Aug 15 05:38:16 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:38:16 user nova-compute[73391]:     </disk>
Aug 15 05:38:16 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:38:16 user nova-compute[73391]:       <mac address="fa:16:3e:89:dc:93"/>
Aug 15 05:38:16 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:38:16 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:38:16 user nova-compute[73391]:       <target dev="tap3e0cb01d-a8"/>
Aug 15 05:38:16 user nova-compute[73391]:     </interface>
Aug 15 05:38:16 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:38:16 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/console.log" append="off"/>
Aug 15 05:38:16 user nova-compute[73391]:     </serial>
Aug 15 05:38:16 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:38:16 user nova-compute[73391]:     <video>
Aug 15 05:38:16 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:38:16 user nova-compute[73391]:     </video>
Aug 15 05:38:16 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:38:16 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:38:16 user nova-compute[73391]:     </rng>
Aug 15 05:38:16 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:38:16 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:38:16 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:38:16 user nova-compute[73391]:     </memballoon>
Aug 15 05:38:16 user nova-compute[73391]:   </devices>
Aug 15 05:38:16 user nova-compute[73391]: </domain>
Aug 15 05:38:16 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:38:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-845602872',display_name='tempest-ServerActionsTestOtherB-server-845602872',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-845602872',id=27,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCi9vkvcVQEbXmigHztv9LlDFuCnimhR/vNlP8kykjc1U9WtN+KwlQqW0CDVIHXojOPVLOC+TJRapzFB5aO8vw7udjudZbg8fWCON+jsBrd+VE/0PuYaOBBV7W22/iAKjg==',key_name='tempest-keypair-1001766799',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='666428ad8c2f4f9cadcd180e498223f7',ramdisk_id='',reservation_id='r-sady4pim',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-762584882',owner_user_name='tempest-ServerActionsTestOtherB-762584882-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:38:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b43158637026445496cc0030b6ce49a2',uuid=8991b32e-6c4b-4c66-a320-e734061f49ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e0cb01d-a82e-44d3-b8dd-723819ec6ffa", "address": "fa:16:3e:89:dc:93", "network": {"id": "11023df3-666d-44e5-955d-cc1fbde6972e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1848872765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "666428ad8c2f4f9cadcd180e498223f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0cb01d-a8", "ovs_interfaceid": "3e0cb01d-a82e-44d3-b8dd-723819ec6ffa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Converting VIF {"id": "3e0cb01d-a82e-44d3-b8dd-723819ec6ffa", "address": "fa:16:3e:89:dc:93", "network": {"id": "11023df3-666d-44e5-955d-cc1fbde6972e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1848872765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "666428ad8c2f4f9cadcd180e498223f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0cb01d-a8", "ovs_interfaceid": "3e0cb01d-a82e-44d3-b8dd-723819ec6ffa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:dc:93,bridge_name='br-int',has_traffic_filtering=True,id=3e0cb01d-a82e-44d3-b8dd-723819ec6ffa,network=Network(11023df3-666d-44e5-955d-cc1fbde6972e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e0cb01d-a8') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG os_vif [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:dc:93,bridge_name='br-int',has_traffic_filtering=True,id=3e0cb01d-a82e-44d3-b8dd-723819ec6ffa,network=Network(11023df3-666d-44e5-955d-cc1fbde6972e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e0cb01d-a8') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e0cb01d-a8, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3e0cb01d-a8, col_values=(('external_ids', {'iface-id': '3e0cb01d-a82e-44d3-b8dd-723819ec6ffa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:dc:93', 'vm-uuid': '8991b32e-6c4b-4c66-a320-e734061f49ee'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG nova.objects.instance [None req-76f3235e-bfb2-4ede-8b9e-ea5f9fdaa15c tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lazy-loading 'flavor' on Instance uuid 8186459b-5bcb-4b5a-b6d8-d424909614e5 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:38:16 user nova-compute[73391]: INFO os_vif [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:dc:93,bridge_name='br-int',has_traffic_filtering=True,id=3e0cb01d-a82e-44d3-b8dd-723819ec6ffa,network=Network(11023df3-666d-44e5-955d-cc1fbde6972e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e0cb01d-a8')
Aug 15 05:38:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ba38e6-f0fe-408f-b1c8-f9b193531952/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-76f3235e-bfb2-4ede-8b9e-ea5f9fdaa15c tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "8186459b-5bcb-4b5a-b6d8-d424909614e5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.620s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:38:16 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] No VIF found with MAC fa:16:3e:89:dc:93, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:38:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ba38e6-f0fe-408f-b1c8-f9b193531952/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:38:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ba38e6-f0fe-408f-b1c8-f9b193531952/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:38:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ba38e6-f0fe-408f-b1c8-f9b193531952/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:38:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:38:17 user nova-compute[73391]: DEBUG nova.network.neutron [req-f81ddecf-9a1b-41f9-a049-ead9128ec115 req-f0eb288c-0131-4078-9bc9-ff1685d2619e service nova] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Updated VIF entry in instance network info cache for port 3e0cb01d-a82e-44d3-b8dd-723819ec6ffa. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:38:17 user nova-compute[73391]: DEBUG nova.network.neutron [req-f81ddecf-9a1b-41f9-a049-ead9128ec115 req-f0eb288c-0131-4078-9bc9-ff1685d2619e service nova] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Updating instance_info_cache with network_info: [{"id": "3e0cb01d-a82e-44d3-b8dd-723819ec6ffa", "address": "fa:16:3e:89:dc:93", "network": {"id": "11023df3-666d-44e5-955d-cc1fbde6972e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1848872765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "666428ad8c2f4f9cadcd180e498223f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0cb01d-a8", "ovs_interfaceid": "3e0cb01d-a82e-44d3-b8dd-723819ec6ffa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:38:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f81ddecf-9a1b-41f9-a049-ead9128ec115 req-f0eb288c-0131-4078-9bc9-ff1685d2619e service nova] Releasing lock "refresh_cache-8991b32e-6c4b-4c66-a320-e734061f49ee" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:38:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:38:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:38:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:38:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab02c376-1432-4981-9179-aeef6e647ea4/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:38:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab02c376-1432-4981-9179-aeef6e647ea4/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:38:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab02c376-1432-4981-9179-aeef6e647ea4/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:38:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab02c376-1432-4981-9179-aeef6e647ea4/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:38:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:38:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:38:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:38:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:38:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:38:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:38:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:38:18 user nova-compute[73391]: DEBUG nova.compute.manager [req-b95e23be-9c75-48b6-b8e4-55701175523f req-736d2dc2-6783-4fc8-9668-99136d6ce939 service nova] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Received event network-vif-plugged-3e0cb01d-a82e-44d3-b8dd-723819ec6ffa {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:38:18 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-b95e23be-9c75-48b6-b8e4-55701175523f req-736d2dc2-6783-4fc8-9668-99136d6ce939 service nova] Acquiring lock "8991b32e-6c4b-4c66-a320-e734061f49ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:38:18 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-b95e23be-9c75-48b6-b8e4-55701175523f req-736d2dc2-6783-4fc8-9668-99136d6ce939 service nova] Lock "8991b32e-6c4b-4c66-a320-e734061f49ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:38:18 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-b95e23be-9c75-48b6-b8e4-55701175523f req-736d2dc2-6783-4fc8-9668-99136d6ce939 service nova] Lock "8991b32e-6c4b-4c66-a320-e734061f49ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:38:18 user nova-compute[73391]: DEBUG nova.compute.manager [req-b95e23be-9c75-48b6-b8e4-55701175523f req-736d2dc2-6783-4fc8-9668-99136d6ce939 service nova] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] No waiting events found dispatching network-vif-plugged-3e0cb01d-a82e-44d3-b8dd-723819ec6ffa {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:38:18 user nova-compute[73391]: WARNING nova.compute.manager [req-b95e23be-9c75-48b6-b8e4-55701175523f req-736d2dc2-6783-4fc8-9668-99136d6ce939 service nova] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Received unexpected event network-vif-plugged-3e0cb01d-a82e-44d3-b8dd-723819ec6ffa for instance with vm_state building and task_state spawning.
Aug 15 05:38:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:38:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:38:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:38:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:38:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:38:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:38:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:38:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:38:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:38:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:38:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:38:19 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:38:19 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:38:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:38:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:38:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:38:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:38:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8186459b-5bcb-4b5a-b6d8-d424909614e5/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:38:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8186459b-5bcb-4b5a-b6d8-d424909614e5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:38:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8186459b-5bcb-4b5a-b6d8-d424909614e5/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:38:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8186459b-5bcb-4b5a-b6d8-d424909614e5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:38:21 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077900.8761923, 8991b32e-6c4b-4c66-a320-e734061f49ee => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:38:21 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] VM Resumed (Lifecycle Event)
Aug 15 05:38:21 user nova-compute[73391]: DEBUG nova.compute.manager [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:38:21 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Guest created on hypervisor {{(pid=73391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 05:38:21 user nova-compute[73391]: DEBUG nova.compute.manager [req-9e78e72a-3f9a-484c-ba0e-af45e2cabbe3 req-d49deb60-5600-4100-af22-73d03aaa1a3b service nova] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Received event network-vif-plugged-3e0cb01d-a82e-44d3-b8dd-723819ec6ffa {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:38:21 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-9e78e72a-3f9a-484c-ba0e-af45e2cabbe3 req-d49deb60-5600-4100-af22-73d03aaa1a3b service nova] Acquiring lock "8991b32e-6c4b-4c66-a320-e734061f49ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:38:21 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-9e78e72a-3f9a-484c-ba0e-af45e2cabbe3 req-d49deb60-5600-4100-af22-73d03aaa1a3b service nova] Lock "8991b32e-6c4b-4c66-a320-e734061f49ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:38:21 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-9e78e72a-3f9a-484c-ba0e-af45e2cabbe3 req-d49deb60-5600-4100-af22-73d03aaa1a3b service nova] Lock "8991b32e-6c4b-4c66-a320-e734061f49ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:38:21 user nova-compute[73391]: DEBUG nova.compute.manager [req-9e78e72a-3f9a-484c-ba0e-af45e2cabbe3 req-d49deb60-5600-4100-af22-73d03aaa1a3b service nova] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] No waiting events found dispatching network-vif-plugged-3e0cb01d-a82e-44d3-b8dd-723819ec6ffa {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:38:21 user nova-compute[73391]: WARNING nova.compute.manager [req-9e78e72a-3f9a-484c-ba0e-af45e2cabbe3 req-d49deb60-5600-4100-af22-73d03aaa1a3b service nova] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Received unexpected event network-vif-plugged-3e0cb01d-a82e-44d3-b8dd-723819ec6ffa for instance with vm_state building and task_state spawning.
Aug 15 05:38:21 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:38:21 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:38:21 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Hypervisor/Node resource view: name=user free_ram=7271MB free_disk=25.307018280029297GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 05:38:21 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:38:21 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:38:21 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:38:21 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Instance spawned successfully.
Aug 15 05:38:21 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 05:38:21 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:38:21 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Found default for hw_cdrom_bus of ide {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:38:21 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Found default for hw_disk_bus of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:38:21 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Found default for hw_input_bus of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:38:21 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Found default for hw_pointer_model of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:38:21 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Found default for hw_video_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:38:21 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Found default for hw_vif_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:38:21 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:38:21 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077900.8802576, 8991b32e-6c4b-4c66-a320-e734061f49ee => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:38:21 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] VM Started (Lifecycle Event)
Aug 15 05:38:21 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:38:21 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:38:21 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:38:21 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 8f08782b-f793-415e-b0d6-5caad1c3d426 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:38:21 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 6ac9d5dc-56be-402f-b9d4-3327bdfd9220 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:38:21 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 6358e825-5705-45d6-86b6-3aacfa5a9bbb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:38:21 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 3f88cd17-c89f-41f3-b630-8eb2c6698155 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:38:21 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 8186459b-5bcb-4b5a-b6d8-d424909614e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:38:21 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance fee43642-30e8-451b-919c-aca4cd4c3f81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:38:21 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance ab02c376-1432-4981-9179-aeef6e647ea4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:38:21 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:38:21 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 730890c6-6999-4a0f-b80c-e4745bff99ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:38:21 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 8ff2da51-5bfd-4cdc-8cef-330cdef93d97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:38:21 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance a1ba38e6-f0fe-408f-b1c8-f9b193531952 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:38:21 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 8991b32e-6c4b-4c66-a320-e734061f49ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:38:21 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 05:38:21 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 05:38:21 user nova-compute[73391]: INFO nova.compute.manager [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Took 7.54 seconds to spawn the instance on the hypervisor.
Aug 15 05:38:21 user nova-compute[73391]: DEBUG nova.compute.manager [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:38:21 user nova-compute[73391]: INFO nova.compute.manager [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Took 8.55 seconds to build instance.
Aug 15 05:38:21 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-9410b990-ef04-4f91-84a6-955eb21f5c5f tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lock "8991b32e-6c4b-4c66-a320-e734061f49ee" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.659s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:38:21 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:38:21 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:38:21 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:38:22 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Compute_service record updated for user:user {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 05:38:22 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.793s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:38:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:38:25 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:38:25 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:38:25 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Starting heal instance info cache {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 05:38:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "refresh_cache-3f88cd17-c89f-41f3-b630-8eb2c6698155" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:38:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquired lock "refresh_cache-3f88cd17-c89f-41f3-b630-8eb2c6698155" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:38:25 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Forcefully refreshing network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 05:38:25 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Updating instance_info_cache with network_info: [{"id": "b00ad802-7ef5-4555-9a1b-7083cdd1c288", "address": "fa:16:3e:62:a5:85", "network": {"id": "85e580e2-7f57-4ac1-87b1-9c805fdcb43f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-949359526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "136ca1d3267b476db6dde10db3f21e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00ad802-7e", "ovs_interfaceid": "b00ad802-7ef5-4555-9a1b-7083cdd1c288", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:38:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Releasing lock "refresh_cache-3f88cd17-c89f-41f3-b630-8eb2c6698155" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:38:25 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Updated the network info_cache for instance {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 05:38:25 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:38:25 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:38:25 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:38:25 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 05:38:26 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:38:29 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:38:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:38:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:38:36 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:38:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:38:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:38:44 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:38:45 user nova-compute[73391]: DEBUG nova.compute.manager [req-f9dd76f2-acb6-4ec6-8f94-e0c5f5f8e4d5 req-861fe1c6-aa8d-45cc-8425-31bb52f49bbf service nova] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Received event network-changed-c1931f1c-7ef8-41c7-82f7-7ace92bb6439 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:38:45 user nova-compute[73391]: DEBUG nova.compute.manager [req-f9dd76f2-acb6-4ec6-8f94-e0c5f5f8e4d5 req-861fe1c6-aa8d-45cc-8425-31bb52f49bbf service nova] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Refreshing instance network info cache due to event network-changed-c1931f1c-7ef8-41c7-82f7-7ace92bb6439. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:38:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f9dd76f2-acb6-4ec6-8f94-e0c5f5f8e4d5 req-861fe1c6-aa8d-45cc-8425-31bb52f49bbf service nova] Acquiring lock "refresh_cache-ab02c376-1432-4981-9179-aeef6e647ea4" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:38:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f9dd76f2-acb6-4ec6-8f94-e0c5f5f8e4d5 req-861fe1c6-aa8d-45cc-8425-31bb52f49bbf service nova] Acquired lock "refresh_cache-ab02c376-1432-4981-9179-aeef6e647ea4" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:38:45 user nova-compute[73391]: DEBUG nova.network.neutron [req-f9dd76f2-acb6-4ec6-8f94-e0c5f5f8e4d5 req-861fe1c6-aa8d-45cc-8425-31bb52f49bbf service nova] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Refreshing network info cache for port c1931f1c-7ef8-41c7-82f7-7ace92bb6439 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:38:46 user nova-compute[73391]: DEBUG nova.network.neutron [req-f9dd76f2-acb6-4ec6-8f94-e0c5f5f8e4d5 req-861fe1c6-aa8d-45cc-8425-31bb52f49bbf service nova] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Updated VIF entry in instance network info cache for port c1931f1c-7ef8-41c7-82f7-7ace92bb6439. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:38:46 user nova-compute[73391]: DEBUG nova.network.neutron [req-f9dd76f2-acb6-4ec6-8f94-e0c5f5f8e4d5 req-861fe1c6-aa8d-45cc-8425-31bb52f49bbf service nova] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Updating instance_info_cache with network_info: [{"id": "c1931f1c-7ef8-41c7-82f7-7ace92bb6439", "address": "fa:16:3e:67:d1:b1", "network": {"id": "f67152a9-4f18-4d7f-9d3e-5e517bd46813", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-731866550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88871d09f7e347a4b9104a558604f2f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1931f1c-7e", "ovs_interfaceid": "c1931f1c-7ef8-41c7-82f7-7ace92bb6439", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:38:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f9dd76f2-acb6-4ec6-8f94-e0c5f5f8e4d5 req-861fe1c6-aa8d-45cc-8425-31bb52f49bbf service nova] Releasing lock "refresh_cache-ab02c376-1432-4981-9179-aeef6e647ea4" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:38:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:38:49 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:38:50 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2ce761c7-4e5c-49f0-bb61-f2db8d50879b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Acquiring lock "ab02c376-1432-4981-9179-aeef6e647ea4" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:38:50 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2ce761c7-4e5c-49f0-bb61-f2db8d50879b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "ab02c376-1432-4981-9179-aeef6e647ea4" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:38:50 user nova-compute[73391]: INFO nova.compute.manager [None req-2ce761c7-4e5c-49f0-bb61-f2db8d50879b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Shelving
Aug 15 05:38:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:38:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:38:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:38:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:38:50 user nova-compute[73391]: DEBUG nova.compute.manager [req-df721a82-4dcf-4093-a7f6-c977ff9960b7 req-63dfdaba-d7d1-4956-9622-0275208554a9 service nova] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Received event network-vif-unplugged-c1931f1c-7ef8-41c7-82f7-7ace92bb6439 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:38:50 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-df721a82-4dcf-4093-a7f6-c977ff9960b7 req-63dfdaba-d7d1-4956-9622-0275208554a9 service nova] Acquiring lock "ab02c376-1432-4981-9179-aeef6e647ea4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:38:50 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-df721a82-4dcf-4093-a7f6-c977ff9960b7 req-63dfdaba-d7d1-4956-9622-0275208554a9 service nova] Lock "ab02c376-1432-4981-9179-aeef6e647ea4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:38:50 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-df721a82-4dcf-4093-a7f6-c977ff9960b7 req-63dfdaba-d7d1-4956-9622-0275208554a9 service nova] Lock "ab02c376-1432-4981-9179-aeef6e647ea4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:38:50 user nova-compute[73391]: DEBUG nova.compute.manager [req-df721a82-4dcf-4093-a7f6-c977ff9960b7 req-63dfdaba-d7d1-4956-9622-0275208554a9 service nova] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] No waiting events found dispatching network-vif-unplugged-c1931f1c-7ef8-41c7-82f7-7ace92bb6439 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:38:50 user nova-compute[73391]: WARNING nova.compute.manager [req-df721a82-4dcf-4093-a7f6-c977ff9960b7 req-63dfdaba-d7d1-4956-9622-0275208554a9 service nova] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Received unexpected event network-vif-unplugged-c1931f1c-7ef8-41c7-82f7-7ace92bb6439 for instance with vm_state active and task_state shelving.
Aug 15 05:38:51 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Instance destroyed successfully.
Aug 15 05:38:51 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-2ce761c7-4e5c-49f0-bb61-f2db8d50879b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Beginning cold snapshot process
Aug 15 05:38:51 user nova-compute[73391]: DEBUG nova.privsep.utils [None req-2ce761c7-4e5c-49f0-bb61-f2db8d50879b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73391) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 05:38:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-2ce761c7-4e5c-49f0-bb61-f2db8d50879b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/ab02c376-1432-4981-9179-aeef6e647ea4/disk /opt/stack/data/nova/instances/snapshots/tmpg0y1o362/de3f16d4688a4c8d9989fbe53293a9c0 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:38:52 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:38:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-2ce761c7-4e5c-49f0-bb61-f2db8d50879b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/ab02c376-1432-4981-9179-aeef6e647ea4/disk /opt/stack/data/nova/instances/snapshots/tmpg0y1o362/de3f16d4688a4c8d9989fbe53293a9c0" returned: 0 in 0.849s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:38:52 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-2ce761c7-4e5c-49f0-bb61-f2db8d50879b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Snapshot extracted, beginning image upload
Aug 15 05:38:52 user nova-compute[73391]: DEBUG nova.compute.manager [req-4facb5c4-58f6-4471-93dd-91287c1d6f95 req-99f82bef-1354-423f-8588-663531a81c43 service nova] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Received event network-vif-plugged-c1931f1c-7ef8-41c7-82f7-7ace92bb6439 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:38:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-4facb5c4-58f6-4471-93dd-91287c1d6f95 req-99f82bef-1354-423f-8588-663531a81c43 service nova] Acquiring lock "ab02c376-1432-4981-9179-aeef6e647ea4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:38:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-4facb5c4-58f6-4471-93dd-91287c1d6f95 req-99f82bef-1354-423f-8588-663531a81c43 service nova] Lock "ab02c376-1432-4981-9179-aeef6e647ea4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:38:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-4facb5c4-58f6-4471-93dd-91287c1d6f95 req-99f82bef-1354-423f-8588-663531a81c43 service nova] Lock "ab02c376-1432-4981-9179-aeef6e647ea4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:38:52 user nova-compute[73391]: DEBUG nova.compute.manager [req-4facb5c4-58f6-4471-93dd-91287c1d6f95 req-99f82bef-1354-423f-8588-663531a81c43 service nova] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] No waiting events found dispatching network-vif-plugged-c1931f1c-7ef8-41c7-82f7-7ace92bb6439 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:38:52 user nova-compute[73391]: WARNING nova.compute.manager [req-4facb5c4-58f6-4471-93dd-91287c1d6f95 req-99f82bef-1354-423f-8588-663531a81c43 service nova] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Received unexpected event network-vif-plugged-c1931f1c-7ef8-41c7-82f7-7ace92bb6439 for instance with vm_state active and task_state shelving_image_uploading.
Aug 15 05:38:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:38:54 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-2ce761c7-4e5c-49f0-bb61-f2db8d50879b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Snapshot image upload complete
Aug 15 05:38:54 user nova-compute[73391]: DEBUG nova.compute.manager [None req-2ce761c7-4e5c-49f0-bb61-f2db8d50879b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:38:54 user nova-compute[73391]: INFO nova.compute.manager [None req-2ce761c7-4e5c-49f0-bb61-f2db8d50879b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Shelve offloading
Aug 15 05:38:54 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Instance destroyed successfully.
Aug 15 05:38:54 user nova-compute[73391]: DEBUG nova.compute.manager [None req-2ce761c7-4e5c-49f0-bb61-f2db8d50879b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:38:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2ce761c7-4e5c-49f0-bb61-f2db8d50879b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Acquiring lock "refresh_cache-ab02c376-1432-4981-9179-aeef6e647ea4" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:38:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2ce761c7-4e5c-49f0-bb61-f2db8d50879b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Acquired lock "refresh_cache-ab02c376-1432-4981-9179-aeef6e647ea4" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:38:54 user nova-compute[73391]: DEBUG nova.network.neutron [None req-2ce761c7-4e5c-49f0-bb61-f2db8d50879b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:38:55 user nova-compute[73391]: DEBUG nova.network.neutron [None req-2ce761c7-4e5c-49f0-bb61-f2db8d50879b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Updating instance_info_cache with network_info: [{"id": "c1931f1c-7ef8-41c7-82f7-7ace92bb6439", "address": "fa:16:3e:67:d1:b1", "network": {"id": "f67152a9-4f18-4d7f-9d3e-5e517bd46813", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-731866550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88871d09f7e347a4b9104a558604f2f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1931f1c-7e", "ovs_interfaceid": "c1931f1c-7ef8-41c7-82f7-7ace92bb6439", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:38:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2ce761c7-4e5c-49f0-bb61-f2db8d50879b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Releasing lock "refresh_cache-ab02c376-1432-4981-9179-aeef6e647ea4" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:38:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:38:55 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Instance destroyed successfully.
Aug 15 05:38:55 user nova-compute[73391]: DEBUG nova.objects.instance [None req-2ce761c7-4e5c-49f0-bb61-f2db8d50879b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lazy-loading 'resources' on Instance uuid ab02c376-1432-4981-9179-aeef6e647ea4 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:38:55 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-2ce761c7-4e5c-49f0-bb61-f2db8d50879b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:36:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-698855278',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-698855278',id=22,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAk8iZa/ytOLHuspv3FTfs6UFC6O0RYBWlGatrlI1q1nEqgwdQunkTmQWSlOgo6yvb0gScc7BBUfbeQPNWDWKld+bhbPO3QCdh+0ZbdeBqDEQ+FzbSaOlaIZahbOfug2ZQ==',key_name='tempest-keypair-1906338828',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:37:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='88871d09f7e347a4b9104a558604f2f6',ramdisk_id='',reservation_id='r-854lfx4v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1774553789',owner_user_name='tempest-AttachVolumeShelveTestJSON-1774553789-project-member',shelved_at='2023-08-15T05:38:54.517352',shelved_host='user',shelved_image_id='1e2f2725-811f-4da5-bf97-18bc774e5360'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:38:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c932032fc884b14b9268d5df91d45ea',uuid=ab02c376-1432-4981-9179-aeef6e647ea4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "c1931f1c-7ef8-41c7-82f7-7ace92bb6439", "address": "fa:16:3e:67:d1:b1", "network": {"id": "f67152a9-4f18-4d7f-9d3e-5e517bd46813", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-731866550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88871d09f7e347a4b9104a558604f2f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1931f1c-7e", "ovs_interfaceid": "c1931f1c-7ef8-41c7-82f7-7ace92bb6439", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:38:55 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-2ce761c7-4e5c-49f0-bb61-f2db8d50879b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Converting VIF {"id": "c1931f1c-7ef8-41c7-82f7-7ace92bb6439", "address": "fa:16:3e:67:d1:b1", "network": {"id": "f67152a9-4f18-4d7f-9d3e-5e517bd46813", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-731866550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88871d09f7e347a4b9104a558604f2f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1931f1c-7e", "ovs_interfaceid": "c1931f1c-7ef8-41c7-82f7-7ace92bb6439", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:38:55 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-2ce761c7-4e5c-49f0-bb61-f2db8d50879b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:d1:b1,bridge_name='br-int',has_traffic_filtering=True,id=c1931f1c-7ef8-41c7-82f7-7ace92bb6439,network=Network(f67152a9-4f18-4d7f-9d3e-5e517bd46813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1931f1c-7e') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:38:55 user nova-compute[73391]: DEBUG os_vif [None req-2ce761c7-4e5c-49f0-bb61-f2db8d50879b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:d1:b1,bridge_name='br-int',has_traffic_filtering=True,id=c1931f1c-7ef8-41c7-82f7-7ace92bb6439,network=Network(f67152a9-4f18-4d7f-9d3e-5e517bd46813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1931f1c-7e') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:38:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:38:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc1931f1c-7e, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:38:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:38:55 user nova-compute[73391]: DEBUG nova.compute.manager [req-11cc1864-2cdf-4469-a675-3fb72df83c69 req-92a9db84-3161-4477-b30a-3c5afa5ece97 service nova] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Received event network-changed-c1931f1c-7ef8-41c7-82f7-7ace92bb6439 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:38:55 user nova-compute[73391]: DEBUG nova.compute.manager [req-11cc1864-2cdf-4469-a675-3fb72df83c69 req-92a9db84-3161-4477-b30a-3c5afa5ece97 service nova] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Refreshing instance network info cache due to event network-changed-c1931f1c-7ef8-41c7-82f7-7ace92bb6439. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:38:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-11cc1864-2cdf-4469-a675-3fb72df83c69 req-92a9db84-3161-4477-b30a-3c5afa5ece97 service nova] Acquiring lock "refresh_cache-ab02c376-1432-4981-9179-aeef6e647ea4" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:38:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-11cc1864-2cdf-4469-a675-3fb72df83c69 req-92a9db84-3161-4477-b30a-3c5afa5ece97 service nova] Acquired lock "refresh_cache-ab02c376-1432-4981-9179-aeef6e647ea4" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:38:55 user nova-compute[73391]: DEBUG nova.network.neutron [req-11cc1864-2cdf-4469-a675-3fb72df83c69 req-92a9db84-3161-4477-b30a-3c5afa5ece97 service nova] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Refreshing network info cache for port c1931f1c-7ef8-41c7-82f7-7ace92bb6439 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:38:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:38:55 user nova-compute[73391]: INFO os_vif [None req-2ce761c7-4e5c-49f0-bb61-f2db8d50879b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:d1:b1,bridge_name='br-int',has_traffic_filtering=True,id=c1931f1c-7ef8-41c7-82f7-7ace92bb6439,network=Network(f67152a9-4f18-4d7f-9d3e-5e517bd46813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1931f1c-7e')
Aug 15 05:38:55 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-2ce761c7-4e5c-49f0-bb61-f2db8d50879b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Deleting instance files /opt/stack/data/nova/instances/ab02c376-1432-4981-9179-aeef6e647ea4_del
Aug 15 05:38:55 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-2ce761c7-4e5c-49f0-bb61-f2db8d50879b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Deletion of /opt/stack/data/nova/instances/ab02c376-1432-4981-9179-aeef6e647ea4_del complete
Aug 15 05:38:55 user nova-compute[73391]: INFO nova.scheduler.client.report [None req-2ce761c7-4e5c-49f0-bb61-f2db8d50879b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Deleted allocations for instance ab02c376-1432-4981-9179-aeef6e647ea4
Aug 15 05:38:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2ce761c7-4e5c-49f0-bb61-f2db8d50879b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:38:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2ce761c7-4e5c-49f0-bb61-f2db8d50879b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:38:56 user nova-compute[73391]: DEBUG nova.objects.instance [None req-2ce761c7-4e5c-49f0-bb61-f2db8d50879b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lazy-loading 'numa_topology' on Instance uuid ab02c376-1432-4981-9179-aeef6e647ea4 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:38:56 user nova-compute[73391]: DEBUG nova.network.neutron [req-11cc1864-2cdf-4469-a675-3fb72df83c69 req-92a9db84-3161-4477-b30a-3c5afa5ece97 service nova] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Updated VIF entry in instance network info cache for port c1931f1c-7ef8-41c7-82f7-7ace92bb6439. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:38:56 user nova-compute[73391]: DEBUG nova.network.neutron [req-11cc1864-2cdf-4469-a675-3fb72df83c69 req-92a9db84-3161-4477-b30a-3c5afa5ece97 service nova] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Updating instance_info_cache with network_info: [{"id": "c1931f1c-7ef8-41c7-82f7-7ace92bb6439", "address": "fa:16:3e:67:d1:b1", "network": {"id": "f67152a9-4f18-4d7f-9d3e-5e517bd46813", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-731866550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88871d09f7e347a4b9104a558604f2f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapc1931f1c-7e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:38:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-11cc1864-2cdf-4469-a675-3fb72df83c69 req-92a9db84-3161-4477-b30a-3c5afa5ece97 service nova] Releasing lock "refresh_cache-ab02c376-1432-4981-9179-aeef6e647ea4" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:38:56 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-2ce761c7-4e5c-49f0-bb61-f2db8d50879b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:38:56 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-2ce761c7-4e5c-49f0-bb61-f2db8d50879b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:38:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2ce761c7-4e5c-49f0-bb61-f2db8d50879b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.475s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:38:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2ce761c7-4e5c-49f0-bb61-f2db8d50879b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "ab02c376-1432-4981-9179-aeef6e647ea4" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.351s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:39:00 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:39:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:39:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-62691b33-7e08-4ddd-a394-1dc3f1232633 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquiring lock "8186459b-5bcb-4b5a-b6d8-d424909614e5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:39:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-62691b33-7e08-4ddd-a394-1dc3f1232633 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "8186459b-5bcb-4b5a-b6d8-d424909614e5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:39:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-62691b33-7e08-4ddd-a394-1dc3f1232633 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquiring lock "8186459b-5bcb-4b5a-b6d8-d424909614e5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:39:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-62691b33-7e08-4ddd-a394-1dc3f1232633 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "8186459b-5bcb-4b5a-b6d8-d424909614e5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:39:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-62691b33-7e08-4ddd-a394-1dc3f1232633 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "8186459b-5bcb-4b5a-b6d8-d424909614e5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:39:04 user nova-compute[73391]: INFO nova.compute.manager [None req-62691b33-7e08-4ddd-a394-1dc3f1232633 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Terminating instance
Aug 15 05:39:04 user nova-compute[73391]: DEBUG nova.compute.manager [None req-62691b33-7e08-4ddd-a394-1dc3f1232633 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Start destroying the instance on the hypervisor. {{(pid=73391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 05:39:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:39:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:39:04 user nova-compute[73391]: DEBUG nova.compute.manager [req-c132f129-37df-4d83-b7f6-66dd93c6fa79 req-3fb60bfc-939f-48cf-8395-913ca4163341 service nova] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Received event network-vif-unplugged-de932b15-d8c8-4714-80c0-c9eedeb26588 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:39:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-c132f129-37df-4d83-b7f6-66dd93c6fa79 req-3fb60bfc-939f-48cf-8395-913ca4163341 service nova] Acquiring lock "8186459b-5bcb-4b5a-b6d8-d424909614e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:39:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-c132f129-37df-4d83-b7f6-66dd93c6fa79 req-3fb60bfc-939f-48cf-8395-913ca4163341 service nova] Lock "8186459b-5bcb-4b5a-b6d8-d424909614e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:39:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-c132f129-37df-4d83-b7f6-66dd93c6fa79 req-3fb60bfc-939f-48cf-8395-913ca4163341 service nova] Lock "8186459b-5bcb-4b5a-b6d8-d424909614e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:39:04 user nova-compute[73391]: DEBUG nova.compute.manager [req-c132f129-37df-4d83-b7f6-66dd93c6fa79 req-3fb60bfc-939f-48cf-8395-913ca4163341 service nova] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] No waiting events found dispatching network-vif-unplugged-de932b15-d8c8-4714-80c0-c9eedeb26588 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:39:04 user nova-compute[73391]: DEBUG nova.compute.manager [req-c132f129-37df-4d83-b7f6-66dd93c6fa79 req-3fb60bfc-939f-48cf-8395-913ca4163341 service nova] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Received event network-vif-unplugged-de932b15-d8c8-4714-80c0-c9eedeb26588 for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 05:39:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:39:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:39:05 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Instance destroyed successfully.
Aug 15 05:39:05 user nova-compute[73391]: DEBUG nova.objects.instance [None req-62691b33-7e08-4ddd-a394-1dc3f1232633 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lazy-loading 'resources' on Instance uuid 8186459b-5bcb-4b5a-b6d8-d424909614e5 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:39:05 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-62691b33-7e08-4ddd-a394-1dc3f1232633 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T05:33:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-812806078',display_name='tempest-ServerActionsTestOtherA-server-1346081936',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-812806078',id=16,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKQF8c52xIn/tpah2OQeeTlaAc50/7SkZ/oBXCnKk+8uX+Qv1Jri1CC3w4ewMsF9mvYSfBkgG+AekpaXFdh8jEXOjDMtbaHzPVlN2+XlP9ua4WN7/3eKAFOiv304VYf4sQ==',key_name='tempest-keypair-393045208',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:35:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60b01853a82243369bd71dc0dbedb5d6',ramdisk_id='',reservation_id='r-u8d1c087',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1927429987',owner_user_name='tempest-ServerActionsTestOtherA-1927429987-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:35:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='124dcfde552147e2978970386274c70a',uuid=8186459b-5bcb-4b5a-b6d8-d424909614e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "de932b15-d8c8-4714-80c0-c9eedeb26588", "address": "fa:16:3e:17:55:32", "network": {"id": "610f78de-5741-4743-815d-d12ba05f8000", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1518164868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b01853a82243369bd71dc0dbedb5d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde932b15-d8", "ovs_interfaceid": "de932b15-d8c8-4714-80c0-c9eedeb26588", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:39:05 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-62691b33-7e08-4ddd-a394-1dc3f1232633 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Converting VIF {"id": "de932b15-d8c8-4714-80c0-c9eedeb26588", "address": "fa:16:3e:17:55:32", "network": {"id": "610f78de-5741-4743-815d-d12ba05f8000", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1518164868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.230", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b01853a82243369bd71dc0dbedb5d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapde932b15-d8", "ovs_interfaceid": "de932b15-d8c8-4714-80c0-c9eedeb26588", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:39:05 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-62691b33-7e08-4ddd-a394-1dc3f1232633 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:17:55:32,bridge_name='br-int',has_traffic_filtering=True,id=de932b15-d8c8-4714-80c0-c9eedeb26588,network=Network(610f78de-5741-4743-815d-d12ba05f8000),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde932b15-d8') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:39:05 user nova-compute[73391]: DEBUG os_vif [None req-62691b33-7e08-4ddd-a394-1dc3f1232633 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:55:32,bridge_name='br-int',has_traffic_filtering=True,id=de932b15-d8c8-4714-80c0-c9eedeb26588,network=Network(610f78de-5741-4743-815d-d12ba05f8000),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde932b15-d8') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:39:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:39:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapde932b15-d8, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:39:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:39:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-a0b3e92c-e22a-4927-9a79-1cc2ad62e32c tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Acquiring lock "3f88cd17-c89f-41f3-b630-8eb2c6698155" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:39:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-a0b3e92c-e22a-4927-9a79-1cc2ad62e32c tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "3f88cd17-c89f-41f3-b630-8eb2c6698155" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:39:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:39:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:39:05 user nova-compute[73391]: INFO os_vif [None req-62691b33-7e08-4ddd-a394-1dc3f1232633 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:17:55:32,bridge_name='br-int',has_traffic_filtering=True,id=de932b15-d8c8-4714-80c0-c9eedeb26588,network=Network(610f78de-5741-4743-815d-d12ba05f8000),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapde932b15-d8')
Aug 15 05:39:05 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-62691b33-7e08-4ddd-a394-1dc3f1232633 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Deleting instance files /opt/stack/data/nova/instances/8186459b-5bcb-4b5a-b6d8-d424909614e5_del
Aug 15 05:39:05 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-62691b33-7e08-4ddd-a394-1dc3f1232633 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Deletion of /opt/stack/data/nova/instances/8186459b-5bcb-4b5a-b6d8-d424909614e5_del complete
Aug 15 05:39:05 user nova-compute[73391]: DEBUG nova.objects.instance [None req-a0b3e92c-e22a-4927-9a79-1cc2ad62e32c tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lazy-loading 'flavor' on Instance uuid 3f88cd17-c89f-41f3-b630-8eb2c6698155 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:39:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-a0b3e92c-e22a-4927-9a79-1cc2ad62e32c tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "3f88cd17-c89f-41f3-b630-8eb2c6698155" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:39:05 user nova-compute[73391]: INFO nova.compute.manager [None req-62691b33-7e08-4ddd-a394-1dc3f1232633 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 15 05:39:05 user nova-compute[73391]: DEBUG oslo.service.loopingcall [None req-62691b33-7e08-4ddd-a394-1dc3f1232633 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 05:39:05 user nova-compute[73391]: DEBUG nova.compute.manager [-] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Deallocating network for instance {{(pid=73391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 05:39:05 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] deallocate_for_instance() {{(pid=73391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 05:39:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-a0b3e92c-e22a-4927-9a79-1cc2ad62e32c tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Acquiring lock "3f88cd17-c89f-41f3-b630-8eb2c6698155" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:39:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-a0b3e92c-e22a-4927-9a79-1cc2ad62e32c tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "3f88cd17-c89f-41f3-b630-8eb2c6698155" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:39:05 user nova-compute[73391]: INFO nova.compute.manager [None req-a0b3e92c-e22a-4927-9a79-1cc2ad62e32c tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Attaching volume 0615210a-52d2-44a1-bf43-af4cfd402a24 to /dev/vdb
Aug 15 05:39:05 user nova-compute[73391]: DEBUG os_brick.utils [None req-a0b3e92c-e22a-4927-9a79-1cc2ad62e32c tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:39:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:05 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ff957b7-9f1f-4cd2-bd03-724bd27d6c84]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:05 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9a8c4a-25e6-4f53-820f-f4e2b9706430]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:05 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[18018b3a-6049-443e-8a16-d41ecfa6b33a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:05 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[493349e0-b84d-436b-a9aa-c57d91d5977c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-a0b3e92c-e22a-4927-9a79-1cc2ad62e32c tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-a0b3e92c-e22a-4927-9a79-1cc2ad62e32c tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:39:05 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a0b3e92c-e22a-4927-9a79-1cc2ad62e32c tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 05:39:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:39:05 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 05:39:05 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd6d6dc-13b2-44db-920f-7862f2ca09fe]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:05 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-a0b3e92c-e22a-4927-9a79-1cc2ad62e32c tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 05:39:05 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-a0b3e92c-e22a-4927-9a79-1cc2ad62e32c tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 05:39:05 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-a0b3e92c-e22a-4927-9a79-1cc2ad62e32c tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 05:39:05 user nova-compute[73391]: DEBUG os_brick.utils [None req-a0b3e92c-e22a-4927-9a79-1cc2ad62e32c tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:39:05 user nova-compute[73391]: DEBUG nova.virt.block_device [None req-a0b3e92c-e22a-4927-9a79-1cc2ad62e32c tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Updating existing volume attachment record: bc0aab4d-504a-45dd-aa8d-c7458e328298 {{(pid=73391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 05:39:06 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692077931.045407, ab02c376-1432-4981-9179-aeef6e647ea4 => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:39:06 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] VM Stopped (Lifecycle Event)
Aug 15 05:39:06 user nova-compute[73391]: DEBUG nova.compute.manager [None req-6301cd5b-79fa-401b-bccd-53dbfe40c5ab None None] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:39:06 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:39:06 user nova-compute[73391]: DEBUG nova.compute.manager [req-b77c2584-1757-4b46-9260-15bf0cacd690 req-9dcec05d-f09f-4d44-b62a-4d59227f8d9a service nova] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Received event network-vif-plugged-de932b15-d8c8-4714-80c0-c9eedeb26588 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:39:06 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-b77c2584-1757-4b46-9260-15bf0cacd690 req-9dcec05d-f09f-4d44-b62a-4d59227f8d9a service nova] Acquiring lock "8186459b-5bcb-4b5a-b6d8-d424909614e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:39:06 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-b77c2584-1757-4b46-9260-15bf0cacd690 req-9dcec05d-f09f-4d44-b62a-4d59227f8d9a service nova] Lock "8186459b-5bcb-4b5a-b6d8-d424909614e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:39:06 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-b77c2584-1757-4b46-9260-15bf0cacd690 req-9dcec05d-f09f-4d44-b62a-4d59227f8d9a service nova] Lock "8186459b-5bcb-4b5a-b6d8-d424909614e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:39:06 user nova-compute[73391]: DEBUG nova.compute.manager [req-b77c2584-1757-4b46-9260-15bf0cacd690 req-9dcec05d-f09f-4d44-b62a-4d59227f8d9a service nova] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] No waiting events found dispatching network-vif-plugged-de932b15-d8c8-4714-80c0-c9eedeb26588 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:39:06 user nova-compute[73391]: WARNING nova.compute.manager [req-b77c2584-1757-4b46-9260-15bf0cacd690 req-9dcec05d-f09f-4d44-b62a-4d59227f8d9a service nova] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Received unexpected event network-vif-plugged-de932b15-d8c8-4714-80c0-c9eedeb26588 for instance with vm_state active and task_state deleting.
Aug 15 05:39:06 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:39:06 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Took 1.46 seconds to deallocate network for instance.
Aug 15 05:39:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-62691b33-7e08-4ddd-a394-1dc3f1232633 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:39:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-62691b33-7e08-4ddd-a394-1dc3f1232633 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:39:07 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-62691b33-7e08-4ddd-a394-1dc3f1232633 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:39:07 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-62691b33-7e08-4ddd-a394-1dc3f1232633 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:39:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-62691b33-7e08-4ddd-a394-1dc3f1232633 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.447s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:39:07 user nova-compute[73391]: INFO nova.scheduler.client.report [None req-62691b33-7e08-4ddd-a394-1dc3f1232633 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Deleted allocations for instance 8186459b-5bcb-4b5a-b6d8-d424909614e5
Aug 15 05:39:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-62691b33-7e08-4ddd-a394-1dc3f1232633 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "8186459b-5bcb-4b5a-b6d8-d424909614e5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.058s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:39:09 user nova-compute[73391]: DEBUG nova.compute.manager [req-8c4b8cf2-67b6-44b8-ba26-b39a3243a724 req-fee57381-6ba2-4cd7-87d1-683e86a02064 service nova] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Received event network-vif-deleted-de932b15-d8c8-4714-80c0-c9eedeb26588 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:39:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:39:10 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:39:10 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:39:12 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:39:12 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:39:14 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:39:15 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:39:15 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0b3e92c-e22a-4927-9a79-1cc2ad62e32c tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 05:39:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0b3e92c-e22a-4927-9a79-1cc2ad62e32c tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0615210a-52d2-44a1-bf43-af4cfd402a24'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'opbkAXRH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:39:15 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-a0b3e92c-e22a-4927-9a79-1cc2ad62e32c tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:39:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-a0b3e92c-e22a-4927-9a79-1cc2ad62e32c tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:39:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-a0b3e92c-e22a-4927-9a79-1cc2ad62e32c tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:39:15 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-a0b3e92c-e22a-4927-9a79-1cc2ad62e32c tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:39:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-a0b3e92c-e22a-4927-9a79-1cc2ad62e32c tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0615210a-52d2-44a1-bf43-af4cfd402a24" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:39:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-a0b3e92c-e22a-4927-9a79-1cc2ad62e32c tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0615210a-52d2-44a1-bf43-af4cfd402a24" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:39:15 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-a0b3e92c-e22a-4927-9a79-1cc2ad62e32c tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 05:39:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0615210a-52d2-44a1-bf43-af4cfd402a24 -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0615210a-52d2-44a1-bf43-af4cfd402a24 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:15 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8c2a78-7b2b-4369-979f-20e523921f67]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0b3e92c-e22a-4927-9a79-1cc2ad62e32c tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 05:39:15 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:39:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0615210a-52d2-44a1-bf43-af4cfd402a24 -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0615210a-52d2-44a1-bf43-af4cfd402a24 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:15 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4401ee2a-c7dc-4416-8ffd-9120aa1dcd21]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0615210a-52d2-44a1-bf43-af4cfd402a24] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0b3e92c-e22a-4927-9a79-1cc2ad62e32c tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0615210a-52d2-44a1-bf43-af4cfd402a24] added
Aug 15 05:39:15 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:39:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0615210a-52d2-44a1-bf43-af4cfd402a24 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0615210a-52d2-44a1-bf43-af4cfd402a24 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:15 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[14762a15-1085-433d-8e5c-2a526e99f742]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0b3e92c-e22a-4927-9a79-1cc2ad62e32c tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:39:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0615210a-52d2-44a1-bf43-af4cfd402a24 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0615210a-52d2-44a1-bf43-af4cfd402a24 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:15 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[380f8c99-1fe0-4c63-bd10-d828725e6c37]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0b3e92c-e22a-4927-9a79-1cc2ad62e32c tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:39:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0615210a-52d2-44a1-bf43-af4cfd402a24 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v opbkAXRH {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0615210a-52d2-44a1-bf43-af4cfd402a24 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v opbkAXRH" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:15 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32949c8-f028-4eec-8524-a4f004236946]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0b3e92c-e22a-4927-9a79-1cc2ad62e32c tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'opbkAXRH'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:39:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0615210a-52d2-44a1-bf43-af4cfd402a24 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0615210a-52d2-44a1-bf43-af4cfd402a24 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:15 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab4c53d-bb41-4ff6-a91f-6b30cd261903]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0b3e92c-e22a-4927-9a79-1cc2ad62e32c tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:39:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:15 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[925b488f-b68e-4aef-93b5-5e4fcb5476d7]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0b3e92c-e22a-4927-9a79-1cc2ad62e32c tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:39:15 user nova-compute[73391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)
Aug 15 05:39:15 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:39:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0b3e92c-e22a-4927-9a79-1cc2ad62e32c tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:39:15 user nova-compute[73391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)
Aug 15 05:39:15 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:39:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0615210a-52d2-44a1-bf43-af4cfd402a24 -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0615210a-52d2-44a1-bf43-af4cfd402a24 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:15 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4de81e7-9e2c-4f88-87f4-f94e1ec21c1a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0615210a-52d2-44a1-bf43-af4cfd402a24, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0615210a-52d2-44a1-bf43-af4cfd402a24, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0b3e92c-e22a-4927-9a79-1cc2ad62e32c tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0615210a-52d2-44a1-bf43-af4cfd402a24, portal: 172.16.0.220,3260]
Aug 15 05:39:15 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:0615210a-52d2-44a1-bf43-af4cfd402a24, portal: 172.16.0.220,3260] successful.
Aug 15 05:39:15 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:39:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0615210a-52d2-44a1-bf43-af4cfd402a24 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0615210a-52d2-44a1-bf43-af4cfd402a24 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:15 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8745582f-e1d5-4b81-91a9-96212141bba1]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0b3e92c-e22a-4927-9a79-1cc2ad62e32c tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:39:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:15 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce42108-939e-4a07-a136-c03132e9a557]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0615210a-52d2-44a1-bf43-af4cfd402a24 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0b3e92c-e22a-4927-9a79-1cc2ad62e32c tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:39:15 user nova-compute[73391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)
Aug 15 05:39:15 user nova-compute[73391]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0615210a-52d2-44a1-bf43-af4cfd402a24 (non-flash)
Aug 15 05:39:15 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:39:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0b3e92c-e22a-4927-9a79-1cc2ad62e32c tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:39:15 user nova-compute[73391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)
Aug 15 05:39:15 user nova-compute[73391]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0615210a-52d2-44a1-bf43-af4cfd402a24 (non-flash)
Aug 15 05:39:15 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:39:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-a0b3e92c-e22a-4927-9a79-1cc2ad62e32c tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0615210a-52d2-44a1-bf43-af4cfd402a24" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:39:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0b3e92c-e22a-4927-9a79-1cc2ad62e32c tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 05:39:15 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-a0b3e92c-e22a-4927-9a79-1cc2ad62e32c tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 05:39:15 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-a0b3e92c-e22a-4927-9a79-1cc2ad62e32c tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 05:39:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:16 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[29819312-cebd-4c33-9708-811cd100a54f]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:16 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-a0b3e92c-e22a-4927-9a79-1cc2ad62e32c tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:39:16 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0b3e92c-e22a-4927-9a79-1cc2ad62e32c tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'opbkAXRH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 05:39:16 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:39:16 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:39:16 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:39:16 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:39:16 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Auditing locally available compute resources for user (node: user) {{(pid=73391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 05:39:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f88cd17-c89f-41f3-b630-8eb2c6698155/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:17 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-a0b3e92c-e22a-4927-9a79-1cc2ad62e32c tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:39:17 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0b3e92c-e22a-4927-9a79-1cc2ad62e32c tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23363313635323537', 'path': '/dev/sdb'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:39:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0b3e92c-e22a-4927-9a79-1cc2ad62e32c tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363313635323537', 'path': '/dev/sdb'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 05:39:17 user nova-compute[73391]: DEBUG nova.objects.instance [None req-a0b3e92c-e22a-4927-9a79-1cc2ad62e32c tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lazy-loading 'flavor' on Instance uuid 3f88cd17-c89f-41f3-b630-8eb2c6698155 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:39:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-a0b3e92c-e22a-4927-9a79-1cc2ad62e32c tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 05:39:17 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:39:17 user nova-compute[73391]:   <source dev="/dev/sdb"/>
Aug 15 05:39:17 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:39:17 user nova-compute[73391]:   <serial>0615210a-52d2-44a1-bf43-af4cfd402a24</serial>
Aug 15 05:39:17 user nova-compute[73391]: </disk>
Aug 15 05:39:17 user nova-compute[73391]:  {{(pid=73391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 05:39:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f88cd17-c89f-41f3-b630-8eb2c6698155/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f88cd17-c89f-41f3-b630-8eb2c6698155/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f88cd17-c89f-41f3-b630-8eb2c6698155/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-a0b3e92c-e22a-4927-9a79-1cc2ad62e32c tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:39:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-a0b3e92c-e22a-4927-9a79-1cc2ad62e32c tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:39:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-a0b3e92c-e22a-4927-9a79-1cc2ad62e32c tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] No VIF found with MAC fa:16:3e:62:a5:85, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:39:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-a0b3e92c-e22a-4927-9a79-1cc2ad62e32c tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "3f88cd17-c89f-41f3-b630-8eb2c6698155" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.022s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:39:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ba38e6-f0fe-408f-b1c8-f9b193531952/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ba38e6-f0fe-408f-b1c8-f9b193531952/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ba38e6-f0fe-408f-b1c8-f9b193531952/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ba38e6-f0fe-408f-b1c8-f9b193531952/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:39:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:19 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:39:19 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:39:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:39:20 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692077945.4070802, 8186459b-5bcb-4b5a-b6d8-d424909614e5 => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:39:20 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] VM Stopped (Lifecycle Event)
Aug 15 05:39:20 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:39:20 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:39:20 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Hypervisor/Node resource view: name=user free_ram=7399MB free_disk=25.190162658691406GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 05:39:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:39:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:39:20 user nova-compute[73391]: DEBUG nova.compute.manager [None req-b78c0662-b34a-476f-9e7a-8a73dad05df9 None None] [instance: 8186459b-5bcb-4b5a-b6d8-d424909614e5] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:39:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-602863f3-21c8-465e-831b-e049d857ba64 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Acquiring lock "3f88cd17-c89f-41f3-b630-8eb2c6698155" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:39:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-602863f3-21c8-465e-831b-e049d857ba64 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "3f88cd17-c89f-41f3-b630-8eb2c6698155" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:39:20 user nova-compute[73391]: INFO nova.compute.manager [None req-602863f3-21c8-465e-831b-e049d857ba64 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Detaching volume 0615210a-52d2-44a1-bf43-af4cfd402a24
Aug 15 05:39:20 user nova-compute[73391]: INFO nova.virt.block_device [None req-602863f3-21c8-465e-831b-e049d857ba64 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Attempting to driver detach volume 0615210a-52d2-44a1-bf43-af4cfd402a24 from mountpoint /dev/vdb
Aug 15 05:39:20 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-602863f3-21c8-465e-831b-e049d857ba64 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Attempting to detach device vdb from instance 3f88cd17-c89f-41f3-b630-8eb2c6698155 from the persistent domain config. {{(pid=73391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 05:39:20 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-602863f3-21c8-465e-831b-e049d857ba64 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 05:39:20 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:39:20 user nova-compute[73391]:   <source dev="/dev/sdb"/>
Aug 15 05:39:20 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:39:20 user nova-compute[73391]:   <serial>0615210a-52d2-44a1-bf43-af4cfd402a24</serial>
Aug 15 05:39:20 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 05:39:20 user nova-compute[73391]: </disk>
Aug 15 05:39:20 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 05:39:20 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-602863f3-21c8-465e-831b-e049d857ba64 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Successfully detached device vdb from instance 3f88cd17-c89f-41f3-b630-8eb2c6698155 from the persistent domain config.
Aug 15 05:39:20 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-602863f3-21c8-465e-831b-e049d857ba64 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3f88cd17-c89f-41f3-b630-8eb2c6698155 from the live domain config. {{(pid=73391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 05:39:20 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-602863f3-21c8-465e-831b-e049d857ba64 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 05:39:20 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:39:20 user nova-compute[73391]:   <source dev="/dev/sdb"/>
Aug 15 05:39:20 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:39:20 user nova-compute[73391]:   <serial>0615210a-52d2-44a1-bf43-af4cfd402a24</serial>
Aug 15 05:39:20 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 05:39:20 user nova-compute[73391]: </disk>
Aug 15 05:39:20 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 05:39:20 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 8f08782b-f793-415e-b0d6-5caad1c3d426 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:39:20 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 6ac9d5dc-56be-402f-b9d4-3327bdfd9220 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:39:20 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 6358e825-5705-45d6-86b6-3aacfa5a9bbb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:39:20 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 3f88cd17-c89f-41f3-b630-8eb2c6698155 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:39:20 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance fee43642-30e8-451b-919c-aca4cd4c3f81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:39:20 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:39:20 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 730890c6-6999-4a0f-b80c-e4745bff99ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:39:20 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 8ff2da51-5bfd-4cdc-8cef-330cdef93d97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:39:20 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance a1ba38e6-f0fe-408f-b1c8-f9b193531952 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:39:20 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 8991b32e-6c4b-4c66-a320-e734061f49ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:39:20 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 05:39:20 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 05:39:21 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:39:21 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:39:21 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Compute_service record updated for user:user {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 05:39:21 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.491s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:39:21 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Received event <DeviceRemovedEvent: 1692077961.419019, 3f88cd17-c89f-41f3-b630-8eb2c6698155 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73391) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 05:39:21 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-602863f3-21c8-465e-831b-e049d857ba64 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3f88cd17-c89f-41f3-b630-8eb2c6698155 {{(pid=73391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 05:39:21 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-602863f3-21c8-465e-831b-e049d857ba64 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Successfully detached device vdb from instance 3f88cd17-c89f-41f3-b630-8eb2c6698155 from the live domain config.
Aug 15 05:39:21 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-602863f3-21c8-465e-831b-e049d857ba64 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 05:39:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-602863f3-21c8-465e-831b-e049d857ba64 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:0615210a-52d2-44a1-bf43-af4cfd402a24'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'opbkAXRH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:39:21 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-602863f3-21c8-465e-831b-e049d857ba64 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:39:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-602863f3-21c8-465e-831b-e049d857ba64 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:39:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-602863f3-21c8-465e-831b-e049d857ba64 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:39:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-602863f3-21c8-465e-831b-e049d857ba64 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0615210a-52d2-44a1-bf43-af4cfd402a24', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 05:39:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:21 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[44831fb1-1f6f-494d-b28c-15e33e751e36]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0615210a-52d2-44a1-bf43-af4cfd402a24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:21 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a0876d4-4aae-461f-8f44-303b1483a93c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0615210a-52d2-44a1-bf43-af4cfd402a24 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-602863f3-21c8-465e-831b-e049d857ba64 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:39:21 user nova-compute[73391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)
Aug 15 05:39:21 user nova-compute[73391]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0615210a-52d2-44a1-bf43-af4cfd402a24 (non-flash)
Aug 15 05:39:21 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:39:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-602863f3-21c8-465e-831b-e049d857ba64 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:39:21 user nova-compute[73391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)
Aug 15 05:39:21 user nova-compute[73391]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0615210a-52d2-44a1-bf43-af4cfd402a24 (non-flash)
Aug 15 05:39:21 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:39:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-602863f3-21c8-465e-831b-e049d857ba64 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7757fd1f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0615210a-52d2-44a1-bf43-af4cfd402a24'): ({'sdb'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 05:39:21 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-602863f3-21c8-465e-831b-e049d857ba64 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Removing single pathed devices sdb {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 05:39:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:21 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[28982d65-096d-4124-9764-72e076adbc51]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:21 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[62189829-94b6-44b0-96b3-bb7b0e201c3e]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:21 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-602863f3-21c8-465e-831b-e049d857ba64 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Flushing IO for device /dev/sdb {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 05:39:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:21 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2f64ce-c305-4fc5-b8b2-8e0c0846d29f]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:21 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-602863f3-21c8-465e-831b-e049d857ba64 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 05:39:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:21 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f937d3-5eed-4f01-9be4-a059fe09db8b]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:21 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-602863f3-21c8-465e-831b-e049d857ba64 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 05:39:21 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-602863f3-21c8-465e-831b-e049d857ba64 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] SCSI volumes sdb have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 05:39:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-602863f3-21c8-465e-831b-e049d857ba64 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0615210a-52d2-44a1-bf43-af4cfd402a24')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 05:39:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0615210a-52d2-44a1-bf43-af4cfd402a24 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0615210a-52d2-44a1-bf43-af4cfd402a24 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:21 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f86befdb-0b36-4ed2-9218-ca1c8f52a9eb]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-602863f3-21c8-465e-831b-e049d857ba64 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:39:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0615210a-52d2-44a1-bf43-af4cfd402a24 -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0615210a-52d2-44a1-bf43-af4cfd402a24 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:21 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c150267-d7e3-42ae-8929-3516840cf943]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:0615210a-52d2-44a1-bf43-af4cfd402a24, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:0615210a-52d2-44a1-bf43-af4cfd402a24, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-602863f3-21c8-465e-831b-e049d857ba64 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:0615210a-52d2-44a1-bf43-af4cfd402a24, portal: 172.16.0.220,3260]
Aug 15 05:39:21 user nova-compute[73391]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:0615210a-52d2-44a1-bf43-af4cfd402a24, portal: 172.16.0.220,3260] successful.
Aug 15 05:39:21 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:39:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0615210a-52d2-44a1-bf43-af4cfd402a24 -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0615210a-52d2-44a1-bf43-af4cfd402a24 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:21 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9eb81b1-92f1-4244-bffa-0e478abc47c0]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-602863f3-21c8-465e-831b-e049d857ba64 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:39:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-602863f3-21c8-465e-831b-e049d857ba64 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:39:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-602863f3-21c8-465e-831b-e049d857ba64 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] <== disconnect_volume: return (299ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:39:21 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-602863f3-21c8-465e-831b-e049d857ba64 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 05:39:23 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:39:23 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:39:23 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:39:23 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Starting heal instance info cache {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 05:39:23 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Didn't find any instances for network info cache update. {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 05:39:23 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:39:23 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:39:23 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:39:23 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 05:39:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:39:25 user nova-compute[73391]: DEBUG nova.objects.instance [None req-602863f3-21c8-465e-831b-e049d857ba64 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lazy-loading 'flavor' on Instance uuid 3f88cd17-c89f-41f3-b630-8eb2c6698155 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:39:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-602863f3-21c8-465e-831b-e049d857ba64 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "3f88cd17-c89f-41f3-b630-8eb2c6698155" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.402s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:39:25 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:39:30 user nova-compute[73391]: DEBUG nova.objects.instance [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lazy-loading 'flavor' on Instance uuid fee43642-30e8-451b-919c-aca4cd4c3f81 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:39:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Acquiring lock "refresh_cache-fee43642-30e8-451b-919c-aca4cd4c3f81" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:39:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Acquired lock "refresh_cache-fee43642-30e8-451b-919c-aca4cd4c3f81" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:39:30 user nova-compute[73391]: DEBUG nova.network.neutron [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:39:30 user nova-compute[73391]: DEBUG nova.objects.instance [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lazy-loading 'info_cache' on Instance uuid fee43642-30e8-451b-919c-aca4cd4c3f81 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:39:30 user nova-compute[73391]: DEBUG nova.compute.manager [None req-a4c15d0e-b0b1-4d2a-af6c-0a4dac3f3a28 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:39:30 user nova-compute[73391]: INFO nova.compute.manager [None req-a4c15d0e-b0b1-4d2a-af6c-0a4dac3f3a28 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] instance snapshotting
Aug 15 05:39:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:39:30 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-a4c15d0e-b0b1-4d2a-af6c-0a4dac3f3a28 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Beginning live snapshot process
Aug 15 05:39:30 user nova-compute[73391]: DEBUG nova.network.neutron [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Updating instance_info_cache with network_info: [{"id": "fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b", "address": "fa:16:3e:57:a8:64", "network": {"id": "c94dfbf4-6803-458e-b2c6-231298da7bc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090354282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f88922b3c294aea9efa3d80909a171a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdb4ce86-9a", "ovs_interfaceid": "fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Releasing lock "refresh_cache-fee43642-30e8-451b-919c-aca4cd4c3f81" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-a4c15d0e-b0b1-4d2a-af6c-0a4dac3f3a28 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1/disk --force-share --output=json -f qcow2 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:31 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Instance destroyed successfully.
Aug 15 05:39:31 user nova-compute[73391]: DEBUG nova.objects.instance [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lazy-loading 'resources' on Instance uuid fee43642-30e8-451b-919c-aca4cd4c3f81 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:35:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1959427232',display_name='tempest-AttachVolumeTestJSON-server-1959427232',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1959427232',id=20,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8c2c+HY2uFg0muioXJ/Qd76WkrwYok3JhcRUo8JvSmW81H3Mw3KqkIDK8NtlIVnkKC4J9LmhNxEjXRZXc6sdj/CKTHFaHD2NbzzeyvSOZNMRKn7xfyQEj9gzmcW7J5qQ==',key_name='tempest-keypair-769603990',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:35:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='9f88922b3c294aea9efa3d80909a171a',ramdisk_id='',reservation_id='r-9kpn3uxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-629721707',owner_user_name='tempest-AttachVolumeTestJSON-629721707-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:37:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='02352e5b84f04d0e9975b8b8e5594b92',uuid=fee43642-30e8-451b-919c-aca4cd4c3f81,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b", "address": "fa:16:3e:57:a8:64", "network": {"id": "c94dfbf4-6803-458e-b2c6-231298da7bc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090354282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f88922b3c294aea9efa3d80909a171a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdb4ce86-9a", "ovs_interfaceid": "fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Converting VIF {"id": "fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b", "address": "fa:16:3e:57:a8:64", "network": {"id": "c94dfbf4-6803-458e-b2c6-231298da7bc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090354282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f88922b3c294aea9efa3d80909a171a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdb4ce86-9a", "ovs_interfaceid": "fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:a8:64,bridge_name='br-int',has_traffic_filtering=True,id=fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b,network=Network(c94dfbf4-6803-458e-b2c6-231298da7bc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdb4ce86-9a') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG os_vif [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:a8:64,bridge_name='br-int',has_traffic_filtering=True,id=fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b,network=Network(c94dfbf4-6803-458e-b2c6-231298da7bc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdb4ce86-9a') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfdb4ce86-9a, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:39:31 user nova-compute[73391]: INFO os_vif [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:a8:64,bridge_name='br-int',has_traffic_filtering=True,id=fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b,network=Network(c94dfbf4-6803-458e-b2c6-231298da7bc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdb4ce86-9a')
Aug 15 05:39:31 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NlCGZfgX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:39:31 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:39:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22dfcb9-fa89-4d54-8839-3552a336ecdf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b051d2-6ef0-4562-bdc9-7cd3bc9f388b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:39:31 user nova-compute[73391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)
Aug 15 05:39:31 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:39:31 user nova-compute[73391]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)
Aug 15 05:39:31 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f774859ecb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd'): ({'sdc'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Removing single pathed devices sdc {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-a4c15d0e-b0b1-4d2a-af6c-0a4dac3f3a28 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1/disk --force-share --output=json -f qcow2" returned: 0 in 0.189s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-a4c15d0e-b0b1-4d2a-af6c-0a4dac3f3a28 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1/disk --force-share --output=json -f qcow2 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a49bca-3060-4351-b644-d623112533c7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[06be1bec-b9d8-4845-bf88-6f4e5d3c4114]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Flushing IO for device /dev/sdc {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d989bcb6-692f-4df3-a4fc-aacb3060e99d]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[846212d9-14fb-4183-966d-92ca54939fd8]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] SCSI volumes sdc have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7be46f-52ea-47dd-883b-f3693d93297d]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-a4c15d0e-b0b1-4d2a-af6c-0a4dac3f3a28 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1/disk --force-share --output=json -f qcow2" returned: 0 in 0.203s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-a4c15d0e-b0b1-4d2a-af6c-0a4dac3f3a28 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[477cd920-5b3a-4085-91b1-90d0aa549fb1]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd, portal: 172.16.0.220,3260]
Aug 15 05:39:31 user nova-compute[73391]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd, portal: 172.16.0.220,3260] successful.
Aug 15 05:39:31 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c849a47-7511-4174-bcf1-5cec7818830f]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] <== disconnect_volume: return (340ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Start _get_guest_xml network_info=[{"id": "fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b", "address": "fa:16:3e:57:a8:64", "network": {"id": "c94dfbf4-6803-458e-b2c6-231298da7bc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090354282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f88922b3c294aea9efa3d80909a171a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdb4ce86-9a", "ovs_interfaceid": "fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '191b1dad-305e-4d1c-9b15-515ec59a3278'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NlCGZfgX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'fee43642-30e8-451b-919c-aca4cd4c3f81', 'attached_at': '', 'detached_at': '', 'volume_id': '83493878-2d16-44dc-b416-c6cadb17f0cd', 'serial': '83493878-2d16-44dc-b416-c6cadb17f0cd'}, 'attachment_id': '8fb1655a-d0b7-4ade-b8c8-7fd22ccc46ae', 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG nova.objects.instance [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lazy-loading 'numa_topology' on Instance uuid fee43642-30e8-451b-919c-aca4cd4c3f81 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:39:31 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:39:31 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:39:31 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG nova.objects.instance [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lazy-loading 'vcpu_model' on Instance uuid fee43642-30e8-451b-919c-aca4cd4c3f81 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NlCGZfgX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:39:31 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:39:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:39:31 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:39:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:39:31 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-a4c15d0e-b0b1-4d2a-af6c-0a4dac3f3a28 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.197s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-a4c15d0e-b0b1-4d2a-af6c-0a4dac3f3a28 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpnx4j5fkz/19e1875dac114c90959601f48af0680b.delta 1073741824 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6abee944-878d-4ba7-8c40-0aa2aa9e7cdb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 05:39:31 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-a4c15d0e-b0b1-4d2a-af6c-0a4dac3f3a28 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpnx4j5fkz/19e1875dac114c90959601f48af0680b.delta 1073741824" returned: 0 in 0.054s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:31 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-a4c15d0e-b0b1-4d2a-af6c-0a4dac3f3a28 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44bef71-152f-4afe-886a-da3884a266f0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd] added
Aug 15 05:39:31 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[129df658-d78e-4530-8355-058124269834]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[01bc7d45-29ca-4326-be70-d9a684c87c4b]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NlCGZfgX {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NlCGZfgX" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5336399f-5448-4ee5-bece-1f16aa8db1bf]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NlCGZfgX'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ae6157-5920-46c7-979e-5ede8f60b669]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a65fd91-c1f2-4c9f-ae32-b6b557029662]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:39:31 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:39:31 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50459ad-b8fc-454c-9639-9f6ddbff680b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd, portal: 172.16.0.220,3260]
Aug 15 05:39:31 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd, portal: 172.16.0.220,3260] successful.
Aug 15 05:39:31 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6d291f-9540-47c3-ba9e-fcdd3f0dc22b]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47a5c7d-a783-4a7b-96e5-1ab018fc7c22]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:39:31 user nova-compute[73391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)
Aug 15 05:39:31 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:39:31 user nova-compute[73391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)
Aug 15 05:39:31 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] HCTL ('33', '-', '-', 0) found on session 30 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.027s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25b2651-9faa-4c55-badb-f5a17df50121]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:39:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NlCGZfgX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 05:39:32 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-a4c15d0e-b0b1-4d2a-af6c-0a4dac3f3a28 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] COPY block job progress, current cursor: 65536 final cursor: 75497472 {{(pid=73391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 05:39:32 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:39:32 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] <== connect_volume: return (1371ms) {'type': 'block', 'scsi_wwn': '26661383139653538', 'path': '/dev/sdb'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:39:32 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661383139653538', 'path': '/dev/sdb'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 05:39:32 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-a4c15d0e-b0b1-4d2a-af6c-0a4dac3f3a28 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] COPY block job progress, current cursor: 10813440 final cursor: 75497472 {{(pid=73391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 05:39:33 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:35:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1959427232',display_name='tempest-AttachVolumeTestJSON-server-1959427232',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1959427232',id=20,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8c2c+HY2uFg0muioXJ/Qd76WkrwYok3JhcRUo8JvSmW81H3Mw3KqkIDK8NtlIVnkKC4J9LmhNxEjXRZXc6sdj/CKTHFaHD2NbzzeyvSOZNMRKn7xfyQEj9gzmcW7J5qQ==',key_name='tempest-keypair-769603990',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:35:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='9f88922b3c294aea9efa3d80909a171a',ramdisk_id='',reservation_id='r-9kpn3uxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-629721707',owner_user_name='tempest-AttachVolumeTestJSON-629721707-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:37:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='02352e5b84f04d0e9975b8b8e5594b92',uuid=fee43642-30e8-451b-919c-aca4cd4c3f81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b", "address": "fa:16:3e:57:a8:64", "network": {"id": "c94dfbf4-6803-458e-b2c6-231298da7bc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090354282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f88922b3c294aea9efa3d80909a171a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdb4ce86-9a", "ovs_interfaceid": "fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:39:33 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Converting VIF {"id": "fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b", "address": "fa:16:3e:57:a8:64", "network": {"id": "c94dfbf4-6803-458e-b2c6-231298da7bc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090354282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f88922b3c294aea9efa3d80909a171a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdb4ce86-9a", "ovs_interfaceid": "fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:39:33 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:a8:64,bridge_name='br-int',has_traffic_filtering=True,id=fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b,network=Network(c94dfbf4-6803-458e-b2c6-231298da7bc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdb4ce86-9a') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:39:33 user nova-compute[73391]: DEBUG nova.objects.instance [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lazy-loading 'pci_devices' on Instance uuid fee43642-30e8-451b-919c-aca4cd4c3f81 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:39:33 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:39:33 user nova-compute[73391]:   <uuid>fee43642-30e8-451b-919c-aca4cd4c3f81</uuid>
Aug 15 05:39:33 user nova-compute[73391]:   <name>instance-00000014</name>
Aug 15 05:39:33 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:39:33 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:39:33 user nova-compute[73391]:   <metadata>
Aug 15 05:39:33 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:39:33 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:39:33 user nova-compute[73391]:       <nova:name>tempest-AttachVolumeTestJSON-server-1959427232</nova:name>
Aug 15 05:39:33 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:39:31</nova:creationTime>
Aug 15 05:39:33 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:39:33 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:39:33 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:39:33 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:39:33 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:39:33 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:39:33 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:39:33 user nova-compute[73391]:       <nova:owner>
Aug 15 05:39:33 user nova-compute[73391]:         <nova:user uuid="02352e5b84f04d0e9975b8b8e5594b92">tempest-AttachVolumeTestJSON-629721707-project-member</nova:user>
Aug 15 05:39:33 user nova-compute[73391]:         <nova:project uuid="9f88922b3c294aea9efa3d80909a171a">tempest-AttachVolumeTestJSON-629721707</nova:project>
Aug 15 05:39:33 user nova-compute[73391]:       </nova:owner>
Aug 15 05:39:33 user nova-compute[73391]:       <nova:root type="image" uuid="191b1dad-305e-4d1c-9b15-515ec59a3278"/>
Aug 15 05:39:33 user nova-compute[73391]:       <nova:ports>
Aug 15 05:39:33 user nova-compute[73391]:         <nova:port uuid="fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b">
Aug 15 05:39:33 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 05:39:33 user nova-compute[73391]:         </nova:port>
Aug 15 05:39:33 user nova-compute[73391]:       </nova:ports>
Aug 15 05:39:33 user nova-compute[73391]:     </nova:instance>
Aug 15 05:39:33 user nova-compute[73391]:   </metadata>
Aug 15 05:39:33 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:39:33 user nova-compute[73391]:     <system>
Aug 15 05:39:33 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:39:33 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:39:33 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:39:33 user nova-compute[73391]:       <entry name="serial">fee43642-30e8-451b-919c-aca4cd4c3f81</entry>
Aug 15 05:39:33 user nova-compute[73391]:       <entry name="uuid">fee43642-30e8-451b-919c-aca4cd4c3f81</entry>
Aug 15 05:39:33 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:39:33 user nova-compute[73391]:     </system>
Aug 15 05:39:33 user nova-compute[73391]:   </sysinfo>
Aug 15 05:39:33 user nova-compute[73391]:   <os>
Aug 15 05:39:33 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:39:33 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:39:33 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:39:33 user nova-compute[73391]:   </os>
Aug 15 05:39:33 user nova-compute[73391]:   <features>
Aug 15 05:39:33 user nova-compute[73391]:     <acpi/>
Aug 15 05:39:33 user nova-compute[73391]:     <apic/>
Aug 15 05:39:33 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:39:33 user nova-compute[73391]:   </features>
Aug 15 05:39:33 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:39:33 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:39:33 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:39:33 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:39:33 user nova-compute[73391]:   </clock>
Aug 15 05:39:33 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:39:33 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:39:33 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:39:33 user nova-compute[73391]:   </cpu>
Aug 15 05:39:33 user nova-compute[73391]:   <devices>
Aug 15 05:39:33 user nova-compute[73391]:     <disk type="file" device="disk">
Aug 15 05:39:33 user nova-compute[73391]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 05:39:33 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk"/>
Aug 15 05:39:33 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:39:33 user nova-compute[73391]:     </disk>
Aug 15 05:39:33 user nova-compute[73391]:     <disk type="block" device="disk">
Aug 15 05:39:33 user nova-compute[73391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:39:33 user nova-compute[73391]:       <source dev="/dev/sdb"/>
Aug 15 05:39:33 user nova-compute[73391]:       <target dev="vdb" bus="virtio"/>
Aug 15 05:39:33 user nova-compute[73391]:       <serial>83493878-2d16-44dc-b416-c6cadb17f0cd</serial>
Aug 15 05:39:33 user nova-compute[73391]:     </disk>
Aug 15 05:39:33 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:39:33 user nova-compute[73391]:       <mac address="fa:16:3e:57:a8:64"/>
Aug 15 05:39:33 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:39:33 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:39:33 user nova-compute[73391]:       <target dev="tapfdb4ce86-9a"/>
Aug 15 05:39:33 user nova-compute[73391]:     </interface>
Aug 15 05:39:33 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:39:33 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/console.log" append="off"/>
Aug 15 05:39:33 user nova-compute[73391]:     </serial>
Aug 15 05:39:33 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:39:33 user nova-compute[73391]:     <video>
Aug 15 05:39:33 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:39:33 user nova-compute[73391]:     </video>
Aug 15 05:39:33 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:39:33 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:39:33 user nova-compute[73391]:     </rng>
Aug 15 05:39:33 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:39:33 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:39:33 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:39:33 user nova-compute[73391]:     </memballoon>
Aug 15 05:39:33 user nova-compute[73391]:   </devices>
Aug 15 05:39:33 user nova-compute[73391]: </domain>
Aug 15 05:39:33 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:39:33 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:33 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:33 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:33 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:33 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:39:33 user nova-compute[73391]: DEBUG nova.objects.instance [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lazy-loading 'trusted_certs' on Instance uuid fee43642-30e8-451b-919c-aca4cd4c3f81 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:39:33 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:33 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-a4c15d0e-b0b1-4d2a-af6c-0a4dac3f3a28 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=73391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 05:39:33 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-a4c15d0e-b0b1-4d2a-af6c-0a4dac3f3a28 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 15 05:39:33 user nova-compute[73391]: DEBUG nova.privsep.utils [None req-a4c15d0e-b0b1-4d2a-af6c-0a4dac3f3a28 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73391) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 05:39:33 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-a4c15d0e-b0b1-4d2a-af6c-0a4dac3f3a28 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpnx4j5fkz/19e1875dac114c90959601f48af0680b.delta /opt/stack/data/nova/instances/snapshots/tmpnx4j5fkz/19e1875dac114c90959601f48af0680b {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:33 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.192s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:33 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk. size=1073741824 {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 05:39:33 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:33 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk --force-share --output=json" returned: 0 in 0.284s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:33 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Cannot resize image /opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk to a smaller size. {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 05:39:33 user nova-compute[73391]: DEBUG nova.objects.instance [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lazy-loading 'migration_context' on Instance uuid fee43642-30e8-451b-919c-aca4cd4c3f81 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:39:33 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:35:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1959427232',display_name='tempest-AttachVolumeTestJSON-server-1959427232',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1959427232',id=20,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8c2c+HY2uFg0muioXJ/Qd76WkrwYok3JhcRUo8JvSmW81H3Mw3KqkIDK8NtlIVnkKC4J9LmhNxEjXRZXc6sdj/CKTHFaHD2NbzzeyvSOZNMRKn7xfyQEj9gzmcW7J5qQ==',key_name='tempest-keypair-769603990',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:35:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='9f88922b3c294aea9efa3d80909a171a',ramdisk_id='',reservation_id='r-9kpn3uxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-629721707',owner_user_name='tempest-AttachVolumeTestJSON-629721707-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:37:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='02352e5b84f04d0e9975b8b8e5594b92',uuid=fee43642-30e8-451b-919c-aca4cd4c3f81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b", "address": "fa:16:3e:57:a8:64", "network": {"id": "c94dfbf4-6803-458e-b2c6-231298da7bc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090354282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f88922b3c294aea9efa3d80909a171a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdb4ce86-9a", "ovs_interfaceid": "fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:39:33 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Converting VIF {"id": "fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b", "address": "fa:16:3e:57:a8:64", "network": {"id": "c94dfbf4-6803-458e-b2c6-231298da7bc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090354282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f88922b3c294aea9efa3d80909a171a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdb4ce86-9a", "ovs_interfaceid": "fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:39:33 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:a8:64,bridge_name='br-int',has_traffic_filtering=True,id=fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b,network=Network(c94dfbf4-6803-458e-b2c6-231298da7bc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdb4ce86-9a') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:39:33 user nova-compute[73391]: DEBUG os_vif [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:a8:64,bridge_name='br-int',has_traffic_filtering=True,id=fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b,network=Network(c94dfbf4-6803-458e-b2c6-231298da7bc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdb4ce86-9a') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:39:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:39:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:39:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:39:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:39:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfdb4ce86-9a, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:39:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfdb4ce86-9a, col_values=(('external_ids', {'iface-id': 'fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:a8:64', 'vm-uuid': 'fee43642-30e8-451b-919c-aca4cd4c3f81'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:39:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:39:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:39:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:39:34 user nova-compute[73391]: INFO os_vif [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:a8:64,bridge_name='br-int',has_traffic_filtering=True,id=fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b,network=Network(c94dfbf4-6803-458e-b2c6-231298da7bc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdb4ce86-9a')
Aug 15 05:39:34 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-a4c15d0e-b0b1-4d2a-af6c-0a4dac3f3a28 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpnx4j5fkz/19e1875dac114c90959601f48af0680b.delta /opt/stack/data/nova/instances/snapshots/tmpnx4j5fkz/19e1875dac114c90959601f48af0680b" returned: 0 in 0.612s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:34 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-a4c15d0e-b0b1-4d2a-af6c-0a4dac3f3a28 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Snapshot extracted, beginning image upload
Aug 15 05:39:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:39:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:39:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:39:35 user nova-compute[73391]: DEBUG nova.compute.manager [req-c4bf9d4a-c105-4ed4-8f2b-59e4b1bd83ac req-efff7825-e52f-4cf4-aee4-01ee2bccda86 service nova] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Received event network-vif-plugged-fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:39:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-c4bf9d4a-c105-4ed4-8f2b-59e4b1bd83ac req-efff7825-e52f-4cf4-aee4-01ee2bccda86 service nova] Acquiring lock "fee43642-30e8-451b-919c-aca4cd4c3f81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:39:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-c4bf9d4a-c105-4ed4-8f2b-59e4b1bd83ac req-efff7825-e52f-4cf4-aee4-01ee2bccda86 service nova] Lock "fee43642-30e8-451b-919c-aca4cd4c3f81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:39:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-c4bf9d4a-c105-4ed4-8f2b-59e4b1bd83ac req-efff7825-e52f-4cf4-aee4-01ee2bccda86 service nova] Lock "fee43642-30e8-451b-919c-aca4cd4c3f81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:39:35 user nova-compute[73391]: DEBUG nova.compute.manager [req-c4bf9d4a-c105-4ed4-8f2b-59e4b1bd83ac req-efff7825-e52f-4cf4-aee4-01ee2bccda86 service nova] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] No waiting events found dispatching network-vif-plugged-fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:39:35 user nova-compute[73391]: WARNING nova.compute.manager [req-c4bf9d4a-c105-4ed4-8f2b-59e4b1bd83ac req-efff7825-e52f-4cf4-aee4-01ee2bccda86 service nova] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Received unexpected event network-vif-plugged-fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b for instance with vm_state stopped and task_state powering-on.
Aug 15 05:39:36 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:39:36 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:39:36 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:39:37 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-a4c15d0e-b0b1-4d2a-af6c-0a4dac3f3a28 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Snapshot image upload complete
Aug 15 05:39:37 user nova-compute[73391]: INFO nova.compute.manager [None req-a4c15d0e-b0b1-4d2a-af6c-0a4dac3f3a28 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Took 6.39 seconds to snapshot the instance on the hypervisor.
Aug 15 05:39:38 user nova-compute[73391]: DEBUG nova.compute.manager [req-545a443b-f06e-4131-ab81-09d152770db9 req-37f378c4-d886-4a08-bf4c-b8c0e7970099 service nova] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Received event network-vif-plugged-fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:39:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-545a443b-f06e-4131-ab81-09d152770db9 req-37f378c4-d886-4a08-bf4c-b8c0e7970099 service nova] Acquiring lock "fee43642-30e8-451b-919c-aca4cd4c3f81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:39:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-545a443b-f06e-4131-ab81-09d152770db9 req-37f378c4-d886-4a08-bf4c-b8c0e7970099 service nova] Lock "fee43642-30e8-451b-919c-aca4cd4c3f81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:39:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-545a443b-f06e-4131-ab81-09d152770db9 req-37f378c4-d886-4a08-bf4c-b8c0e7970099 service nova] Lock "fee43642-30e8-451b-919c-aca4cd4c3f81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:39:38 user nova-compute[73391]: DEBUG nova.compute.manager [req-545a443b-f06e-4131-ab81-09d152770db9 req-37f378c4-d886-4a08-bf4c-b8c0e7970099 service nova] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] No waiting events found dispatching network-vif-plugged-fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:39:38 user nova-compute[73391]: WARNING nova.compute.manager [req-545a443b-f06e-4131-ab81-09d152770db9 req-37f378c4-d886-4a08-bf4c-b8c0e7970099 service nova] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Received unexpected event network-vif-plugged-fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b for instance with vm_state stopped and task_state powering-on.
Aug 15 05:39:38 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077978.1142564, fee43642-30e8-451b-919c-aca4cd4c3f81 => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:39:38 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] VM Resumed (Lifecycle Event)
Aug 15 05:39:38 user nova-compute[73391]: DEBUG nova.compute.manager [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:39:38 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Instance rebooted successfully.
Aug 15 05:39:38 user nova-compute[73391]: DEBUG nova.compute.manager [None req-2307d996-505a-45ff-814f-d86da5c603ce tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:39:38 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:39:38 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:39:38 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 15 05:39:38 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077978.1163144, fee43642-30e8-451b-919c-aca4cd4c3f81 => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:39:38 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] VM Started (Lifecycle Event)
Aug 15 05:39:38 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:39:38 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:39:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Acquiring lock "8d344530-40f9-43f0-8417-15110c6c9748" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:39:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Lock "8d344530-40f9-43f0-8417-15110c6c9748" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:39:38 user nova-compute[73391]: INFO nova.compute.manager [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Unshelving
Aug 15 05:39:38 user nova-compute[73391]: INFO nova.virt.block_device [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Booting with volume cad2c281-e6fc-4384-8628-690691c13cd4 at /dev/vda
Aug 15 05:39:38 user nova-compute[73391]: DEBUG os_brick.utils [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:39:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:38 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1141eddf-8d5a-4027-b298-7379ce22a71d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:38 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5bb761-fd70-4c42-997a-f8ea3fb3f21a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:38 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[411f49df-18c3-44ad-8b15-21dfd3de6c66]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:38 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3f6168-a6a7-438b-9313-e76415be3d98]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:39:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:39:39 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 05:39:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:39:39 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 05:39:39 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd2ab5f-9ee1-4ddb-b63c-fad4eb92df84]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:39 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 05:39:39 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 05:39:39 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 05:39:39 user nova-compute[73391]: DEBUG os_brick.utils [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:39:39 user nova-compute[73391]: DEBUG nova.virt.block_device [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Updating existing volume attachment record: 6ba4ada2-784a-4ca1-b04a-4175bb03f1fa {{(pid=73391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 05:39:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:39:41 user nova-compute[73391]: INFO nova.compute.manager [None req-f5275b42-a698-4c6d-aa64-7b38fc1bc4b6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Rescuing
Aug 15 05:39:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f5275b42-a698-4c6d-aa64-7b38fc1bc4b6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Acquiring lock "refresh_cache-8ff2da51-5bfd-4cdc-8cef-330cdef93d97" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:39:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f5275b42-a698-4c6d-aa64-7b38fc1bc4b6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Acquired lock "refresh_cache-8ff2da51-5bfd-4cdc-8cef-330cdef93d97" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:39:41 user nova-compute[73391]: DEBUG nova.network.neutron [None req-f5275b42-a698-4c6d-aa64-7b38fc1bc4b6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:39:42 user nova-compute[73391]: DEBUG nova.network.neutron [None req-f5275b42-a698-4c6d-aa64-7b38fc1bc4b6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Updating instance_info_cache with network_info: [{"id": "075b72cf-5f6f-443c-a0e1-dd3744944e5b", "address": "fa:16:3e:88:63:d4", "network": {"id": "bec69c6a-b2cb-4b0a-ba6e-ae6dae099818", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7da9448cc34b609120da564a01dba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap075b72cf-5f", "ovs_interfaceid": "075b72cf-5f6f-443c-a0e1-dd3744944e5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:39:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f5275b42-a698-4c6d-aa64-7b38fc1bc4b6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Releasing lock "refresh_cache-8ff2da51-5bfd-4cdc-8cef-330cdef93d97" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:39:42 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:39:42 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:39:42 user nova-compute[73391]: DEBUG nova.compute.manager [req-b5eef9da-f9cc-4344-989d-f2b71e291475 req-268887bd-13eb-4c57-a8d4-dbf206307231 service nova] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Received event network-vif-unplugged-075b72cf-5f6f-443c-a0e1-dd3744944e5b {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:39:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-b5eef9da-f9cc-4344-989d-f2b71e291475 req-268887bd-13eb-4c57-a8d4-dbf206307231 service nova] Acquiring lock "8ff2da51-5bfd-4cdc-8cef-330cdef93d97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:39:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-b5eef9da-f9cc-4344-989d-f2b71e291475 req-268887bd-13eb-4c57-a8d4-dbf206307231 service nova] Lock "8ff2da51-5bfd-4cdc-8cef-330cdef93d97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:39:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-b5eef9da-f9cc-4344-989d-f2b71e291475 req-268887bd-13eb-4c57-a8d4-dbf206307231 service nova] Lock "8ff2da51-5bfd-4cdc-8cef-330cdef93d97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:39:42 user nova-compute[73391]: DEBUG nova.compute.manager [req-b5eef9da-f9cc-4344-989d-f2b71e291475 req-268887bd-13eb-4c57-a8d4-dbf206307231 service nova] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] No waiting events found dispatching network-vif-unplugged-075b72cf-5f6f-443c-a0e1-dd3744944e5b {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:39:42 user nova-compute[73391]: WARNING nova.compute.manager [req-b5eef9da-f9cc-4344-989d-f2b71e291475 req-268887bd-13eb-4c57-a8d4-dbf206307231 service nova] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Received unexpected event network-vif-unplugged-075b72cf-5f6f-443c-a0e1-dd3744944e5b for instance with vm_state active and task_state rescuing.
Aug 15 05:39:42 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:39:42 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:39:43 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:39:43 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:39:43 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Instance destroyed successfully.
Aug 15 05:39:43 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-f5275b42-a698-4c6d-aa64-7b38fc1bc4b6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Attempting rescue
Aug 15 05:39:43 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f5275b42-a698-4c6d-aa64-7b38fc1bc4b6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73391) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 15 05:39:43 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f5275b42-a698-4c6d-aa64-7b38fc1bc4b6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Instance directory exists: not creating {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 05:39:43 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-f5275b42-a698-4c6d-aa64-7b38fc1bc4b6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Creating image(s)
Aug 15 05:39:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f5275b42-a698-4c6d-aa64-7b38fc1bc4b6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Acquiring lock "/opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:39:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f5275b42-a698-4c6d-aa64-7b38fc1bc4b6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "/opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:39:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f5275b42-a698-4c6d-aa64-7b38fc1bc4b6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "/opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:39:43 user nova-compute[73391]: DEBUG nova.objects.instance [None req-f5275b42-a698-4c6d-aa64-7b38fc1bc4b6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8ff2da51-5bfd-4cdc-8cef-330cdef93d97 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:39:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f5275b42-a698-4c6d-aa64-7b38fc1bc4b6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Acquiring lock "999b315ba87151d8252d543312ae7790e7e1583b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:39:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f5275b42-a698-4c6d-aa64-7b38fc1bc4b6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:39:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-f5275b42-a698-4c6d-aa64-7b38fc1bc4b6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-f5275b42-a698-4c6d-aa64-7b38fc1bc4b6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.213s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-f5275b42-a698-4c6d-aa64-7b38fc1bc4b6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-f5275b42-a698-4c6d-aa64-7b38fc1bc4b6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue" returned: 0 in 0.059s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f5275b42-a698-4c6d-aa64-7b38fc1bc4b6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:39:43 user nova-compute[73391]: DEBUG nova.objects.instance [None req-f5275b42-a698-4c6d-aa64-7b38fc1bc4b6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lazy-loading 'migration_context' on Instance uuid 8ff2da51-5bfd-4cdc-8cef-330cdef93d97 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:39:43 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f5275b42-a698-4c6d-aa64-7b38fc1bc4b6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Created local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 05:39:43 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f5275b42-a698-4c6d-aa64-7b38fc1bc4b6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Start _get_guest_xml network_info=[{"id": "075b72cf-5f6f-443c-a0e1-dd3744944e5b", "address": "fa:16:3e:88:63:d4", "network": {"id": "bec69c6a-b2cb-4b0a-ba6e-ae6dae099818", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "vif_mac": "fa:16:3e:88:63:d4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7da9448cc34b609120da564a01dba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap075b72cf-5f", "ovs_interfaceid": "075b72cf-5f6f-443c-a0e1-dd3744944e5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '191b1dad-305e-4d1c-9b15-515ec59a3278', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:39:43 user nova-compute[73391]: DEBUG nova.objects.instance [None req-f5275b42-a698-4c6d-aa64-7b38fc1bc4b6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lazy-loading 'resources' on Instance uuid 8ff2da51-5bfd-4cdc-8cef-330cdef93d97 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:39:43 user nova-compute[73391]: DEBUG nova.objects.instance [None req-f5275b42-a698-4c6d-aa64-7b38fc1bc4b6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lazy-loading 'numa_topology' on Instance uuid 8ff2da51-5bfd-4cdc-8cef-330cdef93d97 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:39:43 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-f5275b42-a698-4c6d-aa64-7b38fc1bc4b6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:39:43 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-f5275b42-a698-4c6d-aa64-7b38fc1bc4b6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:39:43 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-f5275b42-a698-4c6d-aa64-7b38fc1bc4b6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:39:43 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-f5275b42-a698-4c6d-aa64-7b38fc1bc4b6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:39:43 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-f5275b42-a698-4c6d-aa64-7b38fc1bc4b6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:39:43 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-f5275b42-a698-4c6d-aa64-7b38fc1bc4b6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:39:43 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f5275b42-a698-4c6d-aa64-7b38fc1bc4b6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:39:43 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f5275b42-a698-4c6d-aa64-7b38fc1bc4b6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:39:43 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f5275b42-a698-4c6d-aa64-7b38fc1bc4b6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:39:43 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f5275b42-a698-4c6d-aa64-7b38fc1bc4b6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:39:43 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f5275b42-a698-4c6d-aa64-7b38fc1bc4b6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:39:43 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f5275b42-a698-4c6d-aa64-7b38fc1bc4b6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:39:43 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f5275b42-a698-4c6d-aa64-7b38fc1bc4b6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:39:43 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f5275b42-a698-4c6d-aa64-7b38fc1bc4b6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:39:43 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f5275b42-a698-4c6d-aa64-7b38fc1bc4b6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:39:43 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f5275b42-a698-4c6d-aa64-7b38fc1bc4b6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:39:43 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f5275b42-a698-4c6d-aa64-7b38fc1bc4b6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:39:43 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f5275b42-a698-4c6d-aa64-7b38fc1bc4b6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:39:43 user nova-compute[73391]: DEBUG nova.objects.instance [None req-f5275b42-a698-4c6d-aa64-7b38fc1bc4b6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8ff2da51-5bfd-4cdc-8cef-330cdef93d97 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:39:43 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-f5275b42-a698-4c6d-aa64-7b38fc1bc4b6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:37:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-43235834',display_name='tempest-ServerRescueNegativeTestJSON-server-43235834',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-43235834',id=25,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:38:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5a7da9448cc34b609120da564a01dba4',ramdisk_id='',reservation_id='r-yhbtlwt4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1933442633',owner_user_name='tempest-ServerRescueNegativeTestJSON-1933442633-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:38:02Z,user_data=None,user_id='1f0f5888b8c44188a17202fad2725256',uuid=8ff2da51-5bfd-4cdc-8cef-330cdef93d97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "075b72cf-5f6f-443c-a0e1-dd3744944e5b", "address": "fa:16:3e:88:63:d4", "network": {"id": "bec69c6a-b2cb-4b0a-ba6e-ae6dae099818", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "vif_mac": "fa:16:3e:88:63:d4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7da9448cc34b609120da564a01dba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap075b72cf-5f", "ovs_interfaceid": "075b72cf-5f6f-443c-a0e1-dd3744944e5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:39:43 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-f5275b42-a698-4c6d-aa64-7b38fc1bc4b6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Converting VIF {"id": "075b72cf-5f6f-443c-a0e1-dd3744944e5b", "address": "fa:16:3e:88:63:d4", "network": {"id": "bec69c6a-b2cb-4b0a-ba6e-ae6dae099818", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "vif_mac": "fa:16:3e:88:63:d4"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7da9448cc34b609120da564a01dba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap075b72cf-5f", "ovs_interfaceid": "075b72cf-5f6f-443c-a0e1-dd3744944e5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:39:43 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-f5275b42-a698-4c6d-aa64-7b38fc1bc4b6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:63:d4,bridge_name='br-int',has_traffic_filtering=True,id=075b72cf-5f6f-443c-a0e1-dd3744944e5b,network=Network(bec69c6a-b2cb-4b0a-ba6e-ae6dae099818),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap075b72cf-5f') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:39:43 user nova-compute[73391]: DEBUG nova.objects.instance [None req-f5275b42-a698-4c6d-aa64-7b38fc1bc4b6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ff2da51-5bfd-4cdc-8cef-330cdef93d97 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:39:43 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f5275b42-a698-4c6d-aa64-7b38fc1bc4b6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:39:43 user nova-compute[73391]:   <uuid>8ff2da51-5bfd-4cdc-8cef-330cdef93d97</uuid>
Aug 15 05:39:43 user nova-compute[73391]:   <name>instance-00000019</name>
Aug 15 05:39:43 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:39:43 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:39:43 user nova-compute[73391]:   <metadata>
Aug 15 05:39:43 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:39:43 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:39:43 user nova-compute[73391]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-43235834</nova:name>
Aug 15 05:39:43 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:39:43</nova:creationTime>
Aug 15 05:39:43 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:39:43 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:39:43 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:39:43 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:39:43 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:39:43 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:39:43 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:39:43 user nova-compute[73391]:       <nova:owner>
Aug 15 05:39:43 user nova-compute[73391]:         <nova:user uuid="1f0f5888b8c44188a17202fad2725256">tempest-ServerRescueNegativeTestJSON-1933442633-project-member</nova:user>
Aug 15 05:39:43 user nova-compute[73391]:         <nova:project uuid="5a7da9448cc34b609120da564a01dba4">tempest-ServerRescueNegativeTestJSON-1933442633</nova:project>
Aug 15 05:39:43 user nova-compute[73391]:       </nova:owner>
Aug 15 05:39:43 user nova-compute[73391]:       <nova:root type="image" uuid="191b1dad-305e-4d1c-9b15-515ec59a3278"/>
Aug 15 05:39:43 user nova-compute[73391]:       <nova:ports>
Aug 15 05:39:43 user nova-compute[73391]:         <nova:port uuid="075b72cf-5f6f-443c-a0e1-dd3744944e5b">
Aug 15 05:39:43 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 15 05:39:43 user nova-compute[73391]:         </nova:port>
Aug 15 05:39:43 user nova-compute[73391]:       </nova:ports>
Aug 15 05:39:43 user nova-compute[73391]:     </nova:instance>
Aug 15 05:39:43 user nova-compute[73391]:   </metadata>
Aug 15 05:39:43 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:39:43 user nova-compute[73391]:     <system>
Aug 15 05:39:43 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:39:43 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:39:43 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:39:43 user nova-compute[73391]:       <entry name="serial">8ff2da51-5bfd-4cdc-8cef-330cdef93d97</entry>
Aug 15 05:39:43 user nova-compute[73391]:       <entry name="uuid">8ff2da51-5bfd-4cdc-8cef-330cdef93d97</entry>
Aug 15 05:39:43 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:39:43 user nova-compute[73391]:     </system>
Aug 15 05:39:43 user nova-compute[73391]:   </sysinfo>
Aug 15 05:39:43 user nova-compute[73391]:   <os>
Aug 15 05:39:43 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:39:43 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:39:43 user nova-compute[73391]:   </os>
Aug 15 05:39:43 user nova-compute[73391]:   <features>
Aug 15 05:39:43 user nova-compute[73391]:     <acpi/>
Aug 15 05:39:43 user nova-compute[73391]:     <apic/>
Aug 15 05:39:43 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:39:43 user nova-compute[73391]:   </features>
Aug 15 05:39:43 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:39:43 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:39:43 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:39:43 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:39:43 user nova-compute[73391]:   </clock>
Aug 15 05:39:43 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:39:43 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:39:43 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:39:43 user nova-compute[73391]:   </cpu>
Aug 15 05:39:43 user nova-compute[73391]:   <devices>
Aug 15 05:39:43 user nova-compute[73391]:     <disk type="file" device="disk">
Aug 15 05:39:43 user nova-compute[73391]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 05:39:43 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue"/>
Aug 15 05:39:43 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:39:43 user nova-compute[73391]:     </disk>
Aug 15 05:39:43 user nova-compute[73391]:     <disk type="file" device="disk">
Aug 15 05:39:43 user nova-compute[73391]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 05:39:43 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk"/>
Aug 15 05:39:43 user nova-compute[73391]:       <target dev="vdb" bus="virtio"/>
Aug 15 05:39:43 user nova-compute[73391]:     </disk>
Aug 15 05:39:43 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:39:43 user nova-compute[73391]:       <mac address="fa:16:3e:88:63:d4"/>
Aug 15 05:39:43 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:39:43 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:39:43 user nova-compute[73391]:       <target dev="tap075b72cf-5f"/>
Aug 15 05:39:43 user nova-compute[73391]:     </interface>
Aug 15 05:39:43 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:39:43 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/console.log" append="off"/>
Aug 15 05:39:43 user nova-compute[73391]:     </serial>
Aug 15 05:39:43 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:39:43 user nova-compute[73391]:     <video>
Aug 15 05:39:43 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:39:43 user nova-compute[73391]:     </video>
Aug 15 05:39:43 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:39:43 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:39:43 user nova-compute[73391]:     </rng>
Aug 15 05:39:43 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:39:43 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:39:43 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:39:43 user nova-compute[73391]:     </memballoon>
Aug 15 05:39:43 user nova-compute[73391]:   </devices>
Aug 15 05:39:43 user nova-compute[73391]: </domain>
Aug 15 05:39:43 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:39:43 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Instance destroyed successfully.
Aug 15 05:39:43 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f5275b42-a698-4c6d-aa64-7b38fc1bc4b6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:39:43 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f5275b42-a698-4c6d-aa64-7b38fc1bc4b6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:39:43 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f5275b42-a698-4c6d-aa64-7b38fc1bc4b6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] No VIF found with MAC fa:16:3e:88:63:d4, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:39:44 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:39:44 user nova-compute[73391]: DEBUG nova.compute.manager [req-7e4df591-3a58-43c8-a3c2-8e4e9a08b695 req-38c71062-7f15-41ce-b2bc-733314916b99 service nova] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Received event network-vif-plugged-075b72cf-5f6f-443c-a0e1-dd3744944e5b {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:39:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-7e4df591-3a58-43c8-a3c2-8e4e9a08b695 req-38c71062-7f15-41ce-b2bc-733314916b99 service nova] Acquiring lock "8ff2da51-5bfd-4cdc-8cef-330cdef93d97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:39:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-7e4df591-3a58-43c8-a3c2-8e4e9a08b695 req-38c71062-7f15-41ce-b2bc-733314916b99 service nova] Lock "8ff2da51-5bfd-4cdc-8cef-330cdef93d97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:39:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-7e4df591-3a58-43c8-a3c2-8e4e9a08b695 req-38c71062-7f15-41ce-b2bc-733314916b99 service nova] Lock "8ff2da51-5bfd-4cdc-8cef-330cdef93d97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:39:44 user nova-compute[73391]: DEBUG nova.compute.manager [req-7e4df591-3a58-43c8-a3c2-8e4e9a08b695 req-38c71062-7f15-41ce-b2bc-733314916b99 service nova] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] No waiting events found dispatching network-vif-plugged-075b72cf-5f6f-443c-a0e1-dd3744944e5b {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:39:44 user nova-compute[73391]: WARNING nova.compute.manager [req-7e4df591-3a58-43c8-a3c2-8e4e9a08b695 req-38c71062-7f15-41ce-b2bc-733314916b99 service nova] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Received unexpected event network-vif-plugged-075b72cf-5f6f-443c-a0e1-dd3744944e5b for instance with vm_state active and task_state rescuing.
Aug 15 05:39:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:39:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:39:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:39:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:39:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:39:46 user nova-compute[73391]: DEBUG nova.compute.manager [req-b604719d-b994-4efa-8e80-3f7971c5458e req-802da01a-d42e-49bd-bce7-20564b15fd82 service nova] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Received event network-vif-plugged-075b72cf-5f6f-443c-a0e1-dd3744944e5b {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:39:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-b604719d-b994-4efa-8e80-3f7971c5458e req-802da01a-d42e-49bd-bce7-20564b15fd82 service nova] Acquiring lock "8ff2da51-5bfd-4cdc-8cef-330cdef93d97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:39:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-b604719d-b994-4efa-8e80-3f7971c5458e req-802da01a-d42e-49bd-bce7-20564b15fd82 service nova] Lock "8ff2da51-5bfd-4cdc-8cef-330cdef93d97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:39:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-b604719d-b994-4efa-8e80-3f7971c5458e req-802da01a-d42e-49bd-bce7-20564b15fd82 service nova] Lock "8ff2da51-5bfd-4cdc-8cef-330cdef93d97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:39:46 user nova-compute[73391]: DEBUG nova.compute.manager [req-b604719d-b994-4efa-8e80-3f7971c5458e req-802da01a-d42e-49bd-bce7-20564b15fd82 service nova] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] No waiting events found dispatching network-vif-plugged-075b72cf-5f6f-443c-a0e1-dd3744944e5b {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:39:46 user nova-compute[73391]: WARNING nova.compute.manager [req-b604719d-b994-4efa-8e80-3f7971c5458e req-802da01a-d42e-49bd-bce7-20564b15fd82 service nova] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Received unexpected event network-vif-plugged-075b72cf-5f6f-443c-a0e1-dd3744944e5b for instance with vm_state active and task_state rescuing.
Aug 15 05:39:46 user nova-compute[73391]: DEBUG nova.compute.manager [req-b604719d-b994-4efa-8e80-3f7971c5458e req-802da01a-d42e-49bd-bce7-20564b15fd82 service nova] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Received event network-vif-plugged-075b72cf-5f6f-443c-a0e1-dd3744944e5b {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:39:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-b604719d-b994-4efa-8e80-3f7971c5458e req-802da01a-d42e-49bd-bce7-20564b15fd82 service nova] Acquiring lock "8ff2da51-5bfd-4cdc-8cef-330cdef93d97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:39:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-b604719d-b994-4efa-8e80-3f7971c5458e req-802da01a-d42e-49bd-bce7-20564b15fd82 service nova] Lock "8ff2da51-5bfd-4cdc-8cef-330cdef93d97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:39:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-b604719d-b994-4efa-8e80-3f7971c5458e req-802da01a-d42e-49bd-bce7-20564b15fd82 service nova] Lock "8ff2da51-5bfd-4cdc-8cef-330cdef93d97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:39:46 user nova-compute[73391]: DEBUG nova.compute.manager [req-b604719d-b994-4efa-8e80-3f7971c5458e req-802da01a-d42e-49bd-bce7-20564b15fd82 service nova] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] No waiting events found dispatching network-vif-plugged-075b72cf-5f6f-443c-a0e1-dd3744944e5b {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:39:46 user nova-compute[73391]: WARNING nova.compute.manager [req-b604719d-b994-4efa-8e80-3f7971c5458e req-802da01a-d42e-49bd-bce7-20564b15fd82 service nova] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Received unexpected event network-vif-plugged-075b72cf-5f6f-443c-a0e1-dd3744944e5b for instance with vm_state active and task_state rescuing.
Aug 15 05:39:47 user nova-compute[73391]: DEBUG nova.compute.manager [req-c9194e53-73d9-4659-9cb3-bfe414bc0975 req-0f9395d1-eab3-417a-aaf0-48f0b515f2fa service nova] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Received event network-changed-6a4219e2-c727-41cc-badf-17c70f906a78 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:39:47 user nova-compute[73391]: DEBUG nova.compute.manager [req-c9194e53-73d9-4659-9cb3-bfe414bc0975 req-0f9395d1-eab3-417a-aaf0-48f0b515f2fa service nova] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Refreshing instance network info cache due to event network-changed-6a4219e2-c727-41cc-badf-17c70f906a78. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:39:47 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-c9194e53-73d9-4659-9cb3-bfe414bc0975 req-0f9395d1-eab3-417a-aaf0-48f0b515f2fa service nova] Acquiring lock "refresh_cache-a1ba38e6-f0fe-408f-b1c8-f9b193531952" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:39:47 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-c9194e53-73d9-4659-9cb3-bfe414bc0975 req-0f9395d1-eab3-417a-aaf0-48f0b515f2fa service nova] Acquired lock "refresh_cache-a1ba38e6-f0fe-408f-b1c8-f9b193531952" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:39:47 user nova-compute[73391]: DEBUG nova.network.neutron [req-c9194e53-73d9-4659-9cb3-bfe414bc0975 req-0f9395d1-eab3-417a-aaf0-48f0b515f2fa service nova] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Refreshing network info cache for port 6a4219e2-c727-41cc-badf-17c70f906a78 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:39:47 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Removed pending event for 8ff2da51-5bfd-4cdc-8cef-330cdef93d97 due to event {{(pid=73391) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 05:39:47 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077987.6883466, 8ff2da51-5bfd-4cdc-8cef-330cdef93d97 => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:39:47 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] VM Resumed (Lifecycle Event)
Aug 15 05:39:47 user nova-compute[73391]: DEBUG nova.compute.manager [None req-f5275b42-a698-4c6d-aa64-7b38fc1bc4b6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:39:47 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:39:47 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:39:47 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 15 05:39:47 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692077987.6903195, 8ff2da51-5bfd-4cdc-8cef-330cdef93d97 => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:39:47 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] VM Started (Lifecycle Event)
Aug 15 05:39:47 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:39:47 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:39:48 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-281ce9ab-0c6a-4fb9-81b3-0ca714b3e347 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Acquiring lock "a1ba38e6-f0fe-408f-b1c8-f9b193531952" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:39:48 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-281ce9ab-0c6a-4fb9-81b3-0ca714b3e347 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Lock "a1ba38e6-f0fe-408f-b1c8-f9b193531952" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:39:48 user nova-compute[73391]: DEBUG nova.objects.instance [None req-281ce9ab-0c6a-4fb9-81b3-0ca714b3e347 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Lazy-loading 'flavor' on Instance uuid a1ba38e6-f0fe-408f-b1c8-f9b193531952 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:39:48 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-281ce9ab-0c6a-4fb9-81b3-0ca714b3e347 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Lock "a1ba38e6-f0fe-408f-b1c8-f9b193531952" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:39:48 user nova-compute[73391]: DEBUG nova.network.neutron [req-c9194e53-73d9-4659-9cb3-bfe414bc0975 req-0f9395d1-eab3-417a-aaf0-48f0b515f2fa service nova] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Updated VIF entry in instance network info cache for port 6a4219e2-c727-41cc-badf-17c70f906a78. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:39:48 user nova-compute[73391]: DEBUG nova.network.neutron [req-c9194e53-73d9-4659-9cb3-bfe414bc0975 req-0f9395d1-eab3-417a-aaf0-48f0b515f2fa service nova] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Updating instance_info_cache with network_info: [{"id": "6a4219e2-c727-41cc-badf-17c70f906a78", "address": "fa:16:3e:7a:2e:c4", "network": {"id": "2474e5aa-a909-4c0a-b8b0-0a1f31a80aa0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-824802028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae2c2aef51304fd1b6a8ed87a7065bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a4219e2-c7", "ovs_interfaceid": "6a4219e2-c727-41cc-badf-17c70f906a78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:39:48 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-c9194e53-73d9-4659-9cb3-bfe414bc0975 req-0f9395d1-eab3-417a-aaf0-48f0b515f2fa service nova] Releasing lock "refresh_cache-a1ba38e6-f0fe-408f-b1c8-f9b193531952" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:39:48 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-281ce9ab-0c6a-4fb9-81b3-0ca714b3e347 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Acquiring lock "a1ba38e6-f0fe-408f-b1c8-f9b193531952" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:39:48 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-281ce9ab-0c6a-4fb9-81b3-0ca714b3e347 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Lock "a1ba38e6-f0fe-408f-b1c8-f9b193531952" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:39:48 user nova-compute[73391]: INFO nova.compute.manager [None req-281ce9ab-0c6a-4fb9-81b3-0ca714b3e347 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Attaching volume 2c40b512-ed36-41c4-b248-24d3e25d6eb9 to /dev/vdb
Aug 15 05:39:48 user nova-compute[73391]: DEBUG os_brick.utils [None req-281ce9ab-0c6a-4fb9-81b3-0ca714b3e347 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:39:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:48 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[74dddb56-1690-47aa-9b18-7945ba75e39d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:48 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[73dec4d4-fb2d-47d7-be4c-b802d29ecc68]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:48 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc865b5-038f-4937-a86a-8a12b856a2d9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:48 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91646c4-d6c6-4330-83c5-0226ad33094d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-281ce9ab-0c6a-4fb9-81b3-0ca714b3e347 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-281ce9ab-0c6a-4fb9-81b3-0ca714b3e347 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:39:48 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-281ce9ab-0c6a-4fb9-81b3-0ca714b3e347 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 05:39:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:39:48 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 05:39:48 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3478ecb-4544-4c70-a0ea-12819e78c0cb]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:48 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-281ce9ab-0c6a-4fb9-81b3-0ca714b3e347 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 05:39:48 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-281ce9ab-0c6a-4fb9-81b3-0ca714b3e347 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 05:39:48 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-281ce9ab-0c6a-4fb9-81b3-0ca714b3e347 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 05:39:48 user nova-compute[73391]: DEBUG os_brick.utils [None req-281ce9ab-0c6a-4fb9-81b3-0ca714b3e347 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:39:48 user nova-compute[73391]: DEBUG nova.virt.block_device [None req-281ce9ab-0c6a-4fb9-81b3-0ca714b3e347 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Updating existing volume attachment record: 34704d84-3e3b-46b5-b0cb-74c9e02b14f5 {{(pid=73391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 05:39:49 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:39:49 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:39:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:39:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:39:57 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:39:58 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-281ce9ab-0c6a-4fb9-81b3-0ca714b3e347 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 05:39:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-281ce9ab-0c6a-4fb9-81b3-0ca714b3e347 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ixOBfLcp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:39:58 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-281ce9ab-0c6a-4fb9-81b3-0ca714b3e347 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:39:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-281ce9ab-0c6a-4fb9-81b3-0ca714b3e347 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:39:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-281ce9ab-0c6a-4fb9-81b3-0ca714b3e347 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:39:58 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-281ce9ab-0c6a-4fb9-81b3-0ca714b3e347 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:39:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-281ce9ab-0c6a-4fb9-81b3-0ca714b3e347 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:39:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-281ce9ab-0c6a-4fb9-81b3-0ca714b3e347 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:39:58 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-281ce9ab-0c6a-4fb9-81b3-0ca714b3e347 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 05:39:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9 -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:58 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[76aaf497-a152-404c-b90e-c7a5644e0868]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-281ce9ab-0c6a-4fb9-81b3-0ca714b3e347 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 05:39:58 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:39:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:58 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd0eacee-5a7e-4b8e-8bfe-7f6a33df5d70]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-281ce9ab-0c6a-4fb9-81b3-0ca714b3e347 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9] added
Aug 15 05:39:58 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:39:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:58 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f6cc74-b001-4999-b111-cf70674b8afd]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-281ce9ab-0c6a-4fb9-81b3-0ca714b3e347 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:39:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:58 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[abeba09a-b8f9-448e-b086-25e4010f750e]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-281ce9ab-0c6a-4fb9-81b3-0ca714b3e347 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:39:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ixOBfLcp {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ixOBfLcp" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:58 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2460ccc8-bde7-4a4f-a6ae-6d229dca3c7e]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-281ce9ab-0c6a-4fb9-81b3-0ca714b3e347 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ixOBfLcp'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:39:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:58 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4ced4b-60e9-4ec8-a383-bb51171f11c9]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-281ce9ab-0c6a-4fb9-81b3-0ca714b3e347 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:39:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:58 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba906b7-05c2-4e1b-a11c-dfc17cca3e00]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-281ce9ab-0c6a-4fb9-81b3-0ca714b3e347 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:39:58 user nova-compute[73391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)
Aug 15 05:39:58 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:39:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-281ce9ab-0c6a-4fb9-81b3-0ca714b3e347 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:39:58 user nova-compute[73391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)
Aug 15 05:39:58 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:39:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9 -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:58 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08c0f76-e801-4beb-a8da-2754e884fa58]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-281ce9ab-0c6a-4fb9-81b3-0ca714b3e347 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9, portal: 172.16.0.220,3260]
Aug 15 05:39:58 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9, portal: 172.16.0.220,3260] successful.
Aug 15 05:39:58 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:39:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:58 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ce4d3d-89d0-4dad-b207-230825e0f3d2]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-281ce9ab-0c6a-4fb9-81b3-0ca714b3e347 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:39:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:58 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcfd35e7-3f63-43e7-9608-7580d65fac67]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-281ce9ab-0c6a-4fb9-81b3-0ca714b3e347 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:39:58 user nova-compute[73391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)
Aug 15 05:39:58 user nova-compute[73391]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9 (non-flash)
Aug 15 05:39:58 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:39:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-281ce9ab-0c6a-4fb9-81b3-0ca714b3e347 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:39:58 user nova-compute[73391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)
Aug 15 05:39:58 user nova-compute[73391]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9 (non-flash)
Aug 15 05:39:58 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:39:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-281ce9ab-0c6a-4fb9-81b3-0ca714b3e347 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:39:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-281ce9ab-0c6a-4fb9-81b3-0ca714b3e347 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 05:39:58 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-281ce9ab-0c6a-4fb9-81b3-0ca714b3e347 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] HCTL ('34', '-', '-', 0) found on session 31 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 05:39:58 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-281ce9ab-0c6a-4fb9-81b3-0ca714b3e347 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 05:39:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:39:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:39:58 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee4a5ab-dced-49f8-a258-2b47c4bdf282]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:39:58 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-281ce9ab-0c6a-4fb9-81b3-0ca714b3e347 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Searching for a device in session 31 and hctl ['34', '*', '*', 0] yield: None {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:39:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:39:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:39:59 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-281ce9ab-0c6a-4fb9-81b3-0ca714b3e347 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Searching for a device in session 31 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:39:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-281ce9ab-0c6a-4fb9-81b3-0ca714b3e347 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ixOBfLcp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 05:39:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-281ce9ab-0c6a-4fb9-81b3-0ca714b3e347 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:39:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-281ce9ab-0c6a-4fb9-81b3-0ca714b3e347 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '26634363464353834', 'path': '/dev/sdc'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:39:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-281ce9ab-0c6a-4fb9-81b3-0ca714b3e347 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26634363464353834', 'path': '/dev/sdc'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 05:39:59 user nova-compute[73391]: DEBUG nova.objects.instance [None req-281ce9ab-0c6a-4fb9-81b3-0ca714b3e347 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Lazy-loading 'flavor' on Instance uuid a1ba38e6-f0fe-408f-b1c8-f9b193531952 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:39:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-281ce9ab-0c6a-4fb9-81b3-0ca714b3e347 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 05:39:59 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:39:59 user nova-compute[73391]:   <source dev="/dev/sdc"/>
Aug 15 05:39:59 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:39:59 user nova-compute[73391]:   <serial>2c40b512-ed36-41c4-b248-24d3e25d6eb9</serial>
Aug 15 05:39:59 user nova-compute[73391]: </disk>
Aug 15 05:39:59 user nova-compute[73391]:  {{(pid=73391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 05:39:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-281ce9ab-0c6a-4fb9-81b3-0ca714b3e347 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:39:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-281ce9ab-0c6a-4fb9-81b3-0ca714b3e347 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:39:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-281ce9ab-0c6a-4fb9-81b3-0ca714b3e347 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] No VIF found with MAC fa:16:3e:7a:2e:c4, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:40:00 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-281ce9ab-0c6a-4fb9-81b3-0ca714b3e347 tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Lock "a1ba38e6-f0fe-408f-b1c8-f9b193531952" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.605s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:40:01 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:02 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:40:02 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:40:02 user nova-compute[73391]: DEBUG nova.objects.instance [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Lazy-loading 'pci_requests' on Instance uuid 8d344530-40f9-43f0-8417-15110c6c9748 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:40:02 user nova-compute[73391]: DEBUG nova.objects.instance [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Lazy-loading 'numa_topology' on Instance uuid 8d344530-40f9-43f0-8417-15110c6c9748 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:40:02 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 05:40:02 user nova-compute[73391]: INFO nova.compute.claims [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Claim successful on node user
Aug 15 05:40:02 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:40:02 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:40:02 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.505s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:40:02 user nova-compute[73391]: INFO nova.network.neutron [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Updating port 46454c88-9007-47b1-a199-b80afdf843f1 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 15 05:40:03 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Acquiring lock "refresh_cache-8d344530-40f9-43f0-8417-15110c6c9748" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:40:03 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Acquired lock "refresh_cache-8d344530-40f9-43f0-8417-15110c6c9748" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:40:03 user nova-compute[73391]: DEBUG nova.network.neutron [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:40:03 user nova-compute[73391]: DEBUG nova.compute.manager [req-f3bad2a8-40dd-4659-acdb-5b7194df41a3 req-dc6ae567-8edb-4797-859e-9adcf30861d3 service nova] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Received event network-changed-46454c88-9007-47b1-a199-b80afdf843f1 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:40:03 user nova-compute[73391]: DEBUG nova.compute.manager [req-f3bad2a8-40dd-4659-acdb-5b7194df41a3 req-dc6ae567-8edb-4797-859e-9adcf30861d3 service nova] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Refreshing instance network info cache due to event network-changed-46454c88-9007-47b1-a199-b80afdf843f1. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:40:03 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f3bad2a8-40dd-4659-acdb-5b7194df41a3 req-dc6ae567-8edb-4797-859e-9adcf30861d3 service nova] Acquiring lock "refresh_cache-8d344530-40f9-43f0-8417-15110c6c9748" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG nova.compute.manager [req-3515f23d-44e9-4896-b746-efd8cfef5964 req-e57d6301-a3a8-435e-85cb-48811ffc75e4 service nova] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Received event network-changed-3e0cb01d-a82e-44d3-b8dd-723819ec6ffa {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG nova.compute.manager [req-3515f23d-44e9-4896-b746-efd8cfef5964 req-e57d6301-a3a8-435e-85cb-48811ffc75e4 service nova] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Refreshing instance network info cache due to event network-changed-3e0cb01d-a82e-44d3-b8dd-723819ec6ffa. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-3515f23d-44e9-4896-b746-efd8cfef5964 req-e57d6301-a3a8-435e-85cb-48811ffc75e4 service nova] Acquiring lock "refresh_cache-8991b32e-6c4b-4c66-a320-e734061f49ee" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-3515f23d-44e9-4896-b746-efd8cfef5964 req-e57d6301-a3a8-435e-85cb-48811ffc75e4 service nova] Acquired lock "refresh_cache-8991b32e-6c4b-4c66-a320-e734061f49ee" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG nova.network.neutron [req-3515f23d-44e9-4896-b746-efd8cfef5964 req-e57d6301-a3a8-435e-85cb-48811ffc75e4 service nova] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Refreshing network info cache for port 3e0cb01d-a82e-44d3-b8dd-723819ec6ffa {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG nova.network.neutron [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Updating instance_info_cache with network_info: [{"id": "46454c88-9007-47b1-a199-b80afdf843f1", "address": "fa:16:3e:d4:7c:d2", "network": {"id": "234a8df7-8eea-44bf-ae16-0840862765d4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1326637884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a88327b042847d5b910c53bda19976b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46454c88-90", "ovs_interfaceid": "46454c88-9007-47b1-a199-b80afdf843f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Releasing lock "refresh_cache-8d344530-40f9-43f0-8417-15110c6c9748" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Creating instance directory {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 05:40:04 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Creating image(s)
Aug 15 05:40:04 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Did not create local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Ensure instance console log exists: /opt/stack/data/nova/instances/8d344530-40f9-43f0-8417-15110c6c9748/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Start _get_guest_xml network_info=[{"id": "46454c88-9007-47b1-a199-b80afdf843f1", "address": "fa:16:3e:d4:7c:d2", "network": {"id": "234a8df7-8eea-44bf-ae16-0840862765d4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1326637884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a88327b042847d5b910c53bda19976b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46454c88-90", "ovs_interfaceid": "46454c88-9007-47b1-a199-b80afdf843f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MscvTUKS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8d344530-40f9-43f0-8417-15110c6c9748', 'attached_at': '', 'detached_at': '', 'volume_id': 'cad2c281-e6fc-4384-8628-690691c13cd4', 'serial': 'cad2c281-e6fc-4384-8628-690691c13cd4'}, 'attachment_id': '6ba4ada2-784a-4ca1-b04a-4175bb03f1fa', 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'volume_type': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f3bad2a8-40dd-4659-acdb-5b7194df41a3 req-dc6ae567-8edb-4797-859e-9adcf30861d3 service nova] Acquired lock "refresh_cache-8d344530-40f9-43f0-8417-15110c6c9748" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG nova.network.neutron [req-f3bad2a8-40dd-4659-acdb-5b7194df41a3 req-dc6ae567-8edb-4797-859e-9adcf30861d3 service nova] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Refreshing network info cache for port 46454c88-9007-47b1-a199-b80afdf843f1 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:40:04 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:40:04 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:40:04 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG nova.objects.instance [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8d344530-40f9-43f0-8417-15110c6c9748 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MscvTUKS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:40:04 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:40:04 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:40:04 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:40:04 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:40:04 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 05:40:04 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4379bc28-4275-47ec-8c63-28fd8ea99f4f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 05:40:04 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2649be23-02f9-4321-aac2-14c1e4ff535c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4] added
Aug 15 05:40:04 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f82978b-ce44-4728-8b73-47b6e3ad1e41]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG nova.network.neutron [req-3515f23d-44e9-4896-b746-efd8cfef5964 req-e57d6301-a3a8-435e-85cb-48811ffc75e4 service nova] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Updated VIF entry in instance network info cache for port 3e0cb01d-a82e-44d3-b8dd-723819ec6ffa. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG nova.network.neutron [req-3515f23d-44e9-4896-b746-efd8cfef5964 req-e57d6301-a3a8-435e-85cb-48811ffc75e4 service nova] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Updating instance_info_cache with network_info: [{"id": "3e0cb01d-a82e-44d3-b8dd-723819ec6ffa", "address": "fa:16:3e:89:dc:93", "network": {"id": "11023df3-666d-44e5-955d-cc1fbde6972e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1848872765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "666428ad8c2f4f9cadcd180e498223f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0cb01d-a8", "ovs_interfaceid": "3e0cb01d-a82e-44d3-b8dd-723819ec6ffa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f3b25f9-8c4b-420d-b07b-5e6e5a2cbb18]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-3515f23d-44e9-4896-b746-efd8cfef5964 req-e57d6301-a3a8-435e-85cb-48811ffc75e4 service nova] Releasing lock "refresh_cache-8991b32e-6c4b-4c66-a320-e734061f49ee" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MscvTUKS {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MscvTUKS" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5acdd4e0-99ba-424b-aa70-1ea2ae298392]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MscvTUKS'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:40:04 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:05 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd18272-7626-44ea-9854-884811c67fca]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:40:05 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:40:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:05 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[584a8bdb-155b-4e85-a851-8f41b54a8251]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:40:05 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:40:05 user nova-compute[73391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)
Aug 15 05:40:05 user nova-compute[73391]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9 (non-flash)
Aug 15 05:40:05 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:40:05 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:40:05 user nova-compute[73391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)
Aug 15 05:40:05 user nova-compute[73391]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9 (non-flash)
Aug 15 05:40:05 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:40:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:05 user nova-compute[73391]: DEBUG nova.network.neutron [req-f3bad2a8-40dd-4659-acdb-5b7194df41a3 req-dc6ae567-8edb-4797-859e-9adcf30861d3 service nova] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Updated VIF entry in instance network info cache for port 46454c88-9007-47b1-a199-b80afdf843f1. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:40:05 user nova-compute[73391]: DEBUG nova.network.neutron [req-f3bad2a8-40dd-4659-acdb-5b7194df41a3 req-dc6ae567-8edb-4797-859e-9adcf30861d3 service nova] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Updating instance_info_cache with network_info: [{"id": "46454c88-9007-47b1-a199-b80afdf843f1", "address": "fa:16:3e:d4:7c:d2", "network": {"id": "234a8df7-8eea-44bf-ae16-0840862765d4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1326637884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a88327b042847d5b910c53bda19976b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46454c88-90", "ovs_interfaceid": "46454c88-9007-47b1-a199-b80afdf843f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:40:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f3bad2a8-40dd-4659-acdb-5b7194df41a3 req-dc6ae567-8edb-4797-859e-9adcf30861d3 service nova] Releasing lock "refresh_cache-8d344530-40f9-43f0-8417-15110c6c9748" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:40:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-56762056-04a5-4792-8310-0c7a0ba8264c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Acquiring lock "a1ba38e6-f0fe-408f-b1c8-f9b193531952" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:40:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-56762056-04a5-4792-8310-0c7a0ba8264c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Lock "a1ba38e6-f0fe-408f-b1c8-f9b193531952" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:40:05 user nova-compute[73391]: DEBUG nova.objects.instance [None req-56762056-04a5-4792-8310-0c7a0ba8264c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Lazy-loading 'flavor' on Instance uuid a1ba38e6-f0fe-408f-b1c8-f9b193531952 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:40:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-56762056-04a5-4792-8310-0c7a0ba8264c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Lock "a1ba38e6-f0fe-408f-b1c8-f9b193531952" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:40:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-56762056-04a5-4792-8310-0c7a0ba8264c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Acquiring lock "a1ba38e6-f0fe-408f-b1c8-f9b193531952" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:40:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-56762056-04a5-4792-8310-0c7a0ba8264c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Lock "a1ba38e6-f0fe-408f-b1c8-f9b193531952" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:40:05 user nova-compute[73391]: INFO nova.compute.manager [None req-56762056-04a5-4792-8310-0c7a0ba8264c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Attaching volume 47228624-5d4d-4374-8bae-ad9328138b0b to /dev/vdc
Aug 15 05:40:05 user nova-compute[73391]: DEBUG os_brick.utils [None req-56762056-04a5-4792-8310-0c7a0ba8264c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:40:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:05 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca36ce1e-28d7-467a-8082-c4d55f591d31]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:40:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:05 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[885d72b7-660b-47c9-b03d-dd2d9b0beb3c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:40:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:05 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc8d7b57-6480-4bfc-bc49-dabbd2c45a9a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:40:05 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fefe76f-3004-40f1-ac75-bac9b51aced6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:40:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-56762056-04a5-4792-8310-0c7a0ba8264c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-56762056-04a5-4792-8310-0c7a0ba8264c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:40:05 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-56762056-04a5-4792-8310-0c7a0ba8264c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 05:40:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:40:05 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 05:40:05 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf0ace6-009b-4f54-8f64-4860a928a3af]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:40:05 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-56762056-04a5-4792-8310-0c7a0ba8264c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 05:40:05 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-56762056-04a5-4792-8310-0c7a0ba8264c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 05:40:05 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-56762056-04a5-4792-8310-0c7a0ba8264c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 05:40:05 user nova-compute[73391]: DEBUG os_brick.utils [None req-56762056-04a5-4792-8310-0c7a0ba8264c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:40:05 user nova-compute[73391]: DEBUG nova.virt.block_device [None req-56762056-04a5-4792-8310-0c7a0ba8264c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Updating existing volume attachment record: cf14f415-efec-4709-a539-ba2a0225db62 {{(pid=73391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 05:40:07 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 -p 172.16.0.220:3260 --login" returned: 0 in 2.089s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:07 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8924c822-67c2-4148-906d-e728e892b842]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:40:07 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4, portal: 172.16.0.220,3260]
Aug 15 05:40:07 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4, portal: 172.16.0.220,3260] successful.
Aug 15 05:40:07 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:40:07 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:07 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:07 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9552fc21-e2e5-4356-8b36-157d6fd20f61]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:40:07 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:40:07 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:07 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:07 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f025f17-6c1e-4ab2-947e-86fc6eccd0f8]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:40:07 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:40:07 user nova-compute[73391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)
Aug 15 05:40:07 user nova-compute[73391]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9 (non-flash)
Aug 15 05:40:07 user nova-compute[73391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)
Aug 15 05:40:07 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:40:07 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:40:07 user nova-compute[73391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)
Aug 15 05:40:07 user nova-compute[73391]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9 (non-flash)
Aug 15 05:40:07 user nova-compute[73391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)
Aug 15 05:40:07 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:40:07 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.378s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:40:07 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 05:40:07 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] HCTL ('35', '-', '-', 0) found on session 32 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 05:40:07 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 05:40:07 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:07 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.026s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:07 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[72913c04-3267-4cb8-a918-9a2fb4f71cb8]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:40:07 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:40:07 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MscvTUKS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 05:40:07 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:08 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.424s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:40:08 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] <== connect_volume: return (3425ms) {'type': 'block', 'scsi_wwn': '23864343862383734', 'path': '/dev/sdd'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:40:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864343862383734', 'path': '/dev/sdd'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 05:40:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T05:35:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1421040367',display_name='tempest-TestShelveInstance-server-1421040367',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1421040367',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1898835883',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:36:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8a88327b042847d5b910c53bda19976b',ramdisk_id='',reservation_id='r-092d88cq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1216370790',owner_user_name='tempest-TestShelveInstance-1216370790-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:39:39Z,user_data=None,user_id='4f1326da23e34dc29d4469645af81589',uuid=8d344530-40f9-43f0-8417-15110c6c9748,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "46454c88-9007-47b1-a199-b80afdf843f1", "address": "fa:16:3e:d4:7c:d2", "network": {"id": "234a8df7-8eea-44bf-ae16-0840862765d4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1326637884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a88327b042847d5b910c53bda19976b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46454c88-90", "ovs_interfaceid": "46454c88-9007-47b1-a199-b80afdf843f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:40:08 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Converting VIF {"id": "46454c88-9007-47b1-a199-b80afdf843f1", "address": "fa:16:3e:d4:7c:d2", "network": {"id": "234a8df7-8eea-44bf-ae16-0840862765d4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1326637884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a88327b042847d5b910c53bda19976b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46454c88-90", "ovs_interfaceid": "46454c88-9007-47b1-a199-b80afdf843f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:40:08 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:7c:d2,bridge_name='br-int',has_traffic_filtering=True,id=46454c88-9007-47b1-a199-b80afdf843f1,network=Network(234a8df7-8eea-44bf-ae16-0840862765d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46454c88-90') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:40:08 user nova-compute[73391]: DEBUG nova.objects.instance [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Lazy-loading 'pci_devices' on Instance uuid 8d344530-40f9-43f0-8417-15110c6c9748 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:40:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:40:08 user nova-compute[73391]:   <uuid>8d344530-40f9-43f0-8417-15110c6c9748</uuid>
Aug 15 05:40:08 user nova-compute[73391]:   <name>instance-00000015</name>
Aug 15 05:40:08 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:40:08 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:40:08 user nova-compute[73391]:   <metadata>
Aug 15 05:40:08 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:40:08 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:40:08 user nova-compute[73391]:       <nova:name>tempest-TestShelveInstance-server-1421040367</nova:name>
Aug 15 05:40:08 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:40:04</nova:creationTime>
Aug 15 05:40:08 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:40:08 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:40:08 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:40:08 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:40:08 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:40:08 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:40:08 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:40:08 user nova-compute[73391]:       <nova:owner>
Aug 15 05:40:08 user nova-compute[73391]:         <nova:user uuid="4f1326da23e34dc29d4469645af81589">tempest-TestShelveInstance-1216370790-project-member</nova:user>
Aug 15 05:40:08 user nova-compute[73391]:         <nova:project uuid="8a88327b042847d5b910c53bda19976b">tempest-TestShelveInstance-1216370790</nova:project>
Aug 15 05:40:08 user nova-compute[73391]:       </nova:owner>
Aug 15 05:40:08 user nova-compute[73391]:       <nova:ports>
Aug 15 05:40:08 user nova-compute[73391]:         <nova:port uuid="46454c88-9007-47b1-a199-b80afdf843f1">
Aug 15 05:40:08 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 05:40:08 user nova-compute[73391]:         </nova:port>
Aug 15 05:40:08 user nova-compute[73391]:       </nova:ports>
Aug 15 05:40:08 user nova-compute[73391]:     </nova:instance>
Aug 15 05:40:08 user nova-compute[73391]:   </metadata>
Aug 15 05:40:08 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:40:08 user nova-compute[73391]:     <system>
Aug 15 05:40:08 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:40:08 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:40:08 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:40:08 user nova-compute[73391]:       <entry name="serial">8d344530-40f9-43f0-8417-15110c6c9748</entry>
Aug 15 05:40:08 user nova-compute[73391]:       <entry name="uuid">8d344530-40f9-43f0-8417-15110c6c9748</entry>
Aug 15 05:40:08 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:40:08 user nova-compute[73391]:     </system>
Aug 15 05:40:08 user nova-compute[73391]:   </sysinfo>
Aug 15 05:40:08 user nova-compute[73391]:   <os>
Aug 15 05:40:08 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:40:08 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:40:08 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:40:08 user nova-compute[73391]:   </os>
Aug 15 05:40:08 user nova-compute[73391]:   <features>
Aug 15 05:40:08 user nova-compute[73391]:     <acpi/>
Aug 15 05:40:08 user nova-compute[73391]:     <apic/>
Aug 15 05:40:08 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:40:08 user nova-compute[73391]:   </features>
Aug 15 05:40:08 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:40:08 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:40:08 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:40:08 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:40:08 user nova-compute[73391]:   </clock>
Aug 15 05:40:08 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:40:08 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:40:08 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:40:08 user nova-compute[73391]:   </cpu>
Aug 15 05:40:08 user nova-compute[73391]:   <devices>
Aug 15 05:40:08 user nova-compute[73391]:     <disk type="block" device="disk">
Aug 15 05:40:08 user nova-compute[73391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:40:08 user nova-compute[73391]:       <source dev="/dev/sdd"/>
Aug 15 05:40:08 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:40:08 user nova-compute[73391]:       <serial>cad2c281-e6fc-4384-8628-690691c13cd4</serial>
Aug 15 05:40:08 user nova-compute[73391]:     </disk>
Aug 15 05:40:08 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:40:08 user nova-compute[73391]:       <mac address="fa:16:3e:d4:7c:d2"/>
Aug 15 05:40:08 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:40:08 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:40:08 user nova-compute[73391]:       <target dev="tap46454c88-90"/>
Aug 15 05:40:08 user nova-compute[73391]:     </interface>
Aug 15 05:40:08 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:40:08 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/8d344530-40f9-43f0-8417-15110c6c9748/console.log" append="off"/>
Aug 15 05:40:08 user nova-compute[73391]:     </serial>
Aug 15 05:40:08 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:40:08 user nova-compute[73391]:     <video>
Aug 15 05:40:08 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:40:08 user nova-compute[73391]:     </video>
Aug 15 05:40:08 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:40:08 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:40:08 user nova-compute[73391]:     </rng>
Aug 15 05:40:08 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:40:08 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:40:08 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:40:08 user nova-compute[73391]:     </memballoon>
Aug 15 05:40:08 user nova-compute[73391]:   </devices>
Aug 15 05:40:08 user nova-compute[73391]: </domain>
Aug 15 05:40:08 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:40:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T05:35:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1421040367',display_name='tempest-TestShelveInstance-server-1421040367',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1421040367',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1898835883',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:36:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8a88327b042847d5b910c53bda19976b',ramdisk_id='',reservation_id='r-092d88cq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1216370790',owner_user_name='tempest-TestShelveInstance-1216370790-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:39:39Z,user_data=None,user_id='4f1326da23e34dc29d4469645af81589',uuid=8d344530-40f9-43f0-8417-15110c6c9748,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "46454c88-9007-47b1-a199-b80afdf843f1", "address": "fa:16:3e:d4:7c:d2", "network": {"id": "234a8df7-8eea-44bf-ae16-0840862765d4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1326637884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a88327b042847d5b910c53bda19976b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46454c88-90", "ovs_interfaceid": "46454c88-9007-47b1-a199-b80afdf843f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:40:08 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Converting VIF {"id": "46454c88-9007-47b1-a199-b80afdf843f1", "address": "fa:16:3e:d4:7c:d2", "network": {"id": "234a8df7-8eea-44bf-ae16-0840862765d4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1326637884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a88327b042847d5b910c53bda19976b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46454c88-90", "ovs_interfaceid": "46454c88-9007-47b1-a199-b80afdf843f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:40:08 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:7c:d2,bridge_name='br-int',has_traffic_filtering=True,id=46454c88-9007-47b1-a199-b80afdf843f1,network=Network(234a8df7-8eea-44bf-ae16-0840862765d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46454c88-90') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:40:08 user nova-compute[73391]: DEBUG os_vif [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:7c:d2,bridge_name='br-int',has_traffic_filtering=True,id=46454c88-9007-47b1-a199-b80afdf843f1,network=Network(234a8df7-8eea-44bf-ae16-0840862765d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46454c88-90') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:40:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:40:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:40:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap46454c88-90, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:40:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap46454c88-90, col_values=(('external_ids', {'iface-id': '46454c88-9007-47b1-a199-b80afdf843f1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:7c:d2', 'vm-uuid': '8d344530-40f9-43f0-8417-15110c6c9748'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:40:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:40:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:08 user nova-compute[73391]: INFO os_vif [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:7c:d2,bridge_name='br-int',has_traffic_filtering=True,id=46454c88-9007-47b1-a199-b80afdf843f1,network=Network(234a8df7-8eea-44bf-ae16-0840862765d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46454c88-90')
Aug 15 05:40:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:40:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] No VIF found with MAC fa:16:3e:d4:7c:d2, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:40:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:10 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:10 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:10 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:10 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:40:10 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Cleaning up deleted instances {{(pid=73391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 05:40:10 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] There are 0 instances to clean {{(pid=73391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 05:40:10 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:40:12 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078012.4000862, 8d344530-40f9-43f0-8417-15110c6c9748 => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:40:12 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] VM Resumed (Lifecycle Event)
Aug 15 05:40:12 user nova-compute[73391]: DEBUG nova.compute.manager [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:40:12 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Guest created on hypervisor {{(pid=73391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 05:40:12 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Instance spawned successfully.
Aug 15 05:40:12 user nova-compute[73391]: DEBUG nova.compute.manager [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:40:12 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:40:12 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:40:12 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:40:12 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078012.400815, 8d344530-40f9-43f0-8417-15110c6c9748 => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:40:12 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] VM Started (Lifecycle Event)
Aug 15 05:40:12 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:40:12 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:40:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d1069d31-e875-4525-a5d1-357d90efe006 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Lock "8d344530-40f9-43f0-8417-15110c6c9748" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 33.818s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:40:12 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:13 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:14 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:40:14 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:40:14 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:40:15 user nova-compute[73391]: DEBUG nova.compute.manager [req-85c62982-54c6-4756-9b7b-2d77bc7e6874 req-03039453-8dce-4906-b8bc-82adf8e8d533 service nova] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Received event network-vif-plugged-46454c88-9007-47b1-a199-b80afdf843f1 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:40:15 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-85c62982-54c6-4756-9b7b-2d77bc7e6874 req-03039453-8dce-4906-b8bc-82adf8e8d533 service nova] Acquiring lock "8d344530-40f9-43f0-8417-15110c6c9748-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:40:15 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-85c62982-54c6-4756-9b7b-2d77bc7e6874 req-03039453-8dce-4906-b8bc-82adf8e8d533 service nova] Lock "8d344530-40f9-43f0-8417-15110c6c9748-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:40:15 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-85c62982-54c6-4756-9b7b-2d77bc7e6874 req-03039453-8dce-4906-b8bc-82adf8e8d533 service nova] Lock "8d344530-40f9-43f0-8417-15110c6c9748-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:40:15 user nova-compute[73391]: DEBUG nova.compute.manager [req-85c62982-54c6-4756-9b7b-2d77bc7e6874 req-03039453-8dce-4906-b8bc-82adf8e8d533 service nova] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] No waiting events found dispatching network-vif-plugged-46454c88-9007-47b1-a199-b80afdf843f1 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:40:15 user nova-compute[73391]: WARNING nova.compute.manager [req-85c62982-54c6-4756-9b7b-2d77bc7e6874 req-03039453-8dce-4906-b8bc-82adf8e8d533 service nova] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Received unexpected event network-vif-plugged-46454c88-9007-47b1-a199-b80afdf843f1 for instance with vm_state active and task_state None.
Aug 15 05:40:16 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56762056-04a5-4792-8310-0c7a0ba8264c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 05:40:16 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-56762056-04a5-4792-8310-0c7a0ba8264c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:47228624-5d4d-4374-8bae-ad9328138b0b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EsqKrCfW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:40:16 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-56762056-04a5-4792-8310-0c7a0ba8264c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:40:16 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-56762056-04a5-4792-8310-0c7a0ba8264c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:40:16 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-56762056-04a5-4792-8310-0c7a0ba8264c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:40:16 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-56762056-04a5-4792-8310-0c7a0ba8264c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:40:16 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-56762056-04a5-4792-8310-0c7a0ba8264c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47228624-5d4d-4374-8bae-ad9328138b0b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:40:16 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-56762056-04a5-4792-8310-0c7a0ba8264c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47228624-5d4d-4374-8bae-ad9328138b0b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:40:16 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-56762056-04a5-4792-8310-0c7a0ba8264c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 05:40:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47228624-5d4d-4374-8bae-ad9328138b0b -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47228624-5d4d-4374-8bae-ad9328138b0b -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:16 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[abef1d8e-4b1a-456d-81ec-0ec906433ae0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:40:16 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-56762056-04a5-4792-8310-0c7a0ba8264c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 05:40:16 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:40:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47228624-5d4d-4374-8bae-ad9328138b0b -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47228624-5d4d-4374-8bae-ad9328138b0b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:16 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8fccb2c-8fbd-48c2-9780-d6d281def28b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47228624-5d4d-4374-8bae-ad9328138b0b] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:40:16 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-56762056-04a5-4792-8310-0c7a0ba8264c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47228624-5d4d-4374-8bae-ad9328138b0b] added
Aug 15 05:40:16 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:40:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47228624-5d4d-4374-8bae-ad9328138b0b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47228624-5d4d-4374-8bae-ad9328138b0b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:16 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a32409-32e4-4d31-bae7-270f48c2d823]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:40:16 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-56762056-04a5-4792-8310-0c7a0ba8264c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:40:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47228624-5d4d-4374-8bae-ad9328138b0b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47228624-5d4d-4374-8bae-ad9328138b0b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:16 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4adcd04f-d5a1-488f-9577-dff77cda47fc]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:40:16 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-56762056-04a5-4792-8310-0c7a0ba8264c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:40:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47228624-5d4d-4374-8bae-ad9328138b0b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EsqKrCfW {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47228624-5d4d-4374-8bae-ad9328138b0b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EsqKrCfW" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:16 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e6f37d-6d00-436b-93d4-397fb0ec8b51]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:40:16 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-56762056-04a5-4792-8310-0c7a0ba8264c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EsqKrCfW'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:40:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47228624-5d4d-4374-8bae-ad9328138b0b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47228624-5d4d-4374-8bae-ad9328138b0b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:16 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b67008e-4497-4089-9634-9798931ebf4f]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:40:16 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-56762056-04a5-4792-8310-0c7a0ba8264c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:40:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:16 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0928dcd5-a976-4932-97b8-99f438ad75c2]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:40:16 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-56762056-04a5-4792-8310-0c7a0ba8264c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:40:16 user nova-compute[73391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)
Aug 15 05:40:16 user nova-compute[73391]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9 (non-flash)
Aug 15 05:40:16 user nova-compute[73391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)
Aug 15 05:40:16 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:40:16 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-56762056-04a5-4792-8310-0c7a0ba8264c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:40:16 user nova-compute[73391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)
Aug 15 05:40:16 user nova-compute[73391]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9 (non-flash)
Aug 15 05:40:16 user nova-compute[73391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)
Aug 15 05:40:16 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:40:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47228624-5d4d-4374-8bae-ad9328138b0b -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47228624-5d4d-4374-8bae-ad9328138b0b -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:16 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dcebfbc-90f7-46e8-b2f7-16b449bf6437]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:47228624-5d4d-4374-8bae-ad9328138b0b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:47228624-5d4d-4374-8bae-ad9328138b0b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:40:16 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-56762056-04a5-4792-8310-0c7a0ba8264c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:47228624-5d4d-4374-8bae-ad9328138b0b, portal: 172.16.0.220,3260]
Aug 15 05:40:16 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:47228624-5d4d-4374-8bae-ad9328138b0b, portal: 172.16.0.220,3260] successful.
Aug 15 05:40:16 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:40:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47228624-5d4d-4374-8bae-ad9328138b0b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47228624-5d4d-4374-8bae-ad9328138b0b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:16 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2eb3c7c-cb79-4970-a6ec-8494c843e18a]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:40:16 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-56762056-04a5-4792-8310-0c7a0ba8264c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:40:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:16 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[640a892f-0b51-4850-91cb-58253f0f48ad]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47228624-5d4d-4374-8bae-ad9328138b0b (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:40:16 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-56762056-04a5-4792-8310-0c7a0ba8264c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:40:16 user nova-compute[73391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)
Aug 15 05:40:16 user nova-compute[73391]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9 (non-flash)
Aug 15 05:40:16 user nova-compute[73391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)
Aug 15 05:40:16 user nova-compute[73391]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47228624-5d4d-4374-8bae-ad9328138b0b (non-flash)
Aug 15 05:40:16 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:40:16 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-56762056-04a5-4792-8310-0c7a0ba8264c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:40:16 user nova-compute[73391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)
Aug 15 05:40:16 user nova-compute[73391]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9 (non-flash)
Aug 15 05:40:16 user nova-compute[73391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)
Aug 15 05:40:16 user nova-compute[73391]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47228624-5d4d-4374-8bae-ad9328138b0b (non-flash)
Aug 15 05:40:16 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:40:16 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-56762056-04a5-4792-8310-0c7a0ba8264c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47228624-5d4d-4374-8bae-ad9328138b0b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:40:16 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-56762056-04a5-4792-8310-0c7a0ba8264c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 05:40:16 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-56762056-04a5-4792-8310-0c7a0ba8264c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] HCTL ('36', '-', '-', 0) found on session 33 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 05:40:16 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-56762056-04a5-4792-8310-0c7a0ba8264c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 05:40:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.024s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:17 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf87ba3d-1d3f-40ba-87b9-cd388c883158]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:40:17 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-56762056-04a5-4792-8310-0c7a0ba8264c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:40:17 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-56762056-04a5-4792-8310-0c7a0ba8264c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EsqKrCfW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 05:40:17 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:40:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:40:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:40:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:40:17 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Auditing locally available compute resources for user (node: user) {{(pid=73391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 05:40:17 user nova-compute[73391]: DEBUG nova.compute.manager [req-046f3486-d33d-46f7-a68b-c388a5cc24ea req-401c75c1-b565-4c3d-9906-38008d5109ab service nova] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Received event network-vif-plugged-46454c88-9007-47b1-a199-b80afdf843f1 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:40:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-046f3486-d33d-46f7-a68b-c388a5cc24ea req-401c75c1-b565-4c3d-9906-38008d5109ab service nova] Acquiring lock "8d344530-40f9-43f0-8417-15110c6c9748-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:40:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-046f3486-d33d-46f7-a68b-c388a5cc24ea req-401c75c1-b565-4c3d-9906-38008d5109ab service nova] Lock "8d344530-40f9-43f0-8417-15110c6c9748-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:40:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-046f3486-d33d-46f7-a68b-c388a5cc24ea req-401c75c1-b565-4c3d-9906-38008d5109ab service nova] Lock "8d344530-40f9-43f0-8417-15110c6c9748-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:40:17 user nova-compute[73391]: DEBUG nova.compute.manager [req-046f3486-d33d-46f7-a68b-c388a5cc24ea req-401c75c1-b565-4c3d-9906-38008d5109ab service nova] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] No waiting events found dispatching network-vif-plugged-46454c88-9007-47b1-a199-b80afdf843f1 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:40:17 user nova-compute[73391]: WARNING nova.compute.manager [req-046f3486-d33d-46f7-a68b-c388a5cc24ea req-401c75c1-b565-4c3d-9906-38008d5109ab service nova] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Received unexpected event network-vif-plugged-46454c88-9007-47b1-a199-b80afdf843f1 for instance with vm_state active and task_state None.
Aug 15 05:40:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f88cd17-c89f-41f3-b630-8eb2c6698155/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:18 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-56762056-04a5-4792-8310-0c7a0ba8264c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.394s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:40:18 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-56762056-04a5-4792-8310-0c7a0ba8264c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] <== connect_volume: return (1398ms) {'type': 'block', 'scsi_wwn': '23336343864373334', 'path': '/dev/sde'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:40:18 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56762056-04a5-4792-8310-0c7a0ba8264c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23336343864373334', 'path': '/dev/sde'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 05:40:18 user nova-compute[73391]: DEBUG nova.objects.instance [None req-56762056-04a5-4792-8310-0c7a0ba8264c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Lazy-loading 'flavor' on Instance uuid a1ba38e6-f0fe-408f-b1c8-f9b193531952 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:40:18 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-56762056-04a5-4792-8310-0c7a0ba8264c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 05:40:18 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:40:18 user nova-compute[73391]:   <source dev="/dev/sde"/>
Aug 15 05:40:18 user nova-compute[73391]:   <target dev="vdc" bus="virtio"/>
Aug 15 05:40:18 user nova-compute[73391]:   <serial>47228624-5d4d-4374-8bae-ad9328138b0b</serial>
Aug 15 05:40:18 user nova-compute[73391]: </disk>
Aug 15 05:40:18 user nova-compute[73391]:  {{(pid=73391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 05:40:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f88cd17-c89f-41f3-b630-8eb2c6698155/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f88cd17-c89f-41f3-b630-8eb2c6698155/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f88cd17-c89f-41f3-b630-8eb2c6698155/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:18 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-56762056-04a5-4792-8310-0c7a0ba8264c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:40:18 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-56762056-04a5-4792-8310-0c7a0ba8264c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:40:18 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-56762056-04a5-4792-8310-0c7a0ba8264c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:40:18 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-56762056-04a5-4792-8310-0c7a0ba8264c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] No VIF found with MAC fa:16:3e:7a:2e:c4, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:40:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:18 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-56762056-04a5-4792-8310-0c7a0ba8264c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Lock "a1ba38e6-f0fe-408f-b1c8-f9b193531952" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.158s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:40:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ba38e6-f0fe-408f-b1c8-f9b193531952/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ba38e6-f0fe-408f-b1c8-f9b193531952/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ba38e6-f0fe-408f-b1c8-f9b193531952/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ba38e6-f0fe-408f-b1c8-f9b193531952/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:19 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:40:19 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:40:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-76c42c39-2d87-4d11-beb1-2cb3012fa41d tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Acquiring lock "a1ba38e6-f0fe-408f-b1c8-f9b193531952" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:40:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-76c42c39-2d87-4d11-beb1-2cb3012fa41d tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Lock "a1ba38e6-f0fe-408f-b1c8-f9b193531952" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:40:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:20 user nova-compute[73391]: INFO nova.compute.manager [None req-76c42c39-2d87-4d11-beb1-2cb3012fa41d tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Detaching volume 47228624-5d4d-4374-8bae-ad9328138b0b
Aug 15 05:40:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:20 user nova-compute[73391]: INFO nova.virt.block_device [None req-76c42c39-2d87-4d11-beb1-2cb3012fa41d tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Attempting to driver detach volume 47228624-5d4d-4374-8bae-ad9328138b0b from mountpoint /dev/vdc
Aug 15 05:40:20 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-76c42c39-2d87-4d11-beb1-2cb3012fa41d tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Attempting to detach device vdc from instance a1ba38e6-f0fe-408f-b1c8-f9b193531952 from the persistent domain config. {{(pid=73391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 05:40:20 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-76c42c39-2d87-4d11-beb1-2cb3012fa41d tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 05:40:20 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:40:20 user nova-compute[73391]:   <source dev="/dev/sde"/>
Aug 15 05:40:20 user nova-compute[73391]:   <target dev="vdc" bus="virtio"/>
Aug 15 05:40:20 user nova-compute[73391]:   <serial>47228624-5d4d-4374-8bae-ad9328138b0b</serial>
Aug 15 05:40:20 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 15 05:40:20 user nova-compute[73391]: </disk>
Aug 15 05:40:20 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 05:40:20 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-76c42c39-2d87-4d11-beb1-2cb3012fa41d tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Successfully detached device vdc from instance a1ba38e6-f0fe-408f-b1c8-f9b193531952 from the persistent domain config.
Aug 15 05:40:20 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-76c42c39-2d87-4d11-beb1-2cb3012fa41d tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance a1ba38e6-f0fe-408f-b1c8-f9b193531952 from the live domain config. {{(pid=73391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 05:40:20 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-76c42c39-2d87-4d11-beb1-2cb3012fa41d tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 05:40:20 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:40:20 user nova-compute[73391]:   <source dev="/dev/sde"/>
Aug 15 05:40:20 user nova-compute[73391]:   <target dev="vdc" bus="virtio"/>
Aug 15 05:40:20 user nova-compute[73391]:   <serial>47228624-5d4d-4374-8bae-ad9328138b0b</serial>
Aug 15 05:40:20 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 15 05:40:20 user nova-compute[73391]: </disk>
Aug 15 05:40:20 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 05:40:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:20 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Received event <DeviceRemovedEvent: 1692078020.783917, a1ba38e6-f0fe-408f-b1c8-f9b193531952 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73391) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 05:40:20 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-76c42c39-2d87-4d11-beb1-2cb3012fa41d tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance a1ba38e6-f0fe-408f-b1c8-f9b193531952 {{(pid=73391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 05:40:20 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-76c42c39-2d87-4d11-beb1-2cb3012fa41d tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Successfully detached device vdc from instance a1ba38e6-f0fe-408f-b1c8-f9b193531952 from the live domain config.
Aug 15 05:40:20 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76c42c39-2d87-4d11-beb1-2cb3012fa41d tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 05:40:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c42c39-2d87-4d11-beb1-2cb3012fa41d tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:47228624-5d4d-4374-8bae-ad9328138b0b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EsqKrCfW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:40:20 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-76c42c39-2d87-4d11-beb1-2cb3012fa41d tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:40:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-76c42c39-2d87-4d11-beb1-2cb3012fa41d tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:40:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-76c42c39-2d87-4d11-beb1-2cb3012fa41d tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:40:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c42c39-2d87-4d11-beb1-2cb3012fa41d tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47228624-5d4d-4374-8bae-ad9328138b0b', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 05:40:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:20 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cae454e-a9ff-418c-846b-819c1f5ddd0d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47228624-5d4d-4374-8bae-ad9328138b0b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:40:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:20 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6acc24a9-f3b7-40e3-a18e-4264eb89d6fb]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47228624-5d4d-4374-8bae-ad9328138b0b (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:40:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c42c39-2d87-4d11-beb1-2cb3012fa41d tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:40:20 user nova-compute[73391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)
Aug 15 05:40:20 user nova-compute[73391]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9 (non-flash)
Aug 15 05:40:20 user nova-compute[73391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)
Aug 15 05:40:20 user nova-compute[73391]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47228624-5d4d-4374-8bae-ad9328138b0b (non-flash)
Aug 15 05:40:20 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:40:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c42c39-2d87-4d11-beb1-2cb3012fa41d tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:40:20 user nova-compute[73391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)
Aug 15 05:40:20 user nova-compute[73391]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9 (non-flash)
Aug 15 05:40:20 user nova-compute[73391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)
Aug 15 05:40:20 user nova-compute[73391]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47228624-5d4d-4374-8bae-ad9328138b0b (non-flash)
Aug 15 05:40:20 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:40:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c42c39-2d87-4d11-beb1-2cb3012fa41d tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7728338dc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47228624-5d4d-4374-8bae-ad9328138b0b'): ({'sde'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 05:40:20 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-76c42c39-2d87-4d11-beb1-2cb3012fa41d tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Removing single pathed devices sde {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 05:40:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:20 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f00f880-83e5-4c88-ab84-6dbccdc072dd]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:40:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.032s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:20 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8ae5a59-307d-4bb2-89ba-4a5941a8e19d]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:40:20 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-76c42c39-2d87-4d11-beb1-2cb3012fa41d tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Flushing IO for device /dev/sde {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 05:40:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.026s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:21 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae819bc7-63ab-476a-8b4e-cdd8a544475b]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:40:21 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-76c42c39-2d87-4d11-beb1-2cb3012fa41d tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 05:40:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.057s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:21 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e87092b-81e3-490b-8475-6868fccff65a]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:40:21 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-76c42c39-2d87-4d11-beb1-2cb3012fa41d tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 05:40:21 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-76c42c39-2d87-4d11-beb1-2cb3012fa41d tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] SCSI volumes sde have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 05:40:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c42c39-2d87-4d11-beb1-2cb3012fa41d tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47228624-5d4d-4374-8bae-ad9328138b0b')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 05:40:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47228624-5d4d-4374-8bae-ad9328138b0b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47228624-5d4d-4374-8bae-ad9328138b0b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:21 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6bb77a-a8dc-45cf-a435-e1995bdf93c8]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:40:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c42c39-2d87-4d11-beb1-2cb3012fa41d tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:40:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47228624-5d4d-4374-8bae-ad9328138b0b -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47228624-5d4d-4374-8bae-ad9328138b0b -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:21 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd319547-e7fc-418f-824d-89130121452b]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:47228624-5d4d-4374-8bae-ad9328138b0b, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:47228624-5d4d-4374-8bae-ad9328138b0b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:40:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c42c39-2d87-4d11-beb1-2cb3012fa41d tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:47228624-5d4d-4374-8bae-ad9328138b0b, portal: 172.16.0.220,3260]
Aug 15 05:40:21 user nova-compute[73391]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:47228624-5d4d-4374-8bae-ad9328138b0b, portal: 172.16.0.220,3260] successful.
Aug 15 05:40:21 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:40:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47228624-5d4d-4374-8bae-ad9328138b0b -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47228624-5d4d-4374-8bae-ad9328138b0b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:21 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc88dd2-2369-475f-b65c-c9859e7d929f]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:40:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c42c39-2d87-4d11-beb1-2cb3012fa41d tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:40:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-76c42c39-2d87-4d11-beb1-2cb3012fa41d tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.450s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:40:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c42c39-2d87-4d11-beb1-2cb3012fa41d tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] <== disconnect_volume: return (453ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:40:21 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76c42c39-2d87-4d11-beb1-2cb3012fa41d tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 05:40:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:21 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:40:21 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:40:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:22 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:22 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:22 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:22 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:40:22 user nova-compute[73391]: DEBUG nova.objects.instance [None req-76c42c39-2d87-4d11-beb1-2cb3012fa41d tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Lazy-loading 'flavor' on Instance uuid a1ba38e6-f0fe-408f-b1c8-f9b193531952 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:40:22 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-76c42c39-2d87-4d11-beb1-2cb3012fa41d tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Lock "a1ba38e6-f0fe-408f-b1c8-f9b193531952" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.766s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:40:22 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:40:22 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:40:22 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Hypervisor/Node resource view: name=user free_ram=7245MB free_disk=25.125267028808594GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 05:40:22 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:40:22 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:40:23 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 8f08782b-f793-415e-b0d6-5caad1c3d426 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:40:23 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 6ac9d5dc-56be-402f-b9d4-3327bdfd9220 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:40:23 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 6358e825-5705-45d6-86b6-3aacfa5a9bbb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:40:23 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 3f88cd17-c89f-41f3-b630-8eb2c6698155 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:40:23 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance fee43642-30e8-451b-919c-aca4cd4c3f81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:40:23 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:40:23 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 730890c6-6999-4a0f-b80c-e4745bff99ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:40:23 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 8ff2da51-5bfd-4cdc-8cef-330cdef93d97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:40:23 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance a1ba38e6-f0fe-408f-b1c8-f9b193531952 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:40:23 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 8991b32e-6c4b-4c66-a320-e734061f49ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:40:23 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 8d344530-40f9-43f0-8417-15110c6c9748 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:40:23 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 05:40:23 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 05:40:23 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:23 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:40:23 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:40:23 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Compute_service record updated for user:user {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 05:40:23 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.733s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:40:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:25 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:40:25 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:40:25 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Starting heal instance info cache {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 05:40:25 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Rebuilding the list of instances to heal {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 05:40:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "refresh_cache-8f08782b-f793-415e-b0d6-5caad1c3d426" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:40:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquired lock "refresh_cache-8f08782b-f793-415e-b0d6-5caad1c3d426" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:40:25 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Forcefully refreshing network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 05:40:25 user nova-compute[73391]: DEBUG nova.objects.instance [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lazy-loading 'info_cache' on Instance uuid 8f08782b-f793-415e-b0d6-5caad1c3d426 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:40:26 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Updating instance_info_cache with network_info: [{"id": "13c5a27d-b6c3-424b-a876-068d047fad28", "address": "fa:16:3e:61:0b:53", "network": {"id": "70d88082-aea7-48bb-abb4-d77d264aaf01", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b9acbe11654053bb905e7c92558a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c5a27d-b6", "ovs_interfaceid": "13c5a27d-b6c3-424b-a876-068d047fad28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:40:26 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Releasing lock "refresh_cache-8f08782b-f793-415e-b0d6-5caad1c3d426" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:40:26 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Updated the network info_cache for instance {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 05:40:26 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:40:26 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:40:26 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:40:26 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 05:40:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Acquiring lock "76fcbfca-deca-44f0-9182-1f9bbab134d2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:40:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "76fcbfca-deca-44f0-9182-1f9bbab134d2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:40:28 user nova-compute[73391]: DEBUG nova.compute.manager [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Starting instance... {{(pid=73391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 05:40:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:40:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:40:28 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 05:40:28 user nova-compute[73391]: INFO nova.compute.claims [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Claim successful on node user
Aug 15 05:40:28 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:40:28 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:40:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.441s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:40:29 user nova-compute[73391]: DEBUG nova.compute.manager [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Start building networks asynchronously for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 05:40:29 user nova-compute[73391]: DEBUG nova.compute.manager [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Allocating IP information in the background. {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 05:40:29 user nova-compute[73391]: DEBUG nova.network.neutron [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] allocate_for_instance() {{(pid=73391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 05:40:29 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 05:40:29 user nova-compute[73391]: DEBUG nova.compute.manager [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Start building block device mappings for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 05:40:29 user nova-compute[73391]: DEBUG nova.policy [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9779dfb796934195b206b8e0adc81ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6fe94b9014479fbaff5131aefc8834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73391) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 05:40:29 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:29 user nova-compute[73391]: DEBUG nova.compute.manager [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Start spawning the instance on the hypervisor. {{(pid=73391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 05:40:29 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Creating instance directory {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 05:40:29 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Creating image(s)
Aug 15 05:40:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Acquiring lock "/opt/stack/data/nova/instances/76fcbfca-deca-44f0-9182-1f9bbab134d2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:40:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "/opt/stack/data/nova/instances/76fcbfca-deca-44f0-9182-1f9bbab134d2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:40:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "/opt/stack/data/nova/instances/76fcbfca-deca-44f0-9182-1f9bbab134d2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:40:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.185s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Acquiring lock "999b315ba87151d8252d543312ae7790e7e1583b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:40:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:40:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "c21e1783-ddc5-479f-8b8d-db5b13ca068a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:40:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "c21e1783-ddc5-479f-8b8d-db5b13ca068a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:40:29 user nova-compute[73391]: DEBUG nova.compute.manager [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Starting instance... {{(pid=73391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 05:40:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.183s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/76fcbfca-deca-44f0-9182-1f9bbab134d2/disk 1073741824 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/76fcbfca-deca-44f0-9182-1f9bbab134d2/disk 1073741824" returned: 0 in 0.060s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:40:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:40:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:40:29 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 05:40:29 user nova-compute[73391]: INFO nova.compute.claims [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Claim successful on node user
Aug 15 05:40:29 user nova-compute[73391]: DEBUG nova.network.neutron [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Successfully created port: ec5342ba-8cca-4111-9c53-245d0d8f6bb7 {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 05:40:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.191s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:29 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Checking if we can resize image /opt/stack/data/nova/instances/76fcbfca-deca-44f0-9182-1f9bbab134d2/disk. size=1073741824 {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 05:40:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76fcbfca-deca-44f0-9182-1f9bbab134d2/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76fcbfca-deca-44f0-9182-1f9bbab134d2/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:30 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Cannot resize image /opt/stack/data/nova/instances/76fcbfca-deca-44f0-9182-1f9bbab134d2/disk to a smaller size. {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 05:40:30 user nova-compute[73391]: DEBUG nova.objects.instance [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lazy-loading 'migration_context' on Instance uuid 76fcbfca-deca-44f0-9182-1f9bbab134d2 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:40:30 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Created local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 05:40:30 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Ensure instance console log exists: /opt/stack/data/nova/instances/76fcbfca-deca-44f0-9182-1f9bbab134d2/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 05:40:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:40:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:40:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:40:30 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:40:30 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:40:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.524s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:40:30 user nova-compute[73391]: DEBUG nova.compute.manager [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Start building networks asynchronously for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 05:40:30 user nova-compute[73391]: DEBUG nova.compute.manager [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Allocating IP information in the background. {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 05:40:30 user nova-compute[73391]: DEBUG nova.network.neutron [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] allocate_for_instance() {{(pid=73391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 05:40:30 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 05:40:30 user nova-compute[73391]: DEBUG nova.compute.manager [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Start building block device mappings for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 05:40:30 user nova-compute[73391]: INFO nova.virt.block_device [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Booting with volume snapshot 0080dbc8-eb2f-4400-b1fe-164b48132594 at /dev/vda
Aug 15 05:40:30 user nova-compute[73391]: DEBUG nova.policy [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aefb6ccab586465dbe56e71a40bcf1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8188c2e8ca34ef1982faa49f1058bb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73391) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 05:40:31 user nova-compute[73391]: DEBUG nova.network.neutron [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Successfully updated port: ec5342ba-8cca-4111-9c53-245d0d8f6bb7 {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:40:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Acquiring lock "refresh_cache-76fcbfca-deca-44f0-9182-1f9bbab134d2" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:40:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Acquired lock "refresh_cache-76fcbfca-deca-44f0-9182-1f9bbab134d2" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:40:31 user nova-compute[73391]: DEBUG nova.network.neutron [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:40:31 user nova-compute[73391]: DEBUG nova.compute.manager [req-a2616bd5-9433-4e3b-9d26-8eb797885f08 req-3c211661-3a75-479a-a426-77bf00e033bf service nova] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Received event network-changed-ec5342ba-8cca-4111-9c53-245d0d8f6bb7 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:40:31 user nova-compute[73391]: DEBUG nova.compute.manager [req-a2616bd5-9433-4e3b-9d26-8eb797885f08 req-3c211661-3a75-479a-a426-77bf00e033bf service nova] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Refreshing instance network info cache due to event network-changed-ec5342ba-8cca-4111-9c53-245d0d8f6bb7. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:40:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-a2616bd5-9433-4e3b-9d26-8eb797885f08 req-3c211661-3a75-479a-a426-77bf00e033bf service nova] Acquiring lock "refresh_cache-76fcbfca-deca-44f0-9182-1f9bbab134d2" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:40:31 user nova-compute[73391]: DEBUG nova.network.neutron [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:40:31 user nova-compute[73391]: DEBUG nova.network.neutron [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Successfully created port: 5e6f5f62-7fcc-4da7-870a-091a762592e1 {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 05:40:31 user nova-compute[73391]: DEBUG nova.network.neutron [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Updating instance_info_cache with network_info: [{"id": "ec5342ba-8cca-4111-9c53-245d0d8f6bb7", "address": "fa:16:3e:31:53:1e", "network": {"id": "6757637c-358e-4fa8-b3c1-376d7892c884", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-577771159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae6fe94b9014479fbaff5131aefc8834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec5342ba-8c", "ovs_interfaceid": "ec5342ba-8cca-4111-9c53-245d0d8f6bb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:40:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Releasing lock "refresh_cache-76fcbfca-deca-44f0-9182-1f9bbab134d2" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:40:31 user nova-compute[73391]: DEBUG nova.compute.manager [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Instance network_info: |[{"id": "ec5342ba-8cca-4111-9c53-245d0d8f6bb7", "address": "fa:16:3e:31:53:1e", "network": {"id": "6757637c-358e-4fa8-b3c1-376d7892c884", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-577771159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae6fe94b9014479fbaff5131aefc8834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec5342ba-8c", "ovs_interfaceid": "ec5342ba-8cca-4111-9c53-245d0d8f6bb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 05:40:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-a2616bd5-9433-4e3b-9d26-8eb797885f08 req-3c211661-3a75-479a-a426-77bf00e033bf service nova] Acquired lock "refresh_cache-76fcbfca-deca-44f0-9182-1f9bbab134d2" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:40:31 user nova-compute[73391]: DEBUG nova.network.neutron [req-a2616bd5-9433-4e3b-9d26-8eb797885f08 req-3c211661-3a75-479a-a426-77bf00e033bf service nova] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Refreshing network info cache for port ec5342ba-8cca-4111-9c53-245d0d8f6bb7 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:40:31 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Start _get_guest_xml network_info=[{"id": "ec5342ba-8cca-4111-9c53-245d0d8f6bb7", "address": "fa:16:3e:31:53:1e", "network": {"id": "6757637c-358e-4fa8-b3c1-376d7892c884", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-577771159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae6fe94b9014479fbaff5131aefc8834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec5342ba-8c", "ovs_interfaceid": "ec5342ba-8cca-4111-9c53-245d0d8f6bb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '191b1dad-305e-4d1c-9b15-515ec59a3278'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:40:31 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:40:31 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:40:31 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:40:31 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:40:31 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:40:31 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:40:31 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:40:31 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:40:31 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:40:31 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:40:31 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:40:31 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:40:31 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:40:31 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:40:31 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:40:31 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:40:31 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:40:31 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:40:31 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:40:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-371412398',display_name='tempest-VolumesSnapshotTestJSON-instance-371412398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-371412398',id=28,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBTIiNQVesWc5O+2cuHCIxUgiXxVWVO23/YuEGOmcgd2DcoTlKAIc87oZUBgw25fJ2xUKTJSAP9+7KW+ASINvzHz8Bzx9Jf2isXzRr2WLW3hkuTLCNLly0bUkh0fe0gtSA==',key_name='tempest-keypair-1699816707',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae6fe94b9014479fbaff5131aefc8834',ramdisk_id='',reservation_id='r-9a5xhfje',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1902565719',owner_user_name='tempest-VolumesSnapshotTestJSON-1902565719-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:40:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9779dfb796934195b206b8e0adc81ed3',uuid=76fcbfca-deca-44f0-9182-1f9bbab134d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec5342ba-8cca-4111-9c53-245d0d8f6bb7", "address": "fa:16:3e:31:53:1e", "network": {"id": "6757637c-358e-4fa8-b3c1-376d7892c884", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-577771159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae6fe94b9014479fbaff5131aefc8834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec5342ba-8c", "ovs_interfaceid": "ec5342ba-8cca-4111-9c53-245d0d8f6bb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:40:31 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Converting VIF {"id": "ec5342ba-8cca-4111-9c53-245d0d8f6bb7", "address": "fa:16:3e:31:53:1e", "network": {"id": "6757637c-358e-4fa8-b3c1-376d7892c884", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-577771159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae6fe94b9014479fbaff5131aefc8834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec5342ba-8c", "ovs_interfaceid": "ec5342ba-8cca-4111-9c53-245d0d8f6bb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:40:31 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:53:1e,bridge_name='br-int',has_traffic_filtering=True,id=ec5342ba-8cca-4111-9c53-245d0d8f6bb7,network=Network(6757637c-358e-4fa8-b3c1-376d7892c884),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec5342ba-8c') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:40:31 user nova-compute[73391]: DEBUG nova.objects.instance [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lazy-loading 'pci_devices' on Instance uuid 76fcbfca-deca-44f0-9182-1f9bbab134d2 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:40:31 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:40:31 user nova-compute[73391]:   <uuid>76fcbfca-deca-44f0-9182-1f9bbab134d2</uuid>
Aug 15 05:40:31 user nova-compute[73391]:   <name>instance-0000001c</name>
Aug 15 05:40:31 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:40:31 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:40:31 user nova-compute[73391]:   <metadata>
Aug 15 05:40:31 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:40:31 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:40:31 user nova-compute[73391]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-371412398</nova:name>
Aug 15 05:40:31 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:40:31</nova:creationTime>
Aug 15 05:40:31 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:40:31 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:40:31 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:40:31 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:40:31 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:40:31 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:40:31 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:40:31 user nova-compute[73391]:       <nova:owner>
Aug 15 05:40:31 user nova-compute[73391]:         <nova:user uuid="9779dfb796934195b206b8e0adc81ed3">tempest-VolumesSnapshotTestJSON-1902565719-project-member</nova:user>
Aug 15 05:40:31 user nova-compute[73391]:         <nova:project uuid="ae6fe94b9014479fbaff5131aefc8834">tempest-VolumesSnapshotTestJSON-1902565719</nova:project>
Aug 15 05:40:31 user nova-compute[73391]:       </nova:owner>
Aug 15 05:40:31 user nova-compute[73391]:       <nova:root type="image" uuid="191b1dad-305e-4d1c-9b15-515ec59a3278"/>
Aug 15 05:40:31 user nova-compute[73391]:       <nova:ports>
Aug 15 05:40:31 user nova-compute[73391]:         <nova:port uuid="ec5342ba-8cca-4111-9c53-245d0d8f6bb7">
Aug 15 05:40:31 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 05:40:31 user nova-compute[73391]:         </nova:port>
Aug 15 05:40:31 user nova-compute[73391]:       </nova:ports>
Aug 15 05:40:31 user nova-compute[73391]:     </nova:instance>
Aug 15 05:40:31 user nova-compute[73391]:   </metadata>
Aug 15 05:40:31 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:40:31 user nova-compute[73391]:     <system>
Aug 15 05:40:31 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:40:31 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:40:31 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:40:31 user nova-compute[73391]:       <entry name="serial">76fcbfca-deca-44f0-9182-1f9bbab134d2</entry>
Aug 15 05:40:31 user nova-compute[73391]:       <entry name="uuid">76fcbfca-deca-44f0-9182-1f9bbab134d2</entry>
Aug 15 05:40:31 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:40:31 user nova-compute[73391]:     </system>
Aug 15 05:40:31 user nova-compute[73391]:   </sysinfo>
Aug 15 05:40:31 user nova-compute[73391]:   <os>
Aug 15 05:40:31 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:40:31 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:40:31 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:40:31 user nova-compute[73391]:   </os>
Aug 15 05:40:31 user nova-compute[73391]:   <features>
Aug 15 05:40:31 user nova-compute[73391]:     <acpi/>
Aug 15 05:40:31 user nova-compute[73391]:     <apic/>
Aug 15 05:40:31 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:40:31 user nova-compute[73391]:   </features>
Aug 15 05:40:31 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:40:31 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:40:31 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:40:31 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:40:31 user nova-compute[73391]:   </clock>
Aug 15 05:40:31 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:40:31 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:40:31 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:40:31 user nova-compute[73391]:   </cpu>
Aug 15 05:40:31 user nova-compute[73391]:   <devices>
Aug 15 05:40:31 user nova-compute[73391]:     <disk type="file" device="disk">
Aug 15 05:40:31 user nova-compute[73391]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 05:40:31 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/76fcbfca-deca-44f0-9182-1f9bbab134d2/disk"/>
Aug 15 05:40:31 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:40:31 user nova-compute[73391]:     </disk>
Aug 15 05:40:31 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:40:31 user nova-compute[73391]:       <mac address="fa:16:3e:31:53:1e"/>
Aug 15 05:40:31 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:40:31 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:40:31 user nova-compute[73391]:       <target dev="tapec5342ba-8c"/>
Aug 15 05:40:31 user nova-compute[73391]:     </interface>
Aug 15 05:40:31 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:40:31 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/76fcbfca-deca-44f0-9182-1f9bbab134d2/console.log" append="off"/>
Aug 15 05:40:31 user nova-compute[73391]:     </serial>
Aug 15 05:40:31 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:40:31 user nova-compute[73391]:     <video>
Aug 15 05:40:31 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:40:31 user nova-compute[73391]:     </video>
Aug 15 05:40:31 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:40:31 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:40:31 user nova-compute[73391]:     </rng>
Aug 15 05:40:31 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:40:31 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:40:31 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:40:31 user nova-compute[73391]:     </memballoon>
Aug 15 05:40:31 user nova-compute[73391]:   </devices>
Aug 15 05:40:31 user nova-compute[73391]: </domain>
Aug 15 05:40:31 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:40:31 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:40:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-371412398',display_name='tempest-VolumesSnapshotTestJSON-instance-371412398',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-371412398',id=28,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBTIiNQVesWc5O+2cuHCIxUgiXxVWVO23/YuEGOmcgd2DcoTlKAIc87oZUBgw25fJ2xUKTJSAP9+7KW+ASINvzHz8Bzx9Jf2isXzRr2WLW3hkuTLCNLly0bUkh0fe0gtSA==',key_name='tempest-keypair-1699816707',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae6fe94b9014479fbaff5131aefc8834',ramdisk_id='',reservation_id='r-9a5xhfje',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1902565719',owner_user_name='tempest-VolumesSnapshotTestJSON-1902565719-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:40:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9779dfb796934195b206b8e0adc81ed3',uuid=76fcbfca-deca-44f0-9182-1f9bbab134d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec5342ba-8cca-4111-9c53-245d0d8f6bb7", "address": "fa:16:3e:31:53:1e", "network": {"id": "6757637c-358e-4fa8-b3c1-376d7892c884", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-577771159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae6fe94b9014479fbaff5131aefc8834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec5342ba-8c", "ovs_interfaceid": "ec5342ba-8cca-4111-9c53-245d0d8f6bb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:40:31 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Converting VIF {"id": "ec5342ba-8cca-4111-9c53-245d0d8f6bb7", "address": "fa:16:3e:31:53:1e", "network": {"id": "6757637c-358e-4fa8-b3c1-376d7892c884", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-577771159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae6fe94b9014479fbaff5131aefc8834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec5342ba-8c", "ovs_interfaceid": "ec5342ba-8cca-4111-9c53-245d0d8f6bb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:40:31 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:31:53:1e,bridge_name='br-int',has_traffic_filtering=True,id=ec5342ba-8cca-4111-9c53-245d0d8f6bb7,network=Network(6757637c-358e-4fa8-b3c1-376d7892c884),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec5342ba-8c') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:40:31 user nova-compute[73391]: DEBUG os_vif [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:53:1e,bridge_name='br-int',has_traffic_filtering=True,id=ec5342ba-8cca-4111-9c53-245d0d8f6bb7,network=Network(6757637c-358e-4fa8-b3c1-376d7892c884),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec5342ba-8c') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:40:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:40:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:40:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec5342ba-8c, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:40:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapec5342ba-8c, col_values=(('external_ids', {'iface-id': 'ec5342ba-8cca-4111-9c53-245d0d8f6bb7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:31:53:1e', 'vm-uuid': '76fcbfca-deca-44f0-9182-1f9bbab134d2'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:40:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:40:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:31 user nova-compute[73391]: INFO os_vif [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:31:53:1e,bridge_name='br-int',has_traffic_filtering=True,id=ec5342ba-8cca-4111-9c53-245d0d8f6bb7,network=Network(6757637c-358e-4fa8-b3c1-376d7892c884),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec5342ba-8c')
Aug 15 05:40:31 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:40:31 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] No VIF found with MAC fa:16:3e:31:53:1e, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:40:32 user nova-compute[73391]: DEBUG nova.network.neutron [req-a2616bd5-9433-4e3b-9d26-8eb797885f08 req-3c211661-3a75-479a-a426-77bf00e033bf service nova] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Updated VIF entry in instance network info cache for port ec5342ba-8cca-4111-9c53-245d0d8f6bb7. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:40:32 user nova-compute[73391]: DEBUG nova.network.neutron [req-a2616bd5-9433-4e3b-9d26-8eb797885f08 req-3c211661-3a75-479a-a426-77bf00e033bf service nova] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Updating instance_info_cache with network_info: [{"id": "ec5342ba-8cca-4111-9c53-245d0d8f6bb7", "address": "fa:16:3e:31:53:1e", "network": {"id": "6757637c-358e-4fa8-b3c1-376d7892c884", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-577771159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae6fe94b9014479fbaff5131aefc8834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec5342ba-8c", "ovs_interfaceid": "ec5342ba-8cca-4111-9c53-245d0d8f6bb7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:40:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-a2616bd5-9433-4e3b-9d26-8eb797885f08 req-3c211661-3a75-479a-a426-77bf00e033bf service nova] Releasing lock "refresh_cache-76fcbfca-deca-44f0-9182-1f9bbab134d2" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:40:32 user nova-compute[73391]: DEBUG nova.network.neutron [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Successfully updated port: 5e6f5f62-7fcc-4da7-870a-091a762592e1 {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:40:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "refresh_cache-c21e1783-ddc5-479f-8b8d-db5b13ca068a" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:40:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquired lock "refresh_cache-c21e1783-ddc5-479f-8b8d-db5b13ca068a" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:40:32 user nova-compute[73391]: DEBUG nova.network.neutron [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:40:32 user nova-compute[73391]: DEBUG nova.network.neutron [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:40:33 user nova-compute[73391]: DEBUG nova.network.neutron [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Updating instance_info_cache with network_info: [{"id": "5e6f5f62-7fcc-4da7-870a-091a762592e1", "address": "fa:16:3e:44:b8:df", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e6f5f62-7f", "ovs_interfaceid": "5e6f5f62-7fcc-4da7-870a-091a762592e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:40:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Releasing lock "refresh_cache-c21e1783-ddc5-479f-8b8d-db5b13ca068a" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:40:33 user nova-compute[73391]: DEBUG nova.compute.manager [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Instance network_info: |[{"id": "5e6f5f62-7fcc-4da7-870a-091a762592e1", "address": "fa:16:3e:44:b8:df", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e6f5f62-7f", "ovs_interfaceid": "5e6f5f62-7fcc-4da7-870a-091a762592e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 05:40:33 user nova-compute[73391]: DEBUG nova.compute.manager [req-5af63ec3-dec0-4d83-a4c4-fb6032f7beae req-5c55da11-e392-4ed0-95c3-543301f66662 service nova] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Received event network-changed-5e6f5f62-7fcc-4da7-870a-091a762592e1 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:40:33 user nova-compute[73391]: DEBUG nova.compute.manager [req-5af63ec3-dec0-4d83-a4c4-fb6032f7beae req-5c55da11-e392-4ed0-95c3-543301f66662 service nova] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Refreshing instance network info cache due to event network-changed-5e6f5f62-7fcc-4da7-870a-091a762592e1. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:40:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-5af63ec3-dec0-4d83-a4c4-fb6032f7beae req-5c55da11-e392-4ed0-95c3-543301f66662 service nova] Acquiring lock "refresh_cache-c21e1783-ddc5-479f-8b8d-db5b13ca068a" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:40:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-5af63ec3-dec0-4d83-a4c4-fb6032f7beae req-5c55da11-e392-4ed0-95c3-543301f66662 service nova] Acquired lock "refresh_cache-c21e1783-ddc5-479f-8b8d-db5b13ca068a" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:40:33 user nova-compute[73391]: DEBUG nova.network.neutron [req-5af63ec3-dec0-4d83-a4c4-fb6032f7beae req-5c55da11-e392-4ed0-95c3-543301f66662 service nova] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Refreshing network info cache for port 5e6f5f62-7fcc-4da7-870a-091a762592e1 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:40:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:33 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:40:33 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73391) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 05:40:33 user nova-compute[73391]: DEBUG nova.compute.manager [req-7bf074de-2db7-47cb-8c95-9490a927bf92 req-428def0e-11a5-4a3b-bcab-e50849c567d0 service nova] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Received event network-vif-plugged-ec5342ba-8cca-4111-9c53-245d0d8f6bb7 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:40:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-7bf074de-2db7-47cb-8c95-9490a927bf92 req-428def0e-11a5-4a3b-bcab-e50849c567d0 service nova] Acquiring lock "76fcbfca-deca-44f0-9182-1f9bbab134d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:40:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-7bf074de-2db7-47cb-8c95-9490a927bf92 req-428def0e-11a5-4a3b-bcab-e50849c567d0 service nova] Lock "76fcbfca-deca-44f0-9182-1f9bbab134d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:40:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-7bf074de-2db7-47cb-8c95-9490a927bf92 req-428def0e-11a5-4a3b-bcab-e50849c567d0 service nova] Lock "76fcbfca-deca-44f0-9182-1f9bbab134d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:40:33 user nova-compute[73391]: DEBUG nova.compute.manager [req-7bf074de-2db7-47cb-8c95-9490a927bf92 req-428def0e-11a5-4a3b-bcab-e50849c567d0 service nova] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] No waiting events found dispatching network-vif-plugged-ec5342ba-8cca-4111-9c53-245d0d8f6bb7 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:40:33 user nova-compute[73391]: WARNING nova.compute.manager [req-7bf074de-2db7-47cb-8c95-9490a927bf92 req-428def0e-11a5-4a3b-bcab-e50849c567d0 service nova] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Received unexpected event network-vif-plugged-ec5342ba-8cca-4111-9c53-245d0d8f6bb7 for instance with vm_state building and task_state spawning.
Aug 15 05:40:33 user nova-compute[73391]: DEBUG nova.network.neutron [req-5af63ec3-dec0-4d83-a4c4-fb6032f7beae req-5c55da11-e392-4ed0-95c3-543301f66662 service nova] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Updated VIF entry in instance network info cache for port 5e6f5f62-7fcc-4da7-870a-091a762592e1. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:40:33 user nova-compute[73391]: DEBUG nova.network.neutron [req-5af63ec3-dec0-4d83-a4c4-fb6032f7beae req-5c55da11-e392-4ed0-95c3-543301f66662 service nova] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Updating instance_info_cache with network_info: [{"id": "5e6f5f62-7fcc-4da7-870a-091a762592e1", "address": "fa:16:3e:44:b8:df", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e6f5f62-7f", "ovs_interfaceid": "5e6f5f62-7fcc-4da7-870a-091a762592e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:40:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-5af63ec3-dec0-4d83-a4c4-fb6032f7beae req-5c55da11-e392-4ed0-95c3-543301f66662 service nova] Releasing lock "refresh_cache-c21e1783-ddc5-479f-8b8d-db5b13ca068a" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:40:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:35 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078035.4937944, 76fcbfca-deca-44f0-9182-1f9bbab134d2 => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:40:35 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] VM Resumed (Lifecycle Event)
Aug 15 05:40:35 user nova-compute[73391]: DEBUG nova.compute.manager [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:40:35 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Guest created on hypervisor {{(pid=73391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 05:40:35 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Instance spawned successfully.
Aug 15 05:40:35 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 05:40:35 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:40:35 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:40:35 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Found default for hw_cdrom_bus of ide {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:40:35 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Found default for hw_disk_bus of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:40:35 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Found default for hw_input_bus of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:40:35 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Found default for hw_pointer_model of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:40:35 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Found default for hw_video_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:40:35 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Found default for hw_vif_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:40:35 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:40:35 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078035.4951189, 76fcbfca-deca-44f0-9182-1f9bbab134d2 => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:40:35 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] VM Started (Lifecycle Event)
Aug 15 05:40:35 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:40:35 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:40:35 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:40:35 user nova-compute[73391]: INFO nova.compute.manager [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Took 6.30 seconds to spawn the instance on the hypervisor.
Aug 15 05:40:35 user nova-compute[73391]: DEBUG nova.compute.manager [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:40:35 user nova-compute[73391]: INFO nova.compute.manager [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Took 7.14 seconds to build instance.
Aug 15 05:40:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-40662a5c-1dfd-4e1d-9ccf-08586d129abb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "76fcbfca-deca-44f0-9182-1f9bbab134d2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.241s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:40:35 user nova-compute[73391]: DEBUG nova.compute.manager [req-a4a741ed-0d79-4830-8f18-7fd6d9b9c5c9 req-7bfae45c-c10e-4af7-8694-91ead8ae5ab9 service nova] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Received event network-vif-plugged-ec5342ba-8cca-4111-9c53-245d0d8f6bb7 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:40:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-a4a741ed-0d79-4830-8f18-7fd6d9b9c5c9 req-7bfae45c-c10e-4af7-8694-91ead8ae5ab9 service nova] Acquiring lock "76fcbfca-deca-44f0-9182-1f9bbab134d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:40:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-a4a741ed-0d79-4830-8f18-7fd6d9b9c5c9 req-7bfae45c-c10e-4af7-8694-91ead8ae5ab9 service nova] Lock "76fcbfca-deca-44f0-9182-1f9bbab134d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:40:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-a4a741ed-0d79-4830-8f18-7fd6d9b9c5c9 req-7bfae45c-c10e-4af7-8694-91ead8ae5ab9 service nova] Lock "76fcbfca-deca-44f0-9182-1f9bbab134d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:40:35 user nova-compute[73391]: DEBUG nova.compute.manager [req-a4a741ed-0d79-4830-8f18-7fd6d9b9c5c9 req-7bfae45c-c10e-4af7-8694-91ead8ae5ab9 service nova] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] No waiting events found dispatching network-vif-plugged-ec5342ba-8cca-4111-9c53-245d0d8f6bb7 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:40:35 user nova-compute[73391]: WARNING nova.compute.manager [req-a4a741ed-0d79-4830-8f18-7fd6d9b9c5c9 req-7bfae45c-c10e-4af7-8694-91ead8ae5ab9 service nova] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Received unexpected event network-vif-plugged-ec5342ba-8cca-4111-9c53-245d0d8f6bb7 for instance with vm_state active and task_state None.
Aug 15 05:40:36 user nova-compute[73391]: DEBUG os_brick.utils [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:40:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:36 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab23a6d6-f8b7-46a3-884c-0ad79d100f9d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:40:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:36 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba242c3-abd7-49c1-ae4a-fc5e4e3b9ce9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:40:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:36 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3acf7d7-8dfb-4880-8d13-8661949eb157]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:40:36 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48fd9fa-3575-4a62-ae6c-ce0883958829]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:40:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:40:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 05:40:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:40:36 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 05:40:36 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d16b79b-0a43-4839-a522-21889fb7f052]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:40:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 05:40:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 05:40:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 05:40:36 user nova-compute[73391]: DEBUG os_brick.utils [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:40:36 user nova-compute[73391]: DEBUG nova.virt.block_device [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Updating existing volume attachment record: 36956da6-33b5-4535-8258-3eae74a1d952 {{(pid=73391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 05:40:36 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquiring lock "d60616bb-605e-4604-b637-56670f53159e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:40:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "d60616bb-605e-4604-b637-56670f53159e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:40:39 user nova-compute[73391]: DEBUG nova.compute.manager [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] Starting instance... {{(pid=73391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 05:40:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:40:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:40:40 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 05:40:40 user nova-compute[73391]: INFO nova.compute.claims [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] Claim successful on node user
Aug 15 05:40:40 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:40:40 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:40:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.587s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:40:40 user nova-compute[73391]: DEBUG nova.compute.manager [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] Start building networks asynchronously for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 05:40:41 user nova-compute[73391]: DEBUG nova.compute.manager [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] Allocating IP information in the background. {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 05:40:41 user nova-compute[73391]: DEBUG nova.network.neutron [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] allocate_for_instance() {{(pid=73391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 05:40:41 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 05:40:41 user nova-compute[73391]: DEBUG nova.compute.manager [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] Start building block device mappings for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 05:40:41 user nova-compute[73391]: INFO nova.virt.block_device [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] Booting with volume-backed-image 191b1dad-305e-4d1c-9b15-515ec59a3278 at /dev/vda
Aug 15 05:40:41 user nova-compute[73391]: DEBUG nova.policy [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '887f0846cf554e12acf92a663f5ab266', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '83b9acbe11654053bb905e7c92558a35', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73391) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 05:40:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:42 user nova-compute[73391]: DEBUG nova.network.neutron [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] Successfully created port: c8787a16-cd6d-410e-8d37-425bdad344d6 {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 05:40:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Acquiring lock "ab02c376-1432-4981-9179-aeef6e647ea4" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:40:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "ab02c376-1432-4981-9179-aeef6e647ea4" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:40:43 user nova-compute[73391]: INFO nova.compute.manager [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Unshelving
Aug 15 05:40:43 user nova-compute[73391]: DEBUG nova.network.neutron [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] Successfully updated port: c8787a16-cd6d-410e-8d37-425bdad344d6 {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:40:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquiring lock "refresh_cache-d60616bb-605e-4604-b637-56670f53159e" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:40:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquired lock "refresh_cache-d60616bb-605e-4604-b637-56670f53159e" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:40:43 user nova-compute[73391]: DEBUG nova.network.neutron [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:40:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:40:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:40:43 user nova-compute[73391]: DEBUG nova.objects.instance [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lazy-loading 'pci_requests' on Instance uuid ab02c376-1432-4981-9179-aeef6e647ea4 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:40:43 user nova-compute[73391]: DEBUG nova.compute.manager [req-1bbe6902-fef1-4749-83d6-0bee3d6c2542 req-4501e9d4-f9fd-46a2-8f6a-0a4ce5d70671 service nova] [instance: d60616bb-605e-4604-b637-56670f53159e] Received event network-changed-c8787a16-cd6d-410e-8d37-425bdad344d6 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:40:43 user nova-compute[73391]: DEBUG nova.compute.manager [req-1bbe6902-fef1-4749-83d6-0bee3d6c2542 req-4501e9d4-f9fd-46a2-8f6a-0a4ce5d70671 service nova] [instance: d60616bb-605e-4604-b637-56670f53159e] Refreshing instance network info cache due to event network-changed-c8787a16-cd6d-410e-8d37-425bdad344d6. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:40:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-1bbe6902-fef1-4749-83d6-0bee3d6c2542 req-4501e9d4-f9fd-46a2-8f6a-0a4ce5d70671 service nova] Acquiring lock "refresh_cache-d60616bb-605e-4604-b637-56670f53159e" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:40:43 user nova-compute[73391]: DEBUG nova.objects.instance [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lazy-loading 'numa_topology' on Instance uuid ab02c376-1432-4981-9179-aeef6e647ea4 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:40:43 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 05:40:43 user nova-compute[73391]: INFO nova.compute.claims [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Claim successful on node user
Aug 15 05:40:43 user nova-compute[73391]: DEBUG nova.network.neutron [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:40:43 user nova-compute[73391]: DEBUG nova.network.neutron [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] Updating instance_info_cache with network_info: [{"id": "c8787a16-cd6d-410e-8d37-425bdad344d6", "address": "fa:16:3e:f9:58:41", "network": {"id": "70d88082-aea7-48bb-abb4-d77d264aaf01", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b9acbe11654053bb905e7c92558a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8787a16-cd", "ovs_interfaceid": "c8787a16-cd6d-410e-8d37-425bdad344d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:40:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Releasing lock "refresh_cache-d60616bb-605e-4604-b637-56670f53159e" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:40:43 user nova-compute[73391]: DEBUG nova.compute.manager [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] Instance network_info: |[{"id": "c8787a16-cd6d-410e-8d37-425bdad344d6", "address": "fa:16:3e:f9:58:41", "network": {"id": "70d88082-aea7-48bb-abb4-d77d264aaf01", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b9acbe11654053bb905e7c92558a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8787a16-cd", "ovs_interfaceid": "c8787a16-cd6d-410e-8d37-425bdad344d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 05:40:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-1bbe6902-fef1-4749-83d6-0bee3d6c2542 req-4501e9d4-f9fd-46a2-8f6a-0a4ce5d70671 service nova] Acquired lock "refresh_cache-d60616bb-605e-4604-b637-56670f53159e" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:40:43 user nova-compute[73391]: DEBUG nova.network.neutron [req-1bbe6902-fef1-4749-83d6-0bee3d6c2542 req-4501e9d4-f9fd-46a2-8f6a-0a4ce5d70671 service nova] [instance: d60616bb-605e-4604-b637-56670f53159e] Refreshing network info cache for port c8787a16-cd6d-410e-8d37-425bdad344d6 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:40:43 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:40:43 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:40:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.676s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:40:44 user nova-compute[73391]: INFO nova.network.neutron [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Updating port c1931f1c-7ef8-41c7-82f7-7ace92bb6439 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Aug 15 05:40:44 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:44 user nova-compute[73391]: DEBUG nova.network.neutron [req-1bbe6902-fef1-4749-83d6-0bee3d6c2542 req-4501e9d4-f9fd-46a2-8f6a-0a4ce5d70671 service nova] [instance: d60616bb-605e-4604-b637-56670f53159e] Updated VIF entry in instance network info cache for port c8787a16-cd6d-410e-8d37-425bdad344d6. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:40:44 user nova-compute[73391]: DEBUG nova.network.neutron [req-1bbe6902-fef1-4749-83d6-0bee3d6c2542 req-4501e9d4-f9fd-46a2-8f6a-0a4ce5d70671 service nova] [instance: d60616bb-605e-4604-b637-56670f53159e] Updating instance_info_cache with network_info: [{"id": "c8787a16-cd6d-410e-8d37-425bdad344d6", "address": "fa:16:3e:f9:58:41", "network": {"id": "70d88082-aea7-48bb-abb4-d77d264aaf01", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b9acbe11654053bb905e7c92558a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8787a16-cd", "ovs_interfaceid": "c8787a16-cd6d-410e-8d37-425bdad344d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:40:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-1bbe6902-fef1-4749-83d6-0bee3d6c2542 req-4501e9d4-f9fd-46a2-8f6a-0a4ce5d70671 service nova] Releasing lock "refresh_cache-d60616bb-605e-4604-b637-56670f53159e" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:40:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Acquiring lock "refresh_cache-ab02c376-1432-4981-9179-aeef6e647ea4" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:40:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Acquired lock "refresh_cache-ab02c376-1432-4981-9179-aeef6e647ea4" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:40:45 user nova-compute[73391]: DEBUG nova.network.neutron [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:40:45 user nova-compute[73391]: DEBUG nova.compute.manager [req-0fcbad25-9451-4fb5-bb24-7527e4027015 req-7b495804-47f4-404a-ad79-7255b41ef92a service nova] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Received event network-changed-c1931f1c-7ef8-41c7-82f7-7ace92bb6439 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:40:45 user nova-compute[73391]: DEBUG nova.compute.manager [req-0fcbad25-9451-4fb5-bb24-7527e4027015 req-7b495804-47f4-404a-ad79-7255b41ef92a service nova] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Refreshing instance network info cache due to event network-changed-c1931f1c-7ef8-41c7-82f7-7ace92bb6439. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:40:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-0fcbad25-9451-4fb5-bb24-7527e4027015 req-7b495804-47f4-404a-ad79-7255b41ef92a service nova] Acquiring lock "refresh_cache-ab02c376-1432-4981-9179-aeef6e647ea4" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:40:45 user nova-compute[73391]: DEBUG nova.network.neutron [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Updating instance_info_cache with network_info: [{"id": "c1931f1c-7ef8-41c7-82f7-7ace92bb6439", "address": "fa:16:3e:67:d1:b1", "network": {"id": "f67152a9-4f18-4d7f-9d3e-5e517bd46813", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-731866550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88871d09f7e347a4b9104a558604f2f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1931f1c-7e", "ovs_interfaceid": "c1931f1c-7ef8-41c7-82f7-7ace92bb6439", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:40:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Releasing lock "refresh_cache-ab02c376-1432-4981-9179-aeef6e647ea4" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:40:45 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Creating instance directory {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 05:40:45 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Creating image(s)
Aug 15 05:40:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Acquiring lock "/opt/stack/data/nova/instances/ab02c376-1432-4981-9179-aeef6e647ea4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:40:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "/opt/stack/data/nova/instances/ab02c376-1432-4981-9179-aeef6e647ea4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:40:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "/opt/stack/data/nova/instances/ab02c376-1432-4981-9179-aeef6e647ea4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:40:45 user nova-compute[73391]: DEBUG nova.objects.instance [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lazy-loading 'trusted_certs' on Instance uuid ab02c376-1432-4981-9179-aeef6e647ea4 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:40:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-0fcbad25-9451-4fb5-bb24-7527e4027015 req-7b495804-47f4-404a-ad79-7255b41ef92a service nova] Acquired lock "refresh_cache-ab02c376-1432-4981-9179-aeef6e647ea4" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:40:45 user nova-compute[73391]: DEBUG nova.network.neutron [req-0fcbad25-9451-4fb5-bb24-7527e4027015 req-7b495804-47f4-404a-ad79-7255b41ef92a service nova] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Refreshing network info cache for port c1931f1c-7ef8-41c7-82f7-7ace92bb6439 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:40:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Acquiring lock "2c7bea368f90175e09c0878c02431be4aa32d584" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:40:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "2c7bea368f90175e09c0878c02431be4aa32d584" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:40:46 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c7bea368f90175e09c0878c02431be4aa32d584.part --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:46 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c7bea368f90175e09c0878c02431be4aa32d584.part --force-share --output=json" returned: 0 in 0.190s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:46 user nova-compute[73391]: DEBUG nova.virt.images [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] 1e2f2725-811f-4da5-bf97-18bc774e5360 was qcow2, converting to raw {{(pid=73391) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 05:40:46 user nova-compute[73391]: DEBUG nova.privsep.utils [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73391) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 05:40:46 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2c7bea368f90175e09c0878c02431be4aa32d584.part /opt/stack/data/nova/instances/_base/2c7bea368f90175e09c0878c02431be4aa32d584.converted {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:46 user nova-compute[73391]: DEBUG nova.compute.manager [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Start spawning the instance on the hypervisor. {{(pid=73391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 05:40:46 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Creating instance directory {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 05:40:46 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Creating image(s)
Aug 15 05:40:46 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Did not create local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 05:40:46 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Ensure instance console log exists: /opt/stack/data/nova/instances/c21e1783-ddc5-479f-8b8d-db5b13ca068a/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 05:40:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:40:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:40:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:40:46 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Start _get_guest_xml network_info=[{"id": "5e6f5f62-7fcc-4da7-870a-091a762592e1", "address": "fa:16:3e:44:b8:df", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e6f5f62-7f", "ovs_interfaceid": "5e6f5f62-7fcc-4da7-870a-091a762592e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jpvBdxYu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c21e1783-ddc5-479f-8b8d-db5b13ca068a', 'attached_at': '', 'detached_at': '', 'volume_id': 'd1ced146-3460-4915-8be4-08cf705dfc48', 'serial': 'd1ced146-3460-4915-8be4-08cf705dfc48'}, 'attachment_id': '36956da6-33b5-4535-8258-3eae74a1d952', 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'volume_type': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:40:46 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:40:46 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:40:46 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:40:46 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:40:46 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:40:46 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:40:46 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:40:46 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:40:46 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:40:46 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:40:46 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:40:46 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:40:46 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:40:46 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:40:46 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:40:46 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:40:46 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:40:46 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jpvBdxYu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:40:47 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:40:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:40:47 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:40:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.053s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:40:47 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 05:40:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48 -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b8e33d-96f0-44a9-81ef-03615ab0a470]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 05:40:47 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48 -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.048s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed9bb4d-f685-4896-9ca6-e44c3005d7bc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48] added
Aug 15 05:40:47 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[35261e93-29e6-427a-8eef-bdf60453de2d]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[be710ad2-2f46-4b83-8f06-37971764a718]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jpvBdxYu {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG nova.network.neutron [req-0fcbad25-9451-4fb5-bb24-7527e4027015 req-7b495804-47f4-404a-ad79-7255b41ef92a service nova] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Updated VIF entry in instance network info cache for port c1931f1c-7ef8-41c7-82f7-7ace92bb6439. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG nova.network.neutron [req-0fcbad25-9451-4fb5-bb24-7527e4027015 req-7b495804-47f4-404a-ad79-7255b41ef92a service nova] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Updating instance_info_cache with network_info: [{"id": "c1931f1c-7ef8-41c7-82f7-7ace92bb6439", "address": "fa:16:3e:67:d1:b1", "network": {"id": "f67152a9-4f18-4d7f-9d3e-5e517bd46813", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-731866550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88871d09f7e347a4b9104a558604f2f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1931f1c-7e", "ovs_interfaceid": "c1931f1c-7ef8-41c7-82f7-7ace92bb6439", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jpvBdxYu" returned: 0 in 0.095s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b73ee4b-a9a9-41c9-9e35-a7c9a914653c]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jpvBdxYu'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-0fcbad25-9451-4fb5-bb24-7527e4027015 req-7b495804-47f4-404a-ad79-7255b41ef92a service nova] Releasing lock "refresh_cache-ab02c376-1432-4981-9179-aeef6e647ea4" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.091s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[006bd916-a0bd-4ee1-a6a8-e2314e8461eb]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9371567b-0e26-40ec-98aa-cd5ba4642d9e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:40:47 user nova-compute[73391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)
Aug 15 05:40:47 user nova-compute[73391]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9 (non-flash)
Aug 15 05:40:47 user nova-compute[73391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)
Aug 15 05:40:47 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:40:47 user nova-compute[73391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)
Aug 15 05:40:47 user nova-compute[73391]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9 (non-flash)
Aug 15 05:40:47 user nova-compute[73391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)
Aug 15 05:40:47 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48 -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2c7bea368f90175e09c0878c02431be4aa32d584.part /opt/stack/data/nova/instances/_base/2c7bea368f90175e09c0878c02431be4aa32d584.converted" returned: 0 in 0.659s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c7bea368f90175e09c0878c02431be4aa32d584.converted --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdbe41fe-68a8-46f5-82d4-3c18ffb2da63]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48, portal: 172.16.0.220,3260]
Aug 15 05:40:47 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48, portal: 172.16.0.220,3260] successful.
Aug 15 05:40:47 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[64fa94f0-58fe-4fed-bbb6-3e7f5dcd2da9]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc4f8a5-6a31-428e-8767-73d7d340a8c5]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:40:47 user nova-compute[73391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)
Aug 15 05:40:47 user nova-compute[73391]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9 (non-flash)
Aug 15 05:40:47 user nova-compute[73391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)
Aug 15 05:40:47 user nova-compute[73391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48 (non-flash)
Aug 15 05:40:47 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:40:47 user nova-compute[73391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)
Aug 15 05:40:47 user nova-compute[73391]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9 (non-flash)
Aug 15 05:40:47 user nova-compute[73391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)
Aug 15 05:40:47 user nova-compute[73391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48 (non-flash)
Aug 15 05:40:47 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.586s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] HCTL ('36', '-', '-', 0) found on session 34 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65739e1-4b01-4ea7-9757-45b2df997c3f]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: None {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c7bea368f90175e09c0878c02431be4aa32d584.converted --force-share --output=json" returned: 0 in 0.189s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "2c7bea368f90175e09c0878c02431be4aa32d584" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.131s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c7bea368f90175e09c0878c02431be4aa32d584 --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c7bea368f90175e09c0878c02431be4aa32d584 --force-share --output=json" returned: 0 in 0.188s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Acquiring lock "2c7bea368f90175e09c0878c02431be4aa32d584" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "2c7bea368f90175e09c0878c02431be4aa32d584" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:40:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c7bea368f90175e09c0878c02431be4aa32d584 --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c7bea368f90175e09c0878c02431be4aa32d584 --force-share --output=json" returned: 0 in 0.176s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c7bea368f90175e09c0878c02431be4aa32d584,backing_fmt=raw /opt/stack/data/nova/instances/ab02c376-1432-4981-9179-aeef6e647ea4/disk 1073741824 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2c7bea368f90175e09c0878c02431be4aa32d584,backing_fmt=raw /opt/stack/data/nova/instances/ab02c376-1432-4981-9179-aeef6e647ea4/disk 1073741824" returned: 0 in 0.048s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:48 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "2c7bea368f90175e09c0878c02431be4aa32d584" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:40:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c7bea368f90175e09c0878c02431be4aa32d584 --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2c7bea368f90175e09c0878c02431be4aa32d584 --force-share --output=json" returned: 0 in 0.171s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:48 user nova-compute[73391]: DEBUG nova.objects.instance [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lazy-loading 'migration_context' on Instance uuid ab02c376-1432-4981-9179-aeef6e647ea4 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:40:48 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Rebasing disk image.
Aug 15 05:40:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.180s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b -F raw /opt/stack/data/nova/instances/ab02c376-1432-4981-9179-aeef6e647ea4/disk {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:48 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:40:48 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jpvBdxYu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 05:40:48 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.672s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:40:48 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] <== connect_volume: return (1674ms) {'type': 'block', 'scsi_wwn': '23764666331613465', 'path': '/dev/sde'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:40:48 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23764666331613465', 'path': '/dev/sde'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 05:40:48 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:40:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-971154119',display_name='tempest-TestVolumeBootPattern-server-971154119',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-971154119',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8188c2e8ca34ef1982faa49f1058bb7',ramdisk_id='',reservation_id='r-y8sl47p6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1834029963',owner_user_name='tempest-TestVolumeBootPattern-1834029963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:40:30Z,user_data=None,user_id='aefb6ccab586465dbe56e71a40bcf1f0',uuid=c21e1783-ddc5-479f-8b8d-db5b13ca068a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e6f5f62-7fcc-4da7-870a-091a762592e1", "address": "fa:16:3e:44:b8:df", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e6f5f62-7f", "ovs_interfaceid": "5e6f5f62-7fcc-4da7-870a-091a762592e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:40:48 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Converting VIF {"id": "5e6f5f62-7fcc-4da7-870a-091a762592e1", "address": "fa:16:3e:44:b8:df", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e6f5f62-7f", "ovs_interfaceid": "5e6f5f62-7fcc-4da7-870a-091a762592e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:40:48 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:b8:df,bridge_name='br-int',has_traffic_filtering=True,id=5e6f5f62-7fcc-4da7-870a-091a762592e1,network=Network(fae0e46a-88e4-499d-bcff-5b7df55eab4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e6f5f62-7f') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:40:48 user nova-compute[73391]: DEBUG nova.objects.instance [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lazy-loading 'pci_devices' on Instance uuid c21e1783-ddc5-479f-8b8d-db5b13ca068a {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:40:48 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:40:48 user nova-compute[73391]:   <uuid>c21e1783-ddc5-479f-8b8d-db5b13ca068a</uuid>
Aug 15 05:40:48 user nova-compute[73391]:   <name>instance-0000001d</name>
Aug 15 05:40:48 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:40:48 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:40:48 user nova-compute[73391]:   <metadata>
Aug 15 05:40:48 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:40:48 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:40:48 user nova-compute[73391]:       <nova:name>tempest-TestVolumeBootPattern-server-971154119</nova:name>
Aug 15 05:40:48 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:40:46</nova:creationTime>
Aug 15 05:40:48 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:40:48 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:40:48 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:40:48 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:40:48 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:40:48 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:40:48 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:40:48 user nova-compute[73391]:       <nova:owner>
Aug 15 05:40:48 user nova-compute[73391]:         <nova:user uuid="aefb6ccab586465dbe56e71a40bcf1f0">tempest-TestVolumeBootPattern-1834029963-project-member</nova:user>
Aug 15 05:40:48 user nova-compute[73391]:         <nova:project uuid="a8188c2e8ca34ef1982faa49f1058bb7">tempest-TestVolumeBootPattern-1834029963</nova:project>
Aug 15 05:40:48 user nova-compute[73391]:       </nova:owner>
Aug 15 05:40:48 user nova-compute[73391]:       <nova:ports>
Aug 15 05:40:48 user nova-compute[73391]:         <nova:port uuid="5e6f5f62-7fcc-4da7-870a-091a762592e1">
Aug 15 05:40:48 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 15 05:40:48 user nova-compute[73391]:         </nova:port>
Aug 15 05:40:48 user nova-compute[73391]:       </nova:ports>
Aug 15 05:40:48 user nova-compute[73391]:     </nova:instance>
Aug 15 05:40:48 user nova-compute[73391]:   </metadata>
Aug 15 05:40:48 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:40:48 user nova-compute[73391]:     <system>
Aug 15 05:40:48 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:40:48 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:40:48 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:40:48 user nova-compute[73391]:       <entry name="serial">c21e1783-ddc5-479f-8b8d-db5b13ca068a</entry>
Aug 15 05:40:48 user nova-compute[73391]:       <entry name="uuid">c21e1783-ddc5-479f-8b8d-db5b13ca068a</entry>
Aug 15 05:40:48 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:40:48 user nova-compute[73391]:     </system>
Aug 15 05:40:48 user nova-compute[73391]:   </sysinfo>
Aug 15 05:40:48 user nova-compute[73391]:   <os>
Aug 15 05:40:48 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:40:48 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:40:48 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:40:48 user nova-compute[73391]:   </os>
Aug 15 05:40:48 user nova-compute[73391]:   <features>
Aug 15 05:40:48 user nova-compute[73391]:     <acpi/>
Aug 15 05:40:48 user nova-compute[73391]:     <apic/>
Aug 15 05:40:48 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:40:48 user nova-compute[73391]:   </features>
Aug 15 05:40:48 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:40:48 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:40:48 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:40:48 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:40:48 user nova-compute[73391]:   </clock>
Aug 15 05:40:48 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:40:48 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:40:48 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:40:48 user nova-compute[73391]:   </cpu>
Aug 15 05:40:48 user nova-compute[73391]:   <devices>
Aug 15 05:40:48 user nova-compute[73391]:     <disk type="block" device="disk">
Aug 15 05:40:48 user nova-compute[73391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:40:48 user nova-compute[73391]:       <source dev="/dev/sde"/>
Aug 15 05:40:48 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:40:48 user nova-compute[73391]:       <serial>d1ced146-3460-4915-8be4-08cf705dfc48</serial>
Aug 15 05:40:48 user nova-compute[73391]:     </disk>
Aug 15 05:40:48 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:40:48 user nova-compute[73391]:       <mac address="fa:16:3e:44:b8:df"/>
Aug 15 05:40:48 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:40:48 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:40:48 user nova-compute[73391]:       <target dev="tap5e6f5f62-7f"/>
Aug 15 05:40:48 user nova-compute[73391]:     </interface>
Aug 15 05:40:48 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:40:48 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/c21e1783-ddc5-479f-8b8d-db5b13ca068a/console.log" append="off"/>
Aug 15 05:40:48 user nova-compute[73391]:     </serial>
Aug 15 05:40:48 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:40:48 user nova-compute[73391]:     <video>
Aug 15 05:40:48 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:40:48 user nova-compute[73391]:     </video>
Aug 15 05:40:48 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:40:48 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:40:48 user nova-compute[73391]:     </rng>
Aug 15 05:40:48 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:40:48 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:40:48 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:40:48 user nova-compute[73391]:     </memballoon>
Aug 15 05:40:48 user nova-compute[73391]:   </devices>
Aug 15 05:40:48 user nova-compute[73391]: </domain>
Aug 15 05:40:48 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:40:48 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:40:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-971154119',display_name='tempest-TestVolumeBootPattern-server-971154119',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-971154119',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8188c2e8ca34ef1982faa49f1058bb7',ramdisk_id='',reservation_id='r-y8sl47p6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1834029963',owner_user_name='tempest-TestVolumeBootPattern-1834029963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:40:30Z,user_data=None,user_id='aefb6ccab586465dbe56e71a40bcf1f0',uuid=c21e1783-ddc5-479f-8b8d-db5b13ca068a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5e6f5f62-7fcc-4da7-870a-091a762592e1", "address": "fa:16:3e:44:b8:df", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e6f5f62-7f", "ovs_interfaceid": "5e6f5f62-7fcc-4da7-870a-091a762592e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:40:48 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Converting VIF {"id": "5e6f5f62-7fcc-4da7-870a-091a762592e1", "address": "fa:16:3e:44:b8:df", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e6f5f62-7f", "ovs_interfaceid": "5e6f5f62-7fcc-4da7-870a-091a762592e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:40:48 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:b8:df,bridge_name='br-int',has_traffic_filtering=True,id=5e6f5f62-7fcc-4da7-870a-091a762592e1,network=Network(fae0e46a-88e4-499d-bcff-5b7df55eab4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e6f5f62-7f') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:40:48 user nova-compute[73391]: DEBUG os_vif [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:b8:df,bridge_name='br-int',has_traffic_filtering=True,id=5e6f5f62-7fcc-4da7-870a-091a762592e1,network=Network(fae0e46a-88e4-499d-bcff-5b7df55eab4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e6f5f62-7f') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:40:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:40:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:40:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5e6f5f62-7f, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:40:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5e6f5f62-7f, col_values=(('external_ids', {'iface-id': '5e6f5f62-7fcc-4da7-870a-091a762592e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:b8:df', 'vm-uuid': 'c21e1783-ddc5-479f-8b8d-db5b13ca068a'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:40:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:40:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:48 user nova-compute[73391]: INFO os_vif [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:b8:df,bridge_name='br-int',has_traffic_filtering=True,id=5e6f5f62-7fcc-4da7-870a-091a762592e1,network=Network(fae0e46a-88e4-499d-bcff-5b7df55eab4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e6f5f62-7f')
Aug 15 05:40:48 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:40:48 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] No VIF found with MAC fa:16:3e:44:b8:df, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:40:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:51 user nova-compute[73391]: DEBUG nova.compute.manager [req-49619afa-7c46-405c-a459-3ab84e97ab0d req-d2a63b2d-909e-479f-8e20-ab6798085341 service nova] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Received event network-vif-plugged-5e6f5f62-7fcc-4da7-870a-091a762592e1 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:40:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-49619afa-7c46-405c-a459-3ab84e97ab0d req-d2a63b2d-909e-479f-8e20-ab6798085341 service nova] Acquiring lock "c21e1783-ddc5-479f-8b8d-db5b13ca068a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:40:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-49619afa-7c46-405c-a459-3ab84e97ab0d req-d2a63b2d-909e-479f-8e20-ab6798085341 service nova] Lock "c21e1783-ddc5-479f-8b8d-db5b13ca068a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:40:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-49619afa-7c46-405c-a459-3ab84e97ab0d req-d2a63b2d-909e-479f-8e20-ab6798085341 service nova] Lock "c21e1783-ddc5-479f-8b8d-db5b13ca068a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:40:51 user nova-compute[73391]: DEBUG nova.compute.manager [req-49619afa-7c46-405c-a459-3ab84e97ab0d req-d2a63b2d-909e-479f-8e20-ab6798085341 service nova] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] No waiting events found dispatching network-vif-plugged-5e6f5f62-7fcc-4da7-870a-091a762592e1 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:40:51 user nova-compute[73391]: WARNING nova.compute.manager [req-49619afa-7c46-405c-a459-3ab84e97ab0d req-d2a63b2d-909e-479f-8e20-ab6798085341 service nova] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Received unexpected event network-vif-plugged-5e6f5f62-7fcc-4da7-870a-091a762592e1 for instance with vm_state building and task_state spawning.
Aug 15 05:40:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b -F raw /opt/stack/data/nova/instances/ab02c376-1432-4981-9179-aeef6e647ea4/disk" returned: 0 in 2.705s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:51 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Created local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 05:40:51 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Ensure instance console log exists: /opt/stack/data/nova/instances/ab02c376-1432-4981-9179-aeef6e647ea4/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 05:40:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:40:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:40:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:40:51 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Start _get_guest_xml network_info=[{"id": "c1931f1c-7ef8-41c7-82f7-7ace92bb6439", "address": "fa:16:3e:67:d1:b1", "network": {"id": "f67152a9-4f18-4d7f-9d3e-5e517bd46813", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-731866550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88871d09f7e347a4b9104a558604f2f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1931f1c-7e", "ovs_interfaceid": "c1931f1c-7ef8-41c7-82f7-7ace92bb6439", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='50b71629d96d1e1cebd473d65d78c86e',container_format='bare',created_at=2023-08-15T05:38:50Z,direct_url=<?>,disk_format='qcow2',id=1e2f2725-811f-4da5-bf97-18bc774e5360,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-698855278-shelved',owner='88871d09f7e347a4b9104a558604f2f6',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-15T05:38:54Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '191b1dad-305e-4d1c-9b15-515ec59a3278'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:40:51 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:40:51 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:40:51 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:40:51 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:40:51 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:40:51 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:40:51 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:40:51 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='50b71629d96d1e1cebd473d65d78c86e',container_format='bare',created_at=2023-08-15T05:38:50Z,direct_url=<?>,disk_format='qcow2',id=1e2f2725-811f-4da5-bf97-18bc774e5360,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-698855278-shelved',owner='88871d09f7e347a4b9104a558604f2f6',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-15T05:38:54Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:40:51 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:40:51 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:40:51 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:40:51 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:40:51 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:40:51 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:40:51 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:40:51 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:40:51 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:40:51 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:40:51 user nova-compute[73391]: DEBUG nova.objects.instance [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lazy-loading 'vcpu_model' on Instance uuid ab02c376-1432-4981-9179-aeef6e647ea4 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:40:51 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T05:36:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-698855278',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-698855278',id=22,image_ref='1e2f2725-811f-4da5-bf97-18bc774e5360',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1906338828',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:37:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='88871d09f7e347a4b9104a558604f2f6',ramdisk_id='',reservation_id='r-854lfx4v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1774553789',owner_user_name='tempest-AttachVolumeShelveTestJSON-1774553789-project-member',shelved_at='2023-08-15T05:38:54.517352',shelved_host='user',shelved_image_id='1e2f2725-811f-4da5-bf97-18bc774e5360'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:40:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c932032fc884b14b9268d5df91d45ea',uuid=ab02c376-1432-4981-9179-aeef6e647ea4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c1931f1c-7ef8-41c7-82f7-7ace92bb6439", "address": "fa:16:3e:67:d1:b1", "network": {"id": "f67152a9-4f18-4d7f-9d3e-5e517bd46813", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-731866550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88871d09f7e347a4b9104a558604f2f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1931f1c-7e", "ovs_interfaceid": "c1931f1c-7ef8-41c7-82f7-7ace92bb6439", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:40:51 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Converting VIF {"id": "c1931f1c-7ef8-41c7-82f7-7ace92bb6439", "address": "fa:16:3e:67:d1:b1", "network": {"id": "f67152a9-4f18-4d7f-9d3e-5e517bd46813", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-731866550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88871d09f7e347a4b9104a558604f2f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1931f1c-7e", "ovs_interfaceid": "c1931f1c-7ef8-41c7-82f7-7ace92bb6439", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:40:51 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:d1:b1,bridge_name='br-int',has_traffic_filtering=True,id=c1931f1c-7ef8-41c7-82f7-7ace92bb6439,network=Network(f67152a9-4f18-4d7f-9d3e-5e517bd46813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1931f1c-7e') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:40:51 user nova-compute[73391]: DEBUG nova.objects.instance [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lazy-loading 'pci_devices' on Instance uuid ab02c376-1432-4981-9179-aeef6e647ea4 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:40:51 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:40:51 user nova-compute[73391]:   <uuid>ab02c376-1432-4981-9179-aeef6e647ea4</uuid>
Aug 15 05:40:51 user nova-compute[73391]:   <name>instance-00000016</name>
Aug 15 05:40:51 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:40:51 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:40:51 user nova-compute[73391]:   <metadata>
Aug 15 05:40:51 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:40:51 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:40:51 user nova-compute[73391]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-698855278</nova:name>
Aug 15 05:40:51 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:40:51</nova:creationTime>
Aug 15 05:40:51 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:40:51 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:40:51 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:40:51 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:40:51 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:40:51 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:40:51 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:40:51 user nova-compute[73391]:       <nova:owner>
Aug 15 05:40:51 user nova-compute[73391]:         <nova:user uuid="4c932032fc884b14b9268d5df91d45ea">tempest-AttachVolumeShelveTestJSON-1774553789-project-member</nova:user>
Aug 15 05:40:51 user nova-compute[73391]:         <nova:project uuid="88871d09f7e347a4b9104a558604f2f6">tempest-AttachVolumeShelveTestJSON-1774553789</nova:project>
Aug 15 05:40:51 user nova-compute[73391]:       </nova:owner>
Aug 15 05:40:51 user nova-compute[73391]:       <nova:root type="image" uuid="1e2f2725-811f-4da5-bf97-18bc774e5360"/>
Aug 15 05:40:51 user nova-compute[73391]:       <nova:ports>
Aug 15 05:40:51 user nova-compute[73391]:         <nova:port uuid="c1931f1c-7ef8-41c7-82f7-7ace92bb6439">
Aug 15 05:40:51 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 05:40:51 user nova-compute[73391]:         </nova:port>
Aug 15 05:40:51 user nova-compute[73391]:       </nova:ports>
Aug 15 05:40:51 user nova-compute[73391]:     </nova:instance>
Aug 15 05:40:51 user nova-compute[73391]:   </metadata>
Aug 15 05:40:51 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:40:51 user nova-compute[73391]:     <system>
Aug 15 05:40:51 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:40:51 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:40:51 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:40:51 user nova-compute[73391]:       <entry name="serial">ab02c376-1432-4981-9179-aeef6e647ea4</entry>
Aug 15 05:40:51 user nova-compute[73391]:       <entry name="uuid">ab02c376-1432-4981-9179-aeef6e647ea4</entry>
Aug 15 05:40:51 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:40:51 user nova-compute[73391]:     </system>
Aug 15 05:40:51 user nova-compute[73391]:   </sysinfo>
Aug 15 05:40:51 user nova-compute[73391]:   <os>
Aug 15 05:40:51 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:40:51 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:40:51 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:40:51 user nova-compute[73391]:   </os>
Aug 15 05:40:51 user nova-compute[73391]:   <features>
Aug 15 05:40:51 user nova-compute[73391]:     <acpi/>
Aug 15 05:40:51 user nova-compute[73391]:     <apic/>
Aug 15 05:40:51 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:40:51 user nova-compute[73391]:   </features>
Aug 15 05:40:51 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:40:51 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:40:51 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:40:51 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:40:51 user nova-compute[73391]:   </clock>
Aug 15 05:40:51 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:40:51 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:40:51 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:40:51 user nova-compute[73391]:   </cpu>
Aug 15 05:40:51 user nova-compute[73391]:   <devices>
Aug 15 05:40:51 user nova-compute[73391]:     <disk type="file" device="disk">
Aug 15 05:40:51 user nova-compute[73391]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 05:40:51 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/ab02c376-1432-4981-9179-aeef6e647ea4/disk"/>
Aug 15 05:40:51 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:40:51 user nova-compute[73391]:     </disk>
Aug 15 05:40:51 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:40:51 user nova-compute[73391]:       <mac address="fa:16:3e:67:d1:b1"/>
Aug 15 05:40:51 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:40:51 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:40:51 user nova-compute[73391]:       <target dev="tapc1931f1c-7e"/>
Aug 15 05:40:51 user nova-compute[73391]:     </interface>
Aug 15 05:40:51 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:40:51 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/ab02c376-1432-4981-9179-aeef6e647ea4/console.log" append="off"/>
Aug 15 05:40:51 user nova-compute[73391]:     </serial>
Aug 15 05:40:51 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:40:51 user nova-compute[73391]:     <video>
Aug 15 05:40:51 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:40:51 user nova-compute[73391]:     </video>
Aug 15 05:40:51 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:40:51 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:40:51 user nova-compute[73391]:     </rng>
Aug 15 05:40:51 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:40:51 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:40:51 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:40:51 user nova-compute[73391]:     </memballoon>
Aug 15 05:40:51 user nova-compute[73391]:   </devices>
Aug 15 05:40:51 user nova-compute[73391]: </domain>
Aug 15 05:40:51 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:40:51 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T05:36:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-698855278',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-698855278',id=22,image_ref='1e2f2725-811f-4da5-bf97-18bc774e5360',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1906338828',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:37:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='88871d09f7e347a4b9104a558604f2f6',ramdisk_id='',reservation_id='r-854lfx4v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1774553789',owner_user_name='tempest-AttachVolumeShelveTestJSON-1774553789-project-member',shelved_at='2023-08-15T05:38:54.517352',shelved_host='user',shelved_image_id='1e2f2725-811f-4da5-bf97-18bc774e5360'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:40:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c932032fc884b14b9268d5df91d45ea',uuid=ab02c376-1432-4981-9179-aeef6e647ea4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "c1931f1c-7ef8-41c7-82f7-7ace92bb6439", "address": "fa:16:3e:67:d1:b1", "network": {"id": "f67152a9-4f18-4d7f-9d3e-5e517bd46813", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-731866550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88871d09f7e347a4b9104a558604f2f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1931f1c-7e", "ovs_interfaceid": "c1931f1c-7ef8-41c7-82f7-7ace92bb6439", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:40:51 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Converting VIF {"id": "c1931f1c-7ef8-41c7-82f7-7ace92bb6439", "address": "fa:16:3e:67:d1:b1", "network": {"id": "f67152a9-4f18-4d7f-9d3e-5e517bd46813", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-731866550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88871d09f7e347a4b9104a558604f2f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1931f1c-7e", "ovs_interfaceid": "c1931f1c-7ef8-41c7-82f7-7ace92bb6439", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:40:51 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:d1:b1,bridge_name='br-int',has_traffic_filtering=True,id=c1931f1c-7ef8-41c7-82f7-7ace92bb6439,network=Network(f67152a9-4f18-4d7f-9d3e-5e517bd46813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1931f1c-7e') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:40:51 user nova-compute[73391]: DEBUG os_vif [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:d1:b1,bridge_name='br-int',has_traffic_filtering=True,id=c1931f1c-7ef8-41c7-82f7-7ace92bb6439,network=Network(f67152a9-4f18-4d7f-9d3e-5e517bd46813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1931f1c-7e') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:40:51 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:51 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:40:51 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:40:51 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:51 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:51 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:51 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc1931f1c-7e, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:40:51 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc1931f1c-7e, col_values=(('external_ids', {'iface-id': 'c1931f1c-7ef8-41c7-82f7-7ace92bb6439', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:d1:b1', 'vm-uuid': 'ab02c376-1432-4981-9179-aeef6e647ea4'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:40:51 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:51 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:40:51 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:51 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:51 user nova-compute[73391]: INFO os_vif [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:d1:b1,bridge_name='br-int',has_traffic_filtering=True,id=c1931f1c-7ef8-41c7-82f7-7ace92bb6439,network=Network(f67152a9-4f18-4d7f-9d3e-5e517bd46813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1931f1c-7e')
Aug 15 05:40:51 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:40:51 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] No VIF found with MAC fa:16:3e:67:d1:b1, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:40:51 user nova-compute[73391]: DEBUG os_brick.utils [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:40:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:52 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[43330bf3-cdce-4b99-a1c2-0390b1895e9c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:40:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:52 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[62267c5e-786c-4d74-bf03-c046d0503e4c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:40:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:40:52 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4d9b39-2954-4d28-99e0-cdba47195a2c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:40:52 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ade3601-1a3f-46ea-8bbd-58070e54e3df]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:40:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:40:52 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 05:40:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:40:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:40:52 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 05:40:52 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9652c138-06af-4699-bfdd-73cd3219792f]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:40:52 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 05:40:52 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 05:40:52 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 05:40:52 user nova-compute[73391]: DEBUG os_brick.utils [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:40:52 user nova-compute[73391]: DEBUG nova.virt.block_device [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] Updating existing volume attachment record: bf2ec6ca-3f9e-417f-81aa-818d2a60ec9c {{(pid=73391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 05:40:52 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:52 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:52 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:53 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078053.0725467, c21e1783-ddc5-479f-8b8d-db5b13ca068a => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:40:53 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] VM Resumed (Lifecycle Event)
Aug 15 05:40:53 user nova-compute[73391]: DEBUG nova.compute.manager [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:40:53 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Guest created on hypervisor {{(pid=73391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 05:40:53 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Instance spawned successfully.
Aug 15 05:40:53 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 05:40:53 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:40:53 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:40:53 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Found default for hw_cdrom_bus of ide {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:40:53 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Found default for hw_disk_bus of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:40:53 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Found default for hw_input_bus of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:40:53 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Found default for hw_pointer_model of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:40:53 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Found default for hw_video_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:40:53 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Found default for hw_vif_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:40:53 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:40:53 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078053.0856423, c21e1783-ddc5-479f-8b8d-db5b13ca068a => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:40:53 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] VM Started (Lifecycle Event)
Aug 15 05:40:53 user nova-compute[73391]: DEBUG nova.compute.manager [req-e5f5e94a-8f9e-47c5-9916-30e6ffd4d9bc req-a149625b-1250-423e-b032-e7cd32b034e3 service nova] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Received event network-vif-plugged-c1931f1c-7ef8-41c7-82f7-7ace92bb6439 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:40:53 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e5f5e94a-8f9e-47c5-9916-30e6ffd4d9bc req-a149625b-1250-423e-b032-e7cd32b034e3 service nova] Acquiring lock "ab02c376-1432-4981-9179-aeef6e647ea4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:40:53 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e5f5e94a-8f9e-47c5-9916-30e6ffd4d9bc req-a149625b-1250-423e-b032-e7cd32b034e3 service nova] Lock "ab02c376-1432-4981-9179-aeef6e647ea4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:40:53 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e5f5e94a-8f9e-47c5-9916-30e6ffd4d9bc req-a149625b-1250-423e-b032-e7cd32b034e3 service nova] Lock "ab02c376-1432-4981-9179-aeef6e647ea4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:40:53 user nova-compute[73391]: DEBUG nova.compute.manager [req-e5f5e94a-8f9e-47c5-9916-30e6ffd4d9bc req-a149625b-1250-423e-b032-e7cd32b034e3 service nova] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] No waiting events found dispatching network-vif-plugged-c1931f1c-7ef8-41c7-82f7-7ace92bb6439 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:40:53 user nova-compute[73391]: WARNING nova.compute.manager [req-e5f5e94a-8f9e-47c5-9916-30e6ffd4d9bc req-a149625b-1250-423e-b032-e7cd32b034e3 service nova] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Received unexpected event network-vif-plugged-c1931f1c-7ef8-41c7-82f7-7ace92bb6439 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 15 05:40:53 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:40:53 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:40:53 user nova-compute[73391]: INFO nova.compute.manager [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Took 6.29 seconds to spawn the instance on the hypervisor.
Aug 15 05:40:53 user nova-compute[73391]: DEBUG nova.compute.manager [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:40:53 user nova-compute[73391]: DEBUG nova.compute.manager [req-40e425d7-120d-4083-b1cb-a468fb29b839 req-c8415517-9ca4-46cc-8e50-200c0c7bab03 service nova] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Received event network-vif-plugged-5e6f5f62-7fcc-4da7-870a-091a762592e1 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:40:53 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-40e425d7-120d-4083-b1cb-a468fb29b839 req-c8415517-9ca4-46cc-8e50-200c0c7bab03 service nova] Acquiring lock "c21e1783-ddc5-479f-8b8d-db5b13ca068a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:40:53 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-40e425d7-120d-4083-b1cb-a468fb29b839 req-c8415517-9ca4-46cc-8e50-200c0c7bab03 service nova] Lock "c21e1783-ddc5-479f-8b8d-db5b13ca068a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:40:53 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-40e425d7-120d-4083-b1cb-a468fb29b839 req-c8415517-9ca4-46cc-8e50-200c0c7bab03 service nova] Lock "c21e1783-ddc5-479f-8b8d-db5b13ca068a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:40:53 user nova-compute[73391]: DEBUG nova.compute.manager [req-40e425d7-120d-4083-b1cb-a468fb29b839 req-c8415517-9ca4-46cc-8e50-200c0c7bab03 service nova] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] No waiting events found dispatching network-vif-plugged-5e6f5f62-7fcc-4da7-870a-091a762592e1 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:40:53 user nova-compute[73391]: WARNING nova.compute.manager [req-40e425d7-120d-4083-b1cb-a468fb29b839 req-c8415517-9ca4-46cc-8e50-200c0c7bab03 service nova] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Received unexpected event network-vif-plugged-5e6f5f62-7fcc-4da7-870a-091a762592e1 for instance with vm_state building and task_state spawning.
Aug 15 05:40:53 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:40:53 user nova-compute[73391]: INFO nova.compute.manager [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Took 23.60 seconds to build instance.
Aug 15 05:40:53 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-77f15bd4-fad9-4db4-bf69-c902c9069421 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "c21e1783-ddc5-479f-8b8d-db5b13ca068a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.731s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:40:53 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:53 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:53 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-eb04044a-f3bb-4dff-96af-f4af20d4d817 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Acquiring lock "3f88cd17-c89f-41f3-b630-8eb2c6698155" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:40:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-eb04044a-f3bb-4dff-96af-f4af20d4d817 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "3f88cd17-c89f-41f3-b630-8eb2c6698155" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:40:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-eb04044a-f3bb-4dff-96af-f4af20d4d817 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Acquiring lock "3f88cd17-c89f-41f3-b630-8eb2c6698155-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:40:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-eb04044a-f3bb-4dff-96af-f4af20d4d817 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "3f88cd17-c89f-41f3-b630-8eb2c6698155-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:40:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-eb04044a-f3bb-4dff-96af-f4af20d4d817 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "3f88cd17-c89f-41f3-b630-8eb2c6698155-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:40:55 user nova-compute[73391]: INFO nova.compute.manager [None req-eb04044a-f3bb-4dff-96af-f4af20d4d817 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Terminating instance
Aug 15 05:40:55 user nova-compute[73391]: DEBUG nova.compute.manager [None req-eb04044a-f3bb-4dff-96af-f4af20d4d817 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Start destroying the instance on the hypervisor. {{(pid=73391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 05:40:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:55 user nova-compute[73391]: DEBUG nova.compute.manager [req-6a5be2c3-22f2-4248-972e-badec07a67cd req-53d8803f-b017-47a7-b719-70319f597c05 service nova] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Received event network-vif-plugged-c1931f1c-7ef8-41c7-82f7-7ace92bb6439 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:40:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-6a5be2c3-22f2-4248-972e-badec07a67cd req-53d8803f-b017-47a7-b719-70319f597c05 service nova] Acquiring lock "ab02c376-1432-4981-9179-aeef6e647ea4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:40:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-6a5be2c3-22f2-4248-972e-badec07a67cd req-53d8803f-b017-47a7-b719-70319f597c05 service nova] Lock "ab02c376-1432-4981-9179-aeef6e647ea4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:40:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-6a5be2c3-22f2-4248-972e-badec07a67cd req-53d8803f-b017-47a7-b719-70319f597c05 service nova] Lock "ab02c376-1432-4981-9179-aeef6e647ea4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:40:55 user nova-compute[73391]: DEBUG nova.compute.manager [req-6a5be2c3-22f2-4248-972e-badec07a67cd req-53d8803f-b017-47a7-b719-70319f597c05 service nova] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] No waiting events found dispatching network-vif-plugged-c1931f1c-7ef8-41c7-82f7-7ace92bb6439 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:40:55 user nova-compute[73391]: WARNING nova.compute.manager [req-6a5be2c3-22f2-4248-972e-badec07a67cd req-53d8803f-b017-47a7-b719-70319f597c05 service nova] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Received unexpected event network-vif-plugged-c1931f1c-7ef8-41c7-82f7-7ace92bb6439 for instance with vm_state shelved_offloaded and task_state spawning.
Aug 15 05:40:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:55 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078055.2908022, ab02c376-1432-4981-9179-aeef6e647ea4 => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:40:55 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] VM Resumed (Lifecycle Event)
Aug 15 05:40:55 user nova-compute[73391]: DEBUG nova.compute.manager [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:40:55 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Guest created on hypervisor {{(pid=73391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 05:40:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:55 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:40:55 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Instance spawned successfully.
Aug 15 05:40:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:55 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:40:55 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:40:55 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078055.2921817, ab02c376-1432-4981-9179-aeef6e647ea4 => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:40:55 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] VM Started (Lifecycle Event)
Aug 15 05:40:55 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:40:55 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:40:55 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:40:55 user nova-compute[73391]: DEBUG nova.compute.manager [req-0f69cd50-50de-4900-b6de-711bc1364ba9 req-a6abffb0-0c88-4517-94b7-d80b3501520e service nova] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Received event network-vif-unplugged-b00ad802-7ef5-4555-9a1b-7083cdd1c288 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:40:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-0f69cd50-50de-4900-b6de-711bc1364ba9 req-a6abffb0-0c88-4517-94b7-d80b3501520e service nova] Acquiring lock "3f88cd17-c89f-41f3-b630-8eb2c6698155-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:40:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-0f69cd50-50de-4900-b6de-711bc1364ba9 req-a6abffb0-0c88-4517-94b7-d80b3501520e service nova] Lock "3f88cd17-c89f-41f3-b630-8eb2c6698155-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:40:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-0f69cd50-50de-4900-b6de-711bc1364ba9 req-a6abffb0-0c88-4517-94b7-d80b3501520e service nova] Lock "3f88cd17-c89f-41f3-b630-8eb2c6698155-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:40:55 user nova-compute[73391]: DEBUG nova.compute.manager [req-0f69cd50-50de-4900-b6de-711bc1364ba9 req-a6abffb0-0c88-4517-94b7-d80b3501520e service nova] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] No waiting events found dispatching network-vif-unplugged-b00ad802-7ef5-4555-9a1b-7083cdd1c288 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:40:55 user nova-compute[73391]: DEBUG nova.compute.manager [req-0f69cd50-50de-4900-b6de-711bc1364ba9 req-a6abffb0-0c88-4517-94b7-d80b3501520e service nova] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Received event network-vif-unplugged-b00ad802-7ef5-4555-9a1b-7083cdd1c288 for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 05:40:55 user nova-compute[73391]: DEBUG nova.compute.manager [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:40:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d8248f05-24ac-4d2f-8a0e-84d9d975559b tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "ab02c376-1432-4981-9179-aeef6e647ea4" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.699s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:40:55 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Instance destroyed successfully.
Aug 15 05:40:55 user nova-compute[73391]: DEBUG nova.objects.instance [None req-eb04044a-f3bb-4dff-96af-f4af20d4d817 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lazy-loading 'resources' on Instance uuid 3f88cd17-c89f-41f3-b630-8eb2c6698155 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:40:56 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-eb04044a-f3bb-4dff-96af-f4af20d4d817 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:33:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1683927402',display_name='tempest-SnapshotDataIntegrityTests-server-1683927402',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1683927402',id=15,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrpSb8Vc0je36f1mNxFtquzr/fRmXGl6TpPRK5C1vgXu/GOKu04yY/2Bnu2ssyTb3mxXtgFEEyfO4RFAqZ/8hgdt305jvYRykTc6jumG0flu/S6BPMyOAw4weaR2sn3tg==',key_name='tempest-keypair-1212270873',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:33:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='136ca1d3267b476db6dde10db3f21e06',ramdisk_id='',reservation_id='r-psajbjru',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-604035675',owner_user_name='tempest-SnapshotDataIntegrityTests-604035675-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:33:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='49011bcb82534aa3b83e182485a388db',uuid=3f88cd17-c89f-41f3-b630-8eb2c6698155,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b00ad802-7ef5-4555-9a1b-7083cdd1c288", "address": "fa:16:3e:62:a5:85", "network": {"id": "85e580e2-7f57-4ac1-87b1-9c805fdcb43f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-949359526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "136ca1d3267b476db6dde10db3f21e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00ad802-7e", "ovs_interfaceid": "b00ad802-7ef5-4555-9a1b-7083cdd1c288", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:40:56 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-eb04044a-f3bb-4dff-96af-f4af20d4d817 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Converting VIF {"id": "b00ad802-7ef5-4555-9a1b-7083cdd1c288", "address": "fa:16:3e:62:a5:85", "network": {"id": "85e580e2-7f57-4ac1-87b1-9c805fdcb43f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-949359526-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "136ca1d3267b476db6dde10db3f21e06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb00ad802-7e", "ovs_interfaceid": "b00ad802-7ef5-4555-9a1b-7083cdd1c288", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:40:56 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-eb04044a-f3bb-4dff-96af-f4af20d4d817 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:62:a5:85,bridge_name='br-int',has_traffic_filtering=True,id=b00ad802-7ef5-4555-9a1b-7083cdd1c288,network=Network(85e580e2-7f57-4ac1-87b1-9c805fdcb43f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb00ad802-7e') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:40:56 user nova-compute[73391]: DEBUG os_vif [None req-eb04044a-f3bb-4dff-96af-f4af20d4d817 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:a5:85,bridge_name='br-int',has_traffic_filtering=True,id=b00ad802-7ef5-4555-9a1b-7083cdd1c288,network=Network(85e580e2-7f57-4ac1-87b1-9c805fdcb43f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb00ad802-7e') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:40:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb00ad802-7e, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:40:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:40:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:40:56 user nova-compute[73391]: INFO os_vif [None req-eb04044a-f3bb-4dff-96af-f4af20d4d817 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:62:a5:85,bridge_name='br-int',has_traffic_filtering=True,id=b00ad802-7ef5-4555-9a1b-7083cdd1c288,network=Network(85e580e2-7f57-4ac1-87b1-9c805fdcb43f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb00ad802-7e')
Aug 15 05:40:56 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-eb04044a-f3bb-4dff-96af-f4af20d4d817 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Deleting instance files /opt/stack/data/nova/instances/3f88cd17-c89f-41f3-b630-8eb2c6698155_del
Aug 15 05:40:56 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-eb04044a-f3bb-4dff-96af-f4af20d4d817 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Deletion of /opt/stack/data/nova/instances/3f88cd17-c89f-41f3-b630-8eb2c6698155_del complete
Aug 15 05:40:56 user nova-compute[73391]: INFO nova.compute.manager [None req-eb04044a-f3bb-4dff-96af-f4af20d4d817 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 15 05:40:56 user nova-compute[73391]: DEBUG oslo.service.loopingcall [None req-eb04044a-f3bb-4dff-96af-f4af20d4d817 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 05:40:56 user nova-compute[73391]: DEBUG nova.compute.manager [-] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Deallocating network for instance {{(pid=73391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 05:40:56 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] deallocate_for_instance() {{(pid=73391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 05:40:57 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:40:57 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Took 1.01 seconds to deallocate network for instance.
Aug 15 05:40:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-eb04044a-f3bb-4dff-96af-f4af20d4d817 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:40:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-eb04044a-f3bb-4dff-96af-f4af20d4d817 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:40:57 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-eb04044a-f3bb-4dff-96af-f4af20d4d817 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Refreshing inventories for resource provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 05:40:57 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-eb04044a-f3bb-4dff-96af-f4af20d4d817 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Updating ProviderTree inventory for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 05:40:57 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-eb04044a-f3bb-4dff-96af-f4af20d4d817 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Updating inventory in ProviderTree for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 05:40:57 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-eb04044a-f3bb-4dff-96af-f4af20d4d817 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Refreshing aggregate associations for resource provider 771708bd-6a2a-4e0c-9869-46d45e6b1896, aggregates: None {{(pid=73391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 05:40:57 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-eb04044a-f3bb-4dff-96af-f4af20d4d817 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Refreshing trait associations for resource provider 771708bd-6a2a-4e0c-9869-46d45e6b1896, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=73391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 05:40:57 user nova-compute[73391]: DEBUG nova.compute.manager [req-5a3d9f61-2a7b-4396-900c-9af42b33f3d4 req-d22bde6e-700e-491d-b1fa-6bf31b5bb18f service nova] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Received event network-vif-plugged-b00ad802-7ef5-4555-9a1b-7083cdd1c288 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:40:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-5a3d9f61-2a7b-4396-900c-9af42b33f3d4 req-d22bde6e-700e-491d-b1fa-6bf31b5bb18f service nova] Acquiring lock "3f88cd17-c89f-41f3-b630-8eb2c6698155-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:40:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-5a3d9f61-2a7b-4396-900c-9af42b33f3d4 req-d22bde6e-700e-491d-b1fa-6bf31b5bb18f service nova] Lock "3f88cd17-c89f-41f3-b630-8eb2c6698155-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:40:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-5a3d9f61-2a7b-4396-900c-9af42b33f3d4 req-d22bde6e-700e-491d-b1fa-6bf31b5bb18f service nova] Lock "3f88cd17-c89f-41f3-b630-8eb2c6698155-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:40:57 user nova-compute[73391]: DEBUG nova.compute.manager [req-5a3d9f61-2a7b-4396-900c-9af42b33f3d4 req-d22bde6e-700e-491d-b1fa-6bf31b5bb18f service nova] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] No waiting events found dispatching network-vif-plugged-b00ad802-7ef5-4555-9a1b-7083cdd1c288 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:40:57 user nova-compute[73391]: WARNING nova.compute.manager [req-5a3d9f61-2a7b-4396-900c-9af42b33f3d4 req-d22bde6e-700e-491d-b1fa-6bf31b5bb18f service nova] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Received unexpected event network-vif-plugged-b00ad802-7ef5-4555-9a1b-7083cdd1c288 for instance with vm_state deleted and task_state None.
Aug 15 05:40:57 user nova-compute[73391]: DEBUG nova.compute.manager [req-5a3d9f61-2a7b-4396-900c-9af42b33f3d4 req-d22bde6e-700e-491d-b1fa-6bf31b5bb18f service nova] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Received event network-vif-deleted-b00ad802-7ef5-4555-9a1b-7083cdd1c288 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:40:57 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-eb04044a-f3bb-4dff-96af-f4af20d4d817 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:40:57 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-eb04044a-f3bb-4dff-96af-f4af20d4d817 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:40:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-eb04044a-f3bb-4dff-96af-f4af20d4d817 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.827s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:40:58 user nova-compute[73391]: INFO nova.scheduler.client.report [None req-eb04044a-f3bb-4dff-96af-f4af20d4d817 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Deleted allocations for instance 3f88cd17-c89f-41f3-b630-8eb2c6698155
Aug 15 05:40:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-eb04044a-f3bb-4dff-96af-f4af20d4d817 tempest-SnapshotDataIntegrityTests-604035675 tempest-SnapshotDataIntegrityTests-604035675-project-member] Lock "3f88cd17-c89f-41f3-b630-8eb2c6698155" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.075s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:40:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:41:01 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG nova.compute.manager [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] Start spawning the instance on the hypervisor. {{(pid=73391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] Creating instance directory {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 05:41:03 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] Creating image(s)
Aug 15 05:41:03 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] Did not create local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] Ensure instance console log exists: /opt/stack/data/nova/instances/d60616bb-605e-4604-b637-56670f53159e/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] Start _get_guest_xml network_info=[{"id": "c8787a16-cd6d-410e-8d37-425bdad344d6", "address": "fa:16:3e:f9:58:41", "network": {"id": "70d88082-aea7-48bb-abb4-d77d264aaf01", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b9acbe11654053bb905e7c92558a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8787a16-cd", "ovs_interfaceid": "c8787a16-cd6d-410e-8d37-425bdad344d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GSuaqwUj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd60616bb-605e-4604-b637-56670f53159e', 'attached_at': '', 'detached_at': '', 'volume_id': '911dca0b-7771-4c68-9daf-70cae57028cb', 'serial': '911dca0b-7771-4c68-9daf-70cae57028cb'}, 'attachment_id': 'bf2ec6ca-3f9e-417f-81aa-818d2a60ec9c', 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:41:03 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:41:03 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:41:03 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GSuaqwUj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:41:03 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:41:03 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:41:03 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:41:03 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:41:03 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 05:41:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ecbb86d-2589-49a8-98ee-c9944f1fe598]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 05:41:03 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[df27de1e-fd63-4d0f-9ebc-39d60f80ff88]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb] added
Aug 15 05:41:03 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6ba3100-d1bb-422b-8a63-b58d681b7770]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4862568-bdbd-4136-8888-39f0b10c8494]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GSuaqwUj {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GSuaqwUj" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9a52ce-1b29-4a66-9cec-bf54a27a54f5]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GSuaqwUj'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[097e05ab-0d7d-485b-874a-4e92cebfcf68]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[893cd39d-59d1-4143-b21c-3f9fa8d24bde]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:41:03 user nova-compute[73391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)
Aug 15 05:41:03 user nova-compute[73391]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9 (non-flash)
Aug 15 05:41:03 user nova-compute[73391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)
Aug 15 05:41:03 user nova-compute[73391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48 (non-flash)
Aug 15 05:41:03 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:41:03 user nova-compute[73391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)
Aug 15 05:41:03 user nova-compute[73391]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9 (non-flash)
Aug 15 05:41:03 user nova-compute[73391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)
Aug 15 05:41:03 user nova-compute[73391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48 (non-flash)
Aug 15 05:41:03 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0530425d-3aaf-4a2c-83d6-d608b126c550]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb, portal: 172.16.0.220,3260]
Aug 15 05:41:03 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb, portal: 172.16.0.220,3260] successful.
Aug 15 05:41:03 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e668562b-337e-4eb1-9709-ffad78867924]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb691c2-621d-4e02-9a17-f6a842ad636b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:41:03 user nova-compute[73391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)
Aug 15 05:41:03 user nova-compute[73391]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9 (non-flash)
Aug 15 05:41:03 user nova-compute[73391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)
Aug 15 05:41:03 user nova-compute[73391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48 (non-flash)
Aug 15 05:41:03 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:41:03 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:41:03 user nova-compute[73391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)
Aug 15 05:41:03 user nova-compute[73391]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9 (non-flash)
Aug 15 05:41:03 user nova-compute[73391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)
Aug 15 05:41:03 user nova-compute[73391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48 (non-flash)
Aug 15 05:41:03 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:41:03 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] HCTL ('38', '-', '-', 0) found on session 35 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a3f18f-859b-4f89-a7d5-638176b0e14d]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Searching for a device in session 35 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:41:03 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GSuaqwUj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 05:41:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:41:04 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.376s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:41:04 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '26131396232663036', 'path': '/dev/sdg'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:41:04 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131396232663036', 'path': '/dev/sdg'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 05:41:04 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:40:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-173546372',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-173546372',id=30,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83b9acbe11654053bb905e7c92558a35',ramdisk_id='',reservation_id='r-c3nfsozy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1045163116',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:40:41Z,user_data=None,user_id='887f0846cf554e12acf92a663f5ab266',uuid=d60616bb-605e-4604-b637-56670f53159e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8787a16-cd6d-410e-8d37-425bdad344d6", "address": "fa:16:3e:f9:58:41", "network": {"id": "70d88082-aea7-48bb-abb4-d77d264aaf01", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b9acbe11654053bb905e7c92558a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8787a16-cd", "ovs_interfaceid": "c8787a16-cd6d-410e-8d37-425bdad344d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:41:04 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Converting VIF {"id": "c8787a16-cd6d-410e-8d37-425bdad344d6", "address": "fa:16:3e:f9:58:41", "network": {"id": "70d88082-aea7-48bb-abb4-d77d264aaf01", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b9acbe11654053bb905e7c92558a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8787a16-cd", "ovs_interfaceid": "c8787a16-cd6d-410e-8d37-425bdad344d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:41:04 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:58:41,bridge_name='br-int',has_traffic_filtering=True,id=c8787a16-cd6d-410e-8d37-425bdad344d6,network=Network(70d88082-aea7-48bb-abb4-d77d264aaf01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8787a16-cd') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:41:04 user nova-compute[73391]: DEBUG nova.objects.instance [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lazy-loading 'pci_devices' on Instance uuid d60616bb-605e-4604-b637-56670f53159e {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:41:04 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:41:04 user nova-compute[73391]:   <uuid>d60616bb-605e-4604-b637-56670f53159e</uuid>
Aug 15 05:41:04 user nova-compute[73391]:   <name>instance-0000001e</name>
Aug 15 05:41:04 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:41:04 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:41:04 user nova-compute[73391]:   <metadata>
Aug 15 05:41:04 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:41:04 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:41:04 user nova-compute[73391]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-173546372</nova:name>
Aug 15 05:41:04 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:41:03</nova:creationTime>
Aug 15 05:41:04 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:41:04 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:41:04 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:41:04 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:41:04 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:41:04 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:41:04 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:41:04 user nova-compute[73391]:       <nova:owner>
Aug 15 05:41:04 user nova-compute[73391]:         <nova:user uuid="887f0846cf554e12acf92a663f5ab266">tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member</nova:user>
Aug 15 05:41:04 user nova-compute[73391]:         <nova:project uuid="83b9acbe11654053bb905e7c92558a35">tempest-ServerBootFromVolumeStableRescueTest-1045163116</nova:project>
Aug 15 05:41:04 user nova-compute[73391]:       </nova:owner>
Aug 15 05:41:04 user nova-compute[73391]:       <nova:root type="image" uuid="191b1dad-305e-4d1c-9b15-515ec59a3278"/>
Aug 15 05:41:04 user nova-compute[73391]:       <nova:ports>
Aug 15 05:41:04 user nova-compute[73391]:         <nova:port uuid="c8787a16-cd6d-410e-8d37-425bdad344d6">
Aug 15 05:41:04 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 15 05:41:04 user nova-compute[73391]:         </nova:port>
Aug 15 05:41:04 user nova-compute[73391]:       </nova:ports>
Aug 15 05:41:04 user nova-compute[73391]:     </nova:instance>
Aug 15 05:41:04 user nova-compute[73391]:   </metadata>
Aug 15 05:41:04 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:41:04 user nova-compute[73391]:     <system>
Aug 15 05:41:04 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:41:04 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:41:04 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:41:04 user nova-compute[73391]:       <entry name="serial">d60616bb-605e-4604-b637-56670f53159e</entry>
Aug 15 05:41:04 user nova-compute[73391]:       <entry name="uuid">d60616bb-605e-4604-b637-56670f53159e</entry>
Aug 15 05:41:04 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:41:04 user nova-compute[73391]:     </system>
Aug 15 05:41:04 user nova-compute[73391]:   </sysinfo>
Aug 15 05:41:04 user nova-compute[73391]:   <os>
Aug 15 05:41:04 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:41:04 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:41:04 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:41:04 user nova-compute[73391]:   </os>
Aug 15 05:41:04 user nova-compute[73391]:   <features>
Aug 15 05:41:04 user nova-compute[73391]:     <acpi/>
Aug 15 05:41:04 user nova-compute[73391]:     <apic/>
Aug 15 05:41:04 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:41:04 user nova-compute[73391]:   </features>
Aug 15 05:41:04 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:41:04 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:41:04 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:41:04 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:41:04 user nova-compute[73391]:   </clock>
Aug 15 05:41:04 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:41:04 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:41:04 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:41:04 user nova-compute[73391]:   </cpu>
Aug 15 05:41:04 user nova-compute[73391]:   <devices>
Aug 15 05:41:04 user nova-compute[73391]:     <disk type="block" device="disk">
Aug 15 05:41:04 user nova-compute[73391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:41:04 user nova-compute[73391]:       <source dev="/dev/sdg"/>
Aug 15 05:41:04 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:41:04 user nova-compute[73391]:       <serial>911dca0b-7771-4c68-9daf-70cae57028cb</serial>
Aug 15 05:41:04 user nova-compute[73391]:     </disk>
Aug 15 05:41:04 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:41:04 user nova-compute[73391]:       <mac address="fa:16:3e:f9:58:41"/>
Aug 15 05:41:04 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:41:04 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:41:04 user nova-compute[73391]:       <target dev="tapc8787a16-cd"/>
Aug 15 05:41:04 user nova-compute[73391]:     </interface>
Aug 15 05:41:04 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:41:04 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/d60616bb-605e-4604-b637-56670f53159e/console.log" append="off"/>
Aug 15 05:41:04 user nova-compute[73391]:     </serial>
Aug 15 05:41:04 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:41:04 user nova-compute[73391]:     <video>
Aug 15 05:41:04 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:41:04 user nova-compute[73391]:     </video>
Aug 15 05:41:04 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:41:04 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:41:04 user nova-compute[73391]:     </rng>
Aug 15 05:41:04 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:41:04 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:41:04 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:41:04 user nova-compute[73391]:     </memballoon>
Aug 15 05:41:04 user nova-compute[73391]:   </devices>
Aug 15 05:41:04 user nova-compute[73391]: </domain>
Aug 15 05:41:04 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:41:04 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:40:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-173546372',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-173546372',id=30,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='83b9acbe11654053bb905e7c92558a35',ramdisk_id='',reservation_id='r-c3nfsozy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1045163116',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:40:41Z,user_data=None,user_id='887f0846cf554e12acf92a663f5ab266',uuid=d60616bb-605e-4604-b637-56670f53159e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8787a16-cd6d-410e-8d37-425bdad344d6", "address": "fa:16:3e:f9:58:41", "network": {"id": "70d88082-aea7-48bb-abb4-d77d264aaf01", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b9acbe11654053bb905e7c92558a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8787a16-cd", "ovs_interfaceid": "c8787a16-cd6d-410e-8d37-425bdad344d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:41:04 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Converting VIF {"id": "c8787a16-cd6d-410e-8d37-425bdad344d6", "address": "fa:16:3e:f9:58:41", "network": {"id": "70d88082-aea7-48bb-abb4-d77d264aaf01", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b9acbe11654053bb905e7c92558a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8787a16-cd", "ovs_interfaceid": "c8787a16-cd6d-410e-8d37-425bdad344d6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:41:04 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f9:58:41,bridge_name='br-int',has_traffic_filtering=True,id=c8787a16-cd6d-410e-8d37-425bdad344d6,network=Network(70d88082-aea7-48bb-abb4-d77d264aaf01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8787a16-cd') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:41:04 user nova-compute[73391]: DEBUG os_vif [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:58:41,bridge_name='br-int',has_traffic_filtering=True,id=c8787a16-cd6d-410e-8d37-425bdad344d6,network=Network(70d88082-aea7-48bb-abb4-d77d264aaf01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8787a16-cd') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:41:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:41:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:41:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:41:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:41:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc8787a16-cd, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:41:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc8787a16-cd, col_values=(('external_ids', {'iface-id': 'c8787a16-cd6d-410e-8d37-425bdad344d6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f9:58:41', 'vm-uuid': 'd60616bb-605e-4604-b637-56670f53159e'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:41:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:41:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:41:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:41:04 user nova-compute[73391]: INFO os_vif [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f9:58:41,bridge_name='br-int',has_traffic_filtering=True,id=c8787a16-cd6d-410e-8d37-425bdad344d6,network=Network(70d88082-aea7-48bb-abb4-d77d264aaf01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8787a16-cd')
Aug 15 05:41:04 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:41:04 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] No VIF found with MAC fa:16:3e:f9:58:41, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:41:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:41:06 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:41:06 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:41:06 user nova-compute[73391]: DEBUG nova.compute.manager [req-d6fc699d-195b-4f2c-8964-26c86254eb0e req-c909fabd-3afa-4201-8b9f-bed8182b8de8 service nova] [instance: d60616bb-605e-4604-b637-56670f53159e] Received event network-vif-plugged-c8787a16-cd6d-410e-8d37-425bdad344d6 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:41:06 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d6fc699d-195b-4f2c-8964-26c86254eb0e req-c909fabd-3afa-4201-8b9f-bed8182b8de8 service nova] Acquiring lock "d60616bb-605e-4604-b637-56670f53159e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:41:06 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d6fc699d-195b-4f2c-8964-26c86254eb0e req-c909fabd-3afa-4201-8b9f-bed8182b8de8 service nova] Lock "d60616bb-605e-4604-b637-56670f53159e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:41:06 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d6fc699d-195b-4f2c-8964-26c86254eb0e req-c909fabd-3afa-4201-8b9f-bed8182b8de8 service nova] Lock "d60616bb-605e-4604-b637-56670f53159e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:41:06 user nova-compute[73391]: DEBUG nova.compute.manager [req-d6fc699d-195b-4f2c-8964-26c86254eb0e req-c909fabd-3afa-4201-8b9f-bed8182b8de8 service nova] [instance: d60616bb-605e-4604-b637-56670f53159e] No waiting events found dispatching network-vif-plugged-c8787a16-cd6d-410e-8d37-425bdad344d6 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:41:06 user nova-compute[73391]: WARNING nova.compute.manager [req-d6fc699d-195b-4f2c-8964-26c86254eb0e req-c909fabd-3afa-4201-8b9f-bed8182b8de8 service nova] [instance: d60616bb-605e-4604-b637-56670f53159e] Received unexpected event network-vif-plugged-c8787a16-cd6d-410e-8d37-425bdad344d6 for instance with vm_state building and task_state spawning.
Aug 15 05:41:08 user nova-compute[73391]: DEBUG nova.compute.manager [req-2ef6e206-2fa1-4a77-845e-ebd3c82fef9f req-830a559f-3112-4dce-9e9a-5ab554281a91 service nova] [instance: d60616bb-605e-4604-b637-56670f53159e] Received event network-vif-plugged-c8787a16-cd6d-410e-8d37-425bdad344d6 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:41:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2ef6e206-2fa1-4a77-845e-ebd3c82fef9f req-830a559f-3112-4dce-9e9a-5ab554281a91 service nova] Acquiring lock "d60616bb-605e-4604-b637-56670f53159e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:41:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2ef6e206-2fa1-4a77-845e-ebd3c82fef9f req-830a559f-3112-4dce-9e9a-5ab554281a91 service nova] Lock "d60616bb-605e-4604-b637-56670f53159e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.008s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:41:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2ef6e206-2fa1-4a77-845e-ebd3c82fef9f req-830a559f-3112-4dce-9e9a-5ab554281a91 service nova] Lock "d60616bb-605e-4604-b637-56670f53159e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:41:08 user nova-compute[73391]: DEBUG nova.compute.manager [req-2ef6e206-2fa1-4a77-845e-ebd3c82fef9f req-830a559f-3112-4dce-9e9a-5ab554281a91 service nova] [instance: d60616bb-605e-4604-b637-56670f53159e] No waiting events found dispatching network-vif-plugged-c8787a16-cd6d-410e-8d37-425bdad344d6 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:41:08 user nova-compute[73391]: WARNING nova.compute.manager [req-2ef6e206-2fa1-4a77-845e-ebd3c82fef9f req-830a559f-3112-4dce-9e9a-5ab554281a91 service nova] [instance: d60616bb-605e-4604-b637-56670f53159e] Received unexpected event network-vif-plugged-c8787a16-cd6d-410e-8d37-425bdad344d6 for instance with vm_state building and task_state spawning.
Aug 15 05:41:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquiring lock "dc657d66-c3f8-44e5-b30e-3d79e586a8f3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:41:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "dc657d66-c3f8-44e5-b30e-3d79e586a8f3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:41:08 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078068.6329255, d60616bb-605e-4604-b637-56670f53159e => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:41:08 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: d60616bb-605e-4604-b637-56670f53159e] VM Resumed (Lifecycle Event)
Aug 15 05:41:08 user nova-compute[73391]: DEBUG nova.compute.manager [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:41:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] Guest created on hypervisor {{(pid=73391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 05:41:08 user nova-compute[73391]: DEBUG nova.compute.manager [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Starting instance... {{(pid=73391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 05:41:08 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: d60616bb-605e-4604-b637-56670f53159e] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:41:08 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: d60616bb-605e-4604-b637-56670f53159e] Instance spawned successfully.
Aug 15 05:41:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 05:41:08 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: d60616bb-605e-4604-b637-56670f53159e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:41:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] Found default for hw_cdrom_bus of ide {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:41:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] Found default for hw_disk_bus of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:41:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] Found default for hw_input_bus of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:41:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] Found default for hw_pointer_model of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:41:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] Found default for hw_video_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:41:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] Found default for hw_vif_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:41:08 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: d60616bb-605e-4604-b637-56670f53159e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:41:08 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078068.6332123, d60616bb-605e-4604-b637-56670f53159e => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:41:08 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: d60616bb-605e-4604-b637-56670f53159e] VM Started (Lifecycle Event)
Aug 15 05:41:08 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: d60616bb-605e-4604-b637-56670f53159e] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:41:08 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: d60616bb-605e-4604-b637-56670f53159e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:41:08 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: d60616bb-605e-4604-b637-56670f53159e] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:41:08 user nova-compute[73391]: INFO nova.compute.manager [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] Took 5.79 seconds to spawn the instance on the hypervisor.
Aug 15 05:41:08 user nova-compute[73391]: DEBUG nova.compute.manager [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:41:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:41:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:41:08 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 05:41:08 user nova-compute[73391]: INFO nova.compute.claims [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Claim successful on node user
Aug 15 05:41:09 user nova-compute[73391]: INFO nova.compute.manager [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] Took 29.06 seconds to build instance.
Aug 15 05:41:09 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-64387a61-26e5-40e9-9f9e-10c47b741dab tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "d60616bb-605e-4604-b637-56670f53159e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.215s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:41:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:41:09 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:41:09 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:41:09 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.657s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:41:09 user nova-compute[73391]: DEBUG nova.compute.manager [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Start building networks asynchronously for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 05:41:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:41:09 user nova-compute[73391]: DEBUG nova.compute.manager [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Allocating IP information in the background. {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 05:41:09 user nova-compute[73391]: DEBUG nova.network.neutron [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] allocate_for_instance() {{(pid=73391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 05:41:09 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 05:41:09 user nova-compute[73391]: DEBUG nova.compute.manager [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Start building block device mappings for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 05:41:09 user nova-compute[73391]: INFO nova.virt.block_device [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Booting with volume 40b1b33d-a14c-44fe-b274-6004c350d53c at /dev/vda
Aug 15 05:41:09 user nova-compute[73391]: DEBUG nova.policy [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '124dcfde552147e2978970386274c70a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60b01853a82243369bd71dc0dbedb5d6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73391) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 05:41:09 user nova-compute[73391]: DEBUG os_brick.utils [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:41:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:09 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0491e8-8ed9-49a6-a772-6b2043e45667]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:41:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:09 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[01fb283e-cabb-4f4d-af4f-db682859e0bc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:41:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:09 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d622b60-71c5-46bb-a98e-8daf70caae96]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:41:09 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[56afdc29-b569-47d3-8b49-8c12f2e60525]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:41:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:41:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 05:41:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:41:09 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 05:41:09 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a521d5f-ba8f-4f0b-9215-4d4688da80df]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:41:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 05:41:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 05:41:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 05:41:09 user nova-compute[73391]: DEBUG os_brick.utils [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:41:09 user nova-compute[73391]: DEBUG nova.virt.block_device [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Updating existing volume attachment record: 0dd26a48-de53-472a-98f1-e26b2d963fc8 {{(pid=73391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 05:41:10 user nova-compute[73391]: DEBUG nova.network.neutron [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Successfully created port: 83a46e94-e5e7-41bb-803a-30000c4f9a02 {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 05:41:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7e2dd581-cf92-4262-8ea9-51740cefcc6c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Acquiring lock "a1ba38e6-f0fe-408f-b1c8-f9b193531952" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:41:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7e2dd581-cf92-4262-8ea9-51740cefcc6c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Lock "a1ba38e6-f0fe-408f-b1c8-f9b193531952" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:41:10 user nova-compute[73391]: INFO nova.compute.manager [None req-7e2dd581-cf92-4262-8ea9-51740cefcc6c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Detaching volume 2c40b512-ed36-41c4-b248-24d3e25d6eb9
Aug 15 05:41:10 user nova-compute[73391]: INFO nova.virt.block_device [None req-7e2dd581-cf92-4262-8ea9-51740cefcc6c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Attempting to driver detach volume 2c40b512-ed36-41c4-b248-24d3e25d6eb9 from mountpoint /dev/vdb
Aug 15 05:41:10 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-7e2dd581-cf92-4262-8ea9-51740cefcc6c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Attempting to detach device vdb from instance a1ba38e6-f0fe-408f-b1c8-f9b193531952 from the persistent domain config. {{(pid=73391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 05:41:10 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-7e2dd581-cf92-4262-8ea9-51740cefcc6c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 05:41:10 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:41:10 user nova-compute[73391]:   <source dev="/dev/sdc"/>
Aug 15 05:41:10 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:41:10 user nova-compute[73391]:   <serial>2c40b512-ed36-41c4-b248-24d3e25d6eb9</serial>
Aug 15 05:41:10 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 05:41:10 user nova-compute[73391]: </disk>
Aug 15 05:41:10 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 05:41:10 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-7e2dd581-cf92-4262-8ea9-51740cefcc6c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Successfully detached device vdb from instance a1ba38e6-f0fe-408f-b1c8-f9b193531952 from the persistent domain config.
Aug 15 05:41:10 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-7e2dd581-cf92-4262-8ea9-51740cefcc6c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a1ba38e6-f0fe-408f-b1c8-f9b193531952 from the live domain config. {{(pid=73391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 05:41:10 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-7e2dd581-cf92-4262-8ea9-51740cefcc6c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 05:41:10 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:41:10 user nova-compute[73391]:   <source dev="/dev/sdc"/>
Aug 15 05:41:10 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:41:10 user nova-compute[73391]:   <serial>2c40b512-ed36-41c4-b248-24d3e25d6eb9</serial>
Aug 15 05:41:10 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 05:41:10 user nova-compute[73391]: </disk>
Aug 15 05:41:10 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 05:41:10 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692078055.976842, 3f88cd17-c89f-41f3-b630-8eb2c6698155 => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:41:10 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] VM Stopped (Lifecycle Event)
Aug 15 05:41:11 user nova-compute[73391]: DEBUG nova.compute.manager [None req-f7383aed-1457-46c7-8bb1-ec9825e2825e None None] [instance: 3f88cd17-c89f-41f3-b630-8eb2c6698155] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Received event <DeviceRemovedEvent: 1692078071.3615232, a1ba38e6-f0fe-408f-b1c8-f9b193531952 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73391) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-7e2dd581-cf92-4262-8ea9-51740cefcc6c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a1ba38e6-f0fe-408f-b1c8-f9b193531952 {{(pid=73391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 05:41:11 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-7e2dd581-cf92-4262-8ea9-51740cefcc6c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Successfully detached device vdb from instance a1ba38e6-f0fe-408f-b1c8-f9b193531952 from the live domain config.
Aug 15 05:41:11 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e2dd581-cf92-4262-8ea9-51740cefcc6c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e2dd581-cf92-4262-8ea9-51740cefcc6c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ixOBfLcp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:41:11 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-7e2dd581-cf92-4262-8ea9-51740cefcc6c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:41:11 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-7e2dd581-cf92-4262-8ea9-51740cefcc6c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-7e2dd581-cf92-4262-8ea9-51740cefcc6c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e2dd581-cf92-4262-8ea9-51740cefcc6c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9649ed-79ca-4426-8042-40b30c10007c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[977e0eea-0b1c-4176-9906-ed2d8195cc8e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e2dd581-cf92-4262-8ea9-51740cefcc6c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:41:11 user nova-compute[73391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)
Aug 15 05:41:11 user nova-compute[73391]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9 (non-flash)
Aug 15 05:41:11 user nova-compute[73391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)
Aug 15 05:41:11 user nova-compute[73391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48 (non-flash)
Aug 15 05:41:11 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:41:11 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e2dd581-cf92-4262-8ea9-51740cefcc6c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:41:11 user nova-compute[73391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)
Aug 15 05:41:11 user nova-compute[73391]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9 (non-flash)
Aug 15 05:41:11 user nova-compute[73391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)
Aug 15 05:41:11 user nova-compute[73391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48 (non-flash)
Aug 15 05:41:11 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:41:11 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e2dd581-cf92-4262-8ea9-51740cefcc6c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f772833e4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9'): ({'sdc'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-7e2dd581-cf92-4262-8ea9-51740cefcc6c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Removing single pathed devices sdc {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.031s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6524dba4-a02d-4221-954d-a26a3fe5d7be]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9df8b5a-9d8b-4532-ac57-229adf8cd249]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-7e2dd581-cf92-4262-8ea9-51740cefcc6c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Flushing IO for device /dev/sdc {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG nova.network.neutron [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Successfully updated port: 83a46e94-e5e7-41bb-803a-30000c4f9a02 {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquiring lock "refresh_cache-dc657d66-c3f8-44e5-b30e-3d79e586a8f3" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquired lock "refresh_cache-dc657d66-c3f8-44e5-b30e-3d79e586a8f3" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG nova.network.neutron [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4052c1c0-e65c-4242-938d-0725316e6806]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-7e2dd581-cf92-4262-8ea9-51740cefcc6c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG nova.compute.manager [req-43a385b6-7ee4-4598-b8e2-da44c60d0276 req-283b8e0d-c6b3-4b65-89c0-3c8f707e2c67 service nova] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Received event network-changed-83a46e94-e5e7-41bb-803a-30000c4f9a02 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG nova.compute.manager [req-43a385b6-7ee4-4598-b8e2-da44c60d0276 req-283b8e0d-c6b3-4b65-89c0-3c8f707e2c67 service nova] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Refreshing instance network info cache due to event network-changed-83a46e94-e5e7-41bb-803a-30000c4f9a02. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-43a385b6-7ee4-4598-b8e2-da44c60d0276 req-283b8e0d-c6b3-4b65-89c0-3c8f707e2c67 service nova] Acquiring lock "refresh_cache-dc657d66-c3f8-44e5-b30e-3d79e586a8f3" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.055s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[65fa34cd-b186-46c4-8ff5-e723e279f4d0]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-7e2dd581-cf92-4262-8ea9-51740cefcc6c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-7e2dd581-cf92-4262-8ea9-51740cefcc6c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] SCSI volumes sdc have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e2dd581-cf92-4262-8ea9-51740cefcc6c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG nova.network.neutron [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[254e49cf-faff-4ec6-ac1b-24a9ccf27c69]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e2dd581-cf92-4262-8ea9-51740cefcc6c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9 -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9969ab79-c37d-40c9-a622-1841cc39d462]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e2dd581-cf92-4262-8ea9-51740cefcc6c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9, portal: 172.16.0.220,3260]
Aug 15 05:41:11 user nova-compute[73391]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9, portal: 172.16.0.220,3260] successful.
Aug 15 05:41:11 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9 -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2c40b512-ed36-41c4-b248-24d3e25d6eb9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[07af07ce-32f5-452b-a641-02bc594020e9]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e2dd581-cf92-4262-8ea9-51740cefcc6c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-7e2dd581-cf92-4262-8ea9-51740cefcc6c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e2dd581-cf92-4262-8ea9-51740cefcc6c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] <== disconnect_volume: return (367ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e2dd581-cf92-4262-8ea9-51740cefcc6c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG nova.network.neutron [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Updating instance_info_cache with network_info: [{"id": "83a46e94-e5e7-41bb-803a-30000c4f9a02", "address": "fa:16:3e:ab:ac:be", "network": {"id": "610f78de-5741-4743-815d-d12ba05f8000", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1518164868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b01853a82243369bd71dc0dbedb5d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83a46e94-e5", "ovs_interfaceid": "83a46e94-e5e7-41bb-803a-30000c4f9a02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Releasing lock "refresh_cache-dc657d66-c3f8-44e5-b30e-3d79e586a8f3" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG nova.compute.manager [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Instance network_info: |[{"id": "83a46e94-e5e7-41bb-803a-30000c4f9a02", "address": "fa:16:3e:ab:ac:be", "network": {"id": "610f78de-5741-4743-815d-d12ba05f8000", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1518164868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b01853a82243369bd71dc0dbedb5d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83a46e94-e5", "ovs_interfaceid": "83a46e94-e5e7-41bb-803a-30000c4f9a02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-43a385b6-7ee4-4598-b8e2-da44c60d0276 req-283b8e0d-c6b3-4b65-89c0-3c8f707e2c67 service nova] Acquired lock "refresh_cache-dc657d66-c3f8-44e5-b30e-3d79e586a8f3" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:41:11 user nova-compute[73391]: DEBUG nova.network.neutron [req-43a385b6-7ee4-4598-b8e2-da44c60d0276 req-283b8e0d-c6b3-4b65-89c0-3c8f707e2c67 service nova] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Refreshing network info cache for port 83a46e94-e5e7-41bb-803a-30000c4f9a02 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:41:12 user nova-compute[73391]: DEBUG nova.objects.instance [None req-7e2dd581-cf92-4262-8ea9-51740cefcc6c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Lazy-loading 'flavor' on Instance uuid a1ba38e6-f0fe-408f-b1c8-f9b193531952 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:41:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7e2dd581-cf92-4262-8ea9-51740cefcc6c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Lock "a1ba38e6-f0fe-408f-b1c8-f9b193531952" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.908s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:41:12 user nova-compute[73391]: DEBUG nova.network.neutron [req-43a385b6-7ee4-4598-b8e2-da44c60d0276 req-283b8e0d-c6b3-4b65-89c0-3c8f707e2c67 service nova] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Updated VIF entry in instance network info cache for port 83a46e94-e5e7-41bb-803a-30000c4f9a02. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:41:12 user nova-compute[73391]: DEBUG nova.network.neutron [req-43a385b6-7ee4-4598-b8e2-da44c60d0276 req-283b8e0d-c6b3-4b65-89c0-3c8f707e2c67 service nova] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Updating instance_info_cache with network_info: [{"id": "83a46e94-e5e7-41bb-803a-30000c4f9a02", "address": "fa:16:3e:ab:ac:be", "network": {"id": "610f78de-5741-4743-815d-d12ba05f8000", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1518164868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b01853a82243369bd71dc0dbedb5d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83a46e94-e5", "ovs_interfaceid": "83a46e94-e5e7-41bb-803a-30000c4f9a02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:41:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-43a385b6-7ee4-4598-b8e2-da44c60d0276 req-283b8e0d-c6b3-4b65-89c0-3c8f707e2c67 service nova] Releasing lock "refresh_cache-dc657d66-c3f8-44e5-b30e-3d79e586a8f3" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:41:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:41:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:41:14 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:41:15 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:41:16 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:41:17 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:41:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:41:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:41:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:41:17 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Auditing locally available compute resources for user (node: user) {{(pid=73391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 05:41:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab02c376-1432-4981-9179-aeef6e647ea4/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab02c376-1432-4981-9179-aeef6e647ea4/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab02c376-1432-4981-9179-aeef6e647ea4/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab02c376-1432-4981-9179-aeef6e647ea4/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:18 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:41:18 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:41:18 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:41:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:19 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:41:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:41:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:41:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:19 user nova-compute[73391]: DEBUG nova.compute.manager [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Start spawning the instance on the hypervisor. {{(pid=73391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 05:41:19 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Creating instance directory {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 05:41:19 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Creating image(s)
Aug 15 05:41:19 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Did not create local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 05:41:19 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Ensure instance console log exists: /opt/stack/data/nova/instances/dc657d66-c3f8-44e5-b30e-3d79e586a8f3/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 05:41:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:41:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:41:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:41:19 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Start _get_guest_xml network_info=[{"id": "83a46e94-e5e7-41bb-803a-30000c4f9a02", "address": "fa:16:3e:ab:ac:be", "network": {"id": "610f78de-5741-4743-815d-d12ba05f8000", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1518164868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b01853a82243369bd71dc0dbedb5d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83a46e94-e5", "ovs_interfaceid": "83a46e94-e5e7-41bb-803a-30000c4f9a02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tXCnbYNK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'dc657d66-c3f8-44e5-b30e-3d79e586a8f3', 'attached_at': '', 'detached_at': '', 'volume_id': '40b1b33d-a14c-44fe-b274-6004c350d53c', 'serial': '40b1b33d-a14c-44fe-b274-6004c350d53c'}, 'attachment_id': '0dd26a48-de53-472a-98f1-e26b2d963fc8', 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'volume_type': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:41:19 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:41:19 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:41:20 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tXCnbYNK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:41:20 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:41:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:41:20 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:41:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:41:20 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 05:41:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2720d4c-06a3-423e-982e-4a7ea0746b7a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 05:41:20 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1485b9b-5812-4aab-9373-0e96a4d65956]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c] added
Aug 15 05:41:20 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e68f7d70-372d-4c2c-84ae-3d129b5a4631]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed3918d-b1fb-4013-989d-d8d63cc9116e]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tXCnbYNK {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tXCnbYNK" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26add81-0672-4541-9962-ba1f5e742f80]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tXCnbYNK'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.035s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[01bb9d48-73a7-45cf-9a66-1885cf754846]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[643947d5-30a7-40e0-9f22-cd7f08b3c68a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:41:20 user nova-compute[73391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)
Aug 15 05:41:20 user nova-compute[73391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)
Aug 15 05:41:20 user nova-compute[73391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48 (non-flash)
Aug 15 05:41:20 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:41:20 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:41:20 user nova-compute[73391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)
Aug 15 05:41:20 user nova-compute[73391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)
Aug 15 05:41:20 user nova-compute[73391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48 (non-flash)
Aug 15 05:41:20 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:41:20 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[33555045-2ff8-4bdb-a597-83d3db654c13]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c, portal: 172.16.0.220,3260]
Aug 15 05:41:20 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c, portal: 172.16.0.220,3260] successful.
Aug 15 05:41:20 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bd6213-3697-4a3d-a047-ede51836ca81]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ba38e6-f0fe-408f-b1c8-f9b193531952/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ba1654-4f7e-4075-9c1e-96090dcb2bb9]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:41:20 user nova-compute[73391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)
Aug 15 05:41:20 user nova-compute[73391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)
Aug 15 05:41:20 user nova-compute[73391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48 (non-flash)
Aug 15 05:41:20 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:41:20 user nova-compute[73391]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:41:20 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:41:20 user nova-compute[73391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)
Aug 15 05:41:20 user nova-compute[73391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)
Aug 15 05:41:20 user nova-compute[73391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48 (non-flash)
Aug 15 05:41:20 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:41:20 user nova-compute[73391]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:41:20 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.423s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] HCTL ('34', '-', '-', 0) found on session 36 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d5b175-aad1-4c56-9511-4c43ecc81818]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tXCnbYNK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ba38e6-f0fe-408f-b1c8-f9b193531952/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ba38e6-f0fe-408f-b1c8-f9b193531952/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a1ba38e6-f0fe-408f-b1c8-f9b193531952/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.462s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:41:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] <== connect_volume: return (1466ms) {'type': 'block', 'scsi_wwn': '23765613130366438', 'path': '/dev/sdc'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:41:21 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765613130366438', 'path': '/dev/sdc'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 05:41:21 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:41:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-156136201',display_name='tempest-ServerActionsTestOtherA-server-156136201',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-156136201',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNF3pif1QWXVpHrEIxShzB1xE/c22B7LSOZtRDzcmt7Dk63BIrH6/RWzxjN8WpKbyeDl3Aa13tDu+mUrmV6NfezccRAEecdR4P4btA7xRgsBIkQydnisHIujmlpX6Glrow==',key_name='tempest-keypair-512432776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60b01853a82243369bd71dc0dbedb5d6',ramdisk_id='',reservation_id='r-lrepebad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1927429987',owner_user_name='tempest-ServerActionsTestOtherA-1927429987-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:41:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='124dcfde552147e2978970386274c70a',uuid=dc657d66-c3f8-44e5-b30e-3d79e586a8f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83a46e94-e5e7-41bb-803a-30000c4f9a02", "address": "fa:16:3e:ab:ac:be", "network": {"id": "610f78de-5741-4743-815d-d12ba05f8000", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1518164868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b01853a82243369bd71dc0dbedb5d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83a46e94-e5", "ovs_interfaceid": "83a46e94-e5e7-41bb-803a-30000c4f9a02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:41:21 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Converting VIF {"id": "83a46e94-e5e7-41bb-803a-30000c4f9a02", "address": "fa:16:3e:ab:ac:be", "network": {"id": "610f78de-5741-4743-815d-d12ba05f8000", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1518164868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b01853a82243369bd71dc0dbedb5d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83a46e94-e5", "ovs_interfaceid": "83a46e94-e5e7-41bb-803a-30000c4f9a02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:41:21 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:ac:be,bridge_name='br-int',has_traffic_filtering=True,id=83a46e94-e5e7-41bb-803a-30000c4f9a02,network=Network(610f78de-5741-4743-815d-d12ba05f8000),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83a46e94-e5') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:41:21 user nova-compute[73391]: DEBUG nova.objects.instance [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lazy-loading 'pci_devices' on Instance uuid dc657d66-c3f8-44e5-b30e-3d79e586a8f3 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:41:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:21 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-b5a49dca-16c2-4ca8-8055-abb54d0b0c76 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Acquiring lock "fee43642-30e8-451b-919c-aca4cd4c3f81" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:41:21 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-b5a49dca-16c2-4ca8-8055-abb54d0b0c76 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "fee43642-30e8-451b-919c-aca4cd4c3f81" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:41:21 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:41:21 user nova-compute[73391]:   <uuid>dc657d66-c3f8-44e5-b30e-3d79e586a8f3</uuid>
Aug 15 05:41:21 user nova-compute[73391]:   <name>instance-0000001f</name>
Aug 15 05:41:21 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:41:21 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:41:21 user nova-compute[73391]:   <metadata>
Aug 15 05:41:21 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:41:21 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:41:21 user nova-compute[73391]:       <nova:name>tempest-ServerActionsTestOtherA-server-156136201</nova:name>
Aug 15 05:41:21 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:41:19</nova:creationTime>
Aug 15 05:41:21 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:41:21 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:41:21 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:41:21 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:41:21 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:41:21 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:41:21 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:41:21 user nova-compute[73391]:       <nova:owner>
Aug 15 05:41:21 user nova-compute[73391]:         <nova:user uuid="124dcfde552147e2978970386274c70a">tempest-ServerActionsTestOtherA-1927429987-project-member</nova:user>
Aug 15 05:41:21 user nova-compute[73391]:         <nova:project uuid="60b01853a82243369bd71dc0dbedb5d6">tempest-ServerActionsTestOtherA-1927429987</nova:project>
Aug 15 05:41:21 user nova-compute[73391]:       </nova:owner>
Aug 15 05:41:21 user nova-compute[73391]:       <nova:ports>
Aug 15 05:41:21 user nova-compute[73391]:         <nova:port uuid="83a46e94-e5e7-41bb-803a-30000c4f9a02">
Aug 15 05:41:21 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 15 05:41:21 user nova-compute[73391]:         </nova:port>
Aug 15 05:41:21 user nova-compute[73391]:       </nova:ports>
Aug 15 05:41:21 user nova-compute[73391]:     </nova:instance>
Aug 15 05:41:21 user nova-compute[73391]:   </metadata>
Aug 15 05:41:21 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:41:21 user nova-compute[73391]:     <system>
Aug 15 05:41:21 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:41:21 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:41:21 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:41:21 user nova-compute[73391]:       <entry name="serial">dc657d66-c3f8-44e5-b30e-3d79e586a8f3</entry>
Aug 15 05:41:21 user nova-compute[73391]:       <entry name="uuid">dc657d66-c3f8-44e5-b30e-3d79e586a8f3</entry>
Aug 15 05:41:21 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:41:21 user nova-compute[73391]:     </system>
Aug 15 05:41:21 user nova-compute[73391]:   </sysinfo>
Aug 15 05:41:21 user nova-compute[73391]:   <os>
Aug 15 05:41:21 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:41:21 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:41:21 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:41:21 user nova-compute[73391]:   </os>
Aug 15 05:41:21 user nova-compute[73391]:   <features>
Aug 15 05:41:21 user nova-compute[73391]:     <acpi/>
Aug 15 05:41:21 user nova-compute[73391]:     <apic/>
Aug 15 05:41:21 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:41:21 user nova-compute[73391]:   </features>
Aug 15 05:41:21 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:41:21 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:41:21 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:41:21 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:41:21 user nova-compute[73391]:   </clock>
Aug 15 05:41:21 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:41:21 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:41:21 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:41:21 user nova-compute[73391]:   </cpu>
Aug 15 05:41:21 user nova-compute[73391]:   <devices>
Aug 15 05:41:21 user nova-compute[73391]:     <disk type="block" device="disk">
Aug 15 05:41:21 user nova-compute[73391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:41:21 user nova-compute[73391]:       <source dev="/dev/sdc"/>
Aug 15 05:41:21 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:41:21 user nova-compute[73391]:       <serial>40b1b33d-a14c-44fe-b274-6004c350d53c</serial>
Aug 15 05:41:21 user nova-compute[73391]:     </disk>
Aug 15 05:41:21 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:41:21 user nova-compute[73391]:       <mac address="fa:16:3e:ab:ac:be"/>
Aug 15 05:41:21 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:41:21 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:41:21 user nova-compute[73391]:       <target dev="tap83a46e94-e5"/>
Aug 15 05:41:21 user nova-compute[73391]:     </interface>
Aug 15 05:41:21 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:41:21 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/dc657d66-c3f8-44e5-b30e-3d79e586a8f3/console.log" append="off"/>
Aug 15 05:41:21 user nova-compute[73391]:     </serial>
Aug 15 05:41:21 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:41:21 user nova-compute[73391]:     <video>
Aug 15 05:41:21 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:41:21 user nova-compute[73391]:     </video>
Aug 15 05:41:21 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:41:21 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:41:21 user nova-compute[73391]:     </rng>
Aug 15 05:41:21 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:41:21 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:41:21 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:41:21 user nova-compute[73391]:     </memballoon>
Aug 15 05:41:21 user nova-compute[73391]:   </devices>
Aug 15 05:41:21 user nova-compute[73391]: </domain>
Aug 15 05:41:21 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:41:21 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:41:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-156136201',display_name='tempest-ServerActionsTestOtherA-server-156136201',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-156136201',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNF3pif1QWXVpHrEIxShzB1xE/c22B7LSOZtRDzcmt7Dk63BIrH6/RWzxjN8WpKbyeDl3Aa13tDu+mUrmV6NfezccRAEecdR4P4btA7xRgsBIkQydnisHIujmlpX6Glrow==',key_name='tempest-keypair-512432776',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='60b01853a82243369bd71dc0dbedb5d6',ramdisk_id='',reservation_id='r-lrepebad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1927429987',owner_user_name='tempest-ServerActionsTestOtherA-1927429987-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:41:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='124dcfde552147e2978970386274c70a',uuid=dc657d66-c3f8-44e5-b30e-3d79e586a8f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "83a46e94-e5e7-41bb-803a-30000c4f9a02", "address": "fa:16:3e:ab:ac:be", "network": {"id": "610f78de-5741-4743-815d-d12ba05f8000", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1518164868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b01853a82243369bd71dc0dbedb5d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83a46e94-e5", "ovs_interfaceid": "83a46e94-e5e7-41bb-803a-30000c4f9a02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:41:21 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Converting VIF {"id": "83a46e94-e5e7-41bb-803a-30000c4f9a02", "address": "fa:16:3e:ab:ac:be", "network": {"id": "610f78de-5741-4743-815d-d12ba05f8000", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1518164868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b01853a82243369bd71dc0dbedb5d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83a46e94-e5", "ovs_interfaceid": "83a46e94-e5e7-41bb-803a-30000c4f9a02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:41:21 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:ac:be,bridge_name='br-int',has_traffic_filtering=True,id=83a46e94-e5e7-41bb-803a-30000c4f9a02,network=Network(610f78de-5741-4743-815d-d12ba05f8000),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83a46e94-e5') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:41:21 user nova-compute[73391]: DEBUG os_vif [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:ac:be,bridge_name='br-int',has_traffic_filtering=True,id=83a46e94-e5e7-41bb-803a-30000c4f9a02,network=Network(610f78de-5741-4743-815d-d12ba05f8000),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83a46e94-e5') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:41:21 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:41:21 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:41:21 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:41:21 user nova-compute[73391]: INFO nova.compute.manager [None req-b5a49dca-16c2-4ca8-8055-abb54d0b0c76 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Detaching volume 83493878-2d16-44dc-b416-c6cadb17f0cd
Aug 15 05:41:21 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:41:21 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap83a46e94-e5, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:41:21 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap83a46e94-e5, col_values=(('external_ids', {'iface-id': '83a46e94-e5e7-41bb-803a-30000c4f9a02', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:ac:be', 'vm-uuid': 'dc657d66-c3f8-44e5-b30e-3d79e586a8f3'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:41:21 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:41:21 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:41:21 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:41:21 user nova-compute[73391]: INFO os_vif [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:ac:be,bridge_name='br-int',has_traffic_filtering=True,id=83a46e94-e5e7-41bb-803a-30000c4f9a02,network=Network(610f78de-5741-4743-815d-d12ba05f8000),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83a46e94-e5')
Aug 15 05:41:21 user nova-compute[73391]: INFO nova.virt.block_device [None req-b5a49dca-16c2-4ca8-8055-abb54d0b0c76 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Attempting to driver detach volume 83493878-2d16-44dc-b416-c6cadb17f0cd from mountpoint /dev/vdb
Aug 15 05:41:21 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:41:21 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] No VIF found with MAC fa:16:3e:ab:ac:be, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:41:21 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-b5a49dca-16c2-4ca8-8055-abb54d0b0c76 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Attempting to detach device vdb from instance fee43642-30e8-451b-919c-aca4cd4c3f81 from the persistent domain config. {{(pid=73391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 05:41:21 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-b5a49dca-16c2-4ca8-8055-abb54d0b0c76 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 05:41:21 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:41:21 user nova-compute[73391]:   <source dev="/dev/sdb"/>
Aug 15 05:41:21 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:41:21 user nova-compute[73391]:   <serial>83493878-2d16-44dc-b416-c6cadb17f0cd</serial>
Aug 15 05:41:21 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 05:41:21 user nova-compute[73391]: </disk>
Aug 15 05:41:21 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 05:41:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:21 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-b5a49dca-16c2-4ca8-8055-abb54d0b0c76 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Successfully detached device vdb from instance fee43642-30e8-451b-919c-aca4cd4c3f81 from the persistent domain config.
Aug 15 05:41:21 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-b5a49dca-16c2-4ca8-8055-abb54d0b0c76 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fee43642-30e8-451b-919c-aca4cd4c3f81 from the live domain config. {{(pid=73391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 05:41:21 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-b5a49dca-16c2-4ca8-8055-abb54d0b0c76 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 05:41:21 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:41:21 user nova-compute[73391]:   <source dev="/dev/sdb"/>
Aug 15 05:41:21 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:41:21 user nova-compute[73391]:   <serial>83493878-2d16-44dc-b416-c6cadb17f0cd</serial>
Aug 15 05:41:21 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 05:41:21 user nova-compute[73391]: </disk>
Aug 15 05:41:21 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 05:41:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76fcbfca-deca-44f0-9182-1f9bbab134d2/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:22 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76fcbfca-deca-44f0-9182-1f9bbab134d2/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:22 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76fcbfca-deca-44f0-9182-1f9bbab134d2/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:22 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Received event <DeviceRemovedEvent: 1692078082.28603, fee43642-30e8-451b-919c-aca4cd4c3f81 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73391) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 05:41:22 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-b5a49dca-16c2-4ca8-8055-abb54d0b0c76 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fee43642-30e8-451b-919c-aca4cd4c3f81 {{(pid=73391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 05:41:22 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-b5a49dca-16c2-4ca8-8055-abb54d0b0c76 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Successfully detached device vdb from instance fee43642-30e8-451b-919c-aca4cd4c3f81 from the live domain config.
Aug 15 05:41:22 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5a49dca-16c2-4ca8-8055-abb54d0b0c76 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 05:41:22 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a49dca-16c2-4ca8-8055-abb54d0b0c76 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NlCGZfgX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:41:22 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-b5a49dca-16c2-4ca8-8055-abb54d0b0c76 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:41:22 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-b5a49dca-16c2-4ca8-8055-abb54d0b0c76 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:41:22 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-b5a49dca-16c2-4ca8-8055-abb54d0b0c76 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:41:22 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a49dca-16c2-4ca8-8055-abb54d0b0c76 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 05:41:22 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:22 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:22 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[622f55ee-383b-43bb-b777-751e733ca117]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:41:22 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:22 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76fcbfca-deca-44f0-9182-1f9bbab134d2/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:22 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:22 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba09836e-0de2-4f85-9015-f700660e0866]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:41:22 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a49dca-16c2-4ca8-8055-abb54d0b0c76 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:41:22 user nova-compute[73391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)
Aug 15 05:41:22 user nova-compute[73391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)
Aug 15 05:41:22 user nova-compute[73391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48 (non-flash)
Aug 15 05:41:22 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:41:22 user nova-compute[73391]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:41:22 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:41:22 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a49dca-16c2-4ca8-8055-abb54d0b0c76 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:41:22 user nova-compute[73391]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd (non-flash)
Aug 15 05:41:22 user nova-compute[73391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)
Aug 15 05:41:22 user nova-compute[73391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48 (non-flash)
Aug 15 05:41:22 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:41:22 user nova-compute[73391]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:41:22 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:41:22 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a49dca-16c2-4ca8-8055-abb54d0b0c76 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7757fd1480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd'): ({'sdb'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 05:41:22 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-b5a49dca-16c2-4ca8-8055-abb54d0b0c76 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Removing single pathed devices sdb {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 05:41:22 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078085.4911084, dc657d66-c3f8-44e5-b30e-3d79e586a8f3 => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:41:25 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] VM Resumed (Lifecycle Event)
Aug 15 05:41:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c499504-be21-4e07-8c0f-45ef43be8189]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG nova.compute.manager [req-3dee7b01-5519-4ce1-aee7-768e059b217c req-a9f531e7-f5d4-4a38-a393-3a28c8c320eb service nova] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Received event network-vif-plugged-83a46e94-e5e7-41bb-803a-30000c4f9a02 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-3dee7b01-5519-4ce1-aee7-768e059b217c req-a9f531e7-f5d4-4a38-a393-3a28c8c320eb service nova] Acquiring lock "dc657d66-c3f8-44e5-b30e-3d79e586a8f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-3dee7b01-5519-4ce1-aee7-768e059b217c req-a9f531e7-f5d4-4a38-a393-3a28c8c320eb service nova] Lock "dc657d66-c3f8-44e5-b30e-3d79e586a8f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-3dee7b01-5519-4ce1-aee7-768e059b217c req-a9f531e7-f5d4-4a38-a393-3a28c8c320eb service nova] Lock "dc657d66-c3f8-44e5-b30e-3d79e586a8f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG nova.compute.manager [req-3dee7b01-5519-4ce1-aee7-768e059b217c req-a9f531e7-f5d4-4a38-a393-3a28c8c320eb service nova] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] No waiting events found dispatching network-vif-plugged-83a46e94-e5e7-41bb-803a-30000c4f9a02 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:41:25 user nova-compute[73391]: WARNING nova.compute.manager [req-3dee7b01-5519-4ce1-aee7-768e059b217c req-a9f531e7-f5d4-4a38-a393-3a28c8c320eb service nova] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Received unexpected event network-vif-plugged-83a46e94-e5e7-41bb-803a-30000c4f9a02 for instance with vm_state building and task_state spawning.
Aug 15 05:41:25 user nova-compute[73391]: DEBUG nova.compute.manager [req-379cf031-bd48-4173-8d14-90b1fc9b9c19 req-a721c7f1-379b-43b6-8deb-5ff423097c65 service nova] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Received event network-vif-plugged-83a46e94-e5e7-41bb-803a-30000c4f9a02 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-379cf031-bd48-4173-8d14-90b1fc9b9c19 req-a721c7f1-379b-43b6-8deb-5ff423097c65 service nova] Acquiring lock "dc657d66-c3f8-44e5-b30e-3d79e586a8f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-379cf031-bd48-4173-8d14-90b1fc9b9c19 req-a721c7f1-379b-43b6-8deb-5ff423097c65 service nova] Lock "dc657d66-c3f8-44e5-b30e-3d79e586a8f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-379cf031-bd48-4173-8d14-90b1fc9b9c19 req-a721c7f1-379b-43b6-8deb-5ff423097c65 service nova] Lock "dc657d66-c3f8-44e5-b30e-3d79e586a8f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG nova.compute.manager [req-379cf031-bd48-4173-8d14-90b1fc9b9c19 req-a721c7f1-379b-43b6-8deb-5ff423097c65 service nova] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] No waiting events found dispatching network-vif-plugged-83a46e94-e5e7-41bb-803a-30000c4f9a02 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:41:25 user nova-compute[73391]: WARNING nova.compute.manager [req-379cf031-bd48-4173-8d14-90b1fc9b9c19 req-a721c7f1-379b-43b6-8deb-5ff423097c65 service nova] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Received unexpected event network-vif-plugged-83a46e94-e5e7-41bb-803a-30000c4f9a02 for instance with vm_state building and task_state spawning.
Aug 15 05:41:25 user nova-compute[73391]: DEBUG nova.compute.manager [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Guest created on hypervisor {{(pid=73391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:41:25 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Instance spawned successfully.
Aug 15 05:41:25 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:41:25 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:41:25 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Hypervisor/Node resource view: name=user free_ram=6799MB free_disk=25.08633041381836GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe99dab2-81a8-4279-8152-4adb30c36409]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-b5a49dca-16c2-4ca8-8055-abb54d0b0c76 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Flushing IO for device /dev/sdb {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4864f764-0f4a-442c-a84b-47d4dcb396f3]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-b5a49dca-16c2-4ca8-8055-abb54d0b0c76 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Found default for hw_cdrom_bus of ide {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Found default for hw_disk_bus of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Found default for hw_input_bus of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Found default for hw_pointer_model of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Found default for hw_video_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Found default for hw_vif_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:41:25 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:41:25 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078085.492695, dc657d66-c3f8-44e5-b30e-3d79e586a8f3 => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:41:25 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] VM Started (Lifecycle Event)
Aug 15 05:41:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[28156627-3c7d-4430-bdcd-237089c83841]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-b5a49dca-16c2-4ca8-8055-abb54d0b0c76 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-b5a49dca-16c2-4ca8-8055-abb54d0b0c76 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] SCSI volumes sdb have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a49dca-16c2-4ca8-8055-abb54d0b0c76 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[89192cee-2e97-4d92-8086-cc0ec85ba91e]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a49dca-16c2-4ca8-8055-abb54d0b0c76 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:41:25 user nova-compute[73391]: INFO nova.compute.manager [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Took 5.90 seconds to spawn the instance on the hypervisor.
Aug 15 05:41:25 user nova-compute[73391]: DEBUG nova.compute.manager [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:41:25 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:41:25 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 8f08782b-f793-415e-b0d6-5caad1c3d426 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 6ac9d5dc-56be-402f-b9d4-3327bdfd9220 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 6358e825-5705-45d6-86b6-3aacfa5a9bbb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance fee43642-30e8-451b-919c-aca4cd4c3f81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 730890c6-6999-4a0f-b80c-e4745bff99ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 8ff2da51-5bfd-4cdc-8cef-330cdef93d97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance a1ba38e6-f0fe-408f-b1c8-f9b193531952 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 8991b32e-6c4b-4c66-a320-e734061f49ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 8d344530-40f9-43f0-8417-15110c6c9748 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 76fcbfca-deca-44f0-9182-1f9bbab134d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance c21e1783-ddc5-479f-8b8d-db5b13ca068a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance d60616bb-605e-4604-b637-56670f53159e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance ab02c376-1432-4981-9179-aeef6e647ea4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance dc657d66-c3f8-44e5-b30e-3d79e586a8f3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Total usable vcpus: 12, total allocated vcpus: 15 {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=15 pci_stats=[] {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8bb835d-f118-4f57-b6b1-498cb7484ed4]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a49dca-16c2-4ca8-8055-abb54d0b0c76 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd, portal: 172.16.0.220,3260]
Aug 15 05:41:25 user nova-compute[73391]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd, portal: 172.16.0.220,3260] successful.
Aug 15 05:41:25 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:41:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:25 user nova-compute[73391]: INFO nova.compute.manager [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Took 17.11 seconds to build instance.
Aug 15 05:41:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-49287661-d191-46f3-b21d-2d095cc23dfa tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "dc657d66-c3f8-44e5-b30e-3d79e586a8f3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.370s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:41:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:83493878-2d16-44dc-b416-c6cadb17f0cd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:26 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee77f120-5112-467a-ba7e-f70553cb4381]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:41:26 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a49dca-16c2-4ca8-8055-abb54d0b0c76 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:41:26 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-b5a49dca-16c2-4ca8-8055-abb54d0b0c76 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 3.702s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:41:26 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5a49dca-16c2-4ca8-8055-abb54d0b0c76 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] <== disconnect_volume: return (3703ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:41:26 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5a49dca-16c2-4ca8-8055-abb54d0b0c76 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 05:41:26 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:41:26 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:41:26 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Compute_service record updated for user:user {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 05:41:26 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.650s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:41:26 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:41:26 user nova-compute[73391]: DEBUG nova.objects.instance [None req-b5a49dca-16c2-4ca8-8055-abb54d0b0c76 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lazy-loading 'flavor' on Instance uuid fee43642-30e8-451b-919c-aca4cd4c3f81 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:41:26 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-b5a49dca-16c2-4ca8-8055-abb54d0b0c76 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "fee43642-30e8-451b-919c-aca4cd4c3f81" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 5.336s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:41:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-425083fa-3110-4a7f-9af5-35f3552e9cc0 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Acquiring lock "fee43642-30e8-451b-919c-aca4cd4c3f81" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:41:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-425083fa-3110-4a7f-9af5-35f3552e9cc0 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "fee43642-30e8-451b-919c-aca4cd4c3f81" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:41:28 user nova-compute[73391]: DEBUG nova.compute.manager [None req-425083fa-3110-4a7f-9af5-35f3552e9cc0 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:41:28 user nova-compute[73391]: DEBUG nova.compute.manager [None req-425083fa-3110-4a7f-9af5-35f3552e9cc0 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=73391) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Aug 15 05:41:28 user nova-compute[73391]: DEBUG nova.objects.instance [None req-425083fa-3110-4a7f-9af5-35f3552e9cc0 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lazy-loading 'flavor' on Instance uuid fee43642-30e8-451b-919c-aca4cd4c3f81 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:41:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:41:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:41:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:41:28 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:41:28 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:41:28 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:41:28 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Starting heal instance info cache {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 05:41:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:41:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "refresh_cache-6ac9d5dc-56be-402f-b9d4-3327bdfd9220" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:41:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquired lock "refresh_cache-6ac9d5dc-56be-402f-b9d4-3327bdfd9220" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:41:28 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Forcefully refreshing network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 05:41:28 user nova-compute[73391]: DEBUG nova.compute.manager [req-905965eb-4c4d-4e31-9b8f-06ddb4592284 req-98154ac3-cecb-47c8-8408-37471644ef37 service nova] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Received event network-vif-unplugged-fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:41:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-905965eb-4c4d-4e31-9b8f-06ddb4592284 req-98154ac3-cecb-47c8-8408-37471644ef37 service nova] Acquiring lock "fee43642-30e8-451b-919c-aca4cd4c3f81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:41:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-905965eb-4c4d-4e31-9b8f-06ddb4592284 req-98154ac3-cecb-47c8-8408-37471644ef37 service nova] Lock "fee43642-30e8-451b-919c-aca4cd4c3f81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:41:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-905965eb-4c4d-4e31-9b8f-06ddb4592284 req-98154ac3-cecb-47c8-8408-37471644ef37 service nova] Lock "fee43642-30e8-451b-919c-aca4cd4c3f81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:41:28 user nova-compute[73391]: DEBUG nova.compute.manager [req-905965eb-4c4d-4e31-9b8f-06ddb4592284 req-98154ac3-cecb-47c8-8408-37471644ef37 service nova] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] No waiting events found dispatching network-vif-unplugged-fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:41:28 user nova-compute[73391]: WARNING nova.compute.manager [req-905965eb-4c4d-4e31-9b8f-06ddb4592284 req-98154ac3-cecb-47c8-8408-37471644ef37 service nova] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Received unexpected event network-vif-unplugged-fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b for instance with vm_state active and task_state powering-off.
Aug 15 05:41:28 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Instance destroyed successfully.
Aug 15 05:41:28 user nova-compute[73391]: DEBUG nova.compute.manager [None req-425083fa-3110-4a7f-9af5-35f3552e9cc0 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:41:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-425083fa-3110-4a7f-9af5-35f3552e9cc0 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "fee43642-30e8-451b-919c-aca4cd4c3f81" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.866s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:41:29 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:41:29 user nova-compute[73391]: DEBUG nova.compute.manager [req-fc6b6ace-5984-4761-b3fe-50906d05611e req-0cd5a2c2-0837-40e7-a8a1-059ac28fd896 service nova] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Received event network-changed-46454c88-9007-47b1-a199-b80afdf843f1 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:41:29 user nova-compute[73391]: DEBUG nova.compute.manager [req-fc6b6ace-5984-4761-b3fe-50906d05611e req-0cd5a2c2-0837-40e7-a8a1-059ac28fd896 service nova] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Refreshing instance network info cache due to event network-changed-46454c88-9007-47b1-a199-b80afdf843f1. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:41:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-fc6b6ace-5984-4761-b3fe-50906d05611e req-0cd5a2c2-0837-40e7-a8a1-059ac28fd896 service nova] Acquiring lock "refresh_cache-8d344530-40f9-43f0-8417-15110c6c9748" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:41:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-fc6b6ace-5984-4761-b3fe-50906d05611e req-0cd5a2c2-0837-40e7-a8a1-059ac28fd896 service nova] Acquired lock "refresh_cache-8d344530-40f9-43f0-8417-15110c6c9748" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:41:29 user nova-compute[73391]: DEBUG nova.network.neutron [req-fc6b6ace-5984-4761-b3fe-50906d05611e req-0cd5a2c2-0837-40e7-a8a1-059ac28fd896 service nova] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Refreshing network info cache for port 46454c88-9007-47b1-a199-b80afdf843f1 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:41:29 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Updating instance_info_cache with network_info: [{"id": "9cde10e9-3186-4680-8e4d-a3bb0d8600d0", "address": "fa:16:3e:50:39:e0", "network": {"id": "610f78de-5741-4743-815d-d12ba05f8000", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1518164868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b01853a82243369bd71dc0dbedb5d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cde10e9-31", "ovs_interfaceid": "9cde10e9-3186-4680-8e4d-a3bb0d8600d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:41:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Releasing lock "refresh_cache-6ac9d5dc-56be-402f-b9d4-3327bdfd9220" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:41:29 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Updated the network info_cache for instance {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 05:41:29 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:41:29 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:41:29 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:41:29 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 05:41:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ce572460-8748-49a9-9503-b5f5795d6988 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Acquiring lock "8d344530-40f9-43f0-8417-15110c6c9748" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:41:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ce572460-8748-49a9-9503-b5f5795d6988 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Lock "8d344530-40f9-43f0-8417-15110c6c9748" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:41:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ce572460-8748-49a9-9503-b5f5795d6988 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Acquiring lock "8d344530-40f9-43f0-8417-15110c6c9748-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:41:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ce572460-8748-49a9-9503-b5f5795d6988 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Lock "8d344530-40f9-43f0-8417-15110c6c9748-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:41:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ce572460-8748-49a9-9503-b5f5795d6988 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Lock "8d344530-40f9-43f0-8417-15110c6c9748-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:41:29 user nova-compute[73391]: INFO nova.compute.manager [None req-ce572460-8748-49a9-9503-b5f5795d6988 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Terminating instance
Aug 15 05:41:29 user nova-compute[73391]: DEBUG nova.compute.manager [None req-ce572460-8748-49a9-9503-b5f5795d6988 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Start destroying the instance on the hypervisor. {{(pid=73391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 05:41:29 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:41:29 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:41:29 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:41:29 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:41:29 user nova-compute[73391]: DEBUG nova.network.neutron [req-fc6b6ace-5984-4761-b3fe-50906d05611e req-0cd5a2c2-0837-40e7-a8a1-059ac28fd896 service nova] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Updated VIF entry in instance network info cache for port 46454c88-9007-47b1-a199-b80afdf843f1. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:41:29 user nova-compute[73391]: DEBUG nova.network.neutron [req-fc6b6ace-5984-4761-b3fe-50906d05611e req-0cd5a2c2-0837-40e7-a8a1-059ac28fd896 service nova] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Updating instance_info_cache with network_info: [{"id": "46454c88-9007-47b1-a199-b80afdf843f1", "address": "fa:16:3e:d4:7c:d2", "network": {"id": "234a8df7-8eea-44bf-ae16-0840862765d4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1326637884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a88327b042847d5b910c53bda19976b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46454c88-90", "ovs_interfaceid": "46454c88-9007-47b1-a199-b80afdf843f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-fc6b6ace-5984-4761-b3fe-50906d05611e req-0cd5a2c2-0837-40e7-a8a1-059ac28fd896 service nova] Releasing lock "refresh_cache-8d344530-40f9-43f0-8417-15110c6c9748" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG nova.compute.manager [req-fa5dda68-8ff4-43bd-8630-df7a40155ffa req-a191dbb3-f4a8-46cc-8bc8-429f0deb5de6 service nova] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Received event network-vif-unplugged-46454c88-9007-47b1-a199-b80afdf843f1 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-fa5dda68-8ff4-43bd-8630-df7a40155ffa req-a191dbb3-f4a8-46cc-8bc8-429f0deb5de6 service nova] Acquiring lock "8d344530-40f9-43f0-8417-15110c6c9748-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-fa5dda68-8ff4-43bd-8630-df7a40155ffa req-a191dbb3-f4a8-46cc-8bc8-429f0deb5de6 service nova] Lock "8d344530-40f9-43f0-8417-15110c6c9748-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-fa5dda68-8ff4-43bd-8630-df7a40155ffa req-a191dbb3-f4a8-46cc-8bc8-429f0deb5de6 service nova] Lock "8d344530-40f9-43f0-8417-15110c6c9748-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG nova.compute.manager [req-fa5dda68-8ff4-43bd-8630-df7a40155ffa req-a191dbb3-f4a8-46cc-8bc8-429f0deb5de6 service nova] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] No waiting events found dispatching network-vif-unplugged-46454c88-9007-47b1-a199-b80afdf843f1 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG nova.compute.manager [req-fa5dda68-8ff4-43bd-8630-df7a40155ffa req-a191dbb3-f4a8-46cc-8bc8-429f0deb5de6 service nova] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Received event network-vif-unplugged-46454c88-9007-47b1-a199-b80afdf843f1 for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 05:41:30 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Instance destroyed successfully.
Aug 15 05:41:30 user nova-compute[73391]: DEBUG nova.objects.instance [None req-ce572460-8748-49a9-9503-b5f5795d6988 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Lazy-loading 'resources' on Instance uuid 8d344530-40f9-43f0-8417-15110c6c9748 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-ce572460-8748-49a9-9503-b5f5795d6988 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T05:35:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1421040367',display_name='tempest-TestShelveInstance-server-1421040367',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1421040367',id=21,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIjqGEVcAW2Uflq9MaJWAWTPNQuXGUc1NNjM/VUaxwHQAEIj+9ZU31fFYi9+U/4OgXkXULYekTILGFB+ZF6Vju2o5J0ZWcZ4A8I3Iq/WxIc0yOp+wikspXmyImZ32D3lTA==',key_name='tempest-TestShelveInstance-1898835883',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:40:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8a88327b042847d5b910c53bda19976b',ramdisk_id='',reservation_id='r-092d88cq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1216370790',owner_user_name='tempest-TestShelveInstance-1216370790-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:40:13Z,user_data=None,user_id='4f1326da23e34dc29d4469645af81589',uuid=8d344530-40f9-43f0-8417-15110c6c9748,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "46454c88-9007-47b1-a199-b80afdf843f1", "address": "fa:16:3e:d4:7c:d2", "network": {"id": "234a8df7-8eea-44bf-ae16-0840862765d4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1326637884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a88327b042847d5b910c53bda19976b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46454c88-90", "ovs_interfaceid": "46454c88-9007-47b1-a199-b80afdf843f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-ce572460-8748-49a9-9503-b5f5795d6988 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Converting VIF {"id": "46454c88-9007-47b1-a199-b80afdf843f1", "address": "fa:16:3e:d4:7c:d2", "network": {"id": "234a8df7-8eea-44bf-ae16-0840862765d4", "bridge": "br-int", "label": "tempest-TestShelveInstance-1326637884-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a88327b042847d5b910c53bda19976b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap46454c88-90", "ovs_interfaceid": "46454c88-9007-47b1-a199-b80afdf843f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-ce572460-8748-49a9-9503-b5f5795d6988 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:7c:d2,bridge_name='br-int',has_traffic_filtering=True,id=46454c88-9007-47b1-a199-b80afdf843f1,network=Network(234a8df7-8eea-44bf-ae16-0840862765d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46454c88-90') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG os_vif [None req-ce572460-8748-49a9-9503-b5f5795d6988 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:7c:d2,bridge_name='br-int',has_traffic_filtering=True,id=46454c88-9007-47b1-a199-b80afdf843f1,network=Network(234a8df7-8eea-44bf-ae16-0840862765d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46454c88-90') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap46454c88-90, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:41:30 user nova-compute[73391]: INFO os_vif [None req-ce572460-8748-49a9-9503-b5f5795d6988 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:7c:d2,bridge_name='br-int',has_traffic_filtering=True,id=46454c88-9007-47b1-a199-b80afdf843f1,network=Network(234a8df7-8eea-44bf-ae16-0840862765d4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap46454c88-90')
Aug 15 05:41:30 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce572460-8748-49a9-9503-b5f5795d6988 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce572460-8748-49a9-9503-b5f5795d6988 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MscvTUKS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:41:30 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-ce572460-8748-49a9-9503-b5f5795d6988 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:41:30 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-ce572460-8748-49a9-9503-b5f5795d6988 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-ce572460-8748-49a9-9503-b5f5795d6988 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce572460-8748-49a9-9503-b5f5795d6988 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[90523eee-55fa-4765-bfd6-71365828db1e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6b8d93-85d9-4aa8-a845-fbfe1e311aaf]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce572460-8748-49a9-9503-b5f5795d6988 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:41:30 user nova-compute[73391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)
Aug 15 05:41:30 user nova-compute[73391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48 (non-flash)
Aug 15 05:41:30 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:41:30 user nova-compute[73391]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:41:30 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce572460-8748-49a9-9503-b5f5795d6988 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:41:30 user nova-compute[73391]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 (non-flash)
Aug 15 05:41:30 user nova-compute[73391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48 (non-flash)
Aug 15 05:41:30 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:41:30 user nova-compute[73391]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:41:30 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce572460-8748-49a9-9503-b5f5795d6988 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7728494700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4'): ({'sdd'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-ce572460-8748-49a9-9503-b5f5795d6988 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Removing single pathed devices sdd {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7f917e-0466-4961-b522-ad4f4a280187]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c30e4fb-36a9-4d1a-9866-171281222840]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-ce572460-8748-49a9-9503-b5f5795d6988 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Flushing IO for device /dev/sdd {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[01018b1a-84b4-425a-9b10-4e9d23cc033f]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-ce572460-8748-49a9-9503-b5f5795d6988 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[083bfcc4-18c9-44f5-a43e-15968037233b]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-ce572460-8748-49a9-9503-b5f5795d6988 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-ce572460-8748-49a9-9503-b5f5795d6988 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] SCSI volumes sdd have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO5420019f-8d48b8746a4c30d6', '/dev/disk/by-id/scsi-23864343862383734', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_5420019f') {{(pid=84527) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[91fa5115-8c7d-42ab-a6bd-7d03070da239]: (4, None) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce572460-8748-49a9-9503-b5f5795d6988 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[81da3f9f-37c0-43ae-a341-64c61289d278]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce572460-8748-49a9-9503-b5f5795d6988 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG nova.compute.manager [req-4939872c-5438-4891-8fc0-cda74bfb8e07 req-cd1edae6-ca4a-4c63-88a6-4d8c907092c7 service nova] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Received event network-vif-plugged-fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-4939872c-5438-4891-8fc0-cda74bfb8e07 req-cd1edae6-ca4a-4c63-88a6-4d8c907092c7 service nova] Acquiring lock "fee43642-30e8-451b-919c-aca4cd4c3f81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-4939872c-5438-4891-8fc0-cda74bfb8e07 req-cd1edae6-ca4a-4c63-88a6-4d8c907092c7 service nova] Lock "fee43642-30e8-451b-919c-aca4cd4c3f81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-4939872c-5438-4891-8fc0-cda74bfb8e07 req-cd1edae6-ca4a-4c63-88a6-4d8c907092c7 service nova] Lock "fee43642-30e8-451b-919c-aca4cd4c3f81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG nova.compute.manager [req-4939872c-5438-4891-8fc0-cda74bfb8e07 req-cd1edae6-ca4a-4c63-88a6-4d8c907092c7 service nova] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] No waiting events found dispatching network-vif-plugged-fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:41:30 user nova-compute[73391]: WARNING nova.compute.manager [req-4939872c-5438-4891-8fc0-cda74bfb8e07 req-cd1edae6-ca4a-4c63-88a6-4d8c907092c7 service nova] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Received unexpected event network-vif-plugged-fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b for instance with vm_state stopped and task_state None.
Aug 15 05:41:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8ee288-b6a4-4083-beb7-5620b97dc9a0]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce572460-8748-49a9-9503-b5f5795d6988 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4, portal: 172.16.0.220,3260]
Aug 15 05:41:30 user nova-compute[73391]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4, portal: 172.16.0.220,3260] successful.
Aug 15 05:41:30 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cad2c281-e6fc-4384-8628-690691c13cd4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfeffd2a-a911-4914-a7a9-8b2206d1956b]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce572460-8748-49a9-9503-b5f5795d6988 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-ce572460-8748-49a9-9503-b5f5795d6988 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-ce572460-8748-49a9-9503-b5f5795d6988 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] <== disconnect_volume: return (314ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ce572460-8748-49a9-9503-b5f5795d6988 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 05:41:30 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-ce572460-8748-49a9-9503-b5f5795d6988 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Deleting instance files /opt/stack/data/nova/instances/8d344530-40f9-43f0-8417-15110c6c9748_del
Aug 15 05:41:30 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-ce572460-8748-49a9-9503-b5f5795d6988 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Deletion of /opt/stack/data/nova/instances/8d344530-40f9-43f0-8417-15110c6c9748_del complete
Aug 15 05:41:30 user nova-compute[73391]: INFO nova.compute.manager [None req-ce572460-8748-49a9-9503-b5f5795d6988 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Took 1.21 seconds to destroy the instance on the hypervisor.
Aug 15 05:41:30 user nova-compute[73391]: DEBUG oslo.service.loopingcall [None req-ce572460-8748-49a9-9503-b5f5795d6988 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG nova.compute.manager [-] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Deallocating network for instance {{(pid=73391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 05:41:30 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] deallocate_for_instance() {{(pid=73391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 05:41:31 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:41:31 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Took 0.54 seconds to deallocate network for instance.
Aug 15 05:41:31 user nova-compute[73391]: DEBUG nova.compute.manager [req-d83f3c46-aa05-4348-969d-f8760d75e9fe req-c8402ffa-d3f5-4ed7-a72a-19c64293c129 service nova] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Received event network-vif-deleted-46454c88-9007-47b1-a199-b80afdf843f1 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:41:32 user nova-compute[73391]: INFO nova.compute.manager [None req-ce572460-8748-49a9-9503-b5f5795d6988 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Took 0.78 seconds to detach 1 volumes for instance.
Aug 15 05:41:32 user nova-compute[73391]: DEBUG nova.compute.manager [None req-ce572460-8748-49a9-9503-b5f5795d6988 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Deleting volume: cad2c281-e6fc-4384-8628-690691c13cd4 {{(pid=73391) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 15 05:41:32 user nova-compute[73391]: DEBUG nova.compute.manager [req-ef762f69-c390-41c7-affb-a4420f7fa72b req-6df33056-0316-4b4c-babb-7189f33b5a3d service nova] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Received event network-vif-plugged-46454c88-9007-47b1-a199-b80afdf843f1 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:41:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ef762f69-c390-41c7-affb-a4420f7fa72b req-6df33056-0316-4b4c-babb-7189f33b5a3d service nova] Acquiring lock "8d344530-40f9-43f0-8417-15110c6c9748-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:41:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ef762f69-c390-41c7-affb-a4420f7fa72b req-6df33056-0316-4b4c-babb-7189f33b5a3d service nova] Lock "8d344530-40f9-43f0-8417-15110c6c9748-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:41:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ef762f69-c390-41c7-affb-a4420f7fa72b req-6df33056-0316-4b4c-babb-7189f33b5a3d service nova] Lock "8d344530-40f9-43f0-8417-15110c6c9748-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:41:32 user nova-compute[73391]: DEBUG nova.compute.manager [req-ef762f69-c390-41c7-affb-a4420f7fa72b req-6df33056-0316-4b4c-babb-7189f33b5a3d service nova] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] No waiting events found dispatching network-vif-plugged-46454c88-9007-47b1-a199-b80afdf843f1 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:41:32 user nova-compute[73391]: WARNING nova.compute.manager [req-ef762f69-c390-41c7-affb-a4420f7fa72b req-6df33056-0316-4b4c-babb-7189f33b5a3d service nova] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Received unexpected event network-vif-plugged-46454c88-9007-47b1-a199-b80afdf843f1 for instance with vm_state active and task_state deleting.
Aug 15 05:41:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ce572460-8748-49a9-9503-b5f5795d6988 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:41:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ce572460-8748-49a9-9503-b5f5795d6988 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:41:32 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-ce572460-8748-49a9-9503-b5f5795d6988 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:41:32 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-ce572460-8748-49a9-9503-b5f5795d6988 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:41:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ce572460-8748-49a9-9503-b5f5795d6988 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.473s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:41:32 user nova-compute[73391]: INFO nova.scheduler.client.report [None req-ce572460-8748-49a9-9503-b5f5795d6988 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Deleted allocations for instance 8d344530-40f9-43f0-8417-15110c6c9748
Aug 15 05:41:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ce572460-8748-49a9-9503-b5f5795d6988 tempest-TestShelveInstance-1216370790 tempest-TestShelveInstance-1216370790-project-member] Lock "8d344530-40f9-43f0-8417-15110c6c9748" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.283s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:41:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:41:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:41:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:41:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:41:43 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692078088.973056, fee43642-30e8-451b-919c-aca4cd4c3f81 => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:41:43 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] VM Stopped (Lifecycle Event)
Aug 15 05:41:43 user nova-compute[73391]: DEBUG nova.compute.manager [None req-dca2a468-7cf7-40bd-9abf-fe8b47299420 None None] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:41:44 user nova-compute[73391]: DEBUG nova.compute.manager [None req-dca2a468-7cf7-40bd-9abf-fe8b47299420 None None] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:41:44 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:41:45 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692078090.3147197, 8d344530-40f9-43f0-8417-15110c6c9748 => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:41:45 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] VM Stopped (Lifecycle Event)
Aug 15 05:41:45 user nova-compute[73391]: DEBUG nova.compute.manager [None req-c5933926-a8de-445f-86fb-d21ff27bc15f None None] [instance: 8d344530-40f9-43f0-8417-15110c6c9748] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:41:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:41:49 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:41:49 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:41:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:41:52 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:41:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:41:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:00 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:42:00 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f4968de2-7326-4d0a-a25e-705b4b4b8dbc tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Acquiring lock "8991b32e-6c4b-4c66-a320-e734061f49ee" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:42:00 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f4968de2-7326-4d0a-a25e-705b4b4b8dbc tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lock "8991b32e-6c4b-4c66-a320-e734061f49ee" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:42:00 user nova-compute[73391]: DEBUG nova.objects.instance [None req-f4968de2-7326-4d0a-a25e-705b4b4b8dbc tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lazy-loading 'flavor' on Instance uuid 8991b32e-6c4b-4c66-a320-e734061f49ee {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:42:00 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f4968de2-7326-4d0a-a25e-705b4b4b8dbc tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lock "8991b32e-6c4b-4c66-a320-e734061f49ee" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:42:00 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f4968de2-7326-4d0a-a25e-705b4b4b8dbc tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Acquiring lock "8991b32e-6c4b-4c66-a320-e734061f49ee" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:42:00 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f4968de2-7326-4d0a-a25e-705b4b4b8dbc tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lock "8991b32e-6c4b-4c66-a320-e734061f49ee" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:42:00 user nova-compute[73391]: INFO nova.compute.manager [None req-f4968de2-7326-4d0a-a25e-705b4b4b8dbc tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Attaching volume 5ac82e4f-fe64-4376-afab-0fe6cbb31bcf to /dev/vdb
Aug 15 05:42:00 user nova-compute[73391]: DEBUG os_brick.utils [None req-f4968de2-7326-4d0a-a25e-705b4b4b8dbc tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:42:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:00 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[157d678b-6687-4912-8895-18c9d3d81030]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:00 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89f9e56-f91b-44b0-a4ec-d231e1ac7cf9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:00 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6dd919a-7c98-4dc1-a99c-b8bd7b33129b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:00 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa2dd2f-427b-414c-bd65-6f88d4f37f2f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-f4968de2-7326-4d0a-a25e-705b4b4b8dbc tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-f4968de2-7326-4d0a-a25e-705b4b4b8dbc tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:42:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f4968de2-7326-4d0a-a25e-705b4b4b8dbc tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 05:42:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:42:00 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 05:42:00 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[079dd23f-dee9-4e84-b183-8bebd20cdeaa]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-f4968de2-7326-4d0a-a25e-705b4b4b8dbc tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 05:42:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-f4968de2-7326-4d0a-a25e-705b4b4b8dbc tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 05:42:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-f4968de2-7326-4d0a-a25e-705b4b4b8dbc tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 05:42:00 user nova-compute[73391]: DEBUG os_brick.utils [None req-f4968de2-7326-4d0a-a25e-705b4b4b8dbc tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:42:00 user nova-compute[73391]: DEBUG nova.virt.block_device [None req-f4968de2-7326-4d0a-a25e-705b4b4b8dbc tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Updating existing volume attachment record: 6df8b3d0-6e8b-4450-bc6d-a23e3acad3fa {{(pid=73391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 05:42:01 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-9b4540db-8c46-4b35-a46f-9021ef95c82c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Acquiring lock "a1ba38e6-f0fe-408f-b1c8-f9b193531952" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:42:01 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-9b4540db-8c46-4b35-a46f-9021ef95c82c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Lock "a1ba38e6-f0fe-408f-b1c8-f9b193531952" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:42:01 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-9b4540db-8c46-4b35-a46f-9021ef95c82c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Acquiring lock "a1ba38e6-f0fe-408f-b1c8-f9b193531952-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:42:01 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-9b4540db-8c46-4b35-a46f-9021ef95c82c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Lock "a1ba38e6-f0fe-408f-b1c8-f9b193531952-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:42:01 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-9b4540db-8c46-4b35-a46f-9021ef95c82c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Lock "a1ba38e6-f0fe-408f-b1c8-f9b193531952-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:42:01 user nova-compute[73391]: INFO nova.compute.manager [None req-9b4540db-8c46-4b35-a46f-9021ef95c82c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Terminating instance
Aug 15 05:42:01 user nova-compute[73391]: DEBUG nova.compute.manager [None req-9b4540db-8c46-4b35-a46f-9021ef95c82c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Start destroying the instance on the hypervisor. {{(pid=73391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 05:42:01 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:01 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:01 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:01 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:01 user nova-compute[73391]: DEBUG nova.compute.manager [req-d3832005-4c83-4702-8d94-b3cae1b2ec67 req-d8775b16-b174-43d8-ba16-522c4daf64a1 service nova] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Received event network-vif-unplugged-6a4219e2-c727-41cc-badf-17c70f906a78 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:42:01 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d3832005-4c83-4702-8d94-b3cae1b2ec67 req-d8775b16-b174-43d8-ba16-522c4daf64a1 service nova] Acquiring lock "a1ba38e6-f0fe-408f-b1c8-f9b193531952-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:42:01 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d3832005-4c83-4702-8d94-b3cae1b2ec67 req-d8775b16-b174-43d8-ba16-522c4daf64a1 service nova] Lock "a1ba38e6-f0fe-408f-b1c8-f9b193531952-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:42:01 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d3832005-4c83-4702-8d94-b3cae1b2ec67 req-d8775b16-b174-43d8-ba16-522c4daf64a1 service nova] Lock "a1ba38e6-f0fe-408f-b1c8-f9b193531952-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:42:01 user nova-compute[73391]: DEBUG nova.compute.manager [req-d3832005-4c83-4702-8d94-b3cae1b2ec67 req-d8775b16-b174-43d8-ba16-522c4daf64a1 service nova] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] No waiting events found dispatching network-vif-unplugged-6a4219e2-c727-41cc-badf-17c70f906a78 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:42:01 user nova-compute[73391]: DEBUG nova.compute.manager [req-d3832005-4c83-4702-8d94-b3cae1b2ec67 req-d8775b16-b174-43d8-ba16-522c4daf64a1 service nova] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Received event network-vif-unplugged-6a4219e2-c727-41cc-badf-17c70f906a78 for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 05:42:01 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Instance destroyed successfully.
Aug 15 05:42:01 user nova-compute[73391]: DEBUG nova.objects.instance [None req-9b4540db-8c46-4b35-a46f-9021ef95c82c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Lazy-loading 'resources' on Instance uuid a1ba38e6-f0fe-408f-b1c8-f9b193531952 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:42:01 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-9b4540db-8c46-4b35-a46f-9021ef95c82c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:37:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1618686331',display_name='tempest-TestServerVolumeAttachmentScenario-server-1618686331',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1618686331',id=26,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA0i9/ljlk97TqnAbCvpaUUTPmOP+TxyUHIOv0mAXgoxNTvd7yqa/Qp2bWzTnr6HTqMjC/eu1eBk++uGp+OzWTZGWhTAiF0R/jFBpljD2Du+ry45uwnMEMwk+fiZgvBkbg==',key_name='tempest-keypair-647505883',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:38:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae2c2aef51304fd1b6a8ed87a7065bc5',ramdisk_id='',reservation_id='r-v9ln0n06',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1770423001',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1770423001-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:38:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c20e47271ecf400eb874b5c0c46e84fd',uuid=a1ba38e6-f0fe-408f-b1c8-f9b193531952,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a4219e2-c727-41cc-badf-17c70f906a78", "address": "fa:16:3e:7a:2e:c4", "network": {"id": "2474e5aa-a909-4c0a-b8b0-0a1f31a80aa0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-824802028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae2c2aef51304fd1b6a8ed87a7065bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a4219e2-c7", "ovs_interfaceid": "6a4219e2-c727-41cc-badf-17c70f906a78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:42:01 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-9b4540db-8c46-4b35-a46f-9021ef95c82c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Converting VIF {"id": "6a4219e2-c727-41cc-badf-17c70f906a78", "address": "fa:16:3e:7a:2e:c4", "network": {"id": "2474e5aa-a909-4c0a-b8b0-0a1f31a80aa0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-824802028-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae2c2aef51304fd1b6a8ed87a7065bc5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a4219e2-c7", "ovs_interfaceid": "6a4219e2-c727-41cc-badf-17c70f906a78", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:42:01 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-9b4540db-8c46-4b35-a46f-9021ef95c82c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:2e:c4,bridge_name='br-int',has_traffic_filtering=True,id=6a4219e2-c727-41cc-badf-17c70f906a78,network=Network(2474e5aa-a909-4c0a-b8b0-0a1f31a80aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a4219e2-c7') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:42:01 user nova-compute[73391]: DEBUG os_vif [None req-9b4540db-8c46-4b35-a46f-9021ef95c82c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:2e:c4,bridge_name='br-int',has_traffic_filtering=True,id=6a4219e2-c727-41cc-badf-17c70f906a78,network=Network(2474e5aa-a909-4c0a-b8b0-0a1f31a80aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a4219e2-c7') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:42:01 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:01 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a4219e2-c7, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:42:01 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:01 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:42:01 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:01 user nova-compute[73391]: INFO os_vif [None req-9b4540db-8c46-4b35-a46f-9021ef95c82c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:2e:c4,bridge_name='br-int',has_traffic_filtering=True,id=6a4219e2-c727-41cc-badf-17c70f906a78,network=Network(2474e5aa-a909-4c0a-b8b0-0a1f31a80aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a4219e2-c7')
Aug 15 05:42:01 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-9b4540db-8c46-4b35-a46f-9021ef95c82c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Deleting instance files /opt/stack/data/nova/instances/a1ba38e6-f0fe-408f-b1c8-f9b193531952_del
Aug 15 05:42:01 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-9b4540db-8c46-4b35-a46f-9021ef95c82c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Deletion of /opt/stack/data/nova/instances/a1ba38e6-f0fe-408f-b1c8-f9b193531952_del complete
Aug 15 05:42:01 user nova-compute[73391]: INFO nova.compute.manager [None req-9b4540db-8c46-4b35-a46f-9021ef95c82c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 15 05:42:01 user nova-compute[73391]: DEBUG oslo.service.loopingcall [None req-9b4540db-8c46-4b35-a46f-9021ef95c82c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 05:42:01 user nova-compute[73391]: DEBUG nova.compute.manager [-] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Deallocating network for instance {{(pid=73391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 05:42:01 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] deallocate_for_instance() {{(pid=73391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 05:42:02 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:42:02 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Took 0.80 seconds to deallocate network for instance.
Aug 15 05:42:02 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-9b4540db-8c46-4b35-a46f-9021ef95c82c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:42:02 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-9b4540db-8c46-4b35-a46f-9021ef95c82c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:42:03 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-9b4540db-8c46-4b35-a46f-9021ef95c82c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:42:03 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-9b4540db-8c46-4b35-a46f-9021ef95c82c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:42:03 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-9b4540db-8c46-4b35-a46f-9021ef95c82c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.393s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:42:03 user nova-compute[73391]: INFO nova.scheduler.client.report [None req-9b4540db-8c46-4b35-a46f-9021ef95c82c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Deleted allocations for instance a1ba38e6-f0fe-408f-b1c8-f9b193531952
Aug 15 05:42:03 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-9b4540db-8c46-4b35-a46f-9021ef95c82c tempest-TestServerVolumeAttachmentScenario-1770423001 tempest-TestServerVolumeAttachmentScenario-1770423001-project-member] Lock "a1ba38e6-f0fe-408f-b1c8-f9b193531952" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.296s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:42:03 user nova-compute[73391]: DEBUG nova.compute.manager [req-f920982c-244c-45bc-bab9-824c4416c445 req-eeb7c5f5-9424-44ec-9396-bd7c1994875d service nova] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Received event network-vif-plugged-6a4219e2-c727-41cc-badf-17c70f906a78 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:42:03 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f920982c-244c-45bc-bab9-824c4416c445 req-eeb7c5f5-9424-44ec-9396-bd7c1994875d service nova] Acquiring lock "a1ba38e6-f0fe-408f-b1c8-f9b193531952-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:42:03 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f920982c-244c-45bc-bab9-824c4416c445 req-eeb7c5f5-9424-44ec-9396-bd7c1994875d service nova] Lock "a1ba38e6-f0fe-408f-b1c8-f9b193531952-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:42:03 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f920982c-244c-45bc-bab9-824c4416c445 req-eeb7c5f5-9424-44ec-9396-bd7c1994875d service nova] Lock "a1ba38e6-f0fe-408f-b1c8-f9b193531952-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:42:03 user nova-compute[73391]: DEBUG nova.compute.manager [req-f920982c-244c-45bc-bab9-824c4416c445 req-eeb7c5f5-9424-44ec-9396-bd7c1994875d service nova] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] No waiting events found dispatching network-vif-plugged-6a4219e2-c727-41cc-badf-17c70f906a78 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:42:03 user nova-compute[73391]: WARNING nova.compute.manager [req-f920982c-244c-45bc-bab9-824c4416c445 req-eeb7c5f5-9424-44ec-9396-bd7c1994875d service nova] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Received unexpected event network-vif-plugged-6a4219e2-c727-41cc-badf-17c70f906a78 for instance with vm_state deleted and task_state None.
Aug 15 05:42:03 user nova-compute[73391]: DEBUG nova.compute.manager [req-f920982c-244c-45bc-bab9-824c4416c445 req-eeb7c5f5-9424-44ec-9396-bd7c1994875d service nova] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Received event network-vif-deleted-6a4219e2-c727-41cc-badf-17c70f906a78 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:42:06 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:10 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4968de2-7326-4d0a-a25e-705b4b4b8dbc tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 05:42:10 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4968de2-7326-4d0a-a25e-705b4b4b8dbc tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IWGBEMQx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:42:10 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-f4968de2-7326-4d0a-a25e-705b4b4b8dbc tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:42:10 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-f4968de2-7326-4d0a-a25e-705b4b4b8dbc tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:42:10 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-f4968de2-7326-4d0a-a25e-705b4b4b8dbc tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:42:10 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-f4968de2-7326-4d0a-a25e-705b4b4b8dbc tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:42:10 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-f4968de2-7326-4d0a-a25e-705b4b4b8dbc tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:42:10 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-f4968de2-7326-4d0a-a25e-705b4b4b8dbc tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:42:10 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-f4968de2-7326-4d0a-a25e-705b4b4b8dbc tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 05:42:10 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:10 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:10 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b88757-6a10-4b76-a0ad-ead0f13bcbc5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:10 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4968de2-7326-4d0a-a25e-705b4b4b8dbc tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 05:42:10 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:42:10 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:10 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:10 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2504bbc3-0de0-4f93-a77b-cc39b4b85a0f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:10 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4968de2-7326-4d0a-a25e-705b4b4b8dbc tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf] added
Aug 15 05:42:10 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:42:10 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:10 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:10 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba390f3-e734-4218-aed4-24771b5494aa]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:10 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4968de2-7326-4d0a-a25e-705b4b4b8dbc tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:42:10 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:10 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:10 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a5933f-627f-455d-9ecd-b8ccd4ae704d]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:10 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4968de2-7326-4d0a-a25e-705b4b4b8dbc tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:42:10 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IWGBEMQx {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:10 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IWGBEMQx" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:10 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[55fff54b-1745-4c02-a6da-22d29dcdb4a4]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:10 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4968de2-7326-4d0a-a25e-705b4b4b8dbc tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IWGBEMQx'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:42:10 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:10 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:10 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[956bb4f0-5a4f-432d-8252-a4ad381e7bb8]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:10 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4968de2-7326-4d0a-a25e-705b4b4b8dbc tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:42:10 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:10 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:10 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b02ccd-db17-4d7a-8ef1-897b68619899]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:10 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4968de2-7326-4d0a-a25e-705b4b4b8dbc tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:42:10 user nova-compute[73391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48 (non-flash)
Aug 15 05:42:10 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:42:10 user nova-compute[73391]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:42:10 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:42:10 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4968de2-7326-4d0a-a25e-705b4b4b8dbc tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:42:10 user nova-compute[73391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48 (non-flash)
Aug 15 05:42:10 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:42:10 user nova-compute[73391]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:42:10 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:42:10 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:10 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:10 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d5f71a-01a4-420a-828e-1d3588c951c1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:10 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4968de2-7326-4d0a-a25e-705b4b4b8dbc tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf, portal: 172.16.0.220,3260]
Aug 15 05:42:10 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf, portal: 172.16.0.220,3260] successful.
Aug 15 05:42:10 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:42:10 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:10 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:10 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a449e1-149c-466d-8863-ee480f4f512a]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:10 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4968de2-7326-4d0a-a25e-705b4b4b8dbc tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:42:10 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:10 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:10 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb774070-b345-4227-9312-ceab7745565b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:10 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4968de2-7326-4d0a-a25e-705b4b4b8dbc tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:42:10 user nova-compute[73391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48 (non-flash)
Aug 15 05:42:10 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:42:10 user nova-compute[73391]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:42:10 user nova-compute[73391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)
Aug 15 05:42:10 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:42:10 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4968de2-7326-4d0a-a25e-705b4b4b8dbc tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:42:10 user nova-compute[73391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48 (non-flash)
Aug 15 05:42:10 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:42:10 user nova-compute[73391]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:42:10 user nova-compute[73391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)
Aug 15 05:42:10 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:42:10 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-f4968de2-7326-4d0a-a25e-705b4b4b8dbc tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:42:10 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4968de2-7326-4d0a-a25e-705b4b4b8dbc tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 05:42:10 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-f4968de2-7326-4d0a-a25e-705b4b4b8dbc tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] HCTL ('33', '-', '-', 0) found on session 37 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 05:42:10 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-f4968de2-7326-4d0a-a25e-705b4b4b8dbc tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 05:42:10 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:10 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:10 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f187f3-890e-4e2e-9b57-06970cb5f2a5]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:10 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-f4968de2-7326-4d0a-a25e-705b4b4b8dbc tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: None {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:42:11 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-f4968de2-7326-4d0a-a25e-705b4b4b8dbc tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Searching for a device in session 37 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:42:11 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4968de2-7326-4d0a-a25e-705b4b4b8dbc tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IWGBEMQx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 05:42:11 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-f4968de2-7326-4d0a-a25e-705b4b4b8dbc tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:42:11 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4968de2-7326-4d0a-a25e-705b4b4b8dbc tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '26262653465356137', 'path': '/dev/sdb'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:42:11 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4968de2-7326-4d0a-a25e-705b4b4b8dbc tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262653465356137', 'path': '/dev/sdb'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 05:42:11 user nova-compute[73391]: DEBUG nova.objects.instance [None req-f4968de2-7326-4d0a-a25e-705b4b4b8dbc tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lazy-loading 'flavor' on Instance uuid 8991b32e-6c4b-4c66-a320-e734061f49ee {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:42:11 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-f4968de2-7326-4d0a-a25e-705b4b4b8dbc tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 05:42:11 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:42:11 user nova-compute[73391]:   <source dev="/dev/sdb"/>
Aug 15 05:42:11 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:42:11 user nova-compute[73391]:   <serial>5ac82e4f-fe64-4376-afab-0fe6cbb31bcf</serial>
Aug 15 05:42:11 user nova-compute[73391]: </disk>
Aug 15 05:42:11 user nova-compute[73391]:  {{(pid=73391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 05:42:11 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f4968de2-7326-4d0a-a25e-705b4b4b8dbc tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:42:11 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f4968de2-7326-4d0a-a25e-705b4b4b8dbc tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:42:11 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f4968de2-7326-4d0a-a25e-705b4b4b8dbc tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] No VIF found with MAC fa:16:3e:89:dc:93, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:42:11 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:42:11 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f4968de2-7326-4d0a-a25e-705b4b4b8dbc tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lock "8991b32e-6c4b-4c66-a320-e734061f49ee" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.287s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:42:13 user nova-compute[73391]: DEBUG nova.compute.manager [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Stashing vm_state: active {{(pid=73391) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 15 05:42:13 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:42:13 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:42:13 user nova-compute[73391]: DEBUG nova.objects.instance [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lazy-loading 'pci_requests' on Instance uuid 8991b32e-6c4b-4c66-a320-e734061f49ee {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:42:13 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 05:42:13 user nova-compute[73391]: INFO nova.compute.claims [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Claim successful on node user
Aug 15 05:42:13 user nova-compute[73391]: DEBUG nova.objects.instance [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lazy-loading 'resources' on Instance uuid 8991b32e-6c4b-4c66-a320-e734061f49ee {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:42:13 user nova-compute[73391]: DEBUG nova.objects.instance [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lazy-loading 'pci_devices' on Instance uuid 8991b32e-6c4b-4c66-a320-e734061f49ee {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:42:13 user nova-compute[73391]: INFO nova.compute.resource_tracker [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Updating resource usage from migration 7cfcc22d-fce8-47af-89de-3644606f77d2
Aug 15 05:42:14 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:42:14 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:42:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.543s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:42:14 user nova-compute[73391]: INFO nova.compute.manager [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Migrating
Aug 15 05:42:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:42:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Acquired lock "compute-rpcapi-router" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:42:14 user nova-compute[73391]: INFO nova.compute.rpcapi [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Aug 15 05:42:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Releasing lock "compute-rpcapi-router" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:42:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Acquiring lock "refresh_cache-8991b32e-6c4b-4c66-a320-e734061f49ee" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:42:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Acquired lock "refresh_cache-8991b32e-6c4b-4c66-a320-e734061f49ee" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:42:14 user nova-compute[73391]: DEBUG nova.network.neutron [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:42:14 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:42:14 user nova-compute[73391]: DEBUG nova.network.neutron [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Updating instance_info_cache with network_info: [{"id": "3e0cb01d-a82e-44d3-b8dd-723819ec6ffa", "address": "fa:16:3e:89:dc:93", "network": {"id": "11023df3-666d-44e5-955d-cc1fbde6972e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1848872765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "666428ad8c2f4f9cadcd180e498223f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0cb01d-a8", "ovs_interfaceid": "3e0cb01d-a82e-44d3-b8dd-723819ec6ffa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:42:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Releasing lock "refresh_cache-8991b32e-6c4b-4c66-a320-e734061f49ee" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:42:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Starting migrate_disk_and_power_off {{(pid=73391) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 15 05:42:15 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:15 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:15 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:15 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:15 user nova-compute[73391]: DEBUG nova.compute.manager [req-dc70fc12-f666-4660-9ba8-04d541b9f2f3 req-b16fe96c-2e65-4164-86f9-29103501d6c9 service nova] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Received event network-vif-unplugged-3e0cb01d-a82e-44d3-b8dd-723819ec6ffa {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:42:15 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-dc70fc12-f666-4660-9ba8-04d541b9f2f3 req-b16fe96c-2e65-4164-86f9-29103501d6c9 service nova] Acquiring lock "8991b32e-6c4b-4c66-a320-e734061f49ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:42:15 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-dc70fc12-f666-4660-9ba8-04d541b9f2f3 req-b16fe96c-2e65-4164-86f9-29103501d6c9 service nova] Lock "8991b32e-6c4b-4c66-a320-e734061f49ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:42:15 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-dc70fc12-f666-4660-9ba8-04d541b9f2f3 req-b16fe96c-2e65-4164-86f9-29103501d6c9 service nova] Lock "8991b32e-6c4b-4c66-a320-e734061f49ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:42:15 user nova-compute[73391]: DEBUG nova.compute.manager [req-dc70fc12-f666-4660-9ba8-04d541b9f2f3 req-b16fe96c-2e65-4164-86f9-29103501d6c9 service nova] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] No waiting events found dispatching network-vif-unplugged-3e0cb01d-a82e-44d3-b8dd-723819ec6ffa {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:42:15 user nova-compute[73391]: WARNING nova.compute.manager [req-dc70fc12-f666-4660-9ba8-04d541b9f2f3 req-b16fe96c-2e65-4164-86f9-29103501d6c9 service nova] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Received unexpected event network-vif-unplugged-3e0cb01d-a82e-44d3-b8dd-723819ec6ffa for instance with vm_state active and task_state resize_migrating.
Aug 15 05:42:15 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Instance destroyed successfully.
Aug 15 05:42:15 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:38:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-845602872',display_name='tempest-ServerActionsTestOtherB-server-845602872',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-845602872',id=27,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCi9vkvcVQEbXmigHztv9LlDFuCnimhR/vNlP8kykjc1U9WtN+KwlQqW0CDVIHXojOPVLOC+TJRapzFB5aO8vw7udjudZbg8fWCON+jsBrd+VE/0PuYaOBBV7W22/iAKjg==',key_name='tempest-keypair-1001766799',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:38:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='666428ad8c2f4f9cadcd180e498223f7',ramdisk_id='',reservation_id='r-sady4pim',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-762584882',owner_user_name='tempest-ServerActionsTestOtherB-762584882-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:42:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b43158637026445496cc0030b6ce49a2',uuid=8991b32e-6c4b-4c66-a320-e734061f49ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e0cb01d-a82e-44d3-b8dd-723819ec6ffa", "address": "fa:16:3e:89:dc:93", "network": {"id": "11023df3-666d-44e5-955d-cc1fbde6972e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1848872765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1848872765-network", "vif_mac": "fa:16:3e:89:dc:93"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "666428ad8c2f4f9cadcd180e498223f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0cb01d-a8", "ovs_interfaceid": "3e0cb01d-a82e-44d3-b8dd-723819ec6ffa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:42:15 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Converting VIF {"id": "3e0cb01d-a82e-44d3-b8dd-723819ec6ffa", "address": "fa:16:3e:89:dc:93", "network": {"id": "11023df3-666d-44e5-955d-cc1fbde6972e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1848872765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1848872765-network", "vif_mac": "fa:16:3e:89:dc:93"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "666428ad8c2f4f9cadcd180e498223f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0cb01d-a8", "ovs_interfaceid": "3e0cb01d-a82e-44d3-b8dd-723819ec6ffa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:42:15 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:dc:93,bridge_name='br-int',has_traffic_filtering=True,id=3e0cb01d-a82e-44d3-b8dd-723819ec6ffa,network=Network(11023df3-666d-44e5-955d-cc1fbde6972e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e0cb01d-a8') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:42:15 user nova-compute[73391]: DEBUG os_vif [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:dc:93,bridge_name='br-int',has_traffic_filtering=True,id=3e0cb01d-a82e-44d3-b8dd-723819ec6ffa,network=Network(11023df3-666d-44e5-955d-cc1fbde6972e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e0cb01d-a8') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:42:15 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:15 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e0cb01d-a8, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:42:15 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:15 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:42:15 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:15 user nova-compute[73391]: INFO os_vif [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:dc:93,bridge_name='br-int',has_traffic_filtering=True,id=3e0cb01d-a82e-44d3-b8dd-723819ec6ffa,network=Network(11023df3-666d-44e5-955d-cc1fbde6972e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e0cb01d-a8')
Aug 15 05:42:15 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 05:42:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IWGBEMQx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:42:15 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:42:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:42:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:42:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 05:42:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:15 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5999d16-5edc-4323-b7da-22ba15cefdfa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:15 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[97775995-64ff-4be1-97fe-343720beed53]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:42:15 user nova-compute[73391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48 (non-flash)
Aug 15 05:42:15 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:42:15 user nova-compute[73391]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:42:15 user nova-compute[73391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)
Aug 15 05:42:15 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:42:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:42:15 user nova-compute[73391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48 (non-flash)
Aug 15 05:42:15 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:42:15 user nova-compute[73391]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:42:15 user nova-compute[73391]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)
Aug 15 05:42:15 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:42:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77284951b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf'): ({'sdb'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 05:42:15 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Removing single pathed devices sdb {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 05:42:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:15 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef1b9f4-37e2-4827-accb-9763be9881ee]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:15 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec55c66-cc61-4cee-b4dd-cef3c93ce856]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:15 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Flushing IO for device /dev/sdb {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 05:42:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:15 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b7639e-7c6d-4a5a-b42c-c25495eb878a]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:15 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 05:42:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:15 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c1abc4-6d54-43c5-9b32-e40bbae33eba]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:15 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 05:42:15 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] SCSI volumes sdb have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 05:42:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 05:42:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:15 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e416f189-7118-44ed-a29b-6a5b0b650647]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:42:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:16 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e273925e-d005-42ac-86e2-264082a468b9]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:16 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf, portal: 172.16.0.220,3260]
Aug 15 05:42:16 user nova-compute[73391]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf, portal: 172.16.0.220,3260] successful.
Aug 15 05:42:16 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:42:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:16 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3ad3d0-f246-479a-9fb0-c1e1194f1163]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:16 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:42:16 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:42:16 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] <== disconnect_volume: return (322ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:42:16 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 05:42:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:16 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:42:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee_resize/disk /opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/disk {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] CMD "cp -r /opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee_resize/disk /opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/disk" returned: 0 in 0.270s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee_resize/disk.info /opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/disk.info {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] CMD "cp -r /opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee_resize/disk.info /opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/disk.info" returned: 0 in 0.035s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:16 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692078121.8040874, a1ba38e6-f0fe-408f-b1c8-f9b193531952 => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:42:16 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] VM Stopped (Lifecycle Event)
Aug 15 05:42:16 user nova-compute[73391]: DEBUG nova.compute.manager [None req-de416c21-b705-4224-b8ed-4f76187ba65f None None] [instance: a1ba38e6-f0fe-408f-b1c8-f9b193531952] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:42:17 user nova-compute[73391]: DEBUG nova.compute.manager [req-ef21cc3b-6fb1-4c92-bda9-a4a39bf0c695 req-5efff65e-36e9-47f4-94ce-1e42ec755405 service nova] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Received event network-vif-plugged-3e0cb01d-a82e-44d3-b8dd-723819ec6ffa {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:42:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ef21cc3b-6fb1-4c92-bda9-a4a39bf0c695 req-5efff65e-36e9-47f4-94ce-1e42ec755405 service nova] Acquiring lock "8991b32e-6c4b-4c66-a320-e734061f49ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:42:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ef21cc3b-6fb1-4c92-bda9-a4a39bf0c695 req-5efff65e-36e9-47f4-94ce-1e42ec755405 service nova] Lock "8991b32e-6c4b-4c66-a320-e734061f49ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:42:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ef21cc3b-6fb1-4c92-bda9-a4a39bf0c695 req-5efff65e-36e9-47f4-94ce-1e42ec755405 service nova] Lock "8991b32e-6c4b-4c66-a320-e734061f49ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:42:17 user nova-compute[73391]: DEBUG nova.compute.manager [req-ef21cc3b-6fb1-4c92-bda9-a4a39bf0c695 req-5efff65e-36e9-47f4-94ce-1e42ec755405 service nova] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] No waiting events found dispatching network-vif-plugged-3e0cb01d-a82e-44d3-b8dd-723819ec6ffa {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:42:17 user nova-compute[73391]: WARNING nova.compute.manager [req-ef21cc3b-6fb1-4c92-bda9-a4a39bf0c695 req-5efff65e-36e9-47f4-94ce-1e42ec755405 service nova] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Received unexpected event network-vif-plugged-3e0cb01d-a82e-44d3-b8dd-723819ec6ffa for instance with vm_state active and task_state resize_migrating.
Aug 15 05:42:17 user nova-compute[73391]: DEBUG nova.network.neutron [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Port 3e0cb01d-a82e-44d3-b8dd-723819ec6ffa binding to destination host user is already ACTIVE {{(pid=73391) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 15 05:42:17 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:42:17 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:42:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Acquiring lock "8991b32e-6c4b-4c66-a320-e734061f49ee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:42:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lock "8991b32e-6c4b-4c66-a320-e734061f49ee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:42:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lock "8991b32e-6c4b-4c66-a320-e734061f49ee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:42:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Acquiring lock "refresh_cache-8991b32e-6c4b-4c66-a320-e734061f49ee" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:42:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Acquired lock "refresh_cache-8991b32e-6c4b-4c66-a320-e734061f49ee" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:42:17 user nova-compute[73391]: DEBUG nova.network.neutron [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:42:18 user nova-compute[73391]: DEBUG nova.network.neutron [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Updating instance_info_cache with network_info: [{"id": "3e0cb01d-a82e-44d3-b8dd-723819ec6ffa", "address": "fa:16:3e:89:dc:93", "network": {"id": "11023df3-666d-44e5-955d-cc1fbde6972e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1848872765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "666428ad8c2f4f9cadcd180e498223f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0cb01d-a8", "ovs_interfaceid": "3e0cb01d-a82e-44d3-b8dd-723819ec6ffa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:42:18 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Releasing lock "refresh_cache-8991b32e-6c4b-4c66-a320-e734061f49ee" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:42:18 user nova-compute[73391]: DEBUG os_brick.utils [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:42:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:18 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be8bb8d-5e7d-4cea-a4e8-24f0c951e816]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:18 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[38937b89-b091-42fb-bc98-d146e65d6b12]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:18 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[071ef07b-c742-48e5-a9e4-0f8f44c096dc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:18 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ad3a37-16bf-4c90-b916-b81ec7e4a448]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:42:18 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 05:42:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:42:18 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 05:42:18 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb11157b-25ce-4b9e-8274-312f5009e788]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:18 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 05:42:18 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 05:42:18 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 05:42:18 user nova-compute[73391]: DEBUG os_brick.utils [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:42:18 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:42:18 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:42:18 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:42:18 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:42:18 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Auditing locally available compute resources for user (node: user) {{(pid=73391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 05:42:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab02c376-1432-4981-9179-aeef6e647ea4/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab02c376-1432-4981-9179-aeef6e647ea4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab02c376-1432-4981-9179-aeef6e647ea4/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab02c376-1432-4981-9179-aeef6e647ea4/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:19 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:42:19 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:42:19 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:42:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:19 user nova-compute[73391]: DEBUG nova.compute.manager [req-7ad8baa6-26de-46b4-9357-07be8075dbf0 req-786ea9f9-cc2a-4a3e-a163-bfa193de3d1f service nova] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Received event network-changed-ec5342ba-8cca-4111-9c53-245d0d8f6bb7 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:42:19 user nova-compute[73391]: DEBUG nova.compute.manager [req-7ad8baa6-26de-46b4-9357-07be8075dbf0 req-786ea9f9-cc2a-4a3e-a163-bfa193de3d1f service nova] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Refreshing instance network info cache due to event network-changed-ec5342ba-8cca-4111-9c53-245d0d8f6bb7. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:42:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-7ad8baa6-26de-46b4-9357-07be8075dbf0 req-786ea9f9-cc2a-4a3e-a163-bfa193de3d1f service nova] Acquiring lock "refresh_cache-76fcbfca-deca-44f0-9182-1f9bbab134d2" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:42:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-7ad8baa6-26de-46b4-9357-07be8075dbf0 req-786ea9f9-cc2a-4a3e-a163-bfa193de3d1f service nova] Acquired lock "refresh_cache-76fcbfca-deca-44f0-9182-1f9bbab134d2" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:42:19 user nova-compute[73391]: DEBUG nova.network.neutron [req-7ad8baa6-26de-46b4-9357-07be8075dbf0 req-786ea9f9-cc2a-4a3e-a163-bfa193de3d1f service nova] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Refreshing network info cache for port ec5342ba-8cca-4111-9c53-245d0d8f6bb7 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:42:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:20 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:42:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8fe5e5e2-f6c4-4843-a927-f604e10714ca tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Acquiring lock "76fcbfca-deca-44f0-9182-1f9bbab134d2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:42:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8fe5e5e2-f6c4-4843-a927-f604e10714ca tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "76fcbfca-deca-44f0-9182-1f9bbab134d2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:42:20 user nova-compute[73391]: DEBUG nova.objects.instance [None req-8fe5e5e2-f6c4-4843-a927-f604e10714ca tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lazy-loading 'flavor' on Instance uuid 76fcbfca-deca-44f0-9182-1f9bbab134d2 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:42:20 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-8fe5e5e2-f6c4-4843-a927-f604e10714ca tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Ignoring supplied device name: /dev/vdb
Aug 15 05:42:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8fe5e5e2-f6c4-4843-a927-f604e10714ca tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "76fcbfca-deca-44f0-9182-1f9bbab134d2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:42:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7c5209a1-7bf7-474e-93cc-25cc6c95f4f6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "c21e1783-ddc5-479f-8b8d-db5b13ca068a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:42:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7c5209a1-7bf7-474e-93cc-25cc6c95f4f6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "c21e1783-ddc5-479f-8b8d-db5b13ca068a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:42:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7c5209a1-7bf7-474e-93cc-25cc6c95f4f6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "c21e1783-ddc5-479f-8b8d-db5b13ca068a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:42:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7c5209a1-7bf7-474e-93cc-25cc6c95f4f6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "c21e1783-ddc5-479f-8b8d-db5b13ca068a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:42:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7c5209a1-7bf7-474e-93cc-25cc6c95f4f6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "c21e1783-ddc5-479f-8b8d-db5b13ca068a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:42:20 user nova-compute[73391]: INFO nova.compute.manager [None req-7c5209a1-7bf7-474e-93cc-25cc6c95f4f6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Terminating instance
Aug 15 05:42:20 user nova-compute[73391]: DEBUG nova.compute.manager [None req-7c5209a1-7bf7-474e-93cc-25cc6c95f4f6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Start destroying the instance on the hypervisor. {{(pid=73391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 05:42:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8fe5e5e2-f6c4-4843-a927-f604e10714ca tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Acquiring lock "76fcbfca-deca-44f0-9182-1f9bbab134d2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:42:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8fe5e5e2-f6c4-4843-a927-f604e10714ca tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "76fcbfca-deca-44f0-9182-1f9bbab134d2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:42:20 user nova-compute[73391]: INFO nova.compute.manager [None req-8fe5e5e2-f6c4-4843-a927-f604e10714ca tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Attaching volume 47e51a85-6af8-42f7-91fa-052ed34a162a to /dev/vdb
Aug 15 05:42:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:20 user nova-compute[73391]: DEBUG os_brick.utils [None req-8fe5e5e2-f6c4-4843-a927-f604e10714ca tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:42:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:20 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd255364-18d9-410a-8813-1d0d05098067]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:20 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a2d7d0-ec6e-4549-bc98-b2f6e45d4b45]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:20 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9dbc994-21f7-4e73-9442-9f626d54008d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:20 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ed80e6-561b-4573-8a54-c409f189cac1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-8fe5e5e2-f6c4-4843-a927-f604e10714ca tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-8fe5e5e2-f6c4-4843-a927-f604e10714ca tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:42:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8fe5e5e2-f6c4-4843-a927-f604e10714ca tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 05:42:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:42:20 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 05:42:20 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[40682c6e-f801-49ab-8fc5-3c0b39413298]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:20 user nova-compute[73391]: DEBUG nova.network.neutron [req-7ad8baa6-26de-46b4-9357-07be8075dbf0 req-786ea9f9-cc2a-4a3e-a163-bfa193de3d1f service nova] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Updated VIF entry in instance network info cache for port ec5342ba-8cca-4111-9c53-245d0d8f6bb7. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:42:20 user nova-compute[73391]: DEBUG nova.network.neutron [req-7ad8baa6-26de-46b4-9357-07be8075dbf0 req-786ea9f9-cc2a-4a3e-a163-bfa193de3d1f service nova] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Updating instance_info_cache with network_info: [{"id": "ec5342ba-8cca-4111-9c53-245d0d8f6bb7", "address": "fa:16:3e:31:53:1e", "network": {"id": "6757637c-358e-4fa8-b3c1-376d7892c884", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-577771159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae6fe94b9014479fbaff5131aefc8834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec5342ba-8c", "ovs_interfaceid": "ec5342ba-8cca-4111-9c53-245d0d8f6bb7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:42:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-8fe5e5e2-f6c4-4843-a927-f604e10714ca tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 05:42:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-8fe5e5e2-f6c4-4843-a927-f604e10714ca tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 05:42:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-8fe5e5e2-f6c4-4843-a927-f604e10714ca tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 05:42:20 user nova-compute[73391]: DEBUG os_brick.utils [None req-8fe5e5e2-f6c4-4843-a927-f604e10714ca tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] <== get_connector_properties: return (197ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:42:20 user nova-compute[73391]: DEBUG nova.virt.block_device [None req-8fe5e5e2-f6c4-4843-a927-f604e10714ca tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Updating existing volume attachment record: 9fdd98ac-3651-450f-addf-51571b9606fc {{(pid=73391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 05:42:20 user nova-compute[73391]: DEBUG nova.compute.manager [req-e38c58d5-c8e4-4862-8e93-f283c72b803a req-4560b459-7310-4132-8583-2455a267e9f2 service nova] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Received event network-vif-unplugged-5e6f5f62-7fcc-4da7-870a-091a762592e1 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:42:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e38c58d5-c8e4-4862-8e93-f283c72b803a req-4560b459-7310-4132-8583-2455a267e9f2 service nova] Acquiring lock "c21e1783-ddc5-479f-8b8d-db5b13ca068a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:42:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e38c58d5-c8e4-4862-8e93-f283c72b803a req-4560b459-7310-4132-8583-2455a267e9f2 service nova] Lock "c21e1783-ddc5-479f-8b8d-db5b13ca068a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:42:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e38c58d5-c8e4-4862-8e93-f283c72b803a req-4560b459-7310-4132-8583-2455a267e9f2 service nova] Lock "c21e1783-ddc5-479f-8b8d-db5b13ca068a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:42:20 user nova-compute[73391]: DEBUG nova.compute.manager [req-e38c58d5-c8e4-4862-8e93-f283c72b803a req-4560b459-7310-4132-8583-2455a267e9f2 service nova] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] No waiting events found dispatching network-vif-unplugged-5e6f5f62-7fcc-4da7-870a-091a762592e1 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:42:20 user nova-compute[73391]: DEBUG nova.compute.manager [req-e38c58d5-c8e4-4862-8e93-f283c72b803a req-4560b459-7310-4132-8583-2455a267e9f2 service nova] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Received event network-vif-unplugged-5e6f5f62-7fcc-4da7-870a-091a762592e1 for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 05:42:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-7ad8baa6-26de-46b4-9357-07be8075dbf0 req-786ea9f9-cc2a-4a3e-a163-bfa193de3d1f service nova] Releasing lock "refresh_cache-76fcbfca-deca-44f0-9182-1f9bbab134d2" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:42:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:21 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Instance destroyed successfully.
Aug 15 05:42:21 user nova-compute[73391]: DEBUG nova.objects.instance [None req-7c5209a1-7bf7-474e-93cc-25cc6c95f4f6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lazy-loading 'resources' on Instance uuid c21e1783-ddc5-479f-8b8d-db5b13ca068a {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-7c5209a1-7bf7-474e-93cc-25cc6c95f4f6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:40:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-971154119',display_name='tempest-TestVolumeBootPattern-server-971154119',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-971154119',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:40:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8188c2e8ca34ef1982faa49f1058bb7',ramdisk_id='',reservation_id='r-y8sl47p6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1834029963',owner_user_name='tempest-TestVolumeBootPattern-1834029963-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:40:53Z,user_data=None,user_id='aefb6ccab586465dbe56e71a40bcf1f0',uuid=c21e1783-ddc5-479f-8b8d-db5b13ca068a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5e6f5f62-7fcc-4da7-870a-091a762592e1", "address": "fa:16:3e:44:b8:df", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e6f5f62-7f", "ovs_interfaceid": "5e6f5f62-7fcc-4da7-870a-091a762592e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-7c5209a1-7bf7-474e-93cc-25cc6c95f4f6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Converting VIF {"id": "5e6f5f62-7fcc-4da7-870a-091a762592e1", "address": "fa:16:3e:44:b8:df", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5e6f5f62-7f", "ovs_interfaceid": "5e6f5f62-7fcc-4da7-870a-091a762592e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-7c5209a1-7bf7-474e-93cc-25cc6c95f4f6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:b8:df,bridge_name='br-int',has_traffic_filtering=True,id=5e6f5f62-7fcc-4da7-870a-091a762592e1,network=Network(fae0e46a-88e4-499d-bcff-5b7df55eab4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e6f5f62-7f') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG os_vif [None req-7c5209a1-7bf7-474e-93cc-25cc6c95f4f6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:b8:df,bridge_name='br-int',has_traffic_filtering=True,id=5e6f5f62-7fcc-4da7-870a-091a762592e1,network=Network(fae0e46a-88e4-499d-bcff-5b7df55eab4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e6f5f62-7f') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5e6f5f62-7f, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:21 user nova-compute[73391]: INFO os_vif [None req-7c5209a1-7bf7-474e-93cc-25cc6c95f4f6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:b8:df,bridge_name='br-int',has_traffic_filtering=True,id=5e6f5f62-7fcc-4da7-870a-091a762592e1,network=Network(fae0e46a-88e4-499d-bcff-5b7df55eab4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5e6f5f62-7f')
Aug 15 05:42:21 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c5209a1-7bf7-474e-93cc-25cc6c95f4f6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c5209a1-7bf7-474e-93cc-25cc6c95f4f6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jpvBdxYu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:42:21 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-7c5209a1-7bf7-474e-93cc-25cc6c95f4f6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:42:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-7c5209a1-7bf7-474e-93cc-25cc6c95f4f6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-7c5209a1-7bf7-474e-93cc-25cc6c95f4f6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c5209a1-7bf7-474e-93cc-25cc6c95f4f6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9c6d17-8685-48b8-8024-aaf282864c0b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb68602-ab8e-48c5-8c7b-b3c7109666c7]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c5209a1-7bf7-474e-93cc-25cc6c95f4f6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:42:21 user nova-compute[73391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48 (non-flash)
Aug 15 05:42:21 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:42:21 user nova-compute[73391]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:42:21 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c5209a1-7bf7-474e-93cc-25cc6c95f4f6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:42:21 user nova-compute[73391]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48 (non-flash)
Aug 15 05:42:21 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:42:21 user nova-compute[73391]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:42:21 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c5209a1-7bf7-474e-93cc-25cc6c95f4f6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77482d9630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48'): ({'sde'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-7c5209a1-7bf7-474e-93cc-25cc6c95f4f6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Removing single pathed devices sde {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46d92a4-1df5-44c3-a33f-1a5d7f0ca790]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2faeb57-c255-4fb7-a7da-037742c10221]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-7c5209a1-7bf7-474e-93cc-25cc6c95f4f6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Flushing IO for device /dev/sde {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[753b048f-2b9b-4e6a-9c81-6a2f4f8b3e6f]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-7c5209a1-7bf7-474e-93cc-25cc6c95f4f6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.077s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0b40bd-a669-4884-9d95-adf4f03d95b3]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-7c5209a1-7bf7-474e-93cc-25cc6c95f4f6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-7c5209a1-7bf7-474e-93cc-25cc6c95f4f6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] SCSI volumes sde have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23764666331613465', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_691b16f', '/dev/disk/by-id/scsi-1SCST_BIO691b16f-7dfc1a4e3e583aa2') {{(pid=84527) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ea1c83-11aa-471e-9f34-55f9ece70701]: (4, None) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c5209a1-7bf7-474e-93cc-25cc6c95f4f6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a528191-e4b3-48a6-909a-d6db94f88605]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c5209a1-7bf7-474e-93cc-25cc6c95f4f6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48 -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda3fe8c-24a6-4320-b86e-4341f4ab24fa]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c5209a1-7bf7-474e-93cc-25cc6c95f4f6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48, portal: 172.16.0.220,3260]
Aug 15 05:42:21 user nova-compute[73391]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48, portal: 172.16.0.220,3260] successful.
Aug 15 05:42:21 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48 -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1ced146-3460-4915-8be4-08cf705dfc48 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7449968-4e66-4357-ba85-a09f812b3cd8]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c5209a1-7bf7-474e-93cc-25cc6c95f4f6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-7c5209a1-7bf7-474e-93cc-25cc6c95f4f6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.438s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7c5209a1-7bf7-474e-93cc-25cc6c95f4f6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] <== disconnect_volume: return (440ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7c5209a1-7bf7-474e-93cc-25cc6c95f4f6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 05:42:21 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-7c5209a1-7bf7-474e-93cc-25cc6c95f4f6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Deleting instance files /opt/stack/data/nova/instances/c21e1783-ddc5-479f-8b8d-db5b13ca068a_del
Aug 15 05:42:21 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-7c5209a1-7bf7-474e-93cc-25cc6c95f4f6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Deletion of /opt/stack/data/nova/instances/c21e1783-ddc5-479f-8b8d-db5b13ca068a_del complete
Aug 15 05:42:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:21 user nova-compute[73391]: INFO nova.compute.manager [None req-7c5209a1-7bf7-474e-93cc-25cc6c95f4f6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Took 1.37 seconds to destroy the instance on the hypervisor.
Aug 15 05:42:21 user nova-compute[73391]: DEBUG oslo.service.loopingcall [None req-7c5209a1-7bf7-474e-93cc-25cc6c95f4f6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG nova.compute.manager [-] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Deallocating network for instance {{(pid=73391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] deallocate_for_instance() {{(pid=73391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:22 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:22 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:22 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:22 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:22 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:42:22 user nova-compute[73391]: DEBUG nova.compute.manager [req-b7c48971-dd8d-4222-bf79-8d51213933a9 req-c28ca0df-39ab-4ecb-8897-45198069e4c6 service nova] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Received event network-vif-deleted-5e6f5f62-7fcc-4da7-870a-091a762592e1 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:42:22 user nova-compute[73391]: INFO nova.compute.manager [req-b7c48971-dd8d-4222-bf79-8d51213933a9 req-c28ca0df-39ab-4ecb-8897-45198069e4c6 service nova] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Neutron deleted interface 5e6f5f62-7fcc-4da7-870a-091a762592e1; detaching it from the instance and deleting it from the info cache
Aug 15 05:42:22 user nova-compute[73391]: DEBUG nova.network.neutron [req-b7c48971-dd8d-4222-bf79-8d51213933a9 req-c28ca0df-39ab-4ecb-8897-45198069e4c6 service nova] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:42:22 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Took 0.65 seconds to deallocate network for instance.
Aug 15 05:42:22 user nova-compute[73391]: DEBUG nova.compute.manager [req-b7c48971-dd8d-4222-bf79-8d51213933a9 req-c28ca0df-39ab-4ecb-8897-45198069e4c6 service nova] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Detach interface failed, port_id=5e6f5f62-7fcc-4da7-870a-091a762592e1, reason: Instance c21e1783-ddc5-479f-8b8d-db5b13ca068a could not be found. {{(pid=73391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 05:42:22 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:22 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76fcbfca-deca-44f0-9182-1f9bbab134d2/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:22 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76fcbfca-deca-44f0-9182-1f9bbab134d2/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:22 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76fcbfca-deca-44f0-9182-1f9bbab134d2/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:22 user nova-compute[73391]: DEBUG nova.compute.manager [req-eff8077b-398e-472f-886b-de4000fcc5a2 req-9d6a49b7-36c4-4007-8a3e-3c2e20fa6c15 service nova] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Received event network-vif-plugged-5e6f5f62-7fcc-4da7-870a-091a762592e1 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:42:22 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-eff8077b-398e-472f-886b-de4000fcc5a2 req-9d6a49b7-36c4-4007-8a3e-3c2e20fa6c15 service nova] Acquiring lock "c21e1783-ddc5-479f-8b8d-db5b13ca068a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:42:22 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-eff8077b-398e-472f-886b-de4000fcc5a2 req-9d6a49b7-36c4-4007-8a3e-3c2e20fa6c15 service nova] Lock "c21e1783-ddc5-479f-8b8d-db5b13ca068a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:42:22 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-eff8077b-398e-472f-886b-de4000fcc5a2 req-9d6a49b7-36c4-4007-8a3e-3c2e20fa6c15 service nova] Lock "c21e1783-ddc5-479f-8b8d-db5b13ca068a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:42:22 user nova-compute[73391]: DEBUG nova.compute.manager [req-eff8077b-398e-472f-886b-de4000fcc5a2 req-9d6a49b7-36c4-4007-8a3e-3c2e20fa6c15 service nova] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] No waiting events found dispatching network-vif-plugged-5e6f5f62-7fcc-4da7-870a-091a762592e1 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:42:22 user nova-compute[73391]: WARNING nova.compute.manager [req-eff8077b-398e-472f-886b-de4000fcc5a2 req-9d6a49b7-36c4-4007-8a3e-3c2e20fa6c15 service nova] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Received unexpected event network-vif-plugged-5e6f5f62-7fcc-4da7-870a-091a762592e1 for instance with vm_state active and task_state deleting.
Aug 15 05:42:23 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/76fcbfca-deca-44f0-9182-1f9bbab134d2/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:23 user nova-compute[73391]: INFO nova.compute.manager [None req-7c5209a1-7bf7-474e-93cc-25cc6c95f4f6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Took 1.05 seconds to detach 1 volumes for instance.
Aug 15 05:42:23 user nova-compute[73391]: DEBUG nova.compute.manager [None req-7c5209a1-7bf7-474e-93cc-25cc6c95f4f6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Deleting volume: d1ced146-3460-4915-8be4-08cf705dfc48 {{(pid=73391) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 15 05:42:23 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:42:23 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:42:23 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Hypervisor/Node resource view: name=user free_ram=7116MB free_disk=25.082435607910156GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 05:42:23 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:42:23 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:42:23 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Applying migration context for instance 8991b32e-6c4b-4c66-a320-e734061f49ee as it has an incoming, in-progress migration 7cfcc22d-fce8-47af-89de-3644606f77d2. Migration status is post-migrating {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 15 05:42:23 user nova-compute[73391]: INFO nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Updating resource usage from migration 7cfcc22d-fce8-47af-89de-3644606f77d2
Aug 15 05:42:23 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 8f08782b-f793-415e-b0d6-5caad1c3d426 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:42:23 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 6ac9d5dc-56be-402f-b9d4-3327bdfd9220 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:42:23 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 6358e825-5705-45d6-86b6-3aacfa5a9bbb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:42:23 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance fee43642-30e8-451b-919c-aca4cd4c3f81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:42:23 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:42:23 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 730890c6-6999-4a0f-b80c-e4745bff99ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:42:23 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 8ff2da51-5bfd-4cdc-8cef-330cdef93d97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:42:23 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 76fcbfca-deca-44f0-9182-1f9bbab134d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:42:23 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance c21e1783-ddc5-479f-8b8d-db5b13ca068a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:42:23 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance d60616bb-605e-4604-b637-56670f53159e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:42:23 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance ab02c376-1432-4981-9179-aeef6e647ea4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:42:23 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance dc657d66-c3f8-44e5-b30e-3d79e586a8f3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:42:23 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Migration 7cfcc22d-fce8-47af-89de-3644606f77d2 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 15 05:42:23 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 8991b32e-6c4b-4c66-a320-e734061f49ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:42:23 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 05:42:23 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=29GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 05:42:23 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7c5209a1-7bf7-474e-93cc-25cc6c95f4f6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:42:23 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:24 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:42:24 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:42:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:24 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Compute_service record updated for user:user {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 05:42:24 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.903s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:42:24 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7c5209a1-7bf7-474e-93cc-25cc6c95f4f6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.714s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:42:24 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-7c5209a1-7bf7-474e-93cc-25cc6c95f4f6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:42:24 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-7c5209a1-7bf7-474e-93cc-25cc6c95f4f6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:42:24 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7c5209a1-7bf7-474e-93cc-25cc6c95f4f6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.486s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:42:24 user nova-compute[73391]: INFO nova.scheduler.client.report [None req-7c5209a1-7bf7-474e-93cc-25cc6c95f4f6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Deleted allocations for instance c21e1783-ddc5-479f-8b8d-db5b13ca068a
Aug 15 05:42:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7c5209a1-7bf7-474e-93cc-25cc6c95f4f6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "c21e1783-ddc5-479f-8b8d-db5b13ca068a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.655s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:42:26 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:27 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:42:27 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:42:27 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Starting heal instance info cache {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 05:42:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "refresh_cache-6358e825-5705-45d6-86b6-3aacfa5a9bbb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:42:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquired lock "refresh_cache-6358e825-5705-45d6-86b6-3aacfa5a9bbb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:42:27 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Forcefully refreshing network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 05:42:27 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:28 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Updating instance_info_cache with network_info: [{"id": "3b77e3e1-84f9-470a-b684-e8bdc4996c68", "address": "fa:16:3e:68:b6:f9", "network": {"id": "70d88082-aea7-48bb-abb4-d77d264aaf01", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b9acbe11654053bb905e7c92558a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b77e3e1-84", "ovs_interfaceid": "3b77e3e1-84f9-470a-b684-e8bdc4996c68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:42:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Releasing lock "refresh_cache-6358e825-5705-45d6-86b6-3aacfa5a9bbb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:42:28 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Updated the network info_cache for instance {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 05:42:28 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:42:28 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:42:28 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:42:28 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Starting finish_migration {{(pid=73391) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Instance directory exists: not creating {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 05:42:29 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Creating image(s)
Aug 15 05:42:29 user nova-compute[73391]: DEBUG nova.objects.instance [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8991b32e-6c4b-4c66-a320-e734061f49ee {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.207s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/disk. size=21474836480 {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/disk 21474836480 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/disk 21474836480" returned: 0 in 0.056s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Did not create local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Ensure instance console log exists: /opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Start _get_guest_xml network_info=[{"id": "3e0cb01d-a82e-44d3-b8dd-723819ec6ffa", "address": "fa:16:3e:89:dc:93", "network": {"id": "11023df3-666d-44e5-955d-cc1fbde6972e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1848872765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1848872765-network", "vif_mac": "fa:16:3e:89:dc:93"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "666428ad8c2f4f9cadcd180e498223f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0cb01d-a8", "ovs_interfaceid": "3e0cb01d-a82e-44d3-b8dd-723819ec6ffa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '191b1dad-305e-4d1c-9b15-515ec59a3278'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IWGBEMQx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '8991b32e-6c4b-4c66-a320-e734061f49ee', 'attached_at': '2023-08-15T05:42:29.000000', 'detached_at': '', 'volume_id': '5ac82e4f-fe64-4376-afab-0fe6cbb31bcf', 'serial': '5ac82e4f-fe64-4376-afab-0fe6cbb31bcf'}, 'attachment_id': 'c728878f-f999-4198-bf32-893390f90b30', 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:42:29 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:42:29 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:42:29 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG nova.objects.instance [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8991b32e-6c4b-4c66-a320-e734061f49ee {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IWGBEMQx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:42:29 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:42:29 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:42:29 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:42:29 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:42:29 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 05:42:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3cea3f2-580b-449b-98f5-f1aa72793ecf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 05:42:29 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15e2f74-05c9-4a86-a4e6-089a662c49d1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf] added
Aug 15 05:42:29 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5e674c-023b-4b6a-8a7e-1c2c27eb5f44]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bed0fd6-7402-41fa-aff3-117caf451296]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IWGBEMQx {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IWGBEMQx" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12a8717-f7cd-45eb-bd07-97720c31313b]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IWGBEMQx'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[07900aea-5a88-4798-8d64-6e10f354712c]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5388207-360c-4397-98af-ffb10fd9c0b8]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:42:29 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:42:29 user nova-compute[73391]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:42:29 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:42:29 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:42:29 user nova-compute[73391]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:42:29 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[47bf6c51-c1f6-4ae6-8398-f83263bbd33b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf, portal: 172.16.0.220,3260]
Aug 15 05:42:29 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf, portal: 172.16.0.220,3260] successful.
Aug 15 05:42:29 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2284cef-815b-4730-8427-e1e1bbf235e3]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01563d0-8391-4aad-81de-5dd7fb82ef56]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:42:29 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:42:29 user nova-compute[73391]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:42:29 user nova-compute[73391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)
Aug 15 05:42:29 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:42:29 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:42:29 user nova-compute[73391]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:42:29 user nova-compute[73391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)
Aug 15 05:42:29 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] HCTL ('33', '-', '-', 0) found on session 38 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce56193-c374-4cf2-a7a2-a2bbc545865c]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Searching for a device in session 38 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:42:29 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IWGBEMQx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 05:42:30 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692078135.6837263, 8991b32e-6c4b-4c66-a320-e734061f49ee => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:42:30 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] VM Stopped (Lifecycle Event)
Aug 15 05:42:30 user nova-compute[73391]: DEBUG nova.compute.manager [None req-d2df4913-0378-4026-ba5e-b8039fabca4c None None] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:42:30 user nova-compute[73391]: DEBUG nova.compute.manager [None req-d2df4913-0378-4026-ba5e-b8039fabca4c None None] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:42:30 user nova-compute[73391]: INFO nova.compute.manager [None req-d2df4913-0378-4026-ba5e-b8039fabca4c None None] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 15 05:42:30 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.343s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:42:30 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '26262653465356137', 'path': '/dev/sdb'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:42:30 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262653465356137', 'path': '/dev/sdb'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:38:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-845602872',display_name='tempest-ServerActionsTestOtherB-server-845602872',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-845602872',id=27,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCi9vkvcVQEbXmigHztv9LlDFuCnimhR/vNlP8kykjc1U9WtN+KwlQqW0CDVIHXojOPVLOC+TJRapzFB5aO8vw7udjudZbg8fWCON+jsBrd+VE/0PuYaOBBV7W22/iAKjg==',key_name='tempest-keypair-1001766799',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:38:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='666428ad8c2f4f9cadcd180e498223f7',ramdisk_id='',reservation_id='r-sady4pim',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-762584882',owner_user_name='tempest-ServerActionsTestOtherB-762584882-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:42:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b43158637026445496cc0030b6ce49a2',uuid=8991b32e-6c4b-4c66-a320-e734061f49ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e0cb01d-a82e-44d3-b8dd-723819ec6ffa", "address": "fa:16:3e:89:dc:93", "network": {"id": "11023df3-666d-44e5-955d-cc1fbde6972e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1848872765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1848872765-network", "vif_mac": "fa:16:3e:89:dc:93"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "666428ad8c2f4f9cadcd180e498223f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0cb01d-a8", "ovs_interfaceid": "3e0cb01d-a82e-44d3-b8dd-723819ec6ffa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Converting VIF {"id": "3e0cb01d-a82e-44d3-b8dd-723819ec6ffa", "address": "fa:16:3e:89:dc:93", "network": {"id": "11023df3-666d-44e5-955d-cc1fbde6972e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1848872765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1848872765-network", "vif_mac": "fa:16:3e:89:dc:93"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "666428ad8c2f4f9cadcd180e498223f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0cb01d-a8", "ovs_interfaceid": "3e0cb01d-a82e-44d3-b8dd-723819ec6ffa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:dc:93,bridge_name='br-int',has_traffic_filtering=True,id=3e0cb01d-a82e-44d3-b8dd-723819ec6ffa,network=Network(11023df3-666d-44e5-955d-cc1fbde6972e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e0cb01d-a8') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:42:31 user nova-compute[73391]:   <uuid>8991b32e-6c4b-4c66-a320-e734061f49ee</uuid>
Aug 15 05:42:31 user nova-compute[73391]:   <name>instance-0000001b</name>
Aug 15 05:42:31 user nova-compute[73391]:   <memory>2097152</memory>
Aug 15 05:42:31 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:42:31 user nova-compute[73391]:   <metadata>
Aug 15 05:42:31 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:42:31 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:42:31 user nova-compute[73391]:       <nova:name>tempest-ServerActionsTestOtherB-server-845602872</nova:name>
Aug 15 05:42:31 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:42:29</nova:creationTime>
Aug 15 05:42:31 user nova-compute[73391]:       <nova:flavor name="m1.small">
Aug 15 05:42:31 user nova-compute[73391]:         <nova:memory>2048</nova:memory>
Aug 15 05:42:31 user nova-compute[73391]:         <nova:disk>20</nova:disk>
Aug 15 05:42:31 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:42:31 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:42:31 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:42:31 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:42:31 user nova-compute[73391]:       <nova:owner>
Aug 15 05:42:31 user nova-compute[73391]:         <nova:user uuid="b43158637026445496cc0030b6ce49a2">tempest-ServerActionsTestOtherB-762584882-project-member</nova:user>
Aug 15 05:42:31 user nova-compute[73391]:         <nova:project uuid="666428ad8c2f4f9cadcd180e498223f7">tempest-ServerActionsTestOtherB-762584882</nova:project>
Aug 15 05:42:31 user nova-compute[73391]:       </nova:owner>
Aug 15 05:42:31 user nova-compute[73391]:       <nova:root type="image" uuid="191b1dad-305e-4d1c-9b15-515ec59a3278"/>
Aug 15 05:42:31 user nova-compute[73391]:       <nova:ports>
Aug 15 05:42:31 user nova-compute[73391]:         <nova:port uuid="3e0cb01d-a82e-44d3-b8dd-723819ec6ffa">
Aug 15 05:42:31 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 15 05:42:31 user nova-compute[73391]:         </nova:port>
Aug 15 05:42:31 user nova-compute[73391]:       </nova:ports>
Aug 15 05:42:31 user nova-compute[73391]:     </nova:instance>
Aug 15 05:42:31 user nova-compute[73391]:   </metadata>
Aug 15 05:42:31 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:42:31 user nova-compute[73391]:     <system>
Aug 15 05:42:31 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:42:31 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:42:31 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:42:31 user nova-compute[73391]:       <entry name="serial">8991b32e-6c4b-4c66-a320-e734061f49ee</entry>
Aug 15 05:42:31 user nova-compute[73391]:       <entry name="uuid">8991b32e-6c4b-4c66-a320-e734061f49ee</entry>
Aug 15 05:42:31 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:42:31 user nova-compute[73391]:     </system>
Aug 15 05:42:31 user nova-compute[73391]:   </sysinfo>
Aug 15 05:42:31 user nova-compute[73391]:   <os>
Aug 15 05:42:31 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:42:31 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:42:31 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:42:31 user nova-compute[73391]:   </os>
Aug 15 05:42:31 user nova-compute[73391]:   <features>
Aug 15 05:42:31 user nova-compute[73391]:     <acpi/>
Aug 15 05:42:31 user nova-compute[73391]:     <apic/>
Aug 15 05:42:31 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:42:31 user nova-compute[73391]:   </features>
Aug 15 05:42:31 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:42:31 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:42:31 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:42:31 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:42:31 user nova-compute[73391]:   </clock>
Aug 15 05:42:31 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:42:31 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:42:31 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:42:31 user nova-compute[73391]:   </cpu>
Aug 15 05:42:31 user nova-compute[73391]:   <devices>
Aug 15 05:42:31 user nova-compute[73391]:     <disk type="file" device="disk">
Aug 15 05:42:31 user nova-compute[73391]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 05:42:31 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/disk"/>
Aug 15 05:42:31 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:42:31 user nova-compute[73391]:     </disk>
Aug 15 05:42:31 user nova-compute[73391]:     <disk type="block" device="disk">
Aug 15 05:42:31 user nova-compute[73391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:42:31 user nova-compute[73391]:       <source dev="/dev/sdb"/>
Aug 15 05:42:31 user nova-compute[73391]:       <target dev="vdb" bus="virtio"/>
Aug 15 05:42:31 user nova-compute[73391]:       <serial>5ac82e4f-fe64-4376-afab-0fe6cbb31bcf</serial>
Aug 15 05:42:31 user nova-compute[73391]:     </disk>
Aug 15 05:42:31 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:42:31 user nova-compute[73391]:       <mac address="fa:16:3e:89:dc:93"/>
Aug 15 05:42:31 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:42:31 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:42:31 user nova-compute[73391]:       <target dev="tap3e0cb01d-a8"/>
Aug 15 05:42:31 user nova-compute[73391]:     </interface>
Aug 15 05:42:31 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:42:31 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/console.log" append="off"/>
Aug 15 05:42:31 user nova-compute[73391]:     </serial>
Aug 15 05:42:31 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:42:31 user nova-compute[73391]:     <video>
Aug 15 05:42:31 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:42:31 user nova-compute[73391]:     </video>
Aug 15 05:42:31 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:42:31 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:42:31 user nova-compute[73391]:     </rng>
Aug 15 05:42:31 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:42:31 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:42:31 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:42:31 user nova-compute[73391]:     </memballoon>
Aug 15 05:42:31 user nova-compute[73391]:   </devices>
Aug 15 05:42:31 user nova-compute[73391]: </domain>
Aug 15 05:42:31 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:38:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-845602872',display_name='tempest-ServerActionsTestOtherB-server-845602872',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-845602872',id=27,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCi9vkvcVQEbXmigHztv9LlDFuCnimhR/vNlP8kykjc1U9WtN+KwlQqW0CDVIHXojOPVLOC+TJRapzFB5aO8vw7udjudZbg8fWCON+jsBrd+VE/0PuYaOBBV7W22/iAKjg==',key_name='tempest-keypair-1001766799',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:38:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='666428ad8c2f4f9cadcd180e498223f7',ramdisk_id='',reservation_id='r-sady4pim',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-762584882',owner_user_name='tempest-ServerActionsTestOtherB-762584882-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:42:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b43158637026445496cc0030b6ce49a2',uuid=8991b32e-6c4b-4c66-a320-e734061f49ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e0cb01d-a82e-44d3-b8dd-723819ec6ffa", "address": "fa:16:3e:89:dc:93", "network": {"id": "11023df3-666d-44e5-955d-cc1fbde6972e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1848872765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1848872765-network", "vif_mac": "fa:16:3e:89:dc:93"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "666428ad8c2f4f9cadcd180e498223f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0cb01d-a8", "ovs_interfaceid": "3e0cb01d-a82e-44d3-b8dd-723819ec6ffa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Converting VIF {"id": "3e0cb01d-a82e-44d3-b8dd-723819ec6ffa", "address": "fa:16:3e:89:dc:93", "network": {"id": "11023df3-666d-44e5-955d-cc1fbde6972e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1848872765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1848872765-network", "vif_mac": "fa:16:3e:89:dc:93"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "666428ad8c2f4f9cadcd180e498223f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0cb01d-a8", "ovs_interfaceid": "3e0cb01d-a82e-44d3-b8dd-723819ec6ffa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:dc:93,bridge_name='br-int',has_traffic_filtering=True,id=3e0cb01d-a82e-44d3-b8dd-723819ec6ffa,network=Network(11023df3-666d-44e5-955d-cc1fbde6972e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e0cb01d-a8') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG os_vif [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:dc:93,bridge_name='br-int',has_traffic_filtering=True,id=3e0cb01d-a82e-44d3-b8dd-723819ec6ffa,network=Network(11023df3-666d-44e5-955d-cc1fbde6972e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e0cb01d-a8') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e0cb01d-a8, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3e0cb01d-a8, col_values=(('external_ids', {'iface-id': '3e0cb01d-a82e-44d3-b8dd-723819ec6ffa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:dc:93', 'vm-uuid': '8991b32e-6c4b-4c66-a320-e734061f49ee'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:31 user nova-compute[73391]: INFO os_vif [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:dc:93,bridge_name='br-int',has_traffic_filtering=True,id=3e0cb01d-a82e-44d3-b8dd-723819ec6ffa,network=Network(11023df3-666d-44e5-955d-cc1fbde6972e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e0cb01d-a8')
Aug 15 05:42:31 user nova-compute[73391]: INFO nova.compute.manager [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] Rescuing
Aug 15 05:42:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquiring lock "refresh_cache-d60616bb-605e-4604-b637-56670f53159e" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquired lock "refresh_cache-d60616bb-605e-4604-b637-56670f53159e" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG nova.network.neutron [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fe5e5e2-f6c4-4843-a927-f604e10714ca tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe5e5e2-f6c4-4843-a927-f604e10714ca tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sUIeMGbq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:42:31 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-8fe5e5e2-f6c4-4843-a927-f604e10714ca tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:42:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-8fe5e5e2-f6c4-4843-a927-f604e10714ca tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-8fe5e5e2-f6c4-4843-a927-f604e10714ca tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:42:31 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-8fe5e5e2-f6c4-4843-a927-f604e10714ca tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:42:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-8fe5e5e2-f6c4-4843-a927-f604e10714ca tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-8fe5e5e2-f6c4-4843-a927-f604e10714ca tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:42:31 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-8fe5e5e2-f6c4-4843-a927-f604e10714ca tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 05:42:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc00ef8-fef7-4e40-aa1e-2d04ef5e8ec0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe5e5e2-f6c4-4843-a927-f604e10714ca tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 05:42:31 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a14ac674-4e8a-42c2-85ba-5312f1031c47]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe5e5e2-f6c4-4843-a927-f604e10714ca tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a] added
Aug 15 05:42:31 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] No VIF found with MAC fa:16:3e:89:dc:93, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2111d265-727c-406b-8048-b0029c879919]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe5e5e2-f6c4-4843-a927-f604e10714ca tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3323d744-7846-4497-8c88-a2ed4829778d]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe5e5e2-f6c4-4843-a927-f604e10714ca tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sUIeMGbq {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sUIeMGbq" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[275b8fdd-58bc-4a96-a6c7-4a04aa5f3ee7]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe5e5e2-f6c4-4843-a927-f604e10714ca tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sUIeMGbq'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d33334f-7b01-4d6d-9491-9553ea88ca8f]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe5e5e2-f6c4-4843-a927-f604e10714ca tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4c2733-b394-4b9a-b0c9-cf8afc5c7608]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe5e5e2-f6c4-4843-a927-f604e10714ca tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:42:31 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:42:31 user nova-compute[73391]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:42:31 user nova-compute[73391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)
Aug 15 05:42:31 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe5e5e2-f6c4-4843-a927-f604e10714ca tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:42:31 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:42:31 user nova-compute[73391]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:42:31 user nova-compute[73391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)
Aug 15 05:42:31 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c86c650-6248-44ef-ad35-6fe397ba747c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe5e5e2-f6c4-4843-a927-f604e10714ca tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a, portal: 172.16.0.220,3260]
Aug 15 05:42:31 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a, portal: 172.16.0.220,3260] successful.
Aug 15 05:42:31 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7761bc2-3b5b-4e1d-a588-24d03f8fbf04]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe5e5e2-f6c4-4843-a927-f604e10714ca tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[696f0771-025a-458b-b87e-b0b562d6251c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe5e5e2-f6c4-4843-a927-f604e10714ca tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:42:31 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:42:31 user nova-compute[73391]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:42:31 user nova-compute[73391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)
Aug 15 05:42:31 user nova-compute[73391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a (non-flash)
Aug 15 05:42:31 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe5e5e2-f6c4-4843-a927-f604e10714ca tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:42:31 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:42:31 user nova-compute[73391]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:42:31 user nova-compute[73391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)
Aug 15 05:42:31 user nova-compute[73391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a (non-flash)
Aug 15 05:42:31 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-8fe5e5e2-f6c4-4843-a927-f604e10714ca tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe5e5e2-f6c4-4843-a927-f604e10714ca tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-8fe5e5e2-f6c4-4843-a927-f604e10714ca tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] HCTL ('35', '-', '-', 0) found on session 39 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-8fe5e5e2-f6c4-4843-a927-f604e10714ca tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[10b2fa10-af5e-492e-a346-20d61fb12cb3]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-8fe5e5e2-f6c4-4843-a927-f604e10714ca tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Searching for a device in session 39 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe5e5e2-f6c4-4843-a927-f604e10714ca tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sUIeMGbq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG nova.network.neutron [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] Updating instance_info_cache with network_info: [{"id": "c8787a16-cd6d-410e-8d37-425bdad344d6", "address": "fa:16:3e:f9:58:41", "network": {"id": "70d88082-aea7-48bb-abb4-d77d264aaf01", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b9acbe11654053bb905e7c92558a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8787a16-cd", "ovs_interfaceid": "c8787a16-cd6d-410e-8d37-425bdad344d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:42:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Releasing lock "refresh_cache-d60616bb-605e-4604-b637-56670f53159e" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:42:32 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:32 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:32 user nova-compute[73391]: DEBUG nova.compute.manager [req-e5208da2-6636-4f39-ba59-a53cfe374d18 req-78dd5e66-a7b6-42c0-8b61-5b16108596b7 service nova] [instance: d60616bb-605e-4604-b637-56670f53159e] Received event network-vif-unplugged-c8787a16-cd6d-410e-8d37-425bdad344d6 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:42:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e5208da2-6636-4f39-ba59-a53cfe374d18 req-78dd5e66-a7b6-42c0-8b61-5b16108596b7 service nova] Acquiring lock "d60616bb-605e-4604-b637-56670f53159e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:42:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e5208da2-6636-4f39-ba59-a53cfe374d18 req-78dd5e66-a7b6-42c0-8b61-5b16108596b7 service nova] Lock "d60616bb-605e-4604-b637-56670f53159e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:42:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e5208da2-6636-4f39-ba59-a53cfe374d18 req-78dd5e66-a7b6-42c0-8b61-5b16108596b7 service nova] Lock "d60616bb-605e-4604-b637-56670f53159e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:42:32 user nova-compute[73391]: DEBUG nova.compute.manager [req-e5208da2-6636-4f39-ba59-a53cfe374d18 req-78dd5e66-a7b6-42c0-8b61-5b16108596b7 service nova] [instance: d60616bb-605e-4604-b637-56670f53159e] No waiting events found dispatching network-vif-unplugged-c8787a16-cd6d-410e-8d37-425bdad344d6 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:42:32 user nova-compute[73391]: WARNING nova.compute.manager [req-e5208da2-6636-4f39-ba59-a53cfe374d18 req-78dd5e66-a7b6-42c0-8b61-5b16108596b7 service nova] [instance: d60616bb-605e-4604-b637-56670f53159e] Received unexpected event network-vif-unplugged-c8787a16-cd6d-410e-8d37-425bdad344d6 for instance with vm_state active and task_state rescuing.
Aug 15 05:42:32 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:32 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:32 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-8fe5e5e2-f6c4-4843-a927-f604e10714ca tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:42:32 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fe5e5e2-f6c4-4843-a927-f604e10714ca tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '23130353633356539', 'path': '/dev/sdd'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:42:32 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fe5e5e2-f6c4-4843-a927-f604e10714ca tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130353633356539', 'path': '/dev/sdd'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 05:42:32 user nova-compute[73391]: DEBUG nova.objects.instance [None req-8fe5e5e2-f6c4-4843-a927-f604e10714ca tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lazy-loading 'flavor' on Instance uuid 76fcbfca-deca-44f0-9182-1f9bbab134d2 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:42:32 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-8fe5e5e2-f6c4-4843-a927-f604e10714ca tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 05:42:32 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:42:32 user nova-compute[73391]:   <source dev="/dev/sdd"/>
Aug 15 05:42:32 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:42:32 user nova-compute[73391]:   <serial>47e51a85-6af8-42f7-91fa-052ed34a162a</serial>
Aug 15 05:42:32 user nova-compute[73391]: </disk>
Aug 15 05:42:32 user nova-compute[73391]:  {{(pid=73391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 05:42:32 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:32 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:32 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:32 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:33 user nova-compute[73391]: DEBUG nova.compute.manager [req-3586b179-a5cd-4480-850e-33973381c02e req-e0736c31-3a50-4f42-a414-6c51f31673d1 service nova] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Received event network-vif-plugged-3e0cb01d-a82e-44d3-b8dd-723819ec6ffa {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:42:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-3586b179-a5cd-4480-850e-33973381c02e req-e0736c31-3a50-4f42-a414-6c51f31673d1 service nova] Acquiring lock "8991b32e-6c4b-4c66-a320-e734061f49ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:42:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-3586b179-a5cd-4480-850e-33973381c02e req-e0736c31-3a50-4f42-a414-6c51f31673d1 service nova] Lock "8991b32e-6c4b-4c66-a320-e734061f49ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:42:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-3586b179-a5cd-4480-850e-33973381c02e req-e0736c31-3a50-4f42-a414-6c51f31673d1 service nova] Lock "8991b32e-6c4b-4c66-a320-e734061f49ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:42:33 user nova-compute[73391]: DEBUG nova.compute.manager [req-3586b179-a5cd-4480-850e-33973381c02e req-e0736c31-3a50-4f42-a414-6c51f31673d1 service nova] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] No waiting events found dispatching network-vif-plugged-3e0cb01d-a82e-44d3-b8dd-723819ec6ffa {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:42:33 user nova-compute[73391]: WARNING nova.compute.manager [req-3586b179-a5cd-4480-850e-33973381c02e req-e0736c31-3a50-4f42-a414-6c51f31673d1 service nova] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Received unexpected event network-vif-plugged-3e0cb01d-a82e-44d3-b8dd-723819ec6ffa for instance with vm_state active and task_state resize_finish.
Aug 15 05:42:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:34 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: d60616bb-605e-4604-b637-56670f53159e] Instance destroyed successfully.
Aug 15 05:42:34 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-8fe5e5e2-f6c4-4843-a927-f604e10714ca tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:42:34 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-8fe5e5e2-f6c4-4843-a927-f604e10714ca tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:42:34 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-8fe5e5e2-f6c4-4843-a927-f604e10714ca tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] No VIF found with MAC fa:16:3e:31:53:1e, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:42:34 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] Attempting a stable device rescue
Aug 15 05:42:34 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73391) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 15 05:42:34 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] Instance directory exists: not creating {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 05:42:34 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] Creating image(s)
Aug 15 05:42:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquiring lock "/opt/stack/data/nova/instances/d60616bb-605e-4604-b637-56670f53159e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:42:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "/opt/stack/data/nova/instances/d60616bb-605e-4604-b637-56670f53159e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:42:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "/opt/stack/data/nova/instances/d60616bb-605e-4604-b637-56670f53159e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:42:34 user nova-compute[73391]: DEBUG nova.objects.instance [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lazy-loading 'trusted_certs' on Instance uuid d60616bb-605e-4604-b637-56670f53159e {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:42:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquiring lock "633340cb08725de90f042b5867e5e887c024aafa" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:42:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "633340cb08725de90f042b5867e5e887c024aafa" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:42:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8fe5e5e2-f6c4-4843-a927-f604e10714ca tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "76fcbfca-deca-44f0-9182-1f9bbab134d2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 13.782s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:42:35 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/633340cb08725de90f042b5867e5e887c024aafa.part --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:35 user nova-compute[73391]: DEBUG nova.compute.manager [req-2ac29c5f-1083-49ea-8867-e70933d4c982 req-aca177e2-8135-4b13-83c3-a48e51cf661d service nova] [instance: d60616bb-605e-4604-b637-56670f53159e] Received event network-vif-plugged-c8787a16-cd6d-410e-8d37-425bdad344d6 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:42:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2ac29c5f-1083-49ea-8867-e70933d4c982 req-aca177e2-8135-4b13-83c3-a48e51cf661d service nova] Acquiring lock "d60616bb-605e-4604-b637-56670f53159e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:42:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2ac29c5f-1083-49ea-8867-e70933d4c982 req-aca177e2-8135-4b13-83c3-a48e51cf661d service nova] Lock "d60616bb-605e-4604-b637-56670f53159e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:42:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2ac29c5f-1083-49ea-8867-e70933d4c982 req-aca177e2-8135-4b13-83c3-a48e51cf661d service nova] Lock "d60616bb-605e-4604-b637-56670f53159e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:42:35 user nova-compute[73391]: DEBUG nova.compute.manager [req-2ac29c5f-1083-49ea-8867-e70933d4c982 req-aca177e2-8135-4b13-83c3-a48e51cf661d service nova] [instance: d60616bb-605e-4604-b637-56670f53159e] No waiting events found dispatching network-vif-plugged-c8787a16-cd6d-410e-8d37-425bdad344d6 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:42:35 user nova-compute[73391]: WARNING nova.compute.manager [req-2ac29c5f-1083-49ea-8867-e70933d4c982 req-aca177e2-8135-4b13-83c3-a48e51cf661d service nova] [instance: d60616bb-605e-4604-b637-56670f53159e] Received unexpected event network-vif-plugged-c8787a16-cd6d-410e-8d37-425bdad344d6 for instance with vm_state active and task_state rescuing.
Aug 15 05:42:35 user nova-compute[73391]: DEBUG nova.compute.manager [req-e6822c1d-105a-40ba-9f66-c820bc3cfc3d req-61374222-af44-4aa1-a4b0-a6fa4d4db7a4 service nova] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Received event network-vif-plugged-3e0cb01d-a82e-44d3-b8dd-723819ec6ffa {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:42:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e6822c1d-105a-40ba-9f66-c820bc3cfc3d req-61374222-af44-4aa1-a4b0-a6fa4d4db7a4 service nova] Acquiring lock "8991b32e-6c4b-4c66-a320-e734061f49ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:42:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e6822c1d-105a-40ba-9f66-c820bc3cfc3d req-61374222-af44-4aa1-a4b0-a6fa4d4db7a4 service nova] Lock "8991b32e-6c4b-4c66-a320-e734061f49ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:42:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e6822c1d-105a-40ba-9f66-c820bc3cfc3d req-61374222-af44-4aa1-a4b0-a6fa4d4db7a4 service nova] Lock "8991b32e-6c4b-4c66-a320-e734061f49ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:42:35 user nova-compute[73391]: DEBUG nova.compute.manager [req-e6822c1d-105a-40ba-9f66-c820bc3cfc3d req-61374222-af44-4aa1-a4b0-a6fa4d4db7a4 service nova] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] No waiting events found dispatching network-vif-plugged-3e0cb01d-a82e-44d3-b8dd-723819ec6ffa {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:42:35 user nova-compute[73391]: WARNING nova.compute.manager [req-e6822c1d-105a-40ba-9f66-c820bc3cfc3d req-61374222-af44-4aa1-a4b0-a6fa4d4db7a4 service nova] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Received unexpected event network-vif-plugged-3e0cb01d-a82e-44d3-b8dd-723819ec6ffa for instance with vm_state active and task_state resize_finish.
Aug 15 05:42:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-911b07c8-c304-4a7c-9dd0-d4081e3a417f tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Acquiring lock "ab02c376-1432-4981-9179-aeef6e647ea4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:42:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-911b07c8-c304-4a7c-9dd0-d4081e3a417f tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "ab02c376-1432-4981-9179-aeef6e647ea4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:42:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-911b07c8-c304-4a7c-9dd0-d4081e3a417f tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Acquiring lock "ab02c376-1432-4981-9179-aeef6e647ea4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:42:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-911b07c8-c304-4a7c-9dd0-d4081e3a417f tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "ab02c376-1432-4981-9179-aeef6e647ea4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:42:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-911b07c8-c304-4a7c-9dd0-d4081e3a417f tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "ab02c376-1432-4981-9179-aeef6e647ea4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:42:35 user nova-compute[73391]: INFO nova.compute.manager [None req-911b07c8-c304-4a7c-9dd0-d4081e3a417f tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Terminating instance
Aug 15 05:42:35 user nova-compute[73391]: DEBUG nova.compute.manager [None req-911b07c8-c304-4a7c-9dd0-d4081e3a417f tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Start destroying the instance on the hypervisor. {{(pid=73391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 05:42:35 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/633340cb08725de90f042b5867e5e887c024aafa.part --force-share --output=json" returned: 0 in 0.217s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:35 user nova-compute[73391]: DEBUG nova.virt.images [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] 791c4f15-118a-4fae-b432-818aa8672658 was qcow2, converting to raw {{(pid=73391) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 05:42:35 user nova-compute[73391]: DEBUG nova.privsep.utils [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73391) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 05:42:35 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/633340cb08725de90f042b5867e5e887c024aafa.part /opt/stack/data/nova/instances/_base/633340cb08725de90f042b5867e5e887c024aafa.converted {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:36 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:36 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692078141.2092693, c21e1783-ddc5-479f-8b8d-db5b13ca068a => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:42:36 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] VM Stopped (Lifecycle Event)
Aug 15 05:42:36 user nova-compute[73391]: DEBUG nova.compute.manager [None req-5d10ba7e-143e-41b0-b807-b45be7174d5d None None] [instance: c21e1783-ddc5-479f-8b8d-db5b13ca068a] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:42:36 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:36 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078156.4351559, 8991b32e-6c4b-4c66-a320-e734061f49ee => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:42:36 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] VM Resumed (Lifecycle Event)
Aug 15 05:42:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/633340cb08725de90f042b5867e5e887c024aafa.part /opt/stack/data/nova/instances/_base/633340cb08725de90f042b5867e5e887c024aafa.converted" returned: 0 in 0.827s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/633340cb08725de90f042b5867e5e887c024aafa.converted --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:36 user nova-compute[73391]: DEBUG nova.compute.manager [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:42:36 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:36 user nova-compute[73391]: DEBUG nova.compute.manager [req-48435688-b431-437a-bf11-d4ba72ca18c3 req-d184a507-52dd-4694-9cc1-64153f6d2c61 service nova] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Received event network-vif-unplugged-c1931f1c-7ef8-41c7-82f7-7ace92bb6439 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:42:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-48435688-b431-437a-bf11-d4ba72ca18c3 req-d184a507-52dd-4694-9cc1-64153f6d2c61 service nova] Acquiring lock "ab02c376-1432-4981-9179-aeef6e647ea4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:42:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-48435688-b431-437a-bf11-d4ba72ca18c3 req-d184a507-52dd-4694-9cc1-64153f6d2c61 service nova] Lock "ab02c376-1432-4981-9179-aeef6e647ea4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:42:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-48435688-b431-437a-bf11-d4ba72ca18c3 req-d184a507-52dd-4694-9cc1-64153f6d2c61 service nova] Lock "ab02c376-1432-4981-9179-aeef6e647ea4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:42:36 user nova-compute[73391]: DEBUG nova.compute.manager [req-48435688-b431-437a-bf11-d4ba72ca18c3 req-d184a507-52dd-4694-9cc1-64153f6d2c61 service nova] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] No waiting events found dispatching network-vif-unplugged-c1931f1c-7ef8-41c7-82f7-7ace92bb6439 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:42:36 user nova-compute[73391]: DEBUG nova.compute.manager [req-48435688-b431-437a-bf11-d4ba72ca18c3 req-d184a507-52dd-4694-9cc1-64153f6d2c61 service nova] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Received event network-vif-unplugged-c1931f1c-7ef8-41c7-82f7-7ace92bb6439 for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 05:42:36 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:42:36 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Instance running successfully.
Aug 15 05:42:36 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:42:36 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Failed to set time: agent not configured {{(pid=73391) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 15 05:42:36 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0d255e70-7c4c-4b3d-b22b-e87309d45171 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] finish_migration finished successfully. {{(pid=73391) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 15 05:42:36 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Instance destroyed successfully.
Aug 15 05:42:36 user nova-compute[73391]: DEBUG nova.objects.instance [None req-911b07c8-c304-4a7c-9dd0-d4081e3a417f tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lazy-loading 'resources' on Instance uuid ab02c376-1432-4981-9179-aeef6e647ea4 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:42:36 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 15 05:42:36 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078156.4401045, 8991b32e-6c4b-4c66-a320-e734061f49ee => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:42:36 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] VM Started (Lifecycle Event)
Aug 15 05:42:36 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-911b07c8-c304-4a7c-9dd0-d4081e3a417f tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-08-15T05:36:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-698855278',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-698855278',id=22,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAk8iZa/ytOLHuspv3FTfs6UFC6O0RYBWlGatrlI1q1nEqgwdQunkTmQWSlOgo6yvb0gScc7BBUfbeQPNWDWKld+bhbPO3QCdh+0ZbdeBqDEQ+FzbSaOlaIZahbOfug2ZQ==',key_name='tempest-keypair-1906338828',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:40:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='88871d09f7e347a4b9104a558604f2f6',ramdisk_id='',reservation_id='r-854lfx4v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1774553789',owner_user_name='tempest-AttachVolumeShelveTestJSON-1774553789-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:40:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='4c932032fc884b14b9268d5df91d45ea',uuid=ab02c376-1432-4981-9179-aeef6e647ea4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c1931f1c-7ef8-41c7-82f7-7ace92bb6439", "address": "fa:16:3e:67:d1:b1", "network": {"id": "f67152a9-4f18-4d7f-9d3e-5e517bd46813", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-731866550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88871d09f7e347a4b9104a558604f2f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1931f1c-7e", "ovs_interfaceid": "c1931f1c-7ef8-41c7-82f7-7ace92bb6439", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:42:36 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-911b07c8-c304-4a7c-9dd0-d4081e3a417f tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Converting VIF {"id": "c1931f1c-7ef8-41c7-82f7-7ace92bb6439", "address": "fa:16:3e:67:d1:b1", "network": {"id": "f67152a9-4f18-4d7f-9d3e-5e517bd46813", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-731866550-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.66", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "88871d09f7e347a4b9104a558604f2f6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc1931f1c-7e", "ovs_interfaceid": "c1931f1c-7ef8-41c7-82f7-7ace92bb6439", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:42:36 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-911b07c8-c304-4a7c-9dd0-d4081e3a417f tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:d1:b1,bridge_name='br-int',has_traffic_filtering=True,id=c1931f1c-7ef8-41c7-82f7-7ace92bb6439,network=Network(f67152a9-4f18-4d7f-9d3e-5e517bd46813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1931f1c-7e') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:42:36 user nova-compute[73391]: DEBUG os_vif [None req-911b07c8-c304-4a7c-9dd0-d4081e3a417f tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:d1:b1,bridge_name='br-int',has_traffic_filtering=True,id=c1931f1c-7ef8-41c7-82f7-7ace92bb6439,network=Network(f67152a9-4f18-4d7f-9d3e-5e517bd46813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1931f1c-7e') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:42:36 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:36 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc1931f1c-7e, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:42:36 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:36 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:42:36 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:42:36 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:42:36 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:36 user nova-compute[73391]: INFO os_vif [None req-911b07c8-c304-4a7c-9dd0-d4081e3a417f tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:d1:b1,bridge_name='br-int',has_traffic_filtering=True,id=c1931f1c-7ef8-41c7-82f7-7ace92bb6439,network=Network(f67152a9-4f18-4d7f-9d3e-5e517bd46813),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc1931f1c-7e')
Aug 15 05:42:36 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-911b07c8-c304-4a7c-9dd0-d4081e3a417f tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Deleting instance files /opt/stack/data/nova/instances/ab02c376-1432-4981-9179-aeef6e647ea4_del
Aug 15 05:42:36 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-911b07c8-c304-4a7c-9dd0-d4081e3a417f tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Deletion of /opt/stack/data/nova/instances/ab02c376-1432-4981-9179-aeef6e647ea4_del complete
Aug 15 05:42:36 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 15 05:42:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/633340cb08725de90f042b5867e5e887c024aafa.converted --force-share --output=json" returned: 0 in 0.236s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "633340cb08725de90f042b5867e5e887c024aafa" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.540s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:42:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquiring lock "633340cb08725de90f042b5867e5e887c024aafa" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:42:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "633340cb08725de90f042b5867e5e887c024aafa" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:42:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/633340cb08725de90f042b5867e5e887c024aafa --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:36 user nova-compute[73391]: INFO nova.compute.manager [None req-911b07c8-c304-4a7c-9dd0-d4081e3a417f tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Took 1.29 seconds to destroy the instance on the hypervisor.
Aug 15 05:42:36 user nova-compute[73391]: DEBUG oslo.service.loopingcall [None req-911b07c8-c304-4a7c-9dd0-d4081e3a417f tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 05:42:36 user nova-compute[73391]: DEBUG nova.compute.manager [-] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Deallocating network for instance {{(pid=73391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 05:42:36 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] deallocate_for_instance() {{(pid=73391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 05:42:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/633340cb08725de90f042b5867e5e887c024aafa --force-share --output=json" returned: 0 in 0.206s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/633340cb08725de90f042b5867e5e887c024aafa,backing_fmt=raw /opt/stack/data/nova/instances/d60616bb-605e-4604-b637-56670f53159e/disk.rescue {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/633340cb08725de90f042b5867e5e887c024aafa,backing_fmt=raw /opt/stack/data/nova/instances/d60616bb-605e-4604-b637-56670f53159e/disk.rescue" returned: 0 in 0.071s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "633340cb08725de90f042b5867e5e887c024aafa" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG nova.objects.instance [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lazy-loading 'migration_context' on Instance uuid d60616bb-605e-4604-b637-56670f53159e {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] Created local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] Start _get_guest_xml network_info=[{"id": "c8787a16-cd6d-410e-8d37-425bdad344d6", "address": "fa:16:3e:f9:58:41", "network": {"id": "70d88082-aea7-48bb-abb4-d77d264aaf01", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "vif_mac": "fa:16:3e:f9:58:41"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b9acbe11654053bb905e7c92558a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8787a16-cd", "ovs_interfaceid": "c8787a16-cd6d-410e-8d37-425bdad344d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '791c4f15-118a-4fae-b432-818aa8672658', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GSuaqwUj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': 'd60616bb-605e-4604-b637-56670f53159e', 'attached_at': '', 'detached_at': '', 'volume_id': '911dca0b-7771-4c68-9daf-70cae57028cb', 'serial': '911dca0b-7771-4c68-9daf-70cae57028cb'}, 'attachment_id': 'bf2ec6ca-3f9e-417f-81aa-818d2a60ec9c', 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG nova.objects.instance [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lazy-loading 'resources' on Instance uuid d60616bb-605e-4604-b637-56670f53159e {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG nova.objects.instance [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lazy-loading 'numa_topology' on Instance uuid d60616bb-605e-4604-b637-56670f53159e {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:42:37 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:42:37 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:42:37 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG nova.objects.instance [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lazy-loading 'vcpu_model' on Instance uuid d60616bb-605e-4604-b637-56670f53159e {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GSuaqwUj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:42:37 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:42:37 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:42:37 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:42:37 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:42:37 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 05:42:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb -p 172.16.0.220:3260" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e7b6fd-fe29-42e1-a026-eeb89da8f295]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = GSuaqwUj\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 15 05:42:37 user nova-compute[73391]: node.name = iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb
Aug 15 05:42:37 user nova-compute[73391]: node.tpgt = -1
Aug 15 05:42:37 user nova-compute[73391]: node.startup = automatic
Aug 15 05:42:37 user nova-compute[73391]: node.leading_login = No
Aug 15 05:42:37 user nova-compute[73391]: iface.iscsi_ifacename = default
Aug 15 05:42:37 user nova-compute[73391]: iface.net_ifacename = <empty>
Aug 15 05:42:37 user nova-compute[73391]: iface.ipaddress = <empty>
Aug 15 05:42:37 user nova-compute[73391]: iface.prefix_len = 0
Aug 15 05:42:37 user nova-compute[73391]: iface.hwaddress = <empty>
Aug 15 05:42:37 user nova-compute[73391]: iface.transport_name = tcp
Aug 15 05:42:37 user nova-compute[73391]: iface.initiatorname = <empty>
Aug 15 05:42:37 user nova-compute[73391]: iface.state = <empty>
Aug 15 05:42:37 user nova-compute[73391]: iface.vlan_id = 0
Aug 15 05:42:37 user nova-compute[73391]: iface.vlan_priority = 0
Aug 15 05:42:37 user nova-compute[73391]: iface.vlan_state = <empty>
Aug 15 05:42:37 user nova-compute[73391]: iface.iface_num = 0
Aug 15 05:42:37 user nova-compute[73391]: iface.mtu = 0
Aug 15 05:42:37 user nova-compute[73391]: iface.port = 0
Aug 15 05:42:37 user nova-compute[73391]: iface.bootproto = <empty>
Aug 15 05:42:37 user nova-compute[73391]: iface.subnet_mask = <empty>
Aug 15 05:42:37 user nova-compute[73391]: iface.gateway = <empty>
Aug 15 05:42:37 user nova-compute[73391]: iface.dhcp_alt_client_id_state = <empty>
Aug 15 05:42:37 user nova-compute[73391]: iface.dhcp_alt_client_id = <empty>
Aug 15 05:42:37 user nova-compute[73391]: iface.dhcp_dns = <empty>
Aug 15 05:42:37 user nova-compute[73391]: iface.dhcp_learn_iqn = <empty>
Aug 15 05:42:37 user nova-compute[73391]: iface.dhcp_req_vendor_id_state = <empty>
Aug 15 05:42:37 user nova-compute[73391]: iface.dhcp_vendor_id_state = <empty>
Aug 15 05:42:37 user nova-compute[73391]: iface.dhcp_vendor_id = <empty>
Aug 15 05:42:37 user nova-compute[73391]: iface.dhcp_slp_da = <empty>
Aug 15 05:42:37 user nova-compute[73391]: iface.fragmentation = <empty>
Aug 15 05:42:37 user nova-compute[73391]: iface.gratuitous_arp = <empty>
Aug 15 05:42:37 user nova-compute[73391]: iface.incoming_forwarding = <empty>
Aug 15 05:42:37 user nova-compute[73391]: iface.tos_state = <empty>
Aug 15 05:42:37 user nova-compute[73391]: iface.tos = 0
Aug 15 05:42:37 user nova-compute[73391]: iface.ttl = 0
Aug 15 05:42:37 user nova-compute[73391]: iface.delayed_ack = <empty>
Aug 15 05:42:37 user nova-compute[73391]: iface.tcp_nagle = <empty>
Aug 15 05:42:37 user nova-compute[73391]: iface.tcp_wsf_state = <empty>
Aug 15 05:42:37 user nova-compute[73391]: iface.tcp_wsf = 0
Aug 15 05:42:37 user nova-compute[73391]: iface.tcp_timer_scale = 0
Aug 15 05:42:37 user nova-compute[73391]: iface.tcp_timestamp = <empty>
Aug 15 05:42:37 user nova-compute[73391]: iface.redirect = <empty>
Aug 15 05:42:37 user nova-compute[73391]: iface.def_task_mgmt_timeout = 0
Aug 15 05:42:37 user nova-compute[73391]: iface.header_digest = <empty>
Aug 15 05:42:37 user nova-compute[73391]: iface.data_digest = <empty>
Aug 15 05:42:37 user nova-compute[73391]: iface.immediate_data = <empty>
Aug 15 05:42:37 user nova-compute[73391]: iface.initial_r2t = <empty>
Aug 15 05:42:37 user nova-compute[73391]: iface.data_seq_inorder = <empty>
Aug 15 05:42:37 user nova-compute[73391]: iface.data_pdu_inorder = <empty>
Aug 15 05:42:37 user nova-compute[73391]: iface.erl = 0
Aug 15 05:42:37 user nova-compute[73391]: iface.max_receive_data_len = 0
Aug 15 05:42:37 user nova-compute[73391]: iface.first_burst_len = 0
Aug 15 05:42:37 user nova-compute[73391]: iface.max_outstanding_r2t = 0
Aug 15 05:42:37 user nova-compute[73391]: iface.max_burst_len = 0
Aug 15 05:42:37 user nova-compute[73391]: iface.chap_auth = <empty>
Aug 15 05:42:37 user nova-compute[73391]: iface.bidi_chap = <empty>
Aug 15 05:42:37 user nova-compute[73391]: iface.strict_login_compliance = <empty>
Aug 15 05:42:37 user nova-compute[73391]: iface.discovery_auth = <empty>
Aug 15 05:42:37 user nova-compute[73391]: iface.discovery_logout = <empty>
Aug 15 05:42:37 user nova-compute[73391]: node.discovery_address = <empty>
Aug 15 05:42:37 user nova-compute[73391]: node.discovery_port = 0
Aug 15 05:42:37 user nova-compute[73391]: node.discovery_type = static
Aug 15 05:42:37 user nova-compute[73391]: node.session.initial_cmdsn = 0
Aug 15 05:42:37 user nova-compute[73391]: node.session.initial_login_retry_max = 8
Aug 15 05:42:37 user nova-compute[73391]: node.session.xmit_thread_priority = -20
Aug 15 05:42:37 user nova-compute[73391]: node.session.cmds_max = 128
Aug 15 05:42:37 user nova-compute[73391]: node.session.queue_depth = 32
Aug 15 05:42:37 user nova-compute[73391]: node.session.nr_sessions = 1
Aug 15 05:42:37 user nova-compute[73391]: node.session.auth.authmethod = CHAP
Aug 15 05:42:37 user nova-compute[73391]: node.session.auth.username = GSuaqwUj
Aug 15 05:42:37 user nova-compute[73391]: node.session.auth.password = ***
Aug 15 05:42:37 user nova-compute[73391]: node.session.auth.username_in = <empty>
Aug 15 05:42:37 user nova-compute[73391]: node.session.auth.password_in = <empty>
Aug 15 05:42:37 user nova-compute[73391]: node.session.auth.chap_algs = MD5
Aug 15 05:42:37 user nova-compute[73391]: node.session.timeo.replacement_timeout = 120
Aug 15 05:42:37 user nova-compute[73391]: node.session.err_timeo.abort_timeout = 15
Aug 15 05:42:37 user nova-compute[73391]: node.session.err_timeo.lu_reset_timeout = 30
Aug 15 05:42:37 user nova-compute[73391]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 15 05:42:37 user nova-compute[73391]: node.session.err_timeo.host_reset_timeout = 60
Aug 15 05:42:37 user nova-compute[73391]: node.session.iscsi.FastAbort = Yes
Aug 15 05:42:37 user nova-compute[73391]: node.session.iscsi.InitialR2T = No
Aug 15 05:42:37 user nova-compute[73391]: node.session.iscsi.ImmediateData = Yes
Aug 15 05:42:37 user nova-compute[73391]: node.session.iscsi.FirstBurstLength = 262144
Aug 15 05:42:37 user nova-compute[73391]: node.session.iscsi.MaxBurstLength = 16776192
Aug 15 05:42:37 user nova-compute[73391]: node.session.iscsi.DefaultTime2Retain = 0
Aug 15 05:42:37 user nova-compute[73391]: node.session.iscsi.DefaultTime2Wait = 2
Aug 15 05:42:37 user nova-compute[73391]: node.session.iscsi.MaxConnections = 1
Aug 15 05:42:37 user nova-compute[73391]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 15 05:42:37 user nova-compute[73391]: node.session.iscsi.ERL = 0
Aug 15 05:42:37 user nova-compute[73391]: node.session.scan = manual
Aug 15 05:42:37 user nova-compute[73391]: node.session.reopen_max = 0
Aug 15 05:42:37 user nova-compute[73391]: node.conn[0].address = 172.16.0.220
Aug 15 05:42:37 user nova-compute[73391]: node.conn[0].port = 3260
Aug 15 05:42:37 user nova-compute[73391]: node.conn[0].startup = manual
Aug 15 05:42:37 user nova-compute[73391]: node.conn[0].tcp.window_size = 524288
Aug 15 05:42:37 user nova-compute[73391]: node.conn[0].tcp.type_of_service = 0
Aug 15 05:42:37 user nova-compute[73391]: node.conn[0].timeo.logout_timeout = 15
Aug 15 05:42:37 user nova-compute[73391]: node.conn[0].timeo.login_timeout = 15
Aug 15 05:42:37 user nova-compute[73391]: node.conn[0].timeo.auth_timeout = 45
Aug 15 05:42:37 user nova-compute[73391]: node.conn[0].timeo.noop_out_interval = 5
Aug 15 05:42:37 user nova-compute[73391]: node.conn[0].timeo.noop_out_timeout = 5
Aug 15 05:42:37 user nova-compute[73391]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 15 05:42:37 user nova-compute[73391]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 15 05:42:37 user nova-compute[73391]: node.conn[0].iscsi.HeaderDigest = None
Aug 15 05:42:37 user nova-compute[73391]: node.conn[0].iscsi.DataDigest = None
Aug 15 05:42:37 user nova-compute[73391]: node.conn[0].iscsi.IFMarker = No
Aug 15 05:42:37 user nova-compute[73391]: node.conn[0].iscsi.OFMarker = No
Aug 15 05:42:37 user nova-compute[73391]: # END RECORD
Aug 15 05:42:37 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a9c2c4-1f23-437f-838c-001ba3ef98d3]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d344da-f841-4bd4-a6e9-d11a56d58321]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GSuaqwUj {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GSuaqwUj" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9315a9-3fa5-4a58-8b41-dd4cd48844db]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GSuaqwUj'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc53e765-0c48-4848-b108-8781fde0c01c]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b317b907-339f-4110-b686-1662886e430a]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:42:37 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:42:37 user nova-compute[73391]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:42:37 user nova-compute[73391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)
Aug 15 05:42:37 user nova-compute[73391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a (non-flash)
Aug 15 05:42:37 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:42:37 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:42:37 user nova-compute[73391]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:42:37 user nova-compute[73391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)
Aug 15 05:42:37 user nova-compute[73391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a (non-flash)
Aug 15 05:42:37 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.181s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] HCTL ('38', '0', '0', 0) found on session 35 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Scanning host 38 c: 0, t: 0, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[46470aaf-59a2-40f3-b940-6c25c812724a]: (4, ('0 0 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Searching for a device in session 35 and hctl ('38', '0', '0', 0) yield: sdg {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GSuaqwUj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.212s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] <== connect_volume: return (214ms) {'type': 'block', 'scsi_wwn': '26131396232663036', 'path': '/dev/sdg'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131396232663036', 'path': '/dev/sdg'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:40:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-173546372',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-173546372',id=30,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:41:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83b9acbe11654053bb905e7c92558a35',ramdisk_id='',reservation_id='r-c3nfsozy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1045163116',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:41:09Z,user_data=None,user_id='887f0846cf554e12acf92a663f5ab266',uuid=d60616bb-605e-4604-b637-56670f53159e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c8787a16-cd6d-410e-8d37-425bdad344d6", "address": "fa:16:3e:f9:58:41", "network": {"id": "70d88082-aea7-48bb-abb4-d77d264aaf01", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "vif_mac": "fa:16:3e:f9:58:41"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b9acbe11654053bb905e7c92558a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8787a16-cd", "ovs_interfaceid": "c8787a16-cd6d-410e-8d37-425bdad344d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Converting VIF {"id": "c8787a16-cd6d-410e-8d37-425bdad344d6", "address": "fa:16:3e:f9:58:41", "network": {"id": "70d88082-aea7-48bb-abb4-d77d264aaf01", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "vif_mac": "fa:16:3e:f9:58:41"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b9acbe11654053bb905e7c92558a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8787a16-cd", "ovs_interfaceid": "c8787a16-cd6d-410e-8d37-425bdad344d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:58:41,bridge_name='br-int',has_traffic_filtering=True,id=c8787a16-cd6d-410e-8d37-425bdad344d6,network=Network(70d88082-aea7-48bb-abb4-d77d264aaf01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8787a16-cd') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG nova.objects.instance [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lazy-loading 'pci_devices' on Instance uuid d60616bb-605e-4604-b637-56670f53159e {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:42:37 user nova-compute[73391]:   <uuid>d60616bb-605e-4604-b637-56670f53159e</uuid>
Aug 15 05:42:37 user nova-compute[73391]:   <name>instance-0000001e</name>
Aug 15 05:42:37 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:42:37 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:42:37 user nova-compute[73391]:   <metadata>
Aug 15 05:42:37 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:42:37 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:42:37 user nova-compute[73391]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-173546372</nova:name>
Aug 15 05:42:37 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:42:37</nova:creationTime>
Aug 15 05:42:37 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:42:37 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:42:37 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:42:37 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:42:37 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:42:37 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:42:37 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:42:37 user nova-compute[73391]:       <nova:owner>
Aug 15 05:42:37 user nova-compute[73391]:         <nova:user uuid="887f0846cf554e12acf92a663f5ab266">tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member</nova:user>
Aug 15 05:42:37 user nova-compute[73391]:         <nova:project uuid="83b9acbe11654053bb905e7c92558a35">tempest-ServerBootFromVolumeStableRescueTest-1045163116</nova:project>
Aug 15 05:42:37 user nova-compute[73391]:       </nova:owner>
Aug 15 05:42:37 user nova-compute[73391]:       <nova:root type="image" uuid="191b1dad-305e-4d1c-9b15-515ec59a3278"/>
Aug 15 05:42:37 user nova-compute[73391]:       <nova:ports>
Aug 15 05:42:37 user nova-compute[73391]:         <nova:port uuid="c8787a16-cd6d-410e-8d37-425bdad344d6">
Aug 15 05:42:37 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 15 05:42:37 user nova-compute[73391]:         </nova:port>
Aug 15 05:42:37 user nova-compute[73391]:       </nova:ports>
Aug 15 05:42:37 user nova-compute[73391]:     </nova:instance>
Aug 15 05:42:37 user nova-compute[73391]:   </metadata>
Aug 15 05:42:37 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:42:37 user nova-compute[73391]:     <system>
Aug 15 05:42:37 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:42:37 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:42:37 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:42:37 user nova-compute[73391]:       <entry name="serial">d60616bb-605e-4604-b637-56670f53159e</entry>
Aug 15 05:42:37 user nova-compute[73391]:       <entry name="uuid">d60616bb-605e-4604-b637-56670f53159e</entry>
Aug 15 05:42:37 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:42:37 user nova-compute[73391]:     </system>
Aug 15 05:42:37 user nova-compute[73391]:   </sysinfo>
Aug 15 05:42:37 user nova-compute[73391]:   <os>
Aug 15 05:42:37 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:42:37 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:42:37 user nova-compute[73391]:   </os>
Aug 15 05:42:37 user nova-compute[73391]:   <features>
Aug 15 05:42:37 user nova-compute[73391]:     <acpi/>
Aug 15 05:42:37 user nova-compute[73391]:     <apic/>
Aug 15 05:42:37 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:42:37 user nova-compute[73391]:   </features>
Aug 15 05:42:37 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:42:37 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:42:37 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:42:37 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:42:37 user nova-compute[73391]:   </clock>
Aug 15 05:42:37 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:42:37 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:42:37 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:42:37 user nova-compute[73391]:   </cpu>
Aug 15 05:42:37 user nova-compute[73391]:   <devices>
Aug 15 05:42:37 user nova-compute[73391]:     <disk type="block" device="disk">
Aug 15 05:42:37 user nova-compute[73391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:42:37 user nova-compute[73391]:       <source dev="/dev/sdg"/>
Aug 15 05:42:37 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:42:37 user nova-compute[73391]:       <serial>911dca0b-7771-4c68-9daf-70cae57028cb</serial>
Aug 15 05:42:37 user nova-compute[73391]:     </disk>
Aug 15 05:42:37 user nova-compute[73391]:     <disk type="file" device="disk">
Aug 15 05:42:37 user nova-compute[73391]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 05:42:37 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/d60616bb-605e-4604-b637-56670f53159e/disk.rescue"/>
Aug 15 05:42:37 user nova-compute[73391]:       <target dev="vdb" bus="virtio"/>
Aug 15 05:42:37 user nova-compute[73391]:       <boot order="1"/>
Aug 15 05:42:37 user nova-compute[73391]:     </disk>
Aug 15 05:42:37 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:42:37 user nova-compute[73391]:       <mac address="fa:16:3e:f9:58:41"/>
Aug 15 05:42:37 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:42:37 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:42:37 user nova-compute[73391]:       <target dev="tapc8787a16-cd"/>
Aug 15 05:42:37 user nova-compute[73391]:     </interface>
Aug 15 05:42:37 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:42:37 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/d60616bb-605e-4604-b637-56670f53159e/console.log" append="off"/>
Aug 15 05:42:37 user nova-compute[73391]:     </serial>
Aug 15 05:42:37 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:42:37 user nova-compute[73391]:     <video>
Aug 15 05:42:37 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:42:37 user nova-compute[73391]:     </video>
Aug 15 05:42:37 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:42:37 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:42:37 user nova-compute[73391]:     </rng>
Aug 15 05:42:37 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:42:37 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:42:37 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:42:37 user nova-compute[73391]:     </memballoon>
Aug 15 05:42:37 user nova-compute[73391]:   </devices>
Aug 15 05:42:37 user nova-compute[73391]: </domain>
Aug 15 05:42:37 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:42:37 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: d60616bb-605e-4604-b637-56670f53159e] Instance destroyed successfully.
Aug 15 05:42:37 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:42:37 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] No VIF found with MAC fa:16:3e:f9:58:41, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:42:38 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:42:38 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Took 1.22 seconds to deallocate network for instance.
Aug 15 05:42:38 user nova-compute[73391]: DEBUG nova.compute.manager [req-144392ec-5b6f-49a2-a994-19aa5c6c439f req-aaae7758-3aff-47bb-bb69-7f4e6da718e6 service nova] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Received event network-vif-deleted-c1931f1c-7ef8-41c7-82f7-7ace92bb6439 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:42:38 user nova-compute[73391]: INFO nova.compute.manager [req-144392ec-5b6f-49a2-a994-19aa5c6c439f req-aaae7758-3aff-47bb-bb69-7f4e6da718e6 service nova] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Neutron deleted interface c1931f1c-7ef8-41c7-82f7-7ace92bb6439; detaching it from the instance and deleting it from the info cache
Aug 15 05:42:38 user nova-compute[73391]: DEBUG nova.network.neutron [req-144392ec-5b6f-49a2-a994-19aa5c6c439f req-aaae7758-3aff-47bb-bb69-7f4e6da718e6 service nova] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:42:38 user nova-compute[73391]: DEBUG nova.compute.manager [req-144392ec-5b6f-49a2-a994-19aa5c6c439f req-aaae7758-3aff-47bb-bb69-7f4e6da718e6 service nova] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Detach interface failed, port_id=c1931f1c-7ef8-41c7-82f7-7ace92bb6439, reason: Instance ab02c376-1432-4981-9179-aeef6e647ea4 could not be found. {{(pid=73391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 05:42:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-911b07c8-c304-4a7c-9dd0-d4081e3a417f tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:42:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-911b07c8-c304-4a7c-9dd0-d4081e3a417f tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:42:38 user nova-compute[73391]: DEBUG nova.compute.manager [req-ce7c4903-ba92-418f-9091-57d9682cd7f7 req-3e2cfc02-f437-4133-a7d6-43c82025f6ff service nova] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Received event network-vif-plugged-c1931f1c-7ef8-41c7-82f7-7ace92bb6439 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:42:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ce7c4903-ba92-418f-9091-57d9682cd7f7 req-3e2cfc02-f437-4133-a7d6-43c82025f6ff service nova] Acquiring lock "ab02c376-1432-4981-9179-aeef6e647ea4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:42:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ce7c4903-ba92-418f-9091-57d9682cd7f7 req-3e2cfc02-f437-4133-a7d6-43c82025f6ff service nova] Lock "ab02c376-1432-4981-9179-aeef6e647ea4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:42:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ce7c4903-ba92-418f-9091-57d9682cd7f7 req-3e2cfc02-f437-4133-a7d6-43c82025f6ff service nova] Lock "ab02c376-1432-4981-9179-aeef6e647ea4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:42:38 user nova-compute[73391]: DEBUG nova.compute.manager [req-ce7c4903-ba92-418f-9091-57d9682cd7f7 req-3e2cfc02-f437-4133-a7d6-43c82025f6ff service nova] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] No waiting events found dispatching network-vif-plugged-c1931f1c-7ef8-41c7-82f7-7ace92bb6439 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:42:38 user nova-compute[73391]: WARNING nova.compute.manager [req-ce7c4903-ba92-418f-9091-57d9682cd7f7 req-3e2cfc02-f437-4133-a7d6-43c82025f6ff service nova] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Received unexpected event network-vif-plugged-c1931f1c-7ef8-41c7-82f7-7ace92bb6439 for instance with vm_state deleted and task_state None.
Aug 15 05:42:38 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-911b07c8-c304-4a7c-9dd0-d4081e3a417f tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:42:38 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-911b07c8-c304-4a7c-9dd0-d4081e3a417f tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:42:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-911b07c8-c304-4a7c-9dd0-d4081e3a417f tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.553s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:42:38 user nova-compute[73391]: INFO nova.scheduler.client.report [None req-911b07c8-c304-4a7c-9dd0-d4081e3a417f tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Deleted allocations for instance ab02c376-1432-4981-9179-aeef6e647ea4
Aug 15 05:42:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-911b07c8-c304-4a7c-9dd0-d4081e3a417f tempest-AttachVolumeShelveTestJSON-1774553789 tempest-AttachVolumeShelveTestJSON-1774553789-project-member] Lock "ab02c376-1432-4981-9179-aeef6e647ea4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.325s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:42:38 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:38 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:38 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:39 user nova-compute[73391]: INFO nova.compute.manager [None req-43d2043c-9c66-4aba-bd16-87325bb61b48 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Rescuing
Aug 15 05:42:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-43d2043c-9c66-4aba-bd16-87325bb61b48 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Acquiring lock "refresh_cache-730890c6-6999-4a0f-b80c-e4745bff99ab" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:42:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-43d2043c-9c66-4aba-bd16-87325bb61b48 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Acquired lock "refresh_cache-730890c6-6999-4a0f-b80c-e4745bff99ab" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:42:39 user nova-compute[73391]: DEBUG nova.network.neutron [None req-43d2043c-9c66-4aba-bd16-87325bb61b48 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:42:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:40 user nova-compute[73391]: DEBUG nova.network.neutron [None req-43d2043c-9c66-4aba-bd16-87325bb61b48 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Updating instance_info_cache with network_info: [{"id": "f598ee19-8c81-4cf2-a88d-8221516eb1cf", "address": "fa:16:3e:2e:da:40", "network": {"id": "bec69c6a-b2cb-4b0a-ba6e-ae6dae099818", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7da9448cc34b609120da564a01dba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf598ee19-8c", "ovs_interfaceid": "f598ee19-8c81-4cf2-a88d-8221516eb1cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:42:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-43d2043c-9c66-4aba-bd16-87325bb61b48 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Releasing lock "refresh_cache-730890c6-6999-4a0f-b80c-e4745bff99ab" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:42:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:40 user nova-compute[73391]: DEBUG nova.compute.manager [req-ad8bf63d-ac22-4a82-9552-a1e00ad12980 req-8109c469-a88c-4ba2-9110-6c658ad014ef service nova] [instance: d60616bb-605e-4604-b637-56670f53159e] Received event network-vif-plugged-c8787a16-cd6d-410e-8d37-425bdad344d6 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:42:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ad8bf63d-ac22-4a82-9552-a1e00ad12980 req-8109c469-a88c-4ba2-9110-6c658ad014ef service nova] Acquiring lock "d60616bb-605e-4604-b637-56670f53159e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:42:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ad8bf63d-ac22-4a82-9552-a1e00ad12980 req-8109c469-a88c-4ba2-9110-6c658ad014ef service nova] Lock "d60616bb-605e-4604-b637-56670f53159e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:42:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ad8bf63d-ac22-4a82-9552-a1e00ad12980 req-8109c469-a88c-4ba2-9110-6c658ad014ef service nova] Lock "d60616bb-605e-4604-b637-56670f53159e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:42:40 user nova-compute[73391]: DEBUG nova.compute.manager [req-ad8bf63d-ac22-4a82-9552-a1e00ad12980 req-8109c469-a88c-4ba2-9110-6c658ad014ef service nova] [instance: d60616bb-605e-4604-b637-56670f53159e] No waiting events found dispatching network-vif-plugged-c8787a16-cd6d-410e-8d37-425bdad344d6 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:42:40 user nova-compute[73391]: WARNING nova.compute.manager [req-ad8bf63d-ac22-4a82-9552-a1e00ad12980 req-8109c469-a88c-4ba2-9110-6c658ad014ef service nova] [instance: d60616bb-605e-4604-b637-56670f53159e] Received unexpected event network-vif-plugged-c8787a16-cd6d-410e-8d37-425bdad344d6 for instance with vm_state active and task_state rescuing.
Aug 15 05:42:40 user nova-compute[73391]: DEBUG nova.compute.manager [req-ad8bf63d-ac22-4a82-9552-a1e00ad12980 req-8109c469-a88c-4ba2-9110-6c658ad014ef service nova] [instance: d60616bb-605e-4604-b637-56670f53159e] Received event network-vif-plugged-c8787a16-cd6d-410e-8d37-425bdad344d6 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:42:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ad8bf63d-ac22-4a82-9552-a1e00ad12980 req-8109c469-a88c-4ba2-9110-6c658ad014ef service nova] Acquiring lock "d60616bb-605e-4604-b637-56670f53159e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:42:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ad8bf63d-ac22-4a82-9552-a1e00ad12980 req-8109c469-a88c-4ba2-9110-6c658ad014ef service nova] Lock "d60616bb-605e-4604-b637-56670f53159e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:42:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ad8bf63d-ac22-4a82-9552-a1e00ad12980 req-8109c469-a88c-4ba2-9110-6c658ad014ef service nova] Lock "d60616bb-605e-4604-b637-56670f53159e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:42:40 user nova-compute[73391]: DEBUG nova.compute.manager [req-ad8bf63d-ac22-4a82-9552-a1e00ad12980 req-8109c469-a88c-4ba2-9110-6c658ad014ef service nova] [instance: d60616bb-605e-4604-b637-56670f53159e] No waiting events found dispatching network-vif-plugged-c8787a16-cd6d-410e-8d37-425bdad344d6 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:42:40 user nova-compute[73391]: WARNING nova.compute.manager [req-ad8bf63d-ac22-4a82-9552-a1e00ad12980 req-8109c469-a88c-4ba2-9110-6c658ad014ef service nova] [instance: d60616bb-605e-4604-b637-56670f53159e] Received unexpected event network-vif-plugged-c8787a16-cd6d-410e-8d37-425bdad344d6 for instance with vm_state active and task_state rescuing.
Aug 15 05:42:40 user nova-compute[73391]: DEBUG nova.compute.manager [req-ad8bf63d-ac22-4a82-9552-a1e00ad12980 req-8109c469-a88c-4ba2-9110-6c658ad014ef service nova] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Received event network-vif-unplugged-f598ee19-8c81-4cf2-a88d-8221516eb1cf {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:42:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ad8bf63d-ac22-4a82-9552-a1e00ad12980 req-8109c469-a88c-4ba2-9110-6c658ad014ef service nova] Acquiring lock "730890c6-6999-4a0f-b80c-e4745bff99ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:42:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ad8bf63d-ac22-4a82-9552-a1e00ad12980 req-8109c469-a88c-4ba2-9110-6c658ad014ef service nova] Lock "730890c6-6999-4a0f-b80c-e4745bff99ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:42:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ad8bf63d-ac22-4a82-9552-a1e00ad12980 req-8109c469-a88c-4ba2-9110-6c658ad014ef service nova] Lock "730890c6-6999-4a0f-b80c-e4745bff99ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:42:40 user nova-compute[73391]: DEBUG nova.compute.manager [req-ad8bf63d-ac22-4a82-9552-a1e00ad12980 req-8109c469-a88c-4ba2-9110-6c658ad014ef service nova] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] No waiting events found dispatching network-vif-unplugged-f598ee19-8c81-4cf2-a88d-8221516eb1cf {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:42:40 user nova-compute[73391]: WARNING nova.compute.manager [req-ad8bf63d-ac22-4a82-9552-a1e00ad12980 req-8109c469-a88c-4ba2-9110-6c658ad014ef service nova] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Received unexpected event network-vif-unplugged-f598ee19-8c81-4cf2-a88d-8221516eb1cf for instance with vm_state active and task_state rescuing.
Aug 15 05:42:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:40 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Instance destroyed successfully.
Aug 15 05:42:40 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-43d2043c-9c66-4aba-bd16-87325bb61b48 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Attempting rescue
Aug 15 05:42:40 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-43d2043c-9c66-4aba-bd16-87325bb61b48 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73391) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 15 05:42:40 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-43d2043c-9c66-4aba-bd16-87325bb61b48 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Instance directory exists: not creating {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 05:42:40 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-43d2043c-9c66-4aba-bd16-87325bb61b48 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Creating image(s)
Aug 15 05:42:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-43d2043c-9c66-4aba-bd16-87325bb61b48 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Acquiring lock "/opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:42:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-43d2043c-9c66-4aba-bd16-87325bb61b48 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "/opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:42:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-43d2043c-9c66-4aba-bd16-87325bb61b48 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "/opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:42:40 user nova-compute[73391]: DEBUG nova.objects.instance [None req-43d2043c-9c66-4aba-bd16-87325bb61b48 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lazy-loading 'trusted_certs' on Instance uuid 730890c6-6999-4a0f-b80c-e4745bff99ab {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:42:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-43d2043c-9c66-4aba-bd16-87325bb61b48 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Acquiring lock "999b315ba87151d8252d543312ae7790e7e1583b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:42:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-43d2043c-9c66-4aba-bd16-87325bb61b48 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:42:40 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-43d2043c-9c66-4aba-bd16-87325bb61b48 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-43d2043c-9c66-4aba-bd16-87325bb61b48 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.196s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-43d2043c-9c66-4aba-bd16-87325bb61b48 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk.rescue {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:42:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-43d2043c-9c66-4aba-bd16-87325bb61b48 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk.rescue" returned: 0 in 0.055s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:42:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-43d2043c-9c66-4aba-bd16-87325bb61b48 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:42:41 user nova-compute[73391]: DEBUG nova.objects.instance [None req-43d2043c-9c66-4aba-bd16-87325bb61b48 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lazy-loading 'migration_context' on Instance uuid 730890c6-6999-4a0f-b80c-e4745bff99ab {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:42:41 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-43d2043c-9c66-4aba-bd16-87325bb61b48 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Created local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 05:42:41 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-43d2043c-9c66-4aba-bd16-87325bb61b48 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Start _get_guest_xml network_info=[{"id": "f598ee19-8c81-4cf2-a88d-8221516eb1cf", "address": "fa:16:3e:2e:da:40", "network": {"id": "bec69c6a-b2cb-4b0a-ba6e-ae6dae099818", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "vif_mac": "fa:16:3e:2e:da:40"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7da9448cc34b609120da564a01dba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf598ee19-8c", "ovs_interfaceid": "f598ee19-8c81-4cf2-a88d-8221516eb1cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '191b1dad-305e-4d1c-9b15-515ec59a3278', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:42:41 user nova-compute[73391]: DEBUG nova.objects.instance [None req-43d2043c-9c66-4aba-bd16-87325bb61b48 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lazy-loading 'resources' on Instance uuid 730890c6-6999-4a0f-b80c-e4745bff99ab {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:42:41 user nova-compute[73391]: DEBUG nova.objects.instance [None req-43d2043c-9c66-4aba-bd16-87325bb61b48 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lazy-loading 'numa_topology' on Instance uuid 730890c6-6999-4a0f-b80c-e4745bff99ab {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:42:41 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-43d2043c-9c66-4aba-bd16-87325bb61b48 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:42:41 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-43d2043c-9c66-4aba-bd16-87325bb61b48 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:42:41 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-43d2043c-9c66-4aba-bd16-87325bb61b48 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:42:41 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-43d2043c-9c66-4aba-bd16-87325bb61b48 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:42:41 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-43d2043c-9c66-4aba-bd16-87325bb61b48 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:42:41 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-43d2043c-9c66-4aba-bd16-87325bb61b48 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:42:41 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-43d2043c-9c66-4aba-bd16-87325bb61b48 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:42:41 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-43d2043c-9c66-4aba-bd16-87325bb61b48 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:42:41 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-43d2043c-9c66-4aba-bd16-87325bb61b48 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:42:41 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-43d2043c-9c66-4aba-bd16-87325bb61b48 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:42:41 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-43d2043c-9c66-4aba-bd16-87325bb61b48 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:42:41 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-43d2043c-9c66-4aba-bd16-87325bb61b48 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:42:41 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-43d2043c-9c66-4aba-bd16-87325bb61b48 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:42:41 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-43d2043c-9c66-4aba-bd16-87325bb61b48 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:42:41 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-43d2043c-9c66-4aba-bd16-87325bb61b48 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:42:41 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-43d2043c-9c66-4aba-bd16-87325bb61b48 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:42:41 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-43d2043c-9c66-4aba-bd16-87325bb61b48 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:42:41 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-43d2043c-9c66-4aba-bd16-87325bb61b48 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:42:41 user nova-compute[73391]: DEBUG nova.objects.instance [None req-43d2043c-9c66-4aba-bd16-87325bb61b48 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lazy-loading 'vcpu_model' on Instance uuid 730890c6-6999-4a0f-b80c-e4745bff99ab {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:42:41 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-43d2043c-9c66-4aba-bd16-87325bb61b48 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:37:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-639325125',display_name='tempest-ServerRescueNegativeTestJSON-server-639325125',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-639325125',id=24,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:38:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5a7da9448cc34b609120da564a01dba4',ramdisk_id='',reservation_id='r-u63o4wgc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1933442633',owner_user_name='tempest-ServerRescueNegativeTestJSON-1933442633-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:38:01Z,user_data=None,user_id='1f0f5888b8c44188a17202fad2725256',uuid=730890c6-6999-4a0f-b80c-e4745bff99ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f598ee19-8c81-4cf2-a88d-8221516eb1cf", "address": "fa:16:3e:2e:da:40", "network": {"id": "bec69c6a-b2cb-4b0a-ba6e-ae6dae099818", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "vif_mac": "fa:16:3e:2e:da:40"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7da9448cc34b609120da564a01dba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf598ee19-8c", "ovs_interfaceid": "f598ee19-8c81-4cf2-a88d-8221516eb1cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:42:41 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-43d2043c-9c66-4aba-bd16-87325bb61b48 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Converting VIF {"id": "f598ee19-8c81-4cf2-a88d-8221516eb1cf", "address": "fa:16:3e:2e:da:40", "network": {"id": "bec69c6a-b2cb-4b0a-ba6e-ae6dae099818", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "vif_mac": "fa:16:3e:2e:da:40"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7da9448cc34b609120da564a01dba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf598ee19-8c", "ovs_interfaceid": "f598ee19-8c81-4cf2-a88d-8221516eb1cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:42:41 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-43d2043c-9c66-4aba-bd16-87325bb61b48 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:da:40,bridge_name='br-int',has_traffic_filtering=True,id=f598ee19-8c81-4cf2-a88d-8221516eb1cf,network=Network(bec69c6a-b2cb-4b0a-ba6e-ae6dae099818),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf598ee19-8c') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:42:41 user nova-compute[73391]: DEBUG nova.objects.instance [None req-43d2043c-9c66-4aba-bd16-87325bb61b48 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lazy-loading 'pci_devices' on Instance uuid 730890c6-6999-4a0f-b80c-e4745bff99ab {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:42:41 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-43d2043c-9c66-4aba-bd16-87325bb61b48 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:42:41 user nova-compute[73391]:   <uuid>730890c6-6999-4a0f-b80c-e4745bff99ab</uuid>
Aug 15 05:42:41 user nova-compute[73391]:   <name>instance-00000018</name>
Aug 15 05:42:41 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:42:41 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:42:41 user nova-compute[73391]:   <metadata>
Aug 15 05:42:41 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:42:41 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:42:41 user nova-compute[73391]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-639325125</nova:name>
Aug 15 05:42:41 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:42:41</nova:creationTime>
Aug 15 05:42:41 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:42:41 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:42:41 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:42:41 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:42:41 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:42:41 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:42:41 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:42:41 user nova-compute[73391]:       <nova:owner>
Aug 15 05:42:41 user nova-compute[73391]:         <nova:user uuid="1f0f5888b8c44188a17202fad2725256">tempest-ServerRescueNegativeTestJSON-1933442633-project-member</nova:user>
Aug 15 05:42:41 user nova-compute[73391]:         <nova:project uuid="5a7da9448cc34b609120da564a01dba4">tempest-ServerRescueNegativeTestJSON-1933442633</nova:project>
Aug 15 05:42:41 user nova-compute[73391]:       </nova:owner>
Aug 15 05:42:41 user nova-compute[73391]:       <nova:root type="image" uuid="191b1dad-305e-4d1c-9b15-515ec59a3278"/>
Aug 15 05:42:41 user nova-compute[73391]:       <nova:ports>
Aug 15 05:42:41 user nova-compute[73391]:         <nova:port uuid="f598ee19-8c81-4cf2-a88d-8221516eb1cf">
Aug 15 05:42:41 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 15 05:42:41 user nova-compute[73391]:         </nova:port>
Aug 15 05:42:41 user nova-compute[73391]:       </nova:ports>
Aug 15 05:42:41 user nova-compute[73391]:     </nova:instance>
Aug 15 05:42:41 user nova-compute[73391]:   </metadata>
Aug 15 05:42:41 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:42:41 user nova-compute[73391]:     <system>
Aug 15 05:42:41 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:42:41 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:42:41 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:42:41 user nova-compute[73391]:       <entry name="serial">730890c6-6999-4a0f-b80c-e4745bff99ab</entry>
Aug 15 05:42:41 user nova-compute[73391]:       <entry name="uuid">730890c6-6999-4a0f-b80c-e4745bff99ab</entry>
Aug 15 05:42:41 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:42:41 user nova-compute[73391]:     </system>
Aug 15 05:42:41 user nova-compute[73391]:   </sysinfo>
Aug 15 05:42:41 user nova-compute[73391]:   <os>
Aug 15 05:42:41 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:42:41 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:42:41 user nova-compute[73391]:   </os>
Aug 15 05:42:41 user nova-compute[73391]:   <features>
Aug 15 05:42:41 user nova-compute[73391]:     <acpi/>
Aug 15 05:42:41 user nova-compute[73391]:     <apic/>
Aug 15 05:42:41 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:42:41 user nova-compute[73391]:   </features>
Aug 15 05:42:41 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:42:41 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:42:41 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:42:41 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:42:41 user nova-compute[73391]:   </clock>
Aug 15 05:42:41 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:42:41 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:42:41 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:42:41 user nova-compute[73391]:   </cpu>
Aug 15 05:42:41 user nova-compute[73391]:   <devices>
Aug 15 05:42:41 user nova-compute[73391]:     <disk type="file" device="disk">
Aug 15 05:42:41 user nova-compute[73391]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 05:42:41 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk.rescue"/>
Aug 15 05:42:41 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:42:41 user nova-compute[73391]:     </disk>
Aug 15 05:42:41 user nova-compute[73391]:     <disk type="file" device="disk">
Aug 15 05:42:41 user nova-compute[73391]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 05:42:41 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk"/>
Aug 15 05:42:41 user nova-compute[73391]:       <target dev="vdb" bus="virtio"/>
Aug 15 05:42:41 user nova-compute[73391]:     </disk>
Aug 15 05:42:41 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:42:41 user nova-compute[73391]:       <mac address="fa:16:3e:2e:da:40"/>
Aug 15 05:42:41 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:42:41 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:42:41 user nova-compute[73391]:       <target dev="tapf598ee19-8c"/>
Aug 15 05:42:41 user nova-compute[73391]:     </interface>
Aug 15 05:42:41 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:42:41 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/console.log" append="off"/>
Aug 15 05:42:41 user nova-compute[73391]:     </serial>
Aug 15 05:42:41 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:42:41 user nova-compute[73391]:     <video>
Aug 15 05:42:41 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:42:41 user nova-compute[73391]:     </video>
Aug 15 05:42:41 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:42:41 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:42:41 user nova-compute[73391]:     </rng>
Aug 15 05:42:41 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:42:41 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:42:41 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:42:41 user nova-compute[73391]:     </memballoon>
Aug 15 05:42:41 user nova-compute[73391]:   </devices>
Aug 15 05:42:41 user nova-compute[73391]: </domain>
Aug 15 05:42:41 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:42:41 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Instance destroyed successfully.
Aug 15 05:42:41 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-43d2043c-9c66-4aba-bd16-87325bb61b48 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:42:41 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-43d2043c-9c66-4aba-bd16-87325bb61b48 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:42:41 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-43d2043c-9c66-4aba-bd16-87325bb61b48 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] No VIF found with MAC fa:16:3e:2e:da:40, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:42:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:41 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Removed pending event for d60616bb-605e-4604-b637-56670f53159e due to event {{(pid=73391) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 05:42:41 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078161.7685683, d60616bb-605e-4604-b637-56670f53159e => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:42:41 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: d60616bb-605e-4604-b637-56670f53159e] VM Resumed (Lifecycle Event)
Aug 15 05:42:41 user nova-compute[73391]: DEBUG nova.compute.manager [None req-6e84d8ae-e404-4a68-ba22-1aff006eedb3 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:42:41 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: d60616bb-605e-4604-b637-56670f53159e] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:42:41 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: d60616bb-605e-4604-b637-56670f53159e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:42:41 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: d60616bb-605e-4604-b637-56670f53159e] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 15 05:42:41 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078161.7708957, d60616bb-605e-4604-b637-56670f53159e => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:42:41 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: d60616bb-605e-4604-b637-56670f53159e] VM Started (Lifecycle Event)
Aug 15 05:42:41 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: d60616bb-605e-4604-b637-56670f53159e] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:42:41 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: d60616bb-605e-4604-b637-56670f53159e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:42:42 user nova-compute[73391]: DEBUG nova.compute.manager [req-1490aa70-2753-4d5f-bf2b-9247b5d53bb7 req-2d0cf883-02a7-4178-b579-778c43cc3c5e service nova] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Received event network-vif-plugged-f598ee19-8c81-4cf2-a88d-8221516eb1cf {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:42:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-1490aa70-2753-4d5f-bf2b-9247b5d53bb7 req-2d0cf883-02a7-4178-b579-778c43cc3c5e service nova] Acquiring lock "730890c6-6999-4a0f-b80c-e4745bff99ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:42:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-1490aa70-2753-4d5f-bf2b-9247b5d53bb7 req-2d0cf883-02a7-4178-b579-778c43cc3c5e service nova] Lock "730890c6-6999-4a0f-b80c-e4745bff99ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:42:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-1490aa70-2753-4d5f-bf2b-9247b5d53bb7 req-2d0cf883-02a7-4178-b579-778c43cc3c5e service nova] Lock "730890c6-6999-4a0f-b80c-e4745bff99ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:42:42 user nova-compute[73391]: DEBUG nova.compute.manager [req-1490aa70-2753-4d5f-bf2b-9247b5d53bb7 req-2d0cf883-02a7-4178-b579-778c43cc3c5e service nova] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] No waiting events found dispatching network-vif-plugged-f598ee19-8c81-4cf2-a88d-8221516eb1cf {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:42:42 user nova-compute[73391]: WARNING nova.compute.manager [req-1490aa70-2753-4d5f-bf2b-9247b5d53bb7 req-2d0cf883-02a7-4178-b579-778c43cc3c5e service nova] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Received unexpected event network-vif-plugged-f598ee19-8c81-4cf2-a88d-8221516eb1cf for instance with vm_state active and task_state rescuing.
Aug 15 05:42:42 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:42 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:42 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:42 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:43 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:43 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:44 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:44 user nova-compute[73391]: DEBUG nova.compute.manager [req-ecef69eb-00ae-4889-bf6d-759cf5f141bd req-46ab926b-779a-40d2-8e9e-47696854d58b service nova] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Received event network-vif-plugged-f598ee19-8c81-4cf2-a88d-8221516eb1cf {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:42:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ecef69eb-00ae-4889-bf6d-759cf5f141bd req-46ab926b-779a-40d2-8e9e-47696854d58b service nova] Acquiring lock "730890c6-6999-4a0f-b80c-e4745bff99ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:42:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ecef69eb-00ae-4889-bf6d-759cf5f141bd req-46ab926b-779a-40d2-8e9e-47696854d58b service nova] Lock "730890c6-6999-4a0f-b80c-e4745bff99ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:42:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ecef69eb-00ae-4889-bf6d-759cf5f141bd req-46ab926b-779a-40d2-8e9e-47696854d58b service nova] Lock "730890c6-6999-4a0f-b80c-e4745bff99ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:42:44 user nova-compute[73391]: DEBUG nova.compute.manager [req-ecef69eb-00ae-4889-bf6d-759cf5f141bd req-46ab926b-779a-40d2-8e9e-47696854d58b service nova] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] No waiting events found dispatching network-vif-plugged-f598ee19-8c81-4cf2-a88d-8221516eb1cf {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:42:44 user nova-compute[73391]: WARNING nova.compute.manager [req-ecef69eb-00ae-4889-bf6d-759cf5f141bd req-46ab926b-779a-40d2-8e9e-47696854d58b service nova] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Received unexpected event network-vif-plugged-f598ee19-8c81-4cf2-a88d-8221516eb1cf for instance with vm_state active and task_state rescuing.
Aug 15 05:42:44 user nova-compute[73391]: DEBUG nova.compute.manager [req-ecef69eb-00ae-4889-bf6d-759cf5f141bd req-46ab926b-779a-40d2-8e9e-47696854d58b service nova] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Received event network-vif-plugged-f598ee19-8c81-4cf2-a88d-8221516eb1cf {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:42:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ecef69eb-00ae-4889-bf6d-759cf5f141bd req-46ab926b-779a-40d2-8e9e-47696854d58b service nova] Acquiring lock "730890c6-6999-4a0f-b80c-e4745bff99ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:42:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ecef69eb-00ae-4889-bf6d-759cf5f141bd req-46ab926b-779a-40d2-8e9e-47696854d58b service nova] Lock "730890c6-6999-4a0f-b80c-e4745bff99ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:42:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ecef69eb-00ae-4889-bf6d-759cf5f141bd req-46ab926b-779a-40d2-8e9e-47696854d58b service nova] Lock "730890c6-6999-4a0f-b80c-e4745bff99ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:42:44 user nova-compute[73391]: DEBUG nova.compute.manager [req-ecef69eb-00ae-4889-bf6d-759cf5f141bd req-46ab926b-779a-40d2-8e9e-47696854d58b service nova] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] No waiting events found dispatching network-vif-plugged-f598ee19-8c81-4cf2-a88d-8221516eb1cf {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:42:44 user nova-compute[73391]: WARNING nova.compute.manager [req-ecef69eb-00ae-4889-bf6d-759cf5f141bd req-46ab926b-779a-40d2-8e9e-47696854d58b service nova] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Received unexpected event network-vif-plugged-f598ee19-8c81-4cf2-a88d-8221516eb1cf for instance with vm_state active and task_state rescuing.
Aug 15 05:42:45 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Removed pending event for 730890c6-6999-4a0f-b80c-e4745bff99ab due to event {{(pid=73391) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 05:42:45 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078165.3785565, 730890c6-6999-4a0f-b80c-e4745bff99ab => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:42:45 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] VM Resumed (Lifecycle Event)
Aug 15 05:42:45 user nova-compute[73391]: DEBUG nova.compute.manager [None req-43d2043c-9c66-4aba-bd16-87325bb61b48 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:42:45 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:42:45 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:42:45 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 15 05:42:45 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078165.383207, 730890c6-6999-4a0f-b80c-e4745bff99ab => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:42:45 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] VM Started (Lifecycle Event)
Aug 15 05:42:45 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:42:45 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:42:45 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 15 05:42:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:51 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:42:51 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692078156.4534273, ab02c376-1432-4981-9179-aeef6e647ea4 => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:42:51 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] VM Stopped (Lifecycle Event)
Aug 15 05:42:51 user nova-compute[73391]: DEBUG nova.compute.manager [None req-2b88a84a-a59c-4b53-b86d-2978bac66754 None None] [instance: ab02c376-1432-4981-9179-aeef6e647ea4] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:42:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:42:59 user nova-compute[73391]: DEBUG nova.compute.manager [req-20342c47-ea3f-4310-9c94-d353e00c3a8e req-1857f642-a1c4-49f5-954f-999fb6775080 service nova] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Received event network-changed-9cde10e9-3186-4680-8e4d-a3bb0d8600d0 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:42:59 user nova-compute[73391]: DEBUG nova.compute.manager [req-20342c47-ea3f-4310-9c94-d353e00c3a8e req-1857f642-a1c4-49f5-954f-999fb6775080 service nova] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Refreshing instance network info cache due to event network-changed-9cde10e9-3186-4680-8e4d-a3bb0d8600d0. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:42:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-20342c47-ea3f-4310-9c94-d353e00c3a8e req-1857f642-a1c4-49f5-954f-999fb6775080 service nova] Acquiring lock "refresh_cache-6ac9d5dc-56be-402f-b9d4-3327bdfd9220" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:42:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-20342c47-ea3f-4310-9c94-d353e00c3a8e req-1857f642-a1c4-49f5-954f-999fb6775080 service nova] Acquired lock "refresh_cache-6ac9d5dc-56be-402f-b9d4-3327bdfd9220" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:42:59 user nova-compute[73391]: DEBUG nova.network.neutron [req-20342c47-ea3f-4310-9c94-d353e00c3a8e req-1857f642-a1c4-49f5-954f-999fb6775080 service nova] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Refreshing network info cache for port 9cde10e9-3186-4680-8e4d-a3bb0d8600d0 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:43:00 user nova-compute[73391]: DEBUG nova.network.neutron [req-20342c47-ea3f-4310-9c94-d353e00c3a8e req-1857f642-a1c4-49f5-954f-999fb6775080 service nova] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Updated VIF entry in instance network info cache for port 9cde10e9-3186-4680-8e4d-a3bb0d8600d0. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:43:00 user nova-compute[73391]: DEBUG nova.network.neutron [req-20342c47-ea3f-4310-9c94-d353e00c3a8e req-1857f642-a1c4-49f5-954f-999fb6775080 service nova] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Updating instance_info_cache with network_info: [{"id": "9cde10e9-3186-4680-8e4d-a3bb0d8600d0", "address": "fa:16:3e:50:39:e0", "network": {"id": "610f78de-5741-4743-815d-d12ba05f8000", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1518164868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b01853a82243369bd71dc0dbedb5d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cde10e9-31", "ovs_interfaceid": "9cde10e9-3186-4680-8e4d-a3bb0d8600d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:43:00 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-20342c47-ea3f-4310-9c94-d353e00c3a8e req-1857f642-a1c4-49f5-954f-999fb6775080 service nova] Releasing lock "refresh_cache-6ac9d5dc-56be-402f-b9d4-3327bdfd9220" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:43:01 user nova-compute[73391]: DEBUG nova.compute.manager [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Stashing vm_state: active {{(pid=73391) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Aug 15 05:43:01 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:43:01 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:43:01 user nova-compute[73391]: DEBUG nova.objects.instance [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lazy-loading 'pci_requests' on Instance uuid dc657d66-c3f8-44e5-b30e-3d79e586a8f3 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:43:01 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 05:43:01 user nova-compute[73391]: INFO nova.compute.claims [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Claim successful on node user
Aug 15 05:43:01 user nova-compute[73391]: DEBUG nova.objects.instance [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lazy-loading 'resources' on Instance uuid dc657d66-c3f8-44e5-b30e-3d79e586a8f3 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:43:01 user nova-compute[73391]: DEBUG nova.objects.instance [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lazy-loading 'pci_devices' on Instance uuid dc657d66-c3f8-44e5-b30e-3d79e586a8f3 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:43:01 user nova-compute[73391]: INFO nova.compute.resource_tracker [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Updating resource usage from migration 68dd821e-9200-4f15-90ac-3b30802dd875
Aug 15 05:43:01 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:01 user nova-compute[73391]: DEBUG nova.compute.manager [req-83d9e7da-05d4-4700-a5be-7df5ea3c7bcd req-97bdeb80-071e-4b37-a4e2-ef7bacabf1b2 service nova] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Received event network-changed-83a46e94-e5e7-41bb-803a-30000c4f9a02 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:43:01 user nova-compute[73391]: DEBUG nova.compute.manager [req-83d9e7da-05d4-4700-a5be-7df5ea3c7bcd req-97bdeb80-071e-4b37-a4e2-ef7bacabf1b2 service nova] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Refreshing instance network info cache due to event network-changed-83a46e94-e5e7-41bb-803a-30000c4f9a02. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:43:01 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-83d9e7da-05d4-4700-a5be-7df5ea3c7bcd req-97bdeb80-071e-4b37-a4e2-ef7bacabf1b2 service nova] Acquiring lock "refresh_cache-dc657d66-c3f8-44e5-b30e-3d79e586a8f3" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:43:01 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-83d9e7da-05d4-4700-a5be-7df5ea3c7bcd req-97bdeb80-071e-4b37-a4e2-ef7bacabf1b2 service nova] Acquired lock "refresh_cache-dc657d66-c3f8-44e5-b30e-3d79e586a8f3" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:43:01 user nova-compute[73391]: DEBUG nova.network.neutron [req-83d9e7da-05d4-4700-a5be-7df5ea3c7bcd req-97bdeb80-071e-4b37-a4e2-ef7bacabf1b2 service nova] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Refreshing network info cache for port 83a46e94-e5e7-41bb-803a-30000c4f9a02 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:43:02 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:43:02 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:43:02 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.562s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:43:02 user nova-compute[73391]: INFO nova.compute.manager [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Migrating
Aug 15 05:43:02 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquiring lock "refresh_cache-dc657d66-c3f8-44e5-b30e-3d79e586a8f3" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:43:02 user nova-compute[73391]: DEBUG nova.network.neutron [req-83d9e7da-05d4-4700-a5be-7df5ea3c7bcd req-97bdeb80-071e-4b37-a4e2-ef7bacabf1b2 service nova] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Updated VIF entry in instance network info cache for port 83a46e94-e5e7-41bb-803a-30000c4f9a02. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:43:02 user nova-compute[73391]: DEBUG nova.network.neutron [req-83d9e7da-05d4-4700-a5be-7df5ea3c7bcd req-97bdeb80-071e-4b37-a4e2-ef7bacabf1b2 service nova] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Updating instance_info_cache with network_info: [{"id": "83a46e94-e5e7-41bb-803a-30000c4f9a02", "address": "fa:16:3e:ab:ac:be", "network": {"id": "610f78de-5741-4743-815d-d12ba05f8000", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1518164868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b01853a82243369bd71dc0dbedb5d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83a46e94-e5", "ovs_interfaceid": "83a46e94-e5e7-41bb-803a-30000c4f9a02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:43:02 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-83d9e7da-05d4-4700-a5be-7df5ea3c7bcd req-97bdeb80-071e-4b37-a4e2-ef7bacabf1b2 service nova] Releasing lock "refresh_cache-dc657d66-c3f8-44e5-b30e-3d79e586a8f3" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:43:02 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquired lock "refresh_cache-dc657d66-c3f8-44e5-b30e-3d79e586a8f3" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:43:02 user nova-compute[73391]: DEBUG nova.network.neutron [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:43:02 user nova-compute[73391]: DEBUG nova.network.neutron [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Updating instance_info_cache with network_info: [{"id": "83a46e94-e5e7-41bb-803a-30000c4f9a02", "address": "fa:16:3e:ab:ac:be", "network": {"id": "610f78de-5741-4743-815d-d12ba05f8000", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1518164868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b01853a82243369bd71dc0dbedb5d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83a46e94-e5", "ovs_interfaceid": "83a46e94-e5e7-41bb-803a-30000c4f9a02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:43:02 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Releasing lock "refresh_cache-dc657d66-c3f8-44e5-b30e-3d79e586a8f3" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:43:03 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Starting migrate_disk_and_power_off {{(pid=73391) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Aug 15 05:43:03 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:03 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:03 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:03 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:03 user nova-compute[73391]: DEBUG nova.compute.manager [req-0b0c90af-08ca-4fbd-9e6c-03d4148a0eed req-2d6bde18-1388-4b6c-a377-441c7c97e3a7 service nova] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Received event network-vif-unplugged-83a46e94-e5e7-41bb-803a-30000c4f9a02 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:43:03 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-0b0c90af-08ca-4fbd-9e6c-03d4148a0eed req-2d6bde18-1388-4b6c-a377-441c7c97e3a7 service nova] Acquiring lock "dc657d66-c3f8-44e5-b30e-3d79e586a8f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:43:03 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-0b0c90af-08ca-4fbd-9e6c-03d4148a0eed req-2d6bde18-1388-4b6c-a377-441c7c97e3a7 service nova] Lock "dc657d66-c3f8-44e5-b30e-3d79e586a8f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:43:03 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-0b0c90af-08ca-4fbd-9e6c-03d4148a0eed req-2d6bde18-1388-4b6c-a377-441c7c97e3a7 service nova] Lock "dc657d66-c3f8-44e5-b30e-3d79e586a8f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:43:03 user nova-compute[73391]: DEBUG nova.compute.manager [req-0b0c90af-08ca-4fbd-9e6c-03d4148a0eed req-2d6bde18-1388-4b6c-a377-441c7c97e3a7 service nova] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] No waiting events found dispatching network-vif-unplugged-83a46e94-e5e7-41bb-803a-30000c4f9a02 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:43:03 user nova-compute[73391]: WARNING nova.compute.manager [req-0b0c90af-08ca-4fbd-9e6c-03d4148a0eed req-2d6bde18-1388-4b6c-a377-441c7c97e3a7 service nova] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Received unexpected event network-vif-unplugged-83a46e94-e5e7-41bb-803a-30000c4f9a02 for instance with vm_state active and task_state resize_migrating.
Aug 15 05:43:03 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Instance destroyed successfully.
Aug 15 05:43:03 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:41:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-156136201',display_name='tempest-ServerActionsTestOtherA-server-156136201',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-156136201',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNF3pif1QWXVpHrEIxShzB1xE/c22B7LSOZtRDzcmt7Dk63BIrH6/RWzxjN8WpKbyeDl3Aa13tDu+mUrmV6NfezccRAEecdR4P4btA7xRgsBIkQydnisHIujmlpX6Glrow==',key_name='tempest-keypair-512432776',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:41:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='60b01853a82243369bd71dc0dbedb5d6',ramdisk_id='',reservation_id='r-lrepebad',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1927429987',owner_user_name='tempest-ServerActionsTestOtherA-1927429987-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:43:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='124dcfde552147e2978970386274c70a',uuid=dc657d66-c3f8-44e5-b30e-3d79e586a8f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "83a46e94-e5e7-41bb-803a-30000c4f9a02", "address": "fa:16:3e:ab:ac:be", "network": {"id": "610f78de-5741-4743-815d-d12ba05f8000", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1518164868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1518164868-network", "vif_mac": "fa:16:3e:ab:ac:be"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b01853a82243369bd71dc0dbedb5d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83a46e94-e5", "ovs_interfaceid": "83a46e94-e5e7-41bb-803a-30000c4f9a02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:43:03 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Converting VIF {"id": "83a46e94-e5e7-41bb-803a-30000c4f9a02", "address": "fa:16:3e:ab:ac:be", "network": {"id": "610f78de-5741-4743-815d-d12ba05f8000", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1518164868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1518164868-network", "vif_mac": "fa:16:3e:ab:ac:be"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b01853a82243369bd71dc0dbedb5d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83a46e94-e5", "ovs_interfaceid": "83a46e94-e5e7-41bb-803a-30000c4f9a02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:43:03 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ab:ac:be,bridge_name='br-int',has_traffic_filtering=True,id=83a46e94-e5e7-41bb-803a-30000c4f9a02,network=Network(610f78de-5741-4743-815d-d12ba05f8000),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83a46e94-e5') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:43:03 user nova-compute[73391]: DEBUG os_vif [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:ac:be,bridge_name='br-int',has_traffic_filtering=True,id=83a46e94-e5e7-41bb-803a-30000c4f9a02,network=Network(610f78de-5741-4743-815d-d12ba05f8000),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83a46e94-e5') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:43:03 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:03 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap83a46e94-e5, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:43:03 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:03 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:43:03 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:03 user nova-compute[73391]: INFO os_vif [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:ac:be,bridge_name='br-int',has_traffic_filtering=True,id=83a46e94-e5e7-41bb-803a-30000c4f9a02,network=Network(610f78de-5741-4743-815d-d12ba05f8000),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83a46e94-e5')
Aug 15 05:43:03 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 05:43:03 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tXCnbYNK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:43:03 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:43:03 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:43:03 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:43:03 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 05:43:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:03 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a7d0df-f5e5-49a7-a130-f2881fca3d48]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:43:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:03 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[941316da-2a9c-480b-b859-43f67196db09]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:43:03 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:43:03 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:43:03 user nova-compute[73391]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:43:03 user nova-compute[73391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)
Aug 15 05:43:03 user nova-compute[73391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a (non-flash)
Aug 15 05:43:03 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:43:03 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:43:03 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:43:03 user nova-compute[73391]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:43:03 user nova-compute[73391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)
Aug 15 05:43:03 user nova-compute[73391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a (non-flash)
Aug 15 05:43:03 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:43:03 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f772848d900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c'): ({'sdc'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 05:43:03 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Removing single pathed devices sdc {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 05:43:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:03 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1c0142-e8d8-4fc2-a872-6a8639ed69fb]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:43:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:04 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:04 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2108811-6804-411e-935d-45b095f86b69]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:43:04 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Flushing IO for device /dev/sdc {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 05:43:04 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:04 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:04 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6d5721-32c3-4004-8762-71a64fa8c931]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:43:04 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 05:43:04 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:04 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.038s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:04 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e01940-d3fb-4ca9-a4d3-acdbde3ffa34]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:43:04 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 05:43:04 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] SCSI volumes sdc have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 05:43:04 user nova-compute[73391]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO2157f67e-7ea106d8f762fc60', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_2157f67e', '/dev/disk/by-id/scsi-23765613130366438') {{(pid=84527) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 15 05:43:04 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4447e3-dfdb-49b7-9c7c-23b639849d96]: (4, None) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:43:04 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 05:43:04 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:04 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:04 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[943664a9-eed1-416e-9dac-de88a0ceeac6]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:43:04 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:43:04 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:04 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:04 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[63902c77-8ce3-4b1e-81a8-24890ba5fc4e]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:43:04 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c, portal: 172.16.0.220,3260]
Aug 15 05:43:04 user nova-compute[73391]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c, portal: 172.16.0.220,3260] successful.
Aug 15 05:43:04 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:43:04 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:04 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:04 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed31b3b0-1d18-4c0b-aad6-f96c87426bd4]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:43:04 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:43:04 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:43:04 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] <== disconnect_volume: return (310ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:43:04 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 05:43:04 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:43:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:05 user nova-compute[73391]: DEBUG nova.network.neutron [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Port 83a46e94-e5e7-41bb-803a-30000c4f9a02 binding to destination host user is already ACTIVE {{(pid=73391) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 15 05:43:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquiring lock "dc657d66-c3f8-44e5-b30e-3d79e586a8f3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:43:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "dc657d66-c3f8-44e5-b30e-3d79e586a8f3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:43:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "dc657d66-c3f8-44e5-b30e-3d79e586a8f3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:43:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquiring lock "refresh_cache-dc657d66-c3f8-44e5-b30e-3d79e586a8f3" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:43:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquired lock "refresh_cache-dc657d66-c3f8-44e5-b30e-3d79e586a8f3" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:43:05 user nova-compute[73391]: DEBUG nova.network.neutron [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:43:05 user nova-compute[73391]: DEBUG nova.compute.manager [req-0aa37aef-0775-4a3c-b478-3dcd90807abf req-875a65e0-bf36-433d-a599-99f2b774d061 service nova] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Received event network-vif-plugged-83a46e94-e5e7-41bb-803a-30000c4f9a02 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:43:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-0aa37aef-0775-4a3c-b478-3dcd90807abf req-875a65e0-bf36-433d-a599-99f2b774d061 service nova] Acquiring lock "dc657d66-c3f8-44e5-b30e-3d79e586a8f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:43:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-0aa37aef-0775-4a3c-b478-3dcd90807abf req-875a65e0-bf36-433d-a599-99f2b774d061 service nova] Lock "dc657d66-c3f8-44e5-b30e-3d79e586a8f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:43:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-0aa37aef-0775-4a3c-b478-3dcd90807abf req-875a65e0-bf36-433d-a599-99f2b774d061 service nova] Lock "dc657d66-c3f8-44e5-b30e-3d79e586a8f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:43:05 user nova-compute[73391]: DEBUG nova.compute.manager [req-0aa37aef-0775-4a3c-b478-3dcd90807abf req-875a65e0-bf36-433d-a599-99f2b774d061 service nova] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] No waiting events found dispatching network-vif-plugged-83a46e94-e5e7-41bb-803a-30000c4f9a02 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:43:05 user nova-compute[73391]: WARNING nova.compute.manager [req-0aa37aef-0775-4a3c-b478-3dcd90807abf req-875a65e0-bf36-433d-a599-99f2b774d061 service nova] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Received unexpected event network-vif-plugged-83a46e94-e5e7-41bb-803a-30000c4f9a02 for instance with vm_state active and task_state resize_migrated.
Aug 15 05:43:05 user nova-compute[73391]: DEBUG nova.network.neutron [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Updating instance_info_cache with network_info: [{"id": "83a46e94-e5e7-41bb-803a-30000c4f9a02", "address": "fa:16:3e:ab:ac:be", "network": {"id": "610f78de-5741-4743-815d-d12ba05f8000", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1518164868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b01853a82243369bd71dc0dbedb5d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83a46e94-e5", "ovs_interfaceid": "83a46e94-e5e7-41bb-803a-30000c4f9a02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:43:06 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Releasing lock "refresh_cache-dc657d66-c3f8-44e5-b30e-3d79e586a8f3" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:43:06 user nova-compute[73391]: DEBUG os_brick.utils [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:43:06 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:06 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:06 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f8ca5f-fab2-481f-9538-7edcd9011b1c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:43:06 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:06 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:06 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1358f07e-eff5-4121-bc46-12ee1260ea96]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:43:06 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:06 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:06 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8279d6cb-6337-4489-a993-0336c1a4f05f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:43:06 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[608af205-399c-400d-9c23-a21180c437ec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:43:06 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:06 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:43:06 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 05:43:06 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:06 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:43:06 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 05:43:06 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c173a029-30a4-4798-8b69-f27429b3f47b]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:43:06 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 05:43:06 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 05:43:06 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 05:43:06 user nova-compute[73391]: DEBUG os_brick.utils [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:43:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:12 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:13 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:15 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Starting finish_migration {{(pid=73391) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Instance directory exists: not creating {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 05:43:17 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Creating image(s)
Aug 15 05:43:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Did not create local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Ensure instance console log exists: /opt/stack/data/nova/instances/dc657d66-c3f8-44e5-b30e-3d79e586a8f3/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Start _get_guest_xml network_info=[{"id": "83a46e94-e5e7-41bb-803a-30000c4f9a02", "address": "fa:16:3e:ab:ac:be", "network": {"id": "610f78de-5741-4743-815d-d12ba05f8000", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1518164868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1518164868-network", "vif_mac": "fa:16:3e:ab:ac:be"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b01853a82243369bd71dc0dbedb5d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83a46e94-e5", "ovs_interfaceid": "83a46e94-e5e7-41bb-803a-30000c4f9a02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tXCnbYNK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'dc657d66-c3f8-44e5-b30e-3d79e586a8f3', 'attached_at': '2023-08-15T05:43:17.000000', 'detached_at': '', 'volume_id': '40b1b33d-a14c-44fe-b274-6004c350d53c', 'serial': '40b1b33d-a14c-44fe-b274-6004c350d53c'}, 'attachment_id': '9efa60d0-5735-464a-a3b5-ac2167264e73', 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'volume_type': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:43:17 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:43:17 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:43:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:25Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG nova.objects.instance [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lazy-loading 'vcpu_model' on Instance uuid dc657d66-c3f8-44e5-b30e-3d79e586a8f3 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tXCnbYNK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:43:17 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:43:17 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:43:17 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:43:17 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:43:17 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 05:43:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93ab10a-b66d-4426-873d-20277a73e873]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 05:43:17 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb3326d0-00cf-4385-b40e-b45f03baafad]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c] added
Aug 15 05:43:17 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[20aad8a9-2244-4cf7-aacf-5e7485dc921f]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[61aa41db-6780-4a97-bae5-3b848a0ce750]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tXCnbYNK {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tXCnbYNK" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[adde50df-1ad1-4671-a7f9-222c8b87332a]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tXCnbYNK'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cabc0ab-d75a-4131-a6bd-4817931faf7e]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[701d13a3-0ae8-47db-b146-7591ea5617ce]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:43:17 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:43:17 user nova-compute[73391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)
Aug 15 05:43:17 user nova-compute[73391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a (non-flash)
Aug 15 05:43:17 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:43:17 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:43:17 user nova-compute[73391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)
Aug 15 05:43:17 user nova-compute[73391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a (non-flash)
Aug 15 05:43:17 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f049165f-12cc-44a2-919c-39fa539736ad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c, portal: 172.16.0.220,3260]
Aug 15 05:43:17 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c, portal: 172.16.0.220,3260] successful.
Aug 15 05:43:17 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcaca2a4-f1aa-417f-8117-f4185e990c21]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7238546-62e6-4793-9f2d-15915e04e44d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:43:17 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:43:17 user nova-compute[73391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)
Aug 15 05:43:17 user nova-compute[73391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a (non-flash)
Aug 15 05:43:17 user nova-compute[73391]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:43:17 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:43:17 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:43:17 user nova-compute[73391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)
Aug 15 05:43:17 user nova-compute[73391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a (non-flash)
Aug 15 05:43:17 user nova-compute[73391]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:43:17 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] HCTL ('34', '-', '-', 0) found on session 40 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c638a89d-3f44-440b-b60b-fd85718b7273 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Acquiring lock "76fcbfca-deca-44f0-9182-1f9bbab134d2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c638a89d-3f44-440b-b60b-fd85718b7273 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "76fcbfca-deca-44f0-9182-1f9bbab134d2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:17 user nova-compute[73391]: INFO nova.compute.manager [None req-c638a89d-3f44-440b-b60b-fd85718b7273 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Detaching volume 47e51a85-6af8-42f7-91fa-052ed34a162a
Aug 15 05:43:17 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e37589c-b046-4e21-adcf-64f177766268]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Searching for a device in session 40 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tXCnbYNK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 05:43:17 user nova-compute[73391]: INFO nova.virt.block_device [None req-c638a89d-3f44-440b-b60b-fd85718b7273 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Attempting to driver detach volume 47e51a85-6af8-42f7-91fa-052ed34a162a from mountpoint /dev/vdb
Aug 15 05:43:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-c638a89d-3f44-440b-b60b-fd85718b7273 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Attempting to detach device vdb from instance 76fcbfca-deca-44f0-9182-1f9bbab134d2 from the persistent domain config. {{(pid=73391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-c638a89d-3f44-440b-b60b-fd85718b7273 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 05:43:17 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:43:17 user nova-compute[73391]:   <source dev="/dev/sdd"/>
Aug 15 05:43:17 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:43:17 user nova-compute[73391]:   <serial>47e51a85-6af8-42f7-91fa-052ed34a162a</serial>
Aug 15 05:43:17 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 05:43:17 user nova-compute[73391]: </disk>
Aug 15 05:43:17 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 05:43:17 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-c638a89d-3f44-440b-b60b-fd85718b7273 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Successfully detached device vdb from instance 76fcbfca-deca-44f0-9182-1f9bbab134d2 from the persistent domain config.
Aug 15 05:43:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-c638a89d-3f44-440b-b60b-fd85718b7273 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 76fcbfca-deca-44f0-9182-1f9bbab134d2 from the live domain config. {{(pid=73391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-c638a89d-3f44-440b-b60b-fd85718b7273 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 05:43:17 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:43:17 user nova-compute[73391]:   <source dev="/dev/sdd"/>
Aug 15 05:43:17 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:43:17 user nova-compute[73391]:   <serial>47e51a85-6af8-42f7-91fa-052ed34a162a</serial>
Aug 15 05:43:17 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 05:43:17 user nova-compute[73391]: </disk>
Aug 15 05:43:17 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-4a9a1bb0-54c5-4d3d-9fe7-a6f8459bc387 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Acquiring lock "76fcbfca-deca-44f0-9182-1f9bbab134d2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Received event <DeviceRemovedEvent: 1692078197.9831252, 76fcbfca-deca-44f0-9182-1f9bbab134d2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73391) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 05:43:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-c638a89d-3f44-440b-b60b-fd85718b7273 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 76fcbfca-deca-44f0-9182-1f9bbab134d2 {{(pid=73391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 05:43:17 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-c638a89d-3f44-440b-b60b-fd85718b7273 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Successfully detached device vdb from instance 76fcbfca-deca-44f0-9182-1f9bbab134d2 from the live domain config.
Aug 15 05:43:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c638a89d-3f44-440b-b60b-fd85718b7273 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c638a89d-3f44-440b-b60b-fd85718b7273 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sUIeMGbq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:43:18 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-c638a89d-3f44-440b-b60b-fd85718b7273 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:43:18 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-c638a89d-3f44-440b-b60b-fd85718b7273 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '23765613130366438', 'path': '/dev/sdc'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765613130366438', 'path': '/dev/sdc'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-c638a89d-3f44-440b-b60b-fd85718b7273 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.497s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c638a89d-3f44-440b-b60b-fd85718b7273 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1add81-5a29-47ce-8116-bedf29b700fb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:41:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-156136201',display_name='tempest-ServerActionsTestOtherA-server-156136201',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-156136201',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNF3pif1QWXVpHrEIxShzB1xE/c22B7LSOZtRDzcmt7Dk63BIrH6/RWzxjN8WpKbyeDl3Aa13tDu+mUrmV6NfezccRAEecdR4P4btA7xRgsBIkQydnisHIujmlpX6Glrow==',key_name='tempest-keypair-512432776',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:41:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='60b01853a82243369bd71dc0dbedb5d6',ramdisk_id='',reservation_id='r-lrepebad',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1927429987',owner_user_name='tempest-ServerActionsTestOtherA-1927429987-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:43:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='124dcfde552147e2978970386274c70a',uuid=dc657d66-c3f8-44e5-b30e-3d79e586a8f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "83a46e94-e5e7-41bb-803a-30000c4f9a02", "address": "fa:16:3e:ab:ac:be", "network": {"id": "610f78de-5741-4743-815d-d12ba05f8000", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1518164868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1518164868-network", "vif_mac": "fa:16:3e:ab:ac:be"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b01853a82243369bd71dc0dbedb5d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83a46e94-e5", "ovs_interfaceid": "83a46e94-e5e7-41bb-803a-30000c4f9a02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Converting VIF {"id": "83a46e94-e5e7-41bb-803a-30000c4f9a02", "address": "fa:16:3e:ab:ac:be", "network": {"id": "610f78de-5741-4743-815d-d12ba05f8000", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1518164868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1518164868-network", "vif_mac": "fa:16:3e:ab:ac:be"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b01853a82243369bd71dc0dbedb5d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83a46e94-e5", "ovs_interfaceid": "83a46e94-e5e7-41bb-803a-30000c4f9a02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:ac:be,bridge_name='br-int',has_traffic_filtering=True,id=83a46e94-e5e7-41bb-803a-30000c4f9a02,network=Network(610f78de-5741-4743-815d-d12ba05f8000),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83a46e94-e5') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:43:18 user nova-compute[73391]:   <uuid>dc657d66-c3f8-44e5-b30e-3d79e586a8f3</uuid>
Aug 15 05:43:18 user nova-compute[73391]:   <name>instance-0000001f</name>
Aug 15 05:43:18 user nova-compute[73391]:   <memory>2097152</memory>
Aug 15 05:43:18 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:43:18 user nova-compute[73391]:   <metadata>
Aug 15 05:43:18 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:43:18 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:43:18 user nova-compute[73391]:       <nova:name>tempest-ServerActionsTestOtherA-server-156136201</nova:name>
Aug 15 05:43:18 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:43:17</nova:creationTime>
Aug 15 05:43:18 user nova-compute[73391]:       <nova:flavor name="m1.small">
Aug 15 05:43:18 user nova-compute[73391]:         <nova:memory>2048</nova:memory>
Aug 15 05:43:18 user nova-compute[73391]:         <nova:disk>20</nova:disk>
Aug 15 05:43:18 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:43:18 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:43:18 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:43:18 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:43:18 user nova-compute[73391]:       <nova:owner>
Aug 15 05:43:18 user nova-compute[73391]:         <nova:user uuid="124dcfde552147e2978970386274c70a">tempest-ServerActionsTestOtherA-1927429987-project-member</nova:user>
Aug 15 05:43:18 user nova-compute[73391]:         <nova:project uuid="60b01853a82243369bd71dc0dbedb5d6">tempest-ServerActionsTestOtherA-1927429987</nova:project>
Aug 15 05:43:18 user nova-compute[73391]:       </nova:owner>
Aug 15 05:43:18 user nova-compute[73391]:       <nova:ports>
Aug 15 05:43:18 user nova-compute[73391]:         <nova:port uuid="83a46e94-e5e7-41bb-803a-30000c4f9a02">
Aug 15 05:43:18 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Aug 15 05:43:18 user nova-compute[73391]:         </nova:port>
Aug 15 05:43:18 user nova-compute[73391]:       </nova:ports>
Aug 15 05:43:18 user nova-compute[73391]:     </nova:instance>
Aug 15 05:43:18 user nova-compute[73391]:   </metadata>
Aug 15 05:43:18 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:43:18 user nova-compute[73391]:     <system>
Aug 15 05:43:18 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:43:18 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:43:18 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:43:18 user nova-compute[73391]:       <entry name="serial">dc657d66-c3f8-44e5-b30e-3d79e586a8f3</entry>
Aug 15 05:43:18 user nova-compute[73391]:       <entry name="uuid">dc657d66-c3f8-44e5-b30e-3d79e586a8f3</entry>
Aug 15 05:43:18 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:43:18 user nova-compute[73391]:     </system>
Aug 15 05:43:18 user nova-compute[73391]:   </sysinfo>
Aug 15 05:43:18 user nova-compute[73391]:   <os>
Aug 15 05:43:18 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:43:18 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:43:18 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:43:18 user nova-compute[73391]:   </os>
Aug 15 05:43:18 user nova-compute[73391]:   <features>
Aug 15 05:43:18 user nova-compute[73391]:     <acpi/>
Aug 15 05:43:18 user nova-compute[73391]:     <apic/>
Aug 15 05:43:18 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:43:18 user nova-compute[73391]:   </features>
Aug 15 05:43:18 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:43:18 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:43:18 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:43:18 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:43:18 user nova-compute[73391]:   </clock>
Aug 15 05:43:18 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:43:18 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:43:18 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:43:18 user nova-compute[73391]:   </cpu>
Aug 15 05:43:18 user nova-compute[73391]:   <devices>
Aug 15 05:43:18 user nova-compute[73391]:     <disk type="block" device="disk">
Aug 15 05:43:18 user nova-compute[73391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:43:18 user nova-compute[73391]:       <source dev="/dev/sdc"/>
Aug 15 05:43:18 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:43:18 user nova-compute[73391]:       <serial>40b1b33d-a14c-44fe-b274-6004c350d53c</serial>
Aug 15 05:43:18 user nova-compute[73391]:     </disk>
Aug 15 05:43:18 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:43:18 user nova-compute[73391]:       <mac address="fa:16:3e:ab:ac:be"/>
Aug 15 05:43:18 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:43:18 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:43:18 user nova-compute[73391]:       <target dev="tap83a46e94-e5"/>
Aug 15 05:43:18 user nova-compute[73391]:     </interface>
Aug 15 05:43:18 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:43:18 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/dc657d66-c3f8-44e5-b30e-3d79e586a8f3/console.log" append="off"/>
Aug 15 05:43:18 user nova-compute[73391]:     </serial>
Aug 15 05:43:18 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:43:18 user nova-compute[73391]:     <video>
Aug 15 05:43:18 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:43:18 user nova-compute[73391]:     </video>
Aug 15 05:43:18 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:43:18 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:43:18 user nova-compute[73391]:     </rng>
Aug 15 05:43:18 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:43:18 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:43:18 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:43:18 user nova-compute[73391]:     </memballoon>
Aug 15 05:43:18 user nova-compute[73391]:   </devices>
Aug 15 05:43:18 user nova-compute[73391]: </domain>
Aug 15 05:43:18 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:41:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-156136201',display_name='tempest-ServerActionsTestOtherA-server-156136201',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-156136201',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNF3pif1QWXVpHrEIxShzB1xE/c22B7LSOZtRDzcmt7Dk63BIrH6/RWzxjN8WpKbyeDl3Aa13tDu+mUrmV6NfezccRAEecdR4P4btA7xRgsBIkQydnisHIujmlpX6Glrow==',key_name='tempest-keypair-512432776',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:41:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='60b01853a82243369bd71dc0dbedb5d6',ramdisk_id='',reservation_id='r-lrepebad',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1927429987',owner_user_name='tempest-ServerActionsTestOtherA-1927429987-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:43:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='124dcfde552147e2978970386274c70a',uuid=dc657d66-c3f8-44e5-b30e-3d79e586a8f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "83a46e94-e5e7-41bb-803a-30000c4f9a02", "address": "fa:16:3e:ab:ac:be", "network": {"id": "610f78de-5741-4743-815d-d12ba05f8000", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1518164868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1518164868-network", "vif_mac": "fa:16:3e:ab:ac:be"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b01853a82243369bd71dc0dbedb5d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83a46e94-e5", "ovs_interfaceid": "83a46e94-e5e7-41bb-803a-30000c4f9a02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Converting VIF {"id": "83a46e94-e5e7-41bb-803a-30000c4f9a02", "address": "fa:16:3e:ab:ac:be", "network": {"id": "610f78de-5741-4743-815d-d12ba05f8000", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1518164868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1518164868-network", "vif_mac": "fa:16:3e:ab:ac:be"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b01853a82243369bd71dc0dbedb5d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83a46e94-e5", "ovs_interfaceid": "83a46e94-e5e7-41bb-803a-30000c4f9a02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:ac:be,bridge_name='br-int',has_traffic_filtering=True,id=83a46e94-e5e7-41bb-803a-30000c4f9a02,network=Network(610f78de-5741-4743-815d-d12ba05f8000),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83a46e94-e5') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG os_vif [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:ac:be,bridge_name='br-int',has_traffic_filtering=True,id=83a46e94-e5e7-41bb-803a-30000c4f9a02,network=Network(610f78de-5741-4743-815d-d12ba05f8000),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83a46e94-e5') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap83a46e94-e5, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap83a46e94-e5, col_values=(('external_ids', {'iface-id': '83a46e94-e5e7-41bb-803a-30000c4f9a02', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:ac:be', 'vm-uuid': 'dc657d66-c3f8-44e5-b30e-3d79e586a8f3'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d82b11a9-a137-4e8f-9738-56f794e217d7]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c638a89d-3f44-440b-b60b-fd85718b7273 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:43:18 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:43:18 user nova-compute[73391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)
Aug 15 05:43:18 user nova-compute[73391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a (non-flash)
Aug 15 05:43:18 user nova-compute[73391]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:43:18 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c638a89d-3f44-440b-b60b-fd85718b7273 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:43:18 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:43:18 user nova-compute[73391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)
Aug 15 05:43:18 user nova-compute[73391]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a (non-flash)
Aug 15 05:43:18 user nova-compute[73391]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:43:18 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c638a89d-3f44-440b-b60b-fd85718b7273 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77284b4550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a'): ({'sdd'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-c638a89d-3f44-440b-b60b-fd85718b7273 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Removing single pathed devices sdd {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:18 user nova-compute[73391]: INFO os_vif [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:ac:be,bridge_name='br-int',has_traffic_filtering=True,id=83a46e94-e5e7-41bb-803a-30000c4f9a02,network=Network(610f78de-5741-4743-815d-d12ba05f8000),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83a46e94-e5')
Aug 15 05:43:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef69734c-8384-49e5-8867-da29974dcecc]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d609cdd8-0568-4ecb-bb09-4c222e2dedec]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-c638a89d-3f44-440b-b60b-fd85718b7273 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Flushing IO for device /dev/sdd {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a9cd19-354b-49ab-be82-6c7a39029600]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-c638a89d-3f44-440b-b60b-fd85718b7273 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] No VIF found with MAC fa:16:3e:ab:ac:be, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1652588e-4007-403d-b736-a58aaa9607a9]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-c638a89d-3f44-440b-b60b-fd85718b7273 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-c638a89d-3f44-440b-b60b-fd85718b7273 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] SCSI volumes sdd have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c638a89d-3f44-440b-b60b-fd85718b7273 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef93655-a873-412c-87c8-3e1426c2a07a]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c638a89d-3f44-440b-b60b-fd85718b7273 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a9a1b7-d512-44ee-9372-a0777b0435dd]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c638a89d-3f44-440b-b60b-fd85718b7273 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a, portal: 172.16.0.220,3260]
Aug 15 05:43:18 user nova-compute[73391]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a, portal: 172.16.0.220,3260] successful.
Aug 15 05:43:18 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1d346d-6da2-4863-bd83-278504398650]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c638a89d-3f44-440b-b60b-fd85718b7273 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-c638a89d-3f44-440b-b60b-fd85718b7273 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c638a89d-3f44-440b-b60b-fd85718b7273 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] <== disconnect_volume: return (807ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c638a89d-3f44-440b-b60b-fd85718b7273 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692078183.8354084, dc657d66-c3f8-44e5-b30e-3d79e586a8f3 => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:43:18 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] VM Stopped (Lifecycle Event)
Aug 15 05:43:18 user nova-compute[73391]: DEBUG nova.compute.manager [None req-ba299388-2646-4495-b68a-5f53242b5899 None None] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG nova.objects.instance [None req-7863e968-f12e-4c83-9577-c73e9adcc6ec tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lazy-loading 'flavor' on Instance uuid fee43642-30e8-451b-919c-aca4cd4c3f81 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7863e968-f12e-4c83-9577-c73e9adcc6ec tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Acquiring lock "refresh_cache-fee43642-30e8-451b-919c-aca4cd4c3f81" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7863e968-f12e-4c83-9577-c73e9adcc6ec tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Acquired lock "refresh_cache-fee43642-30e8-451b-919c-aca4cd4c3f81" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG nova.network.neutron [None req-7863e968-f12e-4c83-9577-c73e9adcc6ec tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:43:18 user nova-compute[73391]: DEBUG nova.objects.instance [None req-7863e968-f12e-4c83-9577-c73e9adcc6ec tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lazy-loading 'info_cache' on Instance uuid fee43642-30e8-451b-919c-aca4cd4c3f81 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:43:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:19 user nova-compute[73391]: DEBUG nova.objects.instance [None req-c638a89d-3f44-440b-b60b-fd85718b7273 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lazy-loading 'flavor' on Instance uuid 76fcbfca-deca-44f0-9182-1f9bbab134d2 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:43:19 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:43:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:43:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:43:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:43:19 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Auditing locally available compute resources for user (node: user) {{(pid=73391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 05:43:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c638a89d-3f44-440b-b60b-fd85718b7273 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "76fcbfca-deca-44f0-9182-1f9bbab134d2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.262s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:43:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-4a9a1bb0-54c5-4d3d-9fe7-a6f8459bc387 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "76fcbfca-deca-44f0-9182-1f9bbab134d2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 2.143s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:43:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-4a9a1bb0-54c5-4d3d-9fe7-a6f8459bc387 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Acquiring lock "76fcbfca-deca-44f0-9182-1f9bbab134d2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:43:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-4a9a1bb0-54c5-4d3d-9fe7-a6f8459bc387 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "76fcbfca-deca-44f0-9182-1f9bbab134d2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:43:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-4a9a1bb0-54c5-4d3d-9fe7-a6f8459bc387 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "76fcbfca-deca-44f0-9182-1f9bbab134d2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:43:19 user nova-compute[73391]: INFO nova.compute.manager [None req-4a9a1bb0-54c5-4d3d-9fe7-a6f8459bc387 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Terminating instance
Aug 15 05:43:19 user nova-compute[73391]: DEBUG nova.compute.manager [None req-4a9a1bb0-54c5-4d3d-9fe7-a6f8459bc387 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Start destroying the instance on the hypervisor. {{(pid=73391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 05:43:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG nova.network.neutron [None req-7863e968-f12e-4c83-9577-c73e9adcc6ec tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Updating instance_info_cache with network_info: [{"id": "fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b", "address": "fa:16:3e:57:a8:64", "network": {"id": "c94dfbf4-6803-458e-b2c6-231298da7bc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090354282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f88922b3c294aea9efa3d80909a171a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdb4ce86-9a", "ovs_interfaceid": "fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7863e968-f12e-4c83-9577-c73e9adcc6ec tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Releasing lock "refresh_cache-fee43642-30e8-451b-919c-aca4cd4c3f81" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG nova.compute.manager [req-bd7a6148-ca1a-4269-9344-b82b30758dec req-aa1149a1-66d0-4805-aac5-9ef7891d2a1d service nova] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Received event network-vif-unplugged-ec5342ba-8cca-4111-9c53-245d0d8f6bb7 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-bd7a6148-ca1a-4269-9344-b82b30758dec req-aa1149a1-66d0-4805-aac5-9ef7891d2a1d service nova] Acquiring lock "76fcbfca-deca-44f0-9182-1f9bbab134d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-bd7a6148-ca1a-4269-9344-b82b30758dec req-aa1149a1-66d0-4805-aac5-9ef7891d2a1d service nova] Lock "76fcbfca-deca-44f0-9182-1f9bbab134d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-bd7a6148-ca1a-4269-9344-b82b30758dec req-aa1149a1-66d0-4805-aac5-9ef7891d2a1d service nova] Lock "76fcbfca-deca-44f0-9182-1f9bbab134d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG nova.compute.manager [req-bd7a6148-ca1a-4269-9344-b82b30758dec req-aa1149a1-66d0-4805-aac5-9ef7891d2a1d service nova] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] No waiting events found dispatching network-vif-unplugged-ec5342ba-8cca-4111-9c53-245d0d8f6bb7 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG nova.compute.manager [req-bd7a6148-ca1a-4269-9344-b82b30758dec req-aa1149a1-66d0-4805-aac5-9ef7891d2a1d service nova] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Received event network-vif-unplugged-ec5342ba-8cca-4111-9c53-245d0d8f6bb7 for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:20 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Instance destroyed successfully.
Aug 15 05:43:20 user nova-compute[73391]: DEBUG nova.objects.instance [None req-7863e968-f12e-4c83-9577-c73e9adcc6ec tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lazy-loading 'resources' on Instance uuid fee43642-30e8-451b-919c-aca4cd4c3f81 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-7863e968-f12e-4c83-9577-c73e9adcc6ec tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:35:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1959427232',display_name='tempest-AttachVolumeTestJSON-server-1959427232',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1959427232',id=20,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8c2c+HY2uFg0muioXJ/Qd76WkrwYok3JhcRUo8JvSmW81H3Mw3KqkIDK8NtlIVnkKC4J9LmhNxEjXRZXc6sdj/CKTHFaHD2NbzzeyvSOZNMRKn7xfyQEj9gzmcW7J5qQ==',key_name='tempest-keypair-769603990',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:35:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='9f88922b3c294aea9efa3d80909a171a',ramdisk_id='',reservation_id='r-9kpn3uxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-629721707',owner_user_name='tempest-AttachVolumeTestJSON-629721707-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:41:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='02352e5b84f04d0e9975b8b8e5594b92',uuid=fee43642-30e8-451b-919c-aca4cd4c3f81,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b", "address": "fa:16:3e:57:a8:64", "network": {"id": "c94dfbf4-6803-458e-b2c6-231298da7bc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090354282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f88922b3c294aea9efa3d80909a171a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdb4ce86-9a", "ovs_interfaceid": "fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-7863e968-f12e-4c83-9577-c73e9adcc6ec tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Converting VIF {"id": "fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b", "address": "fa:16:3e:57:a8:64", "network": {"id": "c94dfbf4-6803-458e-b2c6-231298da7bc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090354282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f88922b3c294aea9efa3d80909a171a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdb4ce86-9a", "ovs_interfaceid": "fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-7863e968-f12e-4c83-9577-c73e9adcc6ec tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:a8:64,bridge_name='br-int',has_traffic_filtering=True,id=fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b,network=Network(c94dfbf4-6803-458e-b2c6-231298da7bc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdb4ce86-9a') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG os_vif [None req-7863e968-f12e-4c83-9577-c73e9adcc6ec tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:a8:64,bridge_name='br-int',has_traffic_filtering=True,id=fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b,network=Network(c94dfbf4-6803-458e-b2c6-231298da7bc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdb4ce86-9a') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfdb4ce86-9a, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:20 user nova-compute[73391]: INFO os_vif [None req-7863e968-f12e-4c83-9577-c73e9adcc6ec tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:a8:64,bridge_name='br-int',has_traffic_filtering=True,id=fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b,network=Network(c94dfbf4-6803-458e-b2c6-231298da7bc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdb4ce86-9a')
Aug 15 05:43:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:20 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Instance destroyed successfully.
Aug 15 05:43:20 user nova-compute[73391]: DEBUG nova.objects.instance [None req-4a9a1bb0-54c5-4d3d-9fe7-a6f8459bc387 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lazy-loading 'resources' on Instance uuid 76fcbfca-deca-44f0-9182-1f9bbab134d2 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-7863e968-f12e-4c83-9577-c73e9adcc6ec tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Start _get_guest_xml network_info=[{"id": "fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b", "address": "fa:16:3e:57:a8:64", "network": {"id": "c94dfbf4-6803-458e-b2c6-231298da7bc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090354282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f88922b3c294aea9efa3d80909a171a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdb4ce86-9a", "ovs_interfaceid": "fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '191b1dad-305e-4d1c-9b15-515ec59a3278'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG nova.objects.instance [None req-7863e968-f12e-4c83-9577-c73e9adcc6ec tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lazy-loading 'numa_topology' on Instance uuid fee43642-30e8-451b-919c-aca4cd4c3f81 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-4a9a1bb0-54c5-4d3d-9fe7-a6f8459bc387 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:40:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-371412398',display_name='tempest-VolumesSnapshotTestJSON-instance-371412398',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-371412398',id=28,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBTIiNQVesWc5O+2cuHCIxUgiXxVWVO23/YuEGOmcgd2DcoTlKAIc87oZUBgw25fJ2xUKTJSAP9+7KW+ASINvzHz8Bzx9Jf2isXzRr2WLW3hkuTLCNLly0bUkh0fe0gtSA==',key_name='tempest-keypair-1699816707',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:40:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae6fe94b9014479fbaff5131aefc8834',ramdisk_id='',reservation_id='r-9a5xhfje',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1902565719',owner_user_name='tempest-VolumesSnapshotTestJSON-1902565719-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:40:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9779dfb796934195b206b8e0adc81ed3',uuid=76fcbfca-deca-44f0-9182-1f9bbab134d2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec5342ba-8cca-4111-9c53-245d0d8f6bb7", "address": "fa:16:3e:31:53:1e", "network": {"id": "6757637c-358e-4fa8-b3c1-376d7892c884", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-577771159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae6fe94b9014479fbaff5131aefc8834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec5342ba-8c", "ovs_interfaceid": "ec5342ba-8cca-4111-9c53-245d0d8f6bb7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-4a9a1bb0-54c5-4d3d-9fe7-a6f8459bc387 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Converting VIF {"id": "ec5342ba-8cca-4111-9c53-245d0d8f6bb7", "address": "fa:16:3e:31:53:1e", "network": {"id": "6757637c-358e-4fa8-b3c1-376d7892c884", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-577771159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae6fe94b9014479fbaff5131aefc8834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec5342ba-8c", "ovs_interfaceid": "ec5342ba-8cca-4111-9c53-245d0d8f6bb7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-4a9a1bb0-54c5-4d3d-9fe7-a6f8459bc387 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:31:53:1e,bridge_name='br-int',has_traffic_filtering=True,id=ec5342ba-8cca-4111-9c53-245d0d8f6bb7,network=Network(6757637c-358e-4fa8-b3c1-376d7892c884),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec5342ba-8c') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG os_vif [None req-4a9a1bb0-54c5-4d3d-9fe7-a6f8459bc387 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:53:1e,bridge_name='br-int',has_traffic_filtering=True,id=ec5342ba-8cca-4111-9c53-245d0d8f6bb7,network=Network(6757637c-358e-4fa8-b3c1-376d7892c884),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec5342ba-8c') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec5342ba-8c, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:20 user nova-compute[73391]: INFO os_vif [None req-4a9a1bb0-54c5-4d3d-9fe7-a6f8459bc387 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:31:53:1e,bridge_name='br-int',has_traffic_filtering=True,id=ec5342ba-8cca-4111-9c53-245d0d8f6bb7,network=Network(6757637c-358e-4fa8-b3c1-376d7892c884),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec5342ba-8c')
Aug 15 05:43:20 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a9a1bb0-54c5-4d3d-9fe7-a6f8459bc387 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9a1bb0-54c5-4d3d-9fe7-a6f8459bc387 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sUIeMGbq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:43:20 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-4a9a1bb0-54c5-4d3d-9fe7-a6f8459bc387 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:43:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-4a9a1bb0-54c5-4d3d-9fe7-a6f8459bc387 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-4a9a1bb0-54c5-4d3d-9fe7-a6f8459bc387 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9a1bb0-54c5-4d3d-9fe7-a6f8459bc387 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47e51a85-6af8-42f7-91fa-052ed34a162a', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:20 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-7863e968-f12e-4c83-9577-c73e9adcc6ec tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:43:20 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-7863e968-f12e-4c83-9577-c73e9adcc6ec tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:43:20 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-7863e968-f12e-4c83-9577-c73e9adcc6ec tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-7863e968-f12e-4c83-9577-c73e9adcc6ec tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-7863e968-f12e-4c83-9577-c73e9adcc6ec tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-7863e968-f12e-4c83-9577-c73e9adcc6ec tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-7863e968-f12e-4c83-9577-c73e9adcc6ec tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-7863e968-f12e-4c83-9577-c73e9adcc6ec tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-7863e968-f12e-4c83-9577-c73e9adcc6ec tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-7863e968-f12e-4c83-9577-c73e9adcc6ec tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-7863e968-f12e-4c83-9577-c73e9adcc6ec tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-7863e968-f12e-4c83-9577-c73e9adcc6ec tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-7863e968-f12e-4c83-9577-c73e9adcc6ec tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-7863e968-f12e-4c83-9577-c73e9adcc6ec tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-7863e968-f12e-4c83-9577-c73e9adcc6ec tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-7863e968-f12e-4c83-9577-c73e9adcc6ec tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-7863e968-f12e-4c83-9577-c73e9adcc6ec tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-7863e968-f12e-4c83-9577-c73e9adcc6ec tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG nova.objects.instance [None req-7863e968-f12e-4c83-9577-c73e9adcc6ec tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lazy-loading 'vcpu_model' on Instance uuid fee43642-30e8-451b-919c-aca4cd4c3f81 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8286cfc2-2a38-401b-920c-32e68d4c4587]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-7863e968-f12e-4c83-9577-c73e9adcc6ec tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:35:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1959427232',display_name='tempest-AttachVolumeTestJSON-server-1959427232',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1959427232',id=20,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8c2c+HY2uFg0muioXJ/Qd76WkrwYok3JhcRUo8JvSmW81H3Mw3KqkIDK8NtlIVnkKC4J9LmhNxEjXRZXc6sdj/CKTHFaHD2NbzzeyvSOZNMRKn7xfyQEj9gzmcW7J5qQ==',key_name='tempest-keypair-769603990',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:35:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='9f88922b3c294aea9efa3d80909a171a',ramdisk_id='',reservation_id='r-9kpn3uxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-629721707',owner_user_name='tempest-AttachVolumeTestJSON-629721707-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:41:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='02352e5b84f04d0e9975b8b8e5594b92',uuid=fee43642-30e8-451b-919c-aca4cd4c3f81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b", "address": "fa:16:3e:57:a8:64", "network": {"id": "c94dfbf4-6803-458e-b2c6-231298da7bc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090354282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f88922b3c294aea9efa3d80909a171a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdb4ce86-9a", "ovs_interfaceid": "fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-7863e968-f12e-4c83-9577-c73e9adcc6ec tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Converting VIF {"id": "fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b", "address": "fa:16:3e:57:a8:64", "network": {"id": "c94dfbf4-6803-458e-b2c6-231298da7bc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090354282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f88922b3c294aea9efa3d80909a171a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdb4ce86-9a", "ovs_interfaceid": "fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-7863e968-f12e-4c83-9577-c73e9adcc6ec tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:a8:64,bridge_name='br-int',has_traffic_filtering=True,id=fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b,network=Network(c94dfbf4-6803-458e-b2c6-231298da7bc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdb4ce86-9a') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG nova.objects.instance [None req-7863e968-f12e-4c83-9577-c73e9adcc6ec tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lazy-loading 'pci_devices' on Instance uuid fee43642-30e8-451b-919c-aca4cd4c3f81 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf827827-05ae-4e95-a0de-c3fbad7d29a4]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9a1bb0-54c5-4d3d-9fe7-a6f8459bc387 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:43:20 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:43:20 user nova-compute[73391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)
Aug 15 05:43:20 user nova-compute[73391]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:43:20 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9a1bb0-54c5-4d3d-9fe7-a6f8459bc387 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:43:20 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:43:20 user nova-compute[73391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)
Aug 15 05:43:20 user nova-compute[73391]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:43:20 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9a1bb0-54c5-4d3d-9fe7-a6f8459bc387 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f772848eb90>, {}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9a1bb0-54c5-4d3d-9fe7-a6f8459bc387 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Disconnecting from: [] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-4a9a1bb0-54c5-4d3d-9fe7-a6f8459bc387 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.073s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4a9a1bb0-54c5-4d3d-9fe7-a6f8459bc387 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] <== disconnect_volume: return (75ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4a9a1bb0-54c5-4d3d-9fe7-a6f8459bc387 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 05:43:20 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-4a9a1bb0-54c5-4d3d-9fe7-a6f8459bc387 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Deleting instance files /opt/stack/data/nova/instances/76fcbfca-deca-44f0-9182-1f9bbab134d2_del
Aug 15 05:43:20 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-4a9a1bb0-54c5-4d3d-9fe7-a6f8459bc387 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Deletion of /opt/stack/data/nova/instances/76fcbfca-deca-44f0-9182-1f9bbab134d2_del complete
Aug 15 05:43:20 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-7863e968-f12e-4c83-9577-c73e9adcc6ec tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:43:20 user nova-compute[73391]:   <uuid>fee43642-30e8-451b-919c-aca4cd4c3f81</uuid>
Aug 15 05:43:20 user nova-compute[73391]:   <name>instance-00000014</name>
Aug 15 05:43:20 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:43:20 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:43:20 user nova-compute[73391]:   <metadata>
Aug 15 05:43:20 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:43:20 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:43:20 user nova-compute[73391]:       <nova:name>tempest-AttachVolumeTestJSON-server-1959427232</nova:name>
Aug 15 05:43:20 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:43:20</nova:creationTime>
Aug 15 05:43:20 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:43:20 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:43:20 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:43:20 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:43:20 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:43:20 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:43:20 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:43:20 user nova-compute[73391]:       <nova:owner>
Aug 15 05:43:20 user nova-compute[73391]:         <nova:user uuid="02352e5b84f04d0e9975b8b8e5594b92">tempest-AttachVolumeTestJSON-629721707-project-member</nova:user>
Aug 15 05:43:20 user nova-compute[73391]:         <nova:project uuid="9f88922b3c294aea9efa3d80909a171a">tempest-AttachVolumeTestJSON-629721707</nova:project>
Aug 15 05:43:20 user nova-compute[73391]:       </nova:owner>
Aug 15 05:43:20 user nova-compute[73391]:       <nova:root type="image" uuid="191b1dad-305e-4d1c-9b15-515ec59a3278"/>
Aug 15 05:43:20 user nova-compute[73391]:       <nova:ports>
Aug 15 05:43:20 user nova-compute[73391]:         <nova:port uuid="fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b">
Aug 15 05:43:20 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 05:43:20 user nova-compute[73391]:         </nova:port>
Aug 15 05:43:20 user nova-compute[73391]:       </nova:ports>
Aug 15 05:43:20 user nova-compute[73391]:     </nova:instance>
Aug 15 05:43:20 user nova-compute[73391]:   </metadata>
Aug 15 05:43:20 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:43:20 user nova-compute[73391]:     <system>
Aug 15 05:43:20 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:43:20 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:43:20 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:43:20 user nova-compute[73391]:       <entry name="serial">fee43642-30e8-451b-919c-aca4cd4c3f81</entry>
Aug 15 05:43:20 user nova-compute[73391]:       <entry name="uuid">fee43642-30e8-451b-919c-aca4cd4c3f81</entry>
Aug 15 05:43:20 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:43:20 user nova-compute[73391]:     </system>
Aug 15 05:43:20 user nova-compute[73391]:   </sysinfo>
Aug 15 05:43:20 user nova-compute[73391]:   <os>
Aug 15 05:43:20 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:43:20 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:43:20 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:43:20 user nova-compute[73391]:   </os>
Aug 15 05:43:20 user nova-compute[73391]:   <features>
Aug 15 05:43:20 user nova-compute[73391]:     <acpi/>
Aug 15 05:43:20 user nova-compute[73391]:     <apic/>
Aug 15 05:43:20 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:43:20 user nova-compute[73391]:   </features>
Aug 15 05:43:20 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:43:20 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:43:20 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:43:20 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:43:20 user nova-compute[73391]:   </clock>
Aug 15 05:43:20 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:43:20 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:43:20 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:43:20 user nova-compute[73391]:   </cpu>
Aug 15 05:43:20 user nova-compute[73391]:   <devices>
Aug 15 05:43:20 user nova-compute[73391]:     <disk type="file" device="disk">
Aug 15 05:43:20 user nova-compute[73391]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 05:43:20 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk"/>
Aug 15 05:43:20 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:43:20 user nova-compute[73391]:     </disk>
Aug 15 05:43:20 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:43:20 user nova-compute[73391]:       <mac address="fa:16:3e:57:a8:64"/>
Aug 15 05:43:20 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:43:20 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:43:20 user nova-compute[73391]:       <target dev="tapfdb4ce86-9a"/>
Aug 15 05:43:20 user nova-compute[73391]:     </interface>
Aug 15 05:43:20 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:43:20 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/console.log" append="off"/>
Aug 15 05:43:20 user nova-compute[73391]:     </serial>
Aug 15 05:43:20 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:43:20 user nova-compute[73391]:     <video>
Aug 15 05:43:20 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:43:20 user nova-compute[73391]:     </video>
Aug 15 05:43:20 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:43:20 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:43:20 user nova-compute[73391]:     </rng>
Aug 15 05:43:20 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:43:20 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:43:20 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:43:20 user nova-compute[73391]:     </memballoon>
Aug 15 05:43:20 user nova-compute[73391]:   </devices>
Aug 15 05:43:20 user nova-compute[73391]: </domain>
Aug 15 05:43:20 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-7863e968-f12e-4c83-9577-c73e9adcc6ec tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:20 user nova-compute[73391]: INFO nova.compute.manager [None req-4a9a1bb0-54c5-4d3d-9fe7-a6f8459bc387 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Took 1.20 seconds to destroy the instance on the hypervisor.
Aug 15 05:43:20 user nova-compute[73391]: DEBUG oslo.service.loopingcall [None req-4a9a1bb0-54c5-4d3d-9fe7-a6f8459bc387 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG nova.compute.manager [-] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Deallocating network for instance {{(pid=73391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 05:43:20 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] deallocate_for_instance() {{(pid=73391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 05:43:21 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:43:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-7863e968-f12e-4c83-9577-c73e9adcc6ec tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-7863e968-f12e-4c83-9577-c73e9adcc6ec tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:21 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:43:21 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:43:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d60616bb-605e-4604-b637-56670f53159e/disk.rescue --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-7863e968-f12e-4c83-9577-c73e9adcc6ec tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:21 user nova-compute[73391]: DEBUG nova.objects.instance [None req-7863e968-f12e-4c83-9577-c73e9adcc6ec tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lazy-loading 'trusted_certs' on Instance uuid fee43642-30e8-451b-919c-aca4cd4c3f81 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:43:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-7863e968-f12e-4c83-9577-c73e9adcc6ec tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d60616bb-605e-4604-b637-56670f53159e/disk.rescue --force-share --output=json" returned: 0 in 0.233s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d60616bb-605e-4604-b637-56670f53159e/disk.rescue --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-7863e968-f12e-4c83-9577-c73e9adcc6ec tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.178s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:21 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-7863e968-f12e-4c83-9577-c73e9adcc6ec tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk. size=1073741824 {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 05:43:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-7863e968-f12e-4c83-9577-c73e9adcc6ec tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d60616bb-605e-4604-b637-56670f53159e/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-7863e968-f12e-4c83-9577-c73e9adcc6ec tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk --force-share --output=json" returned: 0 in 0.322s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:21 user nova-compute[73391]: DEBUG nova.compute.manager [req-cb6de797-ab8b-47a3-80b2-1a2c7fe8f65b req-e3823d67-580e-442b-82a4-a36fa10466cc service nova] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Received event network-vif-deleted-ec5342ba-8cca-4111-9c53-245d0d8f6bb7 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:43:21 user nova-compute[73391]: INFO nova.compute.manager [req-cb6de797-ab8b-47a3-80b2-1a2c7fe8f65b req-e3823d67-580e-442b-82a4-a36fa10466cc service nova] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Neutron deleted interface ec5342ba-8cca-4111-9c53-245d0d8f6bb7; detaching it from the instance and deleting it from the info cache
Aug 15 05:43:21 user nova-compute[73391]: DEBUG nova.network.neutron [req-cb6de797-ab8b-47a3-80b2-1a2c7fe8f65b req-e3823d67-580e-442b-82a4-a36fa10466cc service nova] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:43:21 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-7863e968-f12e-4c83-9577-c73e9adcc6ec tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Cannot resize image /opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk to a smaller size. {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 05:43:21 user nova-compute[73391]: DEBUG nova.objects.instance [None req-7863e968-f12e-4c83-9577-c73e9adcc6ec tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lazy-loading 'migration_context' on Instance uuid fee43642-30e8-451b-919c-aca4cd4c3f81 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:43:21 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:43:21 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-7863e968-f12e-4c83-9577-c73e9adcc6ec tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:35:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1959427232',display_name='tempest-AttachVolumeTestJSON-server-1959427232',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1959427232',id=20,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8c2c+HY2uFg0muioXJ/Qd76WkrwYok3JhcRUo8JvSmW81H3Mw3KqkIDK8NtlIVnkKC4J9LmhNxEjXRZXc6sdj/CKTHFaHD2NbzzeyvSOZNMRKn7xfyQEj9gzmcW7J5qQ==',key_name='tempest-keypair-769603990',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:35:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='9f88922b3c294aea9efa3d80909a171a',ramdisk_id='',reservation_id='r-9kpn3uxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-629721707',owner_user_name='tempest-AttachVolumeTestJSON-629721707-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:41:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='02352e5b84f04d0e9975b8b8e5594b92',uuid=fee43642-30e8-451b-919c-aca4cd4c3f81,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b", "address": "fa:16:3e:57:a8:64", "network": {"id": "c94dfbf4-6803-458e-b2c6-231298da7bc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090354282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f88922b3c294aea9efa3d80909a171a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdb4ce86-9a", "ovs_interfaceid": "fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:43:21 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-7863e968-f12e-4c83-9577-c73e9adcc6ec tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Converting VIF {"id": "fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b", "address": "fa:16:3e:57:a8:64", "network": {"id": "c94dfbf4-6803-458e-b2c6-231298da7bc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090354282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f88922b3c294aea9efa3d80909a171a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdb4ce86-9a", "ovs_interfaceid": "fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:43:21 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-7863e968-f12e-4c83-9577-c73e9adcc6ec tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:a8:64,bridge_name='br-int',has_traffic_filtering=True,id=fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b,network=Network(c94dfbf4-6803-458e-b2c6-231298da7bc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdb4ce86-9a') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:43:21 user nova-compute[73391]: DEBUG os_vif [None req-7863e968-f12e-4c83-9577-c73e9adcc6ec tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:a8:64,bridge_name='br-int',has_traffic_filtering=True,id=fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b,network=Network(c94dfbf4-6803-458e-b2c6-231298da7bc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdb4ce86-9a') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:43:21 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:21 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:43:21 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:43:21 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:21 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfdb4ce86-9a, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:43:21 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfdb4ce86-9a, col_values=(('external_ids', {'iface-id': 'fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:a8:64', 'vm-uuid': 'fee43642-30e8-451b-919c-aca4cd4c3f81'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:43:21 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:21 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:43:21 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Took 0.93 seconds to deallocate network for instance.
Aug 15 05:43:21 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:21 user nova-compute[73391]: INFO os_vif [None req-7863e968-f12e-4c83-9577-c73e9adcc6ec tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:a8:64,bridge_name='br-int',has_traffic_filtering=True,id=fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b,network=Network(c94dfbf4-6803-458e-b2c6-231298da7bc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdb4ce86-9a')
Aug 15 05:43:21 user nova-compute[73391]: DEBUG nova.compute.manager [req-cb6de797-ab8b-47a3-80b2-1a2c7fe8f65b req-e3823d67-580e-442b-82a4-a36fa10466cc service nova] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Detach interface failed, port_id=ec5342ba-8cca-4111-9c53-245d0d8f6bb7, reason: Instance 76fcbfca-deca-44f0-9182-1f9bbab134d2 could not be found. {{(pid=73391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 05:43:21 user nova-compute[73391]: WARNING nova.volume.cinder [None req-4a9a1bb0-54c5-4d3d-9fe7-a6f8459bc387 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Attachment 9fdd98ac-3651-450f-addf-51571b9606fc does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 9fdd98ac-3651-450f-addf-51571b9606fc. (HTTP 404) (Request-ID: req-51a2dec6-9fa2-49fe-920e-595cce99a0dd)
Aug 15 05:43:21 user nova-compute[73391]: INFO nova.compute.manager [None req-4a9a1bb0-54c5-4d3d-9fe7-a6f8459bc387 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Took 0.05 seconds to detach 1 volumes for instance.
Aug 15 05:43:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:21 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:43:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:22 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-4a9a1bb0-54c5-4d3d-9fe7-a6f8459bc387 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:43:22 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-4a9a1bb0-54c5-4d3d-9fe7-a6f8459bc387 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:43:22 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:22 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:22 user nova-compute[73391]: DEBUG nova.compute.manager [req-3a7e6eec-5d7f-4fc0-89e5-5d1d07b3e3ba req-328030ff-bdcd-4717-9b16-39a5bc8efd35 service nova] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Received event network-vif-plugged-ec5342ba-8cca-4111-9c53-245d0d8f6bb7 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:43:22 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-3a7e6eec-5d7f-4fc0-89e5-5d1d07b3e3ba req-328030ff-bdcd-4717-9b16-39a5bc8efd35 service nova] Acquiring lock "76fcbfca-deca-44f0-9182-1f9bbab134d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:43:22 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-3a7e6eec-5d7f-4fc0-89e5-5d1d07b3e3ba req-328030ff-bdcd-4717-9b16-39a5bc8efd35 service nova] Lock "76fcbfca-deca-44f0-9182-1f9bbab134d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:43:22 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-3a7e6eec-5d7f-4fc0-89e5-5d1d07b3e3ba req-328030ff-bdcd-4717-9b16-39a5bc8efd35 service nova] Lock "76fcbfca-deca-44f0-9182-1f9bbab134d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:43:22 user nova-compute[73391]: DEBUG nova.compute.manager [req-3a7e6eec-5d7f-4fc0-89e5-5d1d07b3e3ba req-328030ff-bdcd-4717-9b16-39a5bc8efd35 service nova] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] No waiting events found dispatching network-vif-plugged-ec5342ba-8cca-4111-9c53-245d0d8f6bb7 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:43:22 user nova-compute[73391]: WARNING nova.compute.manager [req-3a7e6eec-5d7f-4fc0-89e5-5d1d07b3e3ba req-328030ff-bdcd-4717-9b16-39a5bc8efd35 service nova] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Received unexpected event network-vif-plugged-ec5342ba-8cca-4111-9c53-245d0d8f6bb7 for instance with vm_state deleted and task_state None.
Aug 15 05:43:22 user nova-compute[73391]: DEBUG nova.compute.manager [req-3a7e6eec-5d7f-4fc0-89e5-5d1d07b3e3ba req-328030ff-bdcd-4717-9b16-39a5bc8efd35 service nova] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Received event network-vif-plugged-83a46e94-e5e7-41bb-803a-30000c4f9a02 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:43:22 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-3a7e6eec-5d7f-4fc0-89e5-5d1d07b3e3ba req-328030ff-bdcd-4717-9b16-39a5bc8efd35 service nova] Acquiring lock "dc657d66-c3f8-44e5-b30e-3d79e586a8f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:43:22 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-3a7e6eec-5d7f-4fc0-89e5-5d1d07b3e3ba req-328030ff-bdcd-4717-9b16-39a5bc8efd35 service nova] Lock "dc657d66-c3f8-44e5-b30e-3d79e586a8f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:43:22 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-3a7e6eec-5d7f-4fc0-89e5-5d1d07b3e3ba req-328030ff-bdcd-4717-9b16-39a5bc8efd35 service nova] Lock "dc657d66-c3f8-44e5-b30e-3d79e586a8f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:43:22 user nova-compute[73391]: DEBUG nova.compute.manager [req-3a7e6eec-5d7f-4fc0-89e5-5d1d07b3e3ba req-328030ff-bdcd-4717-9b16-39a5bc8efd35 service nova] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] No waiting events found dispatching network-vif-plugged-83a46e94-e5e7-41bb-803a-30000c4f9a02 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:43:22 user nova-compute[73391]: WARNING nova.compute.manager [req-3a7e6eec-5d7f-4fc0-89e5-5d1d07b3e3ba req-328030ff-bdcd-4717-9b16-39a5bc8efd35 service nova] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Received unexpected event network-vif-plugged-83a46e94-e5e7-41bb-803a-30000c4f9a02 for instance with vm_state active and task_state resize_finish.
Aug 15 05:43:22 user nova-compute[73391]: DEBUG nova.compute.manager [req-3a7e6eec-5d7f-4fc0-89e5-5d1d07b3e3ba req-328030ff-bdcd-4717-9b16-39a5bc8efd35 service nova] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Received event network-vif-plugged-83a46e94-e5e7-41bb-803a-30000c4f9a02 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:43:22 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-3a7e6eec-5d7f-4fc0-89e5-5d1d07b3e3ba req-328030ff-bdcd-4717-9b16-39a5bc8efd35 service nova] Acquiring lock "dc657d66-c3f8-44e5-b30e-3d79e586a8f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:43:22 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-3a7e6eec-5d7f-4fc0-89e5-5d1d07b3e3ba req-328030ff-bdcd-4717-9b16-39a5bc8efd35 service nova] Lock "dc657d66-c3f8-44e5-b30e-3d79e586a8f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:43:22 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-3a7e6eec-5d7f-4fc0-89e5-5d1d07b3e3ba req-328030ff-bdcd-4717-9b16-39a5bc8efd35 service nova] Lock "dc657d66-c3f8-44e5-b30e-3d79e586a8f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:43:22 user nova-compute[73391]: DEBUG nova.compute.manager [req-3a7e6eec-5d7f-4fc0-89e5-5d1d07b3e3ba req-328030ff-bdcd-4717-9b16-39a5bc8efd35 service nova] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] No waiting events found dispatching network-vif-plugged-83a46e94-e5e7-41bb-803a-30000c4f9a02 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:43:22 user nova-compute[73391]: WARNING nova.compute.manager [req-3a7e6eec-5d7f-4fc0-89e5-5d1d07b3e3ba req-328030ff-bdcd-4717-9b16-39a5bc8efd35 service nova] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Received unexpected event network-vif-plugged-83a46e94-e5e7-41bb-803a-30000c4f9a02 for instance with vm_state active and task_state resize_finish.
Aug 15 05:43:22 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:22 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk.rescue --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:22 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078202.5053658, dc657d66-c3f8-44e5-b30e-3d79e586a8f3 => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:43:22 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] VM Resumed (Lifecycle Event)
Aug 15 05:43:22 user nova-compute[73391]: DEBUG nova.compute.manager [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:43:22 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-4a9a1bb0-54c5-4d3d-9fe7-a6f8459bc387 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:43:22 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Instance running successfully.
Aug 15 05:43:22 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Failed to set time: agent not configured {{(pid=73391) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Aug 15 05:43:22 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-1128bdc9-afdf-4a6a-8678-731210b185ca tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] finish_migration finished successfully. {{(pid=73391) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Aug 15 05:43:22 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:43:22 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-4a9a1bb0-54c5-4d3d-9fe7-a6f8459bc387 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:43:22 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:43:22 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:22 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk.rescue --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:22 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-4a9a1bb0-54c5-4d3d-9fe7-a6f8459bc387 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.611s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:43:22 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 15 05:43:22 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078202.5157242, dc657d66-c3f8-44e5-b30e-3d79e586a8f3 => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:43:22 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] VM Started (Lifecycle Event)
Aug 15 05:43:22 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:43:22 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:43:22 user nova-compute[73391]: INFO nova.scheduler.client.report [None req-4a9a1bb0-54c5-4d3d-9fe7-a6f8459bc387 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Deleted allocations for instance 76fcbfca-deca-44f0-9182-1f9bbab134d2
Aug 15 05:43:22 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] During sync_power_state the instance has a pending task (resize_finish). Skip.
Aug 15 05:43:22 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-4a9a1bb0-54c5-4d3d-9fe7-a6f8459bc387 tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "76fcbfca-deca-44f0-9182-1f9bbab134d2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.020s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:43:22 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:22 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:22 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:22 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:23 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:23 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:23 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:23 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:23 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:23 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:23 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:23 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:23 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:23 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:23 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:23 user nova-compute[73391]: DEBUG nova.compute.manager [req-c128e898-d25c-4c05-9153-6af3b045a43a req-03a74723-367c-4d25-8a08-b9546df161fd service nova] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Received event network-vif-plugged-fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:43:23 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-c128e898-d25c-4c05-9153-6af3b045a43a req-03a74723-367c-4d25-8a08-b9546df161fd service nova] Acquiring lock "fee43642-30e8-451b-919c-aca4cd4c3f81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:43:23 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-c128e898-d25c-4c05-9153-6af3b045a43a req-03a74723-367c-4d25-8a08-b9546df161fd service nova] Lock "fee43642-30e8-451b-919c-aca4cd4c3f81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:43:23 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-c128e898-d25c-4c05-9153-6af3b045a43a req-03a74723-367c-4d25-8a08-b9546df161fd service nova] Lock "fee43642-30e8-451b-919c-aca4cd4c3f81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:43:23 user nova-compute[73391]: DEBUG nova.compute.manager [req-c128e898-d25c-4c05-9153-6af3b045a43a req-03a74723-367c-4d25-8a08-b9546df161fd service nova] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] No waiting events found dispatching network-vif-plugged-fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:43:23 user nova-compute[73391]: WARNING nova.compute.manager [req-c128e898-d25c-4c05-9153-6af3b045a43a req-03a74723-367c-4d25-8a08-b9546df161fd service nova] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Received unexpected event network-vif-plugged-fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b for instance with vm_state stopped and task_state powering-on.
Aug 15 05:43:23 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:23 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:23 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue --force-share --output=json" returned: 0 in 0.207s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:25 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078205.6655004, fee43642-30e8-451b-919c-aca4cd4c3f81 => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:43:25 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] VM Resumed (Lifecycle Event)
Aug 15 05:43:25 user nova-compute[73391]: DEBUG nova.compute.manager [None req-7863e968-f12e-4c83-9577-c73e9adcc6ec tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:43:25 user nova-compute[73391]: DEBUG nova.compute.manager [req-6ea27b5f-9b0e-4c7f-95c1-2d105e2cab86 req-1bad29c2-4d72-45e4-b7b0-fe122f3e4c2e service nova] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Received event network-vif-plugged-fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:43:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-6ea27b5f-9b0e-4c7f-95c1-2d105e2cab86 req-1bad29c2-4d72-45e4-b7b0-fe122f3e4c2e service nova] Acquiring lock "fee43642-30e8-451b-919c-aca4cd4c3f81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:43:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-6ea27b5f-9b0e-4c7f-95c1-2d105e2cab86 req-1bad29c2-4d72-45e4-b7b0-fe122f3e4c2e service nova] Lock "fee43642-30e8-451b-919c-aca4cd4c3f81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:43:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-6ea27b5f-9b0e-4c7f-95c1-2d105e2cab86 req-1bad29c2-4d72-45e4-b7b0-fe122f3e4c2e service nova] Lock "fee43642-30e8-451b-919c-aca4cd4c3f81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:43:25 user nova-compute[73391]: DEBUG nova.compute.manager [req-6ea27b5f-9b0e-4c7f-95c1-2d105e2cab86 req-1bad29c2-4d72-45e4-b7b0-fe122f3e4c2e service nova] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] No waiting events found dispatching network-vif-plugged-fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:43:25 user nova-compute[73391]: WARNING nova.compute.manager [req-6ea27b5f-9b0e-4c7f-95c1-2d105e2cab86 req-1bad29c2-4d72-45e4-b7b0-fe122f3e4c2e service nova] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Received unexpected event network-vif-plugged-fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b for instance with vm_state stopped and task_state powering-on.
Aug 15 05:43:25 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Instance rebooted successfully.
Aug 15 05:43:25 user nova-compute[73391]: DEBUG nova.compute.manager [None req-7863e968-f12e-4c83-9577-c73e9adcc6ec tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:43:25 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:43:25 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:43:25 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Hypervisor/Node resource view: name=user free_ram=7457MB free_disk=24.99930191040039GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 05:43:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:43:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:43:26 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:43:26 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:43:26 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] During sync_power_state the instance has a pending task (powering-on). Skip.
Aug 15 05:43:26 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078205.6658494, fee43642-30e8-451b-919c-aca4cd4c3f81 => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:43:26 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] VM Started (Lifecycle Event)
Aug 15 05:43:26 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:43:26 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:43:26 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Applying migration context for instance 8991b32e-6c4b-4c66-a320-e734061f49ee as it has an incoming, in-progress migration 7cfcc22d-fce8-47af-89de-3644606f77d2. Migration status is finished {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 15 05:43:26 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Applying migration context for instance dc657d66-c3f8-44e5-b30e-3d79e586a8f3 as it has an incoming, in-progress migration 68dd821e-9200-4f15-90ac-3b30802dd875. Migration status is finished {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 15 05:43:26 user nova-compute[73391]: INFO nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Updating resource usage from migration 7cfcc22d-fce8-47af-89de-3644606f77d2
Aug 15 05:43:26 user nova-compute[73391]: INFO nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Updating resource usage from migration 68dd821e-9200-4f15-90ac-3b30802dd875
Aug 15 05:43:26 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 8f08782b-f793-415e-b0d6-5caad1c3d426 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:43:26 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 6ac9d5dc-56be-402f-b9d4-3327bdfd9220 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:43:26 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 6358e825-5705-45d6-86b6-3aacfa5a9bbb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:43:26 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance fee43642-30e8-451b-919c-aca4cd4c3f81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:43:26 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:43:26 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 730890c6-6999-4a0f-b80c-e4745bff99ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:43:26 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 8ff2da51-5bfd-4cdc-8cef-330cdef93d97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:43:26 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance d60616bb-605e-4604-b637-56670f53159e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:43:26 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Migration 7cfcc22d-fce8-47af-89de-3644606f77d2 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 15 05:43:26 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 8991b32e-6c4b-4c66-a320-e734061f49ee actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:43:26 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Migration 68dd821e-9200-4f15-90ac-3b30802dd875 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 15 05:43:26 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance dc657d66-c3f8-44e5-b30e-3d79e586a8f3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:43:26 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 05:43:26 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Final resource view: name=user phys_ram=16011MB used_ram=9728MB phys_disk=40GB used_disk=27GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 05:43:26 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:43:26 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:43:26 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Compute_service record updated for user:user {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 05:43:26 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.688s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:43:26 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:29 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:29 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:29 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:43:29 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:43:29 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:43:29 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Starting heal instance info cache {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 05:43:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "refresh_cache-fee43642-30e8-451b-919c-aca4cd4c3f81" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:43:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquired lock "refresh_cache-fee43642-30e8-451b-919c-aca4cd4c3f81" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:43:30 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Forcefully refreshing network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 05:43:31 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Updating instance_info_cache with network_info: [{"id": "fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b", "address": "fa:16:3e:57:a8:64", "network": {"id": "c94dfbf4-6803-458e-b2c6-231298da7bc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090354282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f88922b3c294aea9efa3d80909a171a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdb4ce86-9a", "ovs_interfaceid": "fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:43:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Releasing lock "refresh_cache-fee43642-30e8-451b-919c-aca4cd4c3f81" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:43:31 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Updated the network info_cache for instance {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 05:43:31 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:43:31 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:43:31 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:43:31 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 05:43:32 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:35 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692078200.699564, 76fcbfca-deca-44f0-9182-1f9bbab134d2 => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:43:35 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] VM Stopped (Lifecycle Event)
Aug 15 05:43:35 user nova-compute[73391]: DEBUG nova.compute.manager [None req-7f93c690-0b16-4577-bf25-f7003d1ecb37 None None] [instance: 76fcbfca-deca-44f0-9182-1f9bbab134d2] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:43:37 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:37 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Acquiring lock "e8775490-2a9e-44ac-aad7-9450afa4c295" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:43:37 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lock "e8775490-2a9e-44ac-aad7-9450afa4c295" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:43:38 user nova-compute[73391]: DEBUG nova.compute.manager [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Starting instance... {{(pid=73391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 05:43:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:43:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:43:38 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 05:43:38 user nova-compute[73391]: INFO nova.compute.claims [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Claim successful on node user
Aug 15 05:43:38 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:43:38 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:43:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "c5d5343f-b8f4-46b7-92fc-66452212192b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:43:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "c5d5343f-b8f4-46b7-92fc-66452212192b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:43:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.644s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:43:38 user nova-compute[73391]: DEBUG nova.compute.manager [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Start building networks asynchronously for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 05:43:38 user nova-compute[73391]: DEBUG nova.compute.manager [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Starting instance... {{(pid=73391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 05:43:38 user nova-compute[73391]: DEBUG nova.compute.manager [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Allocating IP information in the background. {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 05:43:38 user nova-compute[73391]: DEBUG nova.network.neutron [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] allocate_for_instance() {{(pid=73391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 05:43:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:43:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:43:38 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 05:43:38 user nova-compute[73391]: INFO nova.compute.claims [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Claim successful on node user
Aug 15 05:43:38 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 05:43:38 user nova-compute[73391]: DEBUG nova.compute.manager [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Start building block device mappings for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 05:43:39 user nova-compute[73391]: DEBUG nova.policy [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5f88c49b60b5427bb5c07323e4312b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623d93149e574954839e469432f24fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73391) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 05:43:39 user nova-compute[73391]: DEBUG nova.compute.manager [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Start spawning the instance on the hypervisor. {{(pid=73391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 05:43:39 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Creating instance directory {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 05:43:39 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Creating image(s)
Aug 15 05:43:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Acquiring lock "/opt/stack/data/nova/instances/e8775490-2a9e-44ac-aad7-9450afa4c295/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:43:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lock "/opt/stack/data/nova/instances/e8775490-2a9e-44ac-aad7-9450afa4c295/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:43:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lock "/opt/stack/data/nova/instances/e8775490-2a9e-44ac-aad7-9450afa4c295/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:43:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.207s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Acquiring lock "999b315ba87151d8252d543312ae7790e7e1583b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:43:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:43:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.237s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/e8775490-2a9e-44ac-aad7-9450afa4c295/disk 1073741824 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/e8775490-2a9e-44ac-aad7-9450afa4c295/disk 1073741824" returned: 0 in 0.093s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.335s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:43:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:39 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:43:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.183s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:39 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e8775490-2a9e-44ac-aad7-9450afa4c295/disk. size=1073741824 {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 05:43:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8775490-2a9e-44ac-aad7-9450afa4c295/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:39 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:43:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.057s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:43:40 user nova-compute[73391]: DEBUG nova.compute.manager [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Start building networks asynchronously for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 05:43:40 user nova-compute[73391]: DEBUG nova.compute.manager [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Allocating IP information in the background. {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 05:43:40 user nova-compute[73391]: DEBUG nova.network.neutron [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] allocate_for_instance() {{(pid=73391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 05:43:40 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8775490-2a9e-44ac-aad7-9450afa4c295/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:40 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Cannot resize image /opt/stack/data/nova/instances/e8775490-2a9e-44ac-aad7-9450afa4c295/disk to a smaller size. {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 05:43:40 user nova-compute[73391]: DEBUG nova.objects.instance [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lazy-loading 'migration_context' on Instance uuid e8775490-2a9e-44ac-aad7-9450afa4c295 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:43:40 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 05:43:40 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Created local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 05:43:40 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Ensure instance console log exists: /opt/stack/data/nova/instances/e8775490-2a9e-44ac-aad7-9450afa4c295/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 05:43:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:43:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:43:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:43:40 user nova-compute[73391]: DEBUG nova.compute.manager [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Start building block device mappings for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 05:43:40 user nova-compute[73391]: DEBUG nova.network.neutron [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Successfully created port: 3dc39268-abd9-42ad-8f0d-75b567aa7ec9 {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 05:43:40 user nova-compute[73391]: INFO nova.virt.block_device [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Booting with volume bf1f66ba-446a-4c74-98ec-505477d901c9 at /dev/vda
Aug 15 05:43:40 user nova-compute[73391]: DEBUG nova.policy [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aefb6ccab586465dbe56e71a40bcf1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8188c2e8ca34ef1982faa49f1058bb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73391) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 05:43:40 user nova-compute[73391]: DEBUG os_brick.utils [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:43:40 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:40 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:40 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f80a7d-b862-45f5-82d1-e3da96ab5ba5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:43:40 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:40 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:40 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[21dab8b0-dbb8-4a8d-be75-3ba720b9d6df]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:43:40 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:40 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:40 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f4da56-e6e1-4d46-a00d-5988575aac39]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:43:40 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd34c6c2-2833-41d6-8fcd-12ff3beff05b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:43:40 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:40 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:43:40 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 05:43:40 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:40 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:43:40 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 05:43:40 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8dc8c3-1484-43f1-a208-eb848388239a]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:43:40 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 05:43:40 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 05:43:40 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 05:43:40 user nova-compute[73391]: DEBUG os_brick.utils [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] <== get_connector_properties: return (173ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:43:40 user nova-compute[73391]: DEBUG nova.virt.block_device [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Updating existing volume attachment record: 21870df2-1143-417e-8807-98ffff59304d {{(pid=73391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 05:43:41 user nova-compute[73391]: DEBUG nova.network.neutron [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Successfully updated port: 3dc39268-abd9-42ad-8f0d-75b567aa7ec9 {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:43:41 user nova-compute[73391]: DEBUG nova.network.neutron [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Successfully created port: 38e26266-d25b-4bbd-a6f1-00e0e81a1546 {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 05:43:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Acquiring lock "refresh_cache-e8775490-2a9e-44ac-aad7-9450afa4c295" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:43:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Acquired lock "refresh_cache-e8775490-2a9e-44ac-aad7-9450afa4c295" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:43:41 user nova-compute[73391]: DEBUG nova.network.neutron [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:43:41 user nova-compute[73391]: DEBUG nova.compute.manager [req-1bcf4f33-1ab0-4c68-b155-faaa47d31aa0 req-5431c6c5-a057-4b3b-8228-372dbf5c282e service nova] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Received event network-changed-3dc39268-abd9-42ad-8f0d-75b567aa7ec9 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:43:41 user nova-compute[73391]: DEBUG nova.compute.manager [req-1bcf4f33-1ab0-4c68-b155-faaa47d31aa0 req-5431c6c5-a057-4b3b-8228-372dbf5c282e service nova] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Refreshing instance network info cache due to event network-changed-3dc39268-abd9-42ad-8f0d-75b567aa7ec9. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:43:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-1bcf4f33-1ab0-4c68-b155-faaa47d31aa0 req-5431c6c5-a057-4b3b-8228-372dbf5c282e service nova] Acquiring lock "refresh_cache-e8775490-2a9e-44ac-aad7-9450afa4c295" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:43:41 user nova-compute[73391]: DEBUG nova.network.neutron [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:43:42 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:42 user nova-compute[73391]: DEBUG nova.network.neutron [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Updating instance_info_cache with network_info: [{"id": "3dc39268-abd9-42ad-8f0d-75b567aa7ec9", "address": "fa:16:3e:74:c3:08", "network": {"id": "c7ff2e30-7396-4af7-bd21-e9157804987e", "bridge": "br-int", "label": "tempest-TestStampPattern-2022602784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "623d93149e574954839e469432f24fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dc39268-ab", "ovs_interfaceid": "3dc39268-abd9-42ad-8f0d-75b567aa7ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:43:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Releasing lock "refresh_cache-e8775490-2a9e-44ac-aad7-9450afa4c295" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:43:42 user nova-compute[73391]: DEBUG nova.compute.manager [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Instance network_info: |[{"id": "3dc39268-abd9-42ad-8f0d-75b567aa7ec9", "address": "fa:16:3e:74:c3:08", "network": {"id": "c7ff2e30-7396-4af7-bd21-e9157804987e", "bridge": "br-int", "label": "tempest-TestStampPattern-2022602784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "623d93149e574954839e469432f24fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dc39268-ab", "ovs_interfaceid": "3dc39268-abd9-42ad-8f0d-75b567aa7ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 05:43:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-1bcf4f33-1ab0-4c68-b155-faaa47d31aa0 req-5431c6c5-a057-4b3b-8228-372dbf5c282e service nova] Acquired lock "refresh_cache-e8775490-2a9e-44ac-aad7-9450afa4c295" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:43:42 user nova-compute[73391]: DEBUG nova.network.neutron [req-1bcf4f33-1ab0-4c68-b155-faaa47d31aa0 req-5431c6c5-a057-4b3b-8228-372dbf5c282e service nova] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Refreshing network info cache for port 3dc39268-abd9-42ad-8f0d-75b567aa7ec9 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:43:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Start _get_guest_xml network_info=[{"id": "3dc39268-abd9-42ad-8f0d-75b567aa7ec9", "address": "fa:16:3e:74:c3:08", "network": {"id": "c7ff2e30-7396-4af7-bd21-e9157804987e", "bridge": "br-int", "label": "tempest-TestStampPattern-2022602784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "623d93149e574954839e469432f24fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dc39268-ab", "ovs_interfaceid": "3dc39268-abd9-42ad-8f0d-75b567aa7ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '191b1dad-305e-4d1c-9b15-515ec59a3278'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:43:42 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:43:42 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:43:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:43:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:43:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:43:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:43:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:43:42 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:43:42 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:43:42 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:43:42 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:43:42 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:43:42 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:43:42 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:43:42 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:43:42 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:43:42 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:43:42 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:43:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:43:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1823706797',display_name='tempest-TestStampPattern-server-1823706797',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1823706797',id=32,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQQVWOeuc6yJ6EmMw2rWLVsGpBPeA9gFNl5HRrfI/TUHS+ncoxmVN1359pxZR2y8M4qFx49b4zMDH1GSzjx/6CrvC6kH/thvZ4QYbb7yiE9dJlfo8ha6chN1RxR3KNG5w==',key_name='tempest-TestStampPattern-1501428928',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='623d93149e574954839e469432f24fc8',ramdisk_id='',reservation_id='r-8klg39st',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1421231515',owner_user_name='tempest-TestStampPattern-1421231515-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:43:39Z,user_data=None,user_id='5f88c49b60b5427bb5c07323e4312b14',uuid=e8775490-2a9e-44ac-aad7-9450afa4c295,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3dc39268-abd9-42ad-8f0d-75b567aa7ec9", "address": "fa:16:3e:74:c3:08", "network": {"id": "c7ff2e30-7396-4af7-bd21-e9157804987e", "bridge": "br-int", "label": "tempest-TestStampPattern-2022602784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "623d93149e574954839e469432f24fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dc39268-ab", "ovs_interfaceid": "3dc39268-abd9-42ad-8f0d-75b567aa7ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:43:42 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Converting VIF {"id": "3dc39268-abd9-42ad-8f0d-75b567aa7ec9", "address": "fa:16:3e:74:c3:08", "network": {"id": "c7ff2e30-7396-4af7-bd21-e9157804987e", "bridge": "br-int", "label": "tempest-TestStampPattern-2022602784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "623d93149e574954839e469432f24fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dc39268-ab", "ovs_interfaceid": "3dc39268-abd9-42ad-8f0d-75b567aa7ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:43:42 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:c3:08,bridge_name='br-int',has_traffic_filtering=True,id=3dc39268-abd9-42ad-8f0d-75b567aa7ec9,network=Network(c7ff2e30-7396-4af7-bd21-e9157804987e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dc39268-ab') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:43:42 user nova-compute[73391]: DEBUG nova.objects.instance [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lazy-loading 'pci_devices' on Instance uuid e8775490-2a9e-44ac-aad7-9450afa4c295 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:43:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:43:42 user nova-compute[73391]:   <uuid>e8775490-2a9e-44ac-aad7-9450afa4c295</uuid>
Aug 15 05:43:42 user nova-compute[73391]:   <name>instance-00000020</name>
Aug 15 05:43:42 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:43:42 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:43:42 user nova-compute[73391]:   <metadata>
Aug 15 05:43:42 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:43:42 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:43:42 user nova-compute[73391]:       <nova:name>tempest-TestStampPattern-server-1823706797</nova:name>
Aug 15 05:43:42 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:43:42</nova:creationTime>
Aug 15 05:43:42 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:43:42 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:43:42 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:43:42 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:43:42 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:43:42 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:43:42 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:43:42 user nova-compute[73391]:       <nova:owner>
Aug 15 05:43:42 user nova-compute[73391]:         <nova:user uuid="5f88c49b60b5427bb5c07323e4312b14">tempest-TestStampPattern-1421231515-project-member</nova:user>
Aug 15 05:43:42 user nova-compute[73391]:         <nova:project uuid="623d93149e574954839e469432f24fc8">tempest-TestStampPattern-1421231515</nova:project>
Aug 15 05:43:42 user nova-compute[73391]:       </nova:owner>
Aug 15 05:43:42 user nova-compute[73391]:       <nova:root type="image" uuid="191b1dad-305e-4d1c-9b15-515ec59a3278"/>
Aug 15 05:43:42 user nova-compute[73391]:       <nova:ports>
Aug 15 05:43:42 user nova-compute[73391]:         <nova:port uuid="3dc39268-abd9-42ad-8f0d-75b567aa7ec9">
Aug 15 05:43:42 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 05:43:42 user nova-compute[73391]:         </nova:port>
Aug 15 05:43:42 user nova-compute[73391]:       </nova:ports>
Aug 15 05:43:42 user nova-compute[73391]:     </nova:instance>
Aug 15 05:43:42 user nova-compute[73391]:   </metadata>
Aug 15 05:43:42 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:43:42 user nova-compute[73391]:     <system>
Aug 15 05:43:42 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:43:42 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:43:42 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:43:42 user nova-compute[73391]:       <entry name="serial">e8775490-2a9e-44ac-aad7-9450afa4c295</entry>
Aug 15 05:43:42 user nova-compute[73391]:       <entry name="uuid">e8775490-2a9e-44ac-aad7-9450afa4c295</entry>
Aug 15 05:43:42 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:43:42 user nova-compute[73391]:     </system>
Aug 15 05:43:42 user nova-compute[73391]:   </sysinfo>
Aug 15 05:43:42 user nova-compute[73391]:   <os>
Aug 15 05:43:42 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:43:42 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:43:42 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:43:42 user nova-compute[73391]:   </os>
Aug 15 05:43:42 user nova-compute[73391]:   <features>
Aug 15 05:43:42 user nova-compute[73391]:     <acpi/>
Aug 15 05:43:42 user nova-compute[73391]:     <apic/>
Aug 15 05:43:42 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:43:42 user nova-compute[73391]:   </features>
Aug 15 05:43:42 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:43:42 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:43:42 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:43:42 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:43:42 user nova-compute[73391]:   </clock>
Aug 15 05:43:42 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:43:42 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:43:42 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:43:42 user nova-compute[73391]:   </cpu>
Aug 15 05:43:42 user nova-compute[73391]:   <devices>
Aug 15 05:43:42 user nova-compute[73391]:     <disk type="file" device="disk">
Aug 15 05:43:42 user nova-compute[73391]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 05:43:42 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/e8775490-2a9e-44ac-aad7-9450afa4c295/disk"/>
Aug 15 05:43:42 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:43:42 user nova-compute[73391]:     </disk>
Aug 15 05:43:42 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:43:42 user nova-compute[73391]:       <mac address="fa:16:3e:74:c3:08"/>
Aug 15 05:43:42 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:43:42 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:43:42 user nova-compute[73391]:       <target dev="tap3dc39268-ab"/>
Aug 15 05:43:42 user nova-compute[73391]:     </interface>
Aug 15 05:43:42 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:43:42 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/e8775490-2a9e-44ac-aad7-9450afa4c295/console.log" append="off"/>
Aug 15 05:43:42 user nova-compute[73391]:     </serial>
Aug 15 05:43:42 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:43:42 user nova-compute[73391]:     <video>
Aug 15 05:43:42 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:43:42 user nova-compute[73391]:     </video>
Aug 15 05:43:42 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:43:42 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:43:42 user nova-compute[73391]:     </rng>
Aug 15 05:43:42 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:43:42 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:43:42 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:43:42 user nova-compute[73391]:     </memballoon>
Aug 15 05:43:42 user nova-compute[73391]:   </devices>
Aug 15 05:43:42 user nova-compute[73391]: </domain>
Aug 15 05:43:42 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:43:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:43:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1823706797',display_name='tempest-TestStampPattern-server-1823706797',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1823706797',id=32,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQQVWOeuc6yJ6EmMw2rWLVsGpBPeA9gFNl5HRrfI/TUHS+ncoxmVN1359pxZR2y8M4qFx49b4zMDH1GSzjx/6CrvC6kH/thvZ4QYbb7yiE9dJlfo8ha6chN1RxR3KNG5w==',key_name='tempest-TestStampPattern-1501428928',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='623d93149e574954839e469432f24fc8',ramdisk_id='',reservation_id='r-8klg39st',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1421231515',owner_user_name='tempest-TestStampPattern-1421231515-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:43:39Z,user_data=None,user_id='5f88c49b60b5427bb5c07323e4312b14',uuid=e8775490-2a9e-44ac-aad7-9450afa4c295,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3dc39268-abd9-42ad-8f0d-75b567aa7ec9", "address": "fa:16:3e:74:c3:08", "network": {"id": "c7ff2e30-7396-4af7-bd21-e9157804987e", "bridge": "br-int", "label": "tempest-TestStampPattern-2022602784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "623d93149e574954839e469432f24fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dc39268-ab", "ovs_interfaceid": "3dc39268-abd9-42ad-8f0d-75b567aa7ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:43:42 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Converting VIF {"id": "3dc39268-abd9-42ad-8f0d-75b567aa7ec9", "address": "fa:16:3e:74:c3:08", "network": {"id": "c7ff2e30-7396-4af7-bd21-e9157804987e", "bridge": "br-int", "label": "tempest-TestStampPattern-2022602784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "623d93149e574954839e469432f24fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dc39268-ab", "ovs_interfaceid": "3dc39268-abd9-42ad-8f0d-75b567aa7ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:43:42 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:74:c3:08,bridge_name='br-int',has_traffic_filtering=True,id=3dc39268-abd9-42ad-8f0d-75b567aa7ec9,network=Network(c7ff2e30-7396-4af7-bd21-e9157804987e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dc39268-ab') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:43:42 user nova-compute[73391]: DEBUG os_vif [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:c3:08,bridge_name='br-int',has_traffic_filtering=True,id=3dc39268-abd9-42ad-8f0d-75b567aa7ec9,network=Network(c7ff2e30-7396-4af7-bd21-e9157804987e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dc39268-ab') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:43:42 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:42 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:43:42 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:43:42 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:42 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3dc39268-ab, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:43:42 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3dc39268-ab, col_values=(('external_ids', {'iface-id': '3dc39268-abd9-42ad-8f0d-75b567aa7ec9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:74:c3:08', 'vm-uuid': 'e8775490-2a9e-44ac-aad7-9450afa4c295'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:43:42 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:42 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:43:42 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:42 user nova-compute[73391]: INFO os_vif [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:74:c3:08,bridge_name='br-int',has_traffic_filtering=True,id=3dc39268-abd9-42ad-8f0d-75b567aa7ec9,network=Network(c7ff2e30-7396-4af7-bd21-e9157804987e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dc39268-ab')
Aug 15 05:43:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:43:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] No VIF found with MAC fa:16:3e:74:c3:08, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:43:43 user nova-compute[73391]: DEBUG nova.network.neutron [req-1bcf4f33-1ab0-4c68-b155-faaa47d31aa0 req-5431c6c5-a057-4b3b-8228-372dbf5c282e service nova] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Updated VIF entry in instance network info cache for port 3dc39268-abd9-42ad-8f0d-75b567aa7ec9. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:43:43 user nova-compute[73391]: DEBUG nova.network.neutron [req-1bcf4f33-1ab0-4c68-b155-faaa47d31aa0 req-5431c6c5-a057-4b3b-8228-372dbf5c282e service nova] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Updating instance_info_cache with network_info: [{"id": "3dc39268-abd9-42ad-8f0d-75b567aa7ec9", "address": "fa:16:3e:74:c3:08", "network": {"id": "c7ff2e30-7396-4af7-bd21-e9157804987e", "bridge": "br-int", "label": "tempest-TestStampPattern-2022602784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "623d93149e574954839e469432f24fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dc39268-ab", "ovs_interfaceid": "3dc39268-abd9-42ad-8f0d-75b567aa7ec9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:43:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-1bcf4f33-1ab0-4c68-b155-faaa47d31aa0 req-5431c6c5-a057-4b3b-8228-372dbf5c282e service nova] Releasing lock "refresh_cache-e8775490-2a9e-44ac-aad7-9450afa4c295" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:43:43 user nova-compute[73391]: DEBUG nova.network.neutron [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Successfully updated port: 38e26266-d25b-4bbd-a6f1-00e0e81a1546 {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:43:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "refresh_cache-c5d5343f-b8f4-46b7-92fc-66452212192b" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:43:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquired lock "refresh_cache-c5d5343f-b8f4-46b7-92fc-66452212192b" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:43:43 user nova-compute[73391]: DEBUG nova.network.neutron [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:43:43 user nova-compute[73391]: DEBUG nova.network.neutron [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:43:43 user nova-compute[73391]: DEBUG nova.compute.manager [req-641a639c-c061-4f04-8a1a-b5fe1a131365 req-5ebf4bae-fa99-4f4b-9866-3053da762d90 service nova] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Received event network-changed-38e26266-d25b-4bbd-a6f1-00e0e81a1546 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:43:43 user nova-compute[73391]: DEBUG nova.compute.manager [req-641a639c-c061-4f04-8a1a-b5fe1a131365 req-5ebf4bae-fa99-4f4b-9866-3053da762d90 service nova] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Refreshing instance network info cache due to event network-changed-38e26266-d25b-4bbd-a6f1-00e0e81a1546. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:43:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-641a639c-c061-4f04-8a1a-b5fe1a131365 req-5ebf4bae-fa99-4f4b-9866-3053da762d90 service nova] Acquiring lock "refresh_cache-c5d5343f-b8f4-46b7-92fc-66452212192b" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:43:44 user nova-compute[73391]: DEBUG nova.network.neutron [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Updating instance_info_cache with network_info: [{"id": "38e26266-d25b-4bbd-a6f1-00e0e81a1546", "address": "fa:16:3e:ce:22:5a", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38e26266-d2", "ovs_interfaceid": "38e26266-d25b-4bbd-a6f1-00e0e81a1546", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:43:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Releasing lock "refresh_cache-c5d5343f-b8f4-46b7-92fc-66452212192b" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:43:44 user nova-compute[73391]: DEBUG nova.compute.manager [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Instance network_info: |[{"id": "38e26266-d25b-4bbd-a6f1-00e0e81a1546", "address": "fa:16:3e:ce:22:5a", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38e26266-d2", "ovs_interfaceid": "38e26266-d25b-4bbd-a6f1-00e0e81a1546", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 05:43:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-641a639c-c061-4f04-8a1a-b5fe1a131365 req-5ebf4bae-fa99-4f4b-9866-3053da762d90 service nova] Acquired lock "refresh_cache-c5d5343f-b8f4-46b7-92fc-66452212192b" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:43:44 user nova-compute[73391]: DEBUG nova.network.neutron [req-641a639c-c061-4f04-8a1a-b5fe1a131365 req-5ebf4bae-fa99-4f4b-9866-3053da762d90 service nova] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Refreshing network info cache for port 38e26266-d25b-4bbd-a6f1-00e0e81a1546 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:43:44 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:44 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:44 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:44 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:44 user nova-compute[73391]: DEBUG nova.network.neutron [req-641a639c-c061-4f04-8a1a-b5fe1a131365 req-5ebf4bae-fa99-4f4b-9866-3053da762d90 service nova] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Updated VIF entry in instance network info cache for port 38e26266-d25b-4bbd-a6f1-00e0e81a1546. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:43:44 user nova-compute[73391]: DEBUG nova.network.neutron [req-641a639c-c061-4f04-8a1a-b5fe1a131365 req-5ebf4bae-fa99-4f4b-9866-3053da762d90 service nova] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Updating instance_info_cache with network_info: [{"id": "38e26266-d25b-4bbd-a6f1-00e0e81a1546", "address": "fa:16:3e:ce:22:5a", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38e26266-d2", "ovs_interfaceid": "38e26266-d25b-4bbd-a6f1-00e0e81a1546", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:43:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-641a639c-c061-4f04-8a1a-b5fe1a131365 req-5ebf4bae-fa99-4f4b-9866-3053da762d90 service nova] Releasing lock "refresh_cache-c5d5343f-b8f4-46b7-92fc-66452212192b" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:43:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:45 user nova-compute[73391]: DEBUG nova.compute.manager [req-51bf22f4-4112-403b-9ec8-c6f661674933 req-87c2048b-08b9-4712-8c5d-56ab960357ce service nova] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Received event network-vif-plugged-3dc39268-abd9-42ad-8f0d-75b567aa7ec9 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:43:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-51bf22f4-4112-403b-9ec8-c6f661674933 req-87c2048b-08b9-4712-8c5d-56ab960357ce service nova] Acquiring lock "e8775490-2a9e-44ac-aad7-9450afa4c295-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:43:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-51bf22f4-4112-403b-9ec8-c6f661674933 req-87c2048b-08b9-4712-8c5d-56ab960357ce service nova] Lock "e8775490-2a9e-44ac-aad7-9450afa4c295-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:43:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-51bf22f4-4112-403b-9ec8-c6f661674933 req-87c2048b-08b9-4712-8c5d-56ab960357ce service nova] Lock "e8775490-2a9e-44ac-aad7-9450afa4c295-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:43:45 user nova-compute[73391]: DEBUG nova.compute.manager [req-51bf22f4-4112-403b-9ec8-c6f661674933 req-87c2048b-08b9-4712-8c5d-56ab960357ce service nova] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] No waiting events found dispatching network-vif-plugged-3dc39268-abd9-42ad-8f0d-75b567aa7ec9 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:43:45 user nova-compute[73391]: WARNING nova.compute.manager [req-51bf22f4-4112-403b-9ec8-c6f661674933 req-87c2048b-08b9-4712-8c5d-56ab960357ce service nova] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Received unexpected event network-vif-plugged-3dc39268-abd9-42ad-8f0d-75b567aa7ec9 for instance with vm_state building and task_state spawning.
Aug 15 05:43:45 user nova-compute[73391]: DEBUG nova.compute.manager [req-51bf22f4-4112-403b-9ec8-c6f661674933 req-87c2048b-08b9-4712-8c5d-56ab960357ce service nova] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Received event network-vif-plugged-3dc39268-abd9-42ad-8f0d-75b567aa7ec9 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:43:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-51bf22f4-4112-403b-9ec8-c6f661674933 req-87c2048b-08b9-4712-8c5d-56ab960357ce service nova] Acquiring lock "e8775490-2a9e-44ac-aad7-9450afa4c295-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:43:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-51bf22f4-4112-403b-9ec8-c6f661674933 req-87c2048b-08b9-4712-8c5d-56ab960357ce service nova] Lock "e8775490-2a9e-44ac-aad7-9450afa4c295-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:43:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-51bf22f4-4112-403b-9ec8-c6f661674933 req-87c2048b-08b9-4712-8c5d-56ab960357ce service nova] Lock "e8775490-2a9e-44ac-aad7-9450afa4c295-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:43:45 user nova-compute[73391]: DEBUG nova.compute.manager [req-51bf22f4-4112-403b-9ec8-c6f661674933 req-87c2048b-08b9-4712-8c5d-56ab960357ce service nova] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] No waiting events found dispatching network-vif-plugged-3dc39268-abd9-42ad-8f0d-75b567aa7ec9 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:43:45 user nova-compute[73391]: WARNING nova.compute.manager [req-51bf22f4-4112-403b-9ec8-c6f661674933 req-87c2048b-08b9-4712-8c5d-56ab960357ce service nova] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Received unexpected event network-vif-plugged-3dc39268-abd9-42ad-8f0d-75b567aa7ec9 for instance with vm_state building and task_state spawning.
Aug 15 05:43:46 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078226.8347049, e8775490-2a9e-44ac-aad7-9450afa4c295 => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:43:46 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] VM Resumed (Lifecycle Event)
Aug 15 05:43:46 user nova-compute[73391]: DEBUG nova.compute.manager [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:43:46 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Guest created on hypervisor {{(pid=73391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 05:43:46 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Instance spawned successfully.
Aug 15 05:43:46 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 05:43:46 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:43:46 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:43:46 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Found default for hw_cdrom_bus of ide {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:43:46 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Found default for hw_disk_bus of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:43:46 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Found default for hw_input_bus of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:43:46 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Found default for hw_pointer_model of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:43:46 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Found default for hw_video_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:43:46 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Found default for hw_vif_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:43:46 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:43:46 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078226.8350139, e8775490-2a9e-44ac-aad7-9450afa4c295 => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:43:46 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] VM Started (Lifecycle Event)
Aug 15 05:43:46 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:43:46 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:43:46 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:43:47 user nova-compute[73391]: INFO nova.compute.manager [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Took 7.88 seconds to spawn the instance on the hypervisor.
Aug 15 05:43:47 user nova-compute[73391]: DEBUG nova.compute.manager [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:43:47 user nova-compute[73391]: INFO nova.compute.manager [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Took 9.04 seconds to build instance.
Aug 15 05:43:47 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f75e3b5c-256b-470c-a6c9-4c4920349f5d tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lock "e8775490-2a9e-44ac-aad7-9450afa4c295" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.194s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:43:47 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:49 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:49 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG nova.compute.manager [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Start spawning the instance on the hypervisor. {{(pid=73391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Creating instance directory {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 05:43:52 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Creating image(s)
Aug 15 05:43:52 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Did not create local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Ensure instance console log exists: /opt/stack/data/nova/instances/c5d5343f-b8f4-46b7-92fc-66452212192b/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Start _get_guest_xml network_info=[{"id": "38e26266-d25b-4bbd-a6f1-00e0e81a1546", "address": "fa:16:3e:ce:22:5a", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38e26266-d2", "ovs_interfaceid": "38e26266-d25b-4bbd-a6f1-00e0e81a1546", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WHJRNZTs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c5d5343f-b8f4-46b7-92fc-66452212192b', 'attached_at': '', 'detached_at': '', 'volume_id': 'bf1f66ba-446a-4c74-98ec-505477d901c9', 'serial': 'bf1f66ba-446a-4c74-98ec-505477d901c9'}, 'attachment_id': '21870df2-1143-417e-8807-98ffff59304d', 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'volume_type': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:43:52 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:43:52 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:43:52 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WHJRNZTs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:43:52 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:43:52 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:43:52 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:43:52 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:43:52 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 05:43:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4fc6f13-c263-4182-86e6-53208fd4e467]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 05:43:52 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aabbcf0-1172-4749-b493-fd7fdca43d7e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9] added
Aug 15 05:43:52 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[54fee8f7-de50-4f23-8698-a9ba264e4813]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc55cc5-ba86-40db-bfd1-7baa76452625]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WHJRNZTs {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WHJRNZTs" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b3be45-3e26-4131-a9df-b65be98b268c]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WHJRNZTs'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c13e39-743f-4f83-a64f-0aada846316c]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f94ac65-06e1-4888-b439-c065f8689f0d]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:43:52 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:43:52 user nova-compute[73391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)
Aug 15 05:43:52 user nova-compute[73391]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:43:52 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:43:52 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:43:52 user nova-compute[73391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)
Aug 15 05:43:52 user nova-compute[73391]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:43:52 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9133276-5a9c-4022-810c-3bd50d87be2c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9, portal: 172.16.0.220,3260]
Aug 15 05:43:52 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9, portal: 172.16.0.220,3260] successful.
Aug 15 05:43:52 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28943d3-be92-46f4-8103-ba5af5903ba5]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b121a925-2a68-4cc0-bcd2-9f0c61244597]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:43:52 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:43:52 user nova-compute[73391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)
Aug 15 05:43:52 user nova-compute[73391]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:43:52 user nova-compute[73391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)
Aug 15 05:43:52 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:43:52 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:43:52 user nova-compute[73391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)
Aug 15 05:43:52 user nova-compute[73391]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:43:52 user nova-compute[73391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)
Aug 15 05:43:52 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] HCTL ('35', '-', '-', 0) found on session 41 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3ae50c-c698-4bf4-8858-fc0cd3f88fd2]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Searching for a device in session 41 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WHJRNZTs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 05:43:52 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:53 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:43:53 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] <== connect_volume: return (1373ms) {'type': 'block', 'scsi_wwn': '23132373961666538', 'path': '/dev/sdd'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:43:53 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132373961666538', 'path': '/dev/sdd'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 05:43:53 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:43:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-338118993',display_name='tempest-TestVolumeBootPattern-volume-backed-server-338118993',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-338118993',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFW1+sIZoEFLnPpTAYg0EDhHAtQ7cAXqnax3NryaVFAhDZJvJk4/PvibupTMkUUe1lYjwH4MmmprxSarNF7d+jmyBd+M6obrkGwLFhUGDhHU97jtKvlwFhY2xUb8bLX+Qw==',key_name='tempest-keypair-1848848517',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8188c2e8ca34ef1982faa49f1058bb7',ramdisk_id='',reservation_id='r-ks0a21qu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1834029963',owner_user_name='tempest-TestVolumeBootPattern-1834029963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:43:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aefb6ccab586465dbe56e71a40bcf1f0',uuid=c5d5343f-b8f4-46b7-92fc-66452212192b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38e26266-d25b-4bbd-a6f1-00e0e81a1546", "address": "fa:16:3e:ce:22:5a", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38e26266-d2", "ovs_interfaceid": "38e26266-d25b-4bbd-a6f1-00e0e81a1546", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:43:53 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Converting VIF {"id": "38e26266-d25b-4bbd-a6f1-00e0e81a1546", "address": "fa:16:3e:ce:22:5a", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38e26266-d2", "ovs_interfaceid": "38e26266-d25b-4bbd-a6f1-00e0e81a1546", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:43:53 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:22:5a,bridge_name='br-int',has_traffic_filtering=True,id=38e26266-d25b-4bbd-a6f1-00e0e81a1546,network=Network(fae0e46a-88e4-499d-bcff-5b7df55eab4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38e26266-d2') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:43:53 user nova-compute[73391]: DEBUG nova.objects.instance [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lazy-loading 'pci_devices' on Instance uuid c5d5343f-b8f4-46b7-92fc-66452212192b {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:43:53 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:43:53 user nova-compute[73391]:   <uuid>c5d5343f-b8f4-46b7-92fc-66452212192b</uuid>
Aug 15 05:43:53 user nova-compute[73391]:   <name>instance-00000021</name>
Aug 15 05:43:53 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:43:53 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:43:53 user nova-compute[73391]:   <metadata>
Aug 15 05:43:53 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:43:53 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:43:53 user nova-compute[73391]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-338118993</nova:name>
Aug 15 05:43:53 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:43:52</nova:creationTime>
Aug 15 05:43:53 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:43:53 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:43:53 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:43:53 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:43:53 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:43:53 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:43:53 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:43:53 user nova-compute[73391]:       <nova:owner>
Aug 15 05:43:53 user nova-compute[73391]:         <nova:user uuid="aefb6ccab586465dbe56e71a40bcf1f0">tempest-TestVolumeBootPattern-1834029963-project-member</nova:user>
Aug 15 05:43:53 user nova-compute[73391]:         <nova:project uuid="a8188c2e8ca34ef1982faa49f1058bb7">tempest-TestVolumeBootPattern-1834029963</nova:project>
Aug 15 05:43:53 user nova-compute[73391]:       </nova:owner>
Aug 15 05:43:53 user nova-compute[73391]:       <nova:ports>
Aug 15 05:43:53 user nova-compute[73391]:         <nova:port uuid="38e26266-d25b-4bbd-a6f1-00e0e81a1546">
Aug 15 05:43:53 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 05:43:53 user nova-compute[73391]:         </nova:port>
Aug 15 05:43:53 user nova-compute[73391]:       </nova:ports>
Aug 15 05:43:53 user nova-compute[73391]:     </nova:instance>
Aug 15 05:43:53 user nova-compute[73391]:   </metadata>
Aug 15 05:43:53 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:43:53 user nova-compute[73391]:     <system>
Aug 15 05:43:53 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:43:53 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:43:53 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:43:53 user nova-compute[73391]:       <entry name="serial">c5d5343f-b8f4-46b7-92fc-66452212192b</entry>
Aug 15 05:43:53 user nova-compute[73391]:       <entry name="uuid">c5d5343f-b8f4-46b7-92fc-66452212192b</entry>
Aug 15 05:43:53 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:43:53 user nova-compute[73391]:     </system>
Aug 15 05:43:53 user nova-compute[73391]:   </sysinfo>
Aug 15 05:43:53 user nova-compute[73391]:   <os>
Aug 15 05:43:53 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:43:53 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:43:53 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:43:53 user nova-compute[73391]:   </os>
Aug 15 05:43:53 user nova-compute[73391]:   <features>
Aug 15 05:43:53 user nova-compute[73391]:     <acpi/>
Aug 15 05:43:53 user nova-compute[73391]:     <apic/>
Aug 15 05:43:53 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:43:53 user nova-compute[73391]:   </features>
Aug 15 05:43:53 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:43:53 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:43:53 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:43:53 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:43:53 user nova-compute[73391]:   </clock>
Aug 15 05:43:53 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:43:53 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:43:53 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:43:53 user nova-compute[73391]:   </cpu>
Aug 15 05:43:53 user nova-compute[73391]:   <devices>
Aug 15 05:43:53 user nova-compute[73391]:     <disk type="block" device="disk">
Aug 15 05:43:53 user nova-compute[73391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:43:53 user nova-compute[73391]:       <source dev="/dev/sdd"/>
Aug 15 05:43:53 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:43:53 user nova-compute[73391]:       <serial>bf1f66ba-446a-4c74-98ec-505477d901c9</serial>
Aug 15 05:43:53 user nova-compute[73391]:     </disk>
Aug 15 05:43:53 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:43:53 user nova-compute[73391]:       <mac address="fa:16:3e:ce:22:5a"/>
Aug 15 05:43:53 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:43:53 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:43:53 user nova-compute[73391]:       <target dev="tap38e26266-d2"/>
Aug 15 05:43:53 user nova-compute[73391]:     </interface>
Aug 15 05:43:53 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:43:53 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/c5d5343f-b8f4-46b7-92fc-66452212192b/console.log" append="off"/>
Aug 15 05:43:53 user nova-compute[73391]:     </serial>
Aug 15 05:43:53 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:43:53 user nova-compute[73391]:     <video>
Aug 15 05:43:53 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:43:53 user nova-compute[73391]:     </video>
Aug 15 05:43:53 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:43:53 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:43:53 user nova-compute[73391]:     </rng>
Aug 15 05:43:53 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:43:53 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:43:53 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:43:53 user nova-compute[73391]:     </memballoon>
Aug 15 05:43:53 user nova-compute[73391]:   </devices>
Aug 15 05:43:53 user nova-compute[73391]: </domain>
Aug 15 05:43:53 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:43:53 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:43:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-338118993',display_name='tempest-TestVolumeBootPattern-volume-backed-server-338118993',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-338118993',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFW1+sIZoEFLnPpTAYg0EDhHAtQ7cAXqnax3NryaVFAhDZJvJk4/PvibupTMkUUe1lYjwH4MmmprxSarNF7d+jmyBd+M6obrkGwLFhUGDhHU97jtKvlwFhY2xUb8bLX+Qw==',key_name='tempest-keypair-1848848517',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8188c2e8ca34ef1982faa49f1058bb7',ramdisk_id='',reservation_id='r-ks0a21qu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1834029963',owner_user_name='tempest-TestVolumeBootPattern-1834029963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:43:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aefb6ccab586465dbe56e71a40bcf1f0',uuid=c5d5343f-b8f4-46b7-92fc-66452212192b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38e26266-d25b-4bbd-a6f1-00e0e81a1546", "address": "fa:16:3e:ce:22:5a", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38e26266-d2", "ovs_interfaceid": "38e26266-d25b-4bbd-a6f1-00e0e81a1546", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:43:53 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Converting VIF {"id": "38e26266-d25b-4bbd-a6f1-00e0e81a1546", "address": "fa:16:3e:ce:22:5a", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38e26266-d2", "ovs_interfaceid": "38e26266-d25b-4bbd-a6f1-00e0e81a1546", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:43:53 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:22:5a,bridge_name='br-int',has_traffic_filtering=True,id=38e26266-d25b-4bbd-a6f1-00e0e81a1546,network=Network(fae0e46a-88e4-499d-bcff-5b7df55eab4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38e26266-d2') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:43:53 user nova-compute[73391]: DEBUG os_vif [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:22:5a,bridge_name='br-int',has_traffic_filtering=True,id=38e26266-d25b-4bbd-a6f1-00e0e81a1546,network=Network(fae0e46a-88e4-499d-bcff-5b7df55eab4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38e26266-d2') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:43:53 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:53 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:43:53 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:43:53 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:53 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap38e26266-d2, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:43:53 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap38e26266-d2, col_values=(('external_ids', {'iface-id': '38e26266-d25b-4bbd-a6f1-00e0e81a1546', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:22:5a', 'vm-uuid': 'c5d5343f-b8f4-46b7-92fc-66452212192b'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:43:53 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:53 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:43:53 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:53 user nova-compute[73391]: INFO os_vif [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:22:5a,bridge_name='br-int',has_traffic_filtering=True,id=38e26266-d25b-4bbd-a6f1-00e0e81a1546,network=Network(fae0e46a-88e4-499d-bcff-5b7df55eab4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38e26266-d2')
Aug 15 05:43:53 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:43:53 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] No VIF found with MAC fa:16:3e:ce:22:5a, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:43:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:55 user nova-compute[73391]: DEBUG nova.compute.manager [req-bc2eccaf-571d-4490-9e3f-6a3486054185 req-2fd0ca05-2620-41ca-a944-2454d0603f39 service nova] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Received event network-vif-plugged-38e26266-d25b-4bbd-a6f1-00e0e81a1546 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:43:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-bc2eccaf-571d-4490-9e3f-6a3486054185 req-2fd0ca05-2620-41ca-a944-2454d0603f39 service nova] Acquiring lock "c5d5343f-b8f4-46b7-92fc-66452212192b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:43:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-bc2eccaf-571d-4490-9e3f-6a3486054185 req-2fd0ca05-2620-41ca-a944-2454d0603f39 service nova] Lock "c5d5343f-b8f4-46b7-92fc-66452212192b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:43:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-bc2eccaf-571d-4490-9e3f-6a3486054185 req-2fd0ca05-2620-41ca-a944-2454d0603f39 service nova] Lock "c5d5343f-b8f4-46b7-92fc-66452212192b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:43:55 user nova-compute[73391]: DEBUG nova.compute.manager [req-bc2eccaf-571d-4490-9e3f-6a3486054185 req-2fd0ca05-2620-41ca-a944-2454d0603f39 service nova] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] No waiting events found dispatching network-vif-plugged-38e26266-d25b-4bbd-a6f1-00e0e81a1546 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:43:55 user nova-compute[73391]: WARNING nova.compute.manager [req-bc2eccaf-571d-4490-9e3f-6a3486054185 req-2fd0ca05-2620-41ca-a944-2454d0603f39 service nova] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Received unexpected event network-vif-plugged-38e26266-d25b-4bbd-a6f1-00e0e81a1546 for instance with vm_state building and task_state spawning.
Aug 15 05:43:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:57 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078237.1694384, c5d5343f-b8f4-46b7-92fc-66452212192b => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:43:57 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] VM Resumed (Lifecycle Event)
Aug 15 05:43:57 user nova-compute[73391]: DEBUG nova.compute.manager [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:43:57 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Guest created on hypervisor {{(pid=73391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 05:43:57 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Instance spawned successfully.
Aug 15 05:43:57 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 05:43:57 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Found default for hw_cdrom_bus of ide {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:43:57 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Found default for hw_disk_bus of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:43:57 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Found default for hw_input_bus of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:43:57 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Found default for hw_pointer_model of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:43:57 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Found default for hw_video_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:43:57 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Found default for hw_vif_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:43:57 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:43:57 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:43:57 user nova-compute[73391]: DEBUG nova.compute.manager [req-9591ec7c-dced-4661-bb74-792a18251841 req-bddcb0c8-c579-45c4-9e55-83091db0d4a6 service nova] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Received event network-vif-plugged-38e26266-d25b-4bbd-a6f1-00e0e81a1546 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:43:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-9591ec7c-dced-4661-bb74-792a18251841 req-bddcb0c8-c579-45c4-9e55-83091db0d4a6 service nova] Acquiring lock "c5d5343f-b8f4-46b7-92fc-66452212192b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:43:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-9591ec7c-dced-4661-bb74-792a18251841 req-bddcb0c8-c579-45c4-9e55-83091db0d4a6 service nova] Lock "c5d5343f-b8f4-46b7-92fc-66452212192b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:43:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-9591ec7c-dced-4661-bb74-792a18251841 req-bddcb0c8-c579-45c4-9e55-83091db0d4a6 service nova] Lock "c5d5343f-b8f4-46b7-92fc-66452212192b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:43:57 user nova-compute[73391]: DEBUG nova.compute.manager [req-9591ec7c-dced-4661-bb74-792a18251841 req-bddcb0c8-c579-45c4-9e55-83091db0d4a6 service nova] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] No waiting events found dispatching network-vif-plugged-38e26266-d25b-4bbd-a6f1-00e0e81a1546 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:43:57 user nova-compute[73391]: WARNING nova.compute.manager [req-9591ec7c-dced-4661-bb74-792a18251841 req-bddcb0c8-c579-45c4-9e55-83091db0d4a6 service nova] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Received unexpected event network-vif-plugged-38e26266-d25b-4bbd-a6f1-00e0e81a1546 for instance with vm_state building and task_state spawning.
Aug 15 05:43:57 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:43:57 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078237.1730094, c5d5343f-b8f4-46b7-92fc-66452212192b => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:43:57 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] VM Started (Lifecycle Event)
Aug 15 05:43:57 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:43:57 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:43:57 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:43:57 user nova-compute[73391]: INFO nova.compute.manager [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Took 5.19 seconds to spawn the instance on the hypervisor.
Aug 15 05:43:57 user nova-compute[73391]: DEBUG nova.compute.manager [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:43:57 user nova-compute[73391]: INFO nova.compute.manager [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Took 18.61 seconds to build instance.
Aug 15 05:43:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-de47c2c7-05dd-457f-975f-cc97957d7c20 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "c5d5343f-b8f4-46b7-92fc-66452212192b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.735s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:43:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:43:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:03 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:04 user nova-compute[73391]: DEBUG nova.network.neutron [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Port 3e0cb01d-a82e-44d3-b8dd-723819ec6ffa binding to destination host user is already ACTIVE {{(pid=73391) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Aug 15 05:44:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Acquiring lock "refresh_cache-8991b32e-6c4b-4c66-a320-e734061f49ee" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:44:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Acquired lock "refresh_cache-8991b32e-6c4b-4c66-a320-e734061f49ee" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:44:04 user nova-compute[73391]: DEBUG nova.network.neutron [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:44:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:04 user nova-compute[73391]: DEBUG nova.network.neutron [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Updating instance_info_cache with network_info: [{"id": "3e0cb01d-a82e-44d3-b8dd-723819ec6ffa", "address": "fa:16:3e:89:dc:93", "network": {"id": "11023df3-666d-44e5-955d-cc1fbde6972e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1848872765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "666428ad8c2f4f9cadcd180e498223f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0cb01d-a8", "ovs_interfaceid": "3e0cb01d-a82e-44d3-b8dd-723819ec6ffa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:44:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Releasing lock "refresh_cache-8991b32e-6c4b-4c66-a320-e734061f49ee" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:44:04 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Creating tmpfile /opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/tmp2mzxq04z to verify with other compute node that the instance is on the same shared storage. {{(pid=73391) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Aug 15 05:44:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:05 user nova-compute[73391]: DEBUG nova.compute.manager [req-f95c290a-5a0c-4002-a198-a07cd2b9bd7c req-d59bb664-5dae-4a1f-ab44-877c3535a067 service nova] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Received event network-vif-unplugged-3e0cb01d-a82e-44d3-b8dd-723819ec6ffa {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:44:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f95c290a-5a0c-4002-a198-a07cd2b9bd7c req-d59bb664-5dae-4a1f-ab44-877c3535a067 service nova] Acquiring lock "8991b32e-6c4b-4c66-a320-e734061f49ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:44:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f95c290a-5a0c-4002-a198-a07cd2b9bd7c req-d59bb664-5dae-4a1f-ab44-877c3535a067 service nova] Lock "8991b32e-6c4b-4c66-a320-e734061f49ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:44:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f95c290a-5a0c-4002-a198-a07cd2b9bd7c req-d59bb664-5dae-4a1f-ab44-877c3535a067 service nova] Lock "8991b32e-6c4b-4c66-a320-e734061f49ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:44:05 user nova-compute[73391]: DEBUG nova.compute.manager [req-f95c290a-5a0c-4002-a198-a07cd2b9bd7c req-d59bb664-5dae-4a1f-ab44-877c3535a067 service nova] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] No waiting events found dispatching network-vif-unplugged-3e0cb01d-a82e-44d3-b8dd-723819ec6ffa {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:44:05 user nova-compute[73391]: WARNING nova.compute.manager [req-f95c290a-5a0c-4002-a198-a07cd2b9bd7c req-d59bb664-5dae-4a1f-ab44-877c3535a067 service nova] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Received unexpected event network-vif-unplugged-3e0cb01d-a82e-44d3-b8dd-723819ec6ffa for instance with vm_state resized and task_state resize_reverting.
Aug 15 05:44:05 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Instance destroyed successfully.
Aug 15 05:44:05 user nova-compute[73391]: DEBUG nova.objects.instance [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lazy-loading 'resources' on Instance uuid 8991b32e-6c4b-4c66-a320-e734061f49ee {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:44:05 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:38:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-845602872',display_name='tempest-ServerActionsTestOtherB-server-845602872',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-845602872',id=27,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCi9vkvcVQEbXmigHztv9LlDFuCnimhR/vNlP8kykjc1U9WtN+KwlQqW0CDVIHXojOPVLOC+TJRapzFB5aO8vw7udjudZbg8fWCON+jsBrd+VE/0PuYaOBBV7W22/iAKjg==',key_name='tempest-keypair-1001766799',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:42:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='666428ad8c2f4f9cadcd180e498223f7',ramdisk_id='',reservation_id='r-sady4pim',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-762584882',owner_user_name='tempest-ServerActionsTestOtherB-762584882-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:42:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b43158637026445496cc0030b6ce49a2',uuid=8991b32e-6c4b-4c66-a320-e734061f49ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "3e0cb01d-a82e-44d3-b8dd-723819ec6ffa", "address": "fa:16:3e:89:dc:93", "network": {"id": "11023df3-666d-44e5-955d-cc1fbde6972e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1848872765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "666428ad8c2f4f9cadcd180e498223f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0cb01d-a8", "ovs_interfaceid": "3e0cb01d-a82e-44d3-b8dd-723819ec6ffa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:44:05 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Converting VIF {"id": "3e0cb01d-a82e-44d3-b8dd-723819ec6ffa", "address": "fa:16:3e:89:dc:93", "network": {"id": "11023df3-666d-44e5-955d-cc1fbde6972e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1848872765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "666428ad8c2f4f9cadcd180e498223f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0cb01d-a8", "ovs_interfaceid": "3e0cb01d-a82e-44d3-b8dd-723819ec6ffa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:44:05 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:89:dc:93,bridge_name='br-int',has_traffic_filtering=True,id=3e0cb01d-a82e-44d3-b8dd-723819ec6ffa,network=Network(11023df3-666d-44e5-955d-cc1fbde6972e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e0cb01d-a8') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:44:05 user nova-compute[73391]: DEBUG os_vif [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:dc:93,bridge_name='br-int',has_traffic_filtering=True,id=3e0cb01d-a82e-44d3-b8dd-723819ec6ffa,network=Network(11023df3-666d-44e5-955d-cc1fbde6972e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e0cb01d-a8') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:44:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e0cb01d-a8, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:44:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:44:05 user nova-compute[73391]: INFO os_vif [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:89:dc:93,bridge_name='br-int',has_traffic_filtering=True,id=3e0cb01d-a82e-44d3-b8dd-723819ec6ffa,network=Network(11023df3-666d-44e5-955d-cc1fbde6972e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e0cb01d-a8')
Aug 15 05:44:05 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 05:44:05 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IWGBEMQx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:44:05 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:44:05 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:44:05 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:44:05 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 05:44:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:44:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:44:05 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0247ad4d-e580-4c51-bcb4-817d7887ce7d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e4fcd2cb-f557-4163-82e0-96d633ffb846\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:44:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:44:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:44:05 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[25f8b076-8f4b-4ce1-b975-dbf0560b5d44]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4fcd2cb-f557-4163-82e0-96d633ffb846 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:44:05 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:44:05 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:44:05 user nova-compute[73391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)
Aug 15 05:44:05 user nova-compute[73391]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:44:05 user nova-compute[73391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)
Aug 15 05:44:05 user nova-compute[73391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4fcd2cb-f557-4163-82e0-96d633ffb846 (non-flash)
Aug 15 05:44:05 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:44:05 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:44:05 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:44:05 user nova-compute[73391]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)
Aug 15 05:44:05 user nova-compute[73391]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:44:05 user nova-compute[73391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)
Aug 15 05:44:05 user nova-compute[73391]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e4fcd2cb-f557-4163-82e0-96d633ffb846 (non-flash)
Aug 15 05:44:05 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:44:05 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7728311090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf'): ({'sdb'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 05:44:05 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Removing single pathed devices sdb {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 05:44:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:44:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:44:05 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b39ec56-7b99-40f8-9097-b7a701923147]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:44:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:44:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:44:05 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5790cc-3fcc-4192-80b7-33b2a0fa8cbd]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:44:05 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Flushing IO for device /dev/sdb {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 05:44:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:44:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:44:05 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8244c30-cdf1-4507-9038-d6f5e0db57fd]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:44:05 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 05:44:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:44:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:44:05 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d86ddee2-566f-498c-bf8a-ab94f3b6bc50]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:44:05 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 05:44:05 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] SCSI volumes sdb have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 05:44:05 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 05:44:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:44:06 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:44:06 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3cadbf-ced0-4127-8743-3db34f38d446]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:44:06 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:44:06 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:44:06 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:44:06 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ccffd6-c31f-4ddb-9a39-2350d1d477f1]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:44:06 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf, portal: 172.16.0.220,3260]
Aug 15 05:44:06 user nova-compute[73391]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf, portal: 172.16.0.220,3260] successful.
Aug 15 05:44:06 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:44:06 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:44:06 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:44:06 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fade7b71-f78f-480e-84e6-fd22847726d8]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:44:06 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:44:06 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:44:06 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] <== disconnect_volume: return (313ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:44:06 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 05:44:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:44:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:44:07 user nova-compute[73391]: DEBUG nova.objects.instance [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lazy-loading 'migration_context' on Instance uuid 8991b32e-6c4b-4c66-a320-e734061f49ee {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:44:07 user nova-compute[73391]: DEBUG nova.compute.manager [req-168ccc25-2acf-4e3d-a6b5-71a13b57426f req-2e59cd27-027f-4a33-a44f-edfcf7a868fc service nova] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Received event network-vif-plugged-3e0cb01d-a82e-44d3-b8dd-723819ec6ffa {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:44:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-168ccc25-2acf-4e3d-a6b5-71a13b57426f req-2e59cd27-027f-4a33-a44f-edfcf7a868fc service nova] Acquiring lock "8991b32e-6c4b-4c66-a320-e734061f49ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:44:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-168ccc25-2acf-4e3d-a6b5-71a13b57426f req-2e59cd27-027f-4a33-a44f-edfcf7a868fc service nova] Lock "8991b32e-6c4b-4c66-a320-e734061f49ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:44:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-168ccc25-2acf-4e3d-a6b5-71a13b57426f req-2e59cd27-027f-4a33-a44f-edfcf7a868fc service nova] Lock "8991b32e-6c4b-4c66-a320-e734061f49ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:44:07 user nova-compute[73391]: DEBUG nova.compute.manager [req-168ccc25-2acf-4e3d-a6b5-71a13b57426f req-2e59cd27-027f-4a33-a44f-edfcf7a868fc service nova] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] No waiting events found dispatching network-vif-plugged-3e0cb01d-a82e-44d3-b8dd-723819ec6ffa {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:44:07 user nova-compute[73391]: WARNING nova.compute.manager [req-168ccc25-2acf-4e3d-a6b5-71a13b57426f req-2e59cd27-027f-4a33-a44f-edfcf7a868fc service nova] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Received unexpected event network-vif-plugged-3e0cb01d-a82e-44d3-b8dd-723819ec6ffa for instance with vm_state resized and task_state resize_reverting.
Aug 15 05:44:07 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:44:07 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:44:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.815s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:44:08 user nova-compute[73391]: INFO nova.compute.manager [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Swapping old allocation on dict_keys(['771708bd-6a2a-4e0c-9869-46d45e6b1896']) held by migration 7cfcc22d-fce8-47af-89de-3644606f77d2 for instance
Aug 15 05:44:08 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Overwriting current allocation {'allocations': {'771708bd-6a2a-4e0c-9869-46d45e6b1896': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 42}}, 'project_id': '666428ad8c2f4f9cadcd180e498223f7', 'user_id': 'b43158637026445496cc0030b6ce49a2', 'consumer_generation': 1} on consumer 8991b32e-6c4b-4c66-a320-e734061f49ee {{(pid=73391) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Aug 15 05:44:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Acquiring lock "refresh_cache-8991b32e-6c4b-4c66-a320-e734061f49ee" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:44:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Acquired lock "refresh_cache-8991b32e-6c4b-4c66-a320-e734061f49ee" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:44:08 user nova-compute[73391]: DEBUG nova.network.neutron [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:44:09 user nova-compute[73391]: DEBUG nova.network.neutron [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Updating instance_info_cache with network_info: [{"id": "3e0cb01d-a82e-44d3-b8dd-723819ec6ffa", "address": "fa:16:3e:89:dc:93", "network": {"id": "11023df3-666d-44e5-955d-cc1fbde6972e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1848872765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "666428ad8c2f4f9cadcd180e498223f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0cb01d-a8", "ovs_interfaceid": "3e0cb01d-a82e-44d3-b8dd-723819ec6ffa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:44:09 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Releasing lock "refresh_cache-8991b32e-6c4b-4c66-a320-e734061f49ee" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:44:09 user nova-compute[73391]: DEBUG os_brick.utils [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:44:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:44:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:44:09 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9252816-2323-4f01-9bb3-4822be41708e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:44:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:44:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:44:09 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[838eb343-b807-4776-9314-4286b825e5a8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:44:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:44:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:44:09 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80cc3e9-1a20-4470-947c-9e2d25e9e099]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:44:09 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c686f0b6-fe8c-4c4f-b342-0a908e3ba54c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:44:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:44:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:44:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 05:44:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:44:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:44:09 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 05:44:09 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44d5261-80a0-48c4-a800-6f23d2d1371a]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:44:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 05:44:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 05:44:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 05:44:09 user nova-compute[73391]: DEBUG os_brick.utils [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:44:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:10 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:15 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:16 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:44:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:19 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:44:20 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:44:20 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:44:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:44:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:44:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:44:20 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Auditing locally available compute resources for user (node: user) {{(pid=73391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 05:44:20 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692078245.728146, 8991b32e-6c4b-4c66-a320-e734061f49ee => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:44:20 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] VM Stopped (Lifecycle Event)
Aug 15 05:44:20 user nova-compute[73391]: DEBUG nova.compute.manager [None req-ec61b7fc-6028-40a3-9954-e4ad40b7923c None None] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:44:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:20 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:44:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8775490-2a9e-44ac-aad7-9450afa4c295/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:44:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8775490-2a9e-44ac-aad7-9450afa4c295/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:44:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8775490-2a9e-44ac-aad7-9450afa4c295/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:44:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8775490-2a9e-44ac-aad7-9450afa4c295/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:44:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:44:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:44:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:44:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:44:21 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:44:21 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:44:21 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:44:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d60616bb-605e-4604-b637-56670f53159e/disk.rescue --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:44:21 user nova-compute[73391]: INFO nova.compute.manager [None req-a480caae-dd0d-46d1-bf93-682049564d85 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] Unrescuing
Aug 15 05:44:21 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-a480caae-dd0d-46d1-bf93-682049564d85 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquiring lock "refresh_cache-d60616bb-605e-4604-b637-56670f53159e" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:44:21 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-a480caae-dd0d-46d1-bf93-682049564d85 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquired lock "refresh_cache-d60616bb-605e-4604-b637-56670f53159e" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:44:21 user nova-compute[73391]: DEBUG nova.network.neutron [None req-a480caae-dd0d-46d1-bf93-682049564d85 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:44:22 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d60616bb-605e-4604-b637-56670f53159e/disk.rescue --force-share --output=json" returned: 0 in 0.246s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:44:22 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d60616bb-605e-4604-b637-56670f53159e/disk.rescue --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:44:22 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d60616bb-605e-4604-b637-56670f53159e/disk.rescue --force-share --output=json" returned: 0 in 0.223s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:44:22 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:44:22 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:44:22 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:44:22 user nova-compute[73391]: DEBUG nova.network.neutron [None req-a480caae-dd0d-46d1-bf93-682049564d85 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] Updating instance_info_cache with network_info: [{"id": "c8787a16-cd6d-410e-8d37-425bdad344d6", "address": "fa:16:3e:f9:58:41", "network": {"id": "70d88082-aea7-48bb-abb4-d77d264aaf01", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b9acbe11654053bb905e7c92558a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8787a16-cd", "ovs_interfaceid": "c8787a16-cd6d-410e-8d37-425bdad344d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:44:22 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-a480caae-dd0d-46d1-bf93-682049564d85 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Releasing lock "refresh_cache-d60616bb-605e-4604-b637-56670f53159e" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:44:22 user nova-compute[73391]: DEBUG nova.objects.instance [None req-a480caae-dd0d-46d1-bf93-682049564d85 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lazy-loading 'flavor' on Instance uuid d60616bb-605e-4604-b637-56670f53159e {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:44:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:22 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:44:22 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk.rescue --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:44:23 user nova-compute[73391]: DEBUG nova.compute.manager [req-c4551f7f-9a36-4c1f-ba23-5e914e0c2edf req-0067bf96-37ee-4c84-9498-138dce4292e6 service nova] [instance: d60616bb-605e-4604-b637-56670f53159e] Received event network-vif-unplugged-c8787a16-cd6d-410e-8d37-425bdad344d6 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:44:23 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-c4551f7f-9a36-4c1f-ba23-5e914e0c2edf req-0067bf96-37ee-4c84-9498-138dce4292e6 service nova] Acquiring lock "d60616bb-605e-4604-b637-56670f53159e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:44:23 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-c4551f7f-9a36-4c1f-ba23-5e914e0c2edf req-0067bf96-37ee-4c84-9498-138dce4292e6 service nova] Lock "d60616bb-605e-4604-b637-56670f53159e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:44:23 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-c4551f7f-9a36-4c1f-ba23-5e914e0c2edf req-0067bf96-37ee-4c84-9498-138dce4292e6 service nova] Lock "d60616bb-605e-4604-b637-56670f53159e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:44:23 user nova-compute[73391]: DEBUG nova.compute.manager [req-c4551f7f-9a36-4c1f-ba23-5e914e0c2edf req-0067bf96-37ee-4c84-9498-138dce4292e6 service nova] [instance: d60616bb-605e-4604-b637-56670f53159e] No waiting events found dispatching network-vif-unplugged-c8787a16-cd6d-410e-8d37-425bdad344d6 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:44:23 user nova-compute[73391]: WARNING nova.compute.manager [req-c4551f7f-9a36-4c1f-ba23-5e914e0c2edf req-0067bf96-37ee-4c84-9498-138dce4292e6 service nova] [instance: d60616bb-605e-4604-b637-56670f53159e] Received unexpected event network-vif-unplugged-c8787a16-cd6d-410e-8d37-425bdad344d6 for instance with vm_state rescued and task_state unrescuing.
Aug 15 05:44:23 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk.rescue --force-share --output=json" returned: 0 in 0.223s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:44:23 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk.rescue --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:44:23 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:23 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk.rescue --force-share --output=json" returned: 0 in 0.241s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:44:23 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:44:23 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:23 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:23 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:23 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:44:23 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:44:23 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: d60616bb-605e-4604-b637-56670f53159e] Instance destroyed successfully.
Aug 15 05:44:23 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:23 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:44:23 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:44:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:44:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:44:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:44:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:44:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:44:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:44:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:44:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:44:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue --force-share --output=json" returned: 0 in 0.234s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:44:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:44:25 user nova-compute[73391]: DEBUG nova.compute.manager [req-2454e627-428a-487c-becf-e0bd150e5e70 req-811064bc-3da1-4586-8a67-bf6351d06cf8 service nova] [instance: d60616bb-605e-4604-b637-56670f53159e] Received event network-vif-plugged-c8787a16-cd6d-410e-8d37-425bdad344d6 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:44:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2454e627-428a-487c-becf-e0bd150e5e70 req-811064bc-3da1-4586-8a67-bf6351d06cf8 service nova] Acquiring lock "d60616bb-605e-4604-b637-56670f53159e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:44:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2454e627-428a-487c-becf-e0bd150e5e70 req-811064bc-3da1-4586-8a67-bf6351d06cf8 service nova] Lock "d60616bb-605e-4604-b637-56670f53159e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:44:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2454e627-428a-487c-becf-e0bd150e5e70 req-811064bc-3da1-4586-8a67-bf6351d06cf8 service nova] Lock "d60616bb-605e-4604-b637-56670f53159e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:44:25 user nova-compute[73391]: DEBUG nova.compute.manager [req-2454e627-428a-487c-becf-e0bd150e5e70 req-811064bc-3da1-4586-8a67-bf6351d06cf8 service nova] [instance: d60616bb-605e-4604-b637-56670f53159e] No waiting events found dispatching network-vif-plugged-c8787a16-cd6d-410e-8d37-425bdad344d6 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:44:25 user nova-compute[73391]: WARNING nova.compute.manager [req-2454e627-428a-487c-becf-e0bd150e5e70 req-811064bc-3da1-4586-8a67-bf6351d06cf8 service nova] [instance: d60616bb-605e-4604-b637-56670f53159e] Received unexpected event network-vif-plugged-c8787a16-cd6d-410e-8d37-425bdad344d6 for instance with vm_state rescued and task_state unrescuing.
Aug 15 05:44:25 user nova-compute[73391]: DEBUG nova.compute.manager [req-2454e627-428a-487c-becf-e0bd150e5e70 req-811064bc-3da1-4586-8a67-bf6351d06cf8 service nova] [instance: d60616bb-605e-4604-b637-56670f53159e] Received event network-vif-plugged-c8787a16-cd6d-410e-8d37-425bdad344d6 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:44:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2454e627-428a-487c-becf-e0bd150e5e70 req-811064bc-3da1-4586-8a67-bf6351d06cf8 service nova] Acquiring lock "d60616bb-605e-4604-b637-56670f53159e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:44:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2454e627-428a-487c-becf-e0bd150e5e70 req-811064bc-3da1-4586-8a67-bf6351d06cf8 service nova] Lock "d60616bb-605e-4604-b637-56670f53159e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:44:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2454e627-428a-487c-becf-e0bd150e5e70 req-811064bc-3da1-4586-8a67-bf6351d06cf8 service nova] Lock "d60616bb-605e-4604-b637-56670f53159e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:44:25 user nova-compute[73391]: DEBUG nova.compute.manager [req-2454e627-428a-487c-becf-e0bd150e5e70 req-811064bc-3da1-4586-8a67-bf6351d06cf8 service nova] [instance: d60616bb-605e-4604-b637-56670f53159e] No waiting events found dispatching network-vif-plugged-c8787a16-cd6d-410e-8d37-425bdad344d6 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:44:25 user nova-compute[73391]: WARNING nova.compute.manager [req-2454e627-428a-487c-becf-e0bd150e5e70 req-811064bc-3da1-4586-8a67-bf6351d06cf8 service nova] [instance: d60616bb-605e-4604-b637-56670f53159e] Received unexpected event network-vif-plugged-c8787a16-cd6d-410e-8d37-425bdad344d6 for instance with vm_state rescued and task_state unrescuing.
Aug 15 05:44:25 user nova-compute[73391]: DEBUG nova.compute.manager [req-2454e627-428a-487c-becf-e0bd150e5e70 req-811064bc-3da1-4586-8a67-bf6351d06cf8 service nova] [instance: d60616bb-605e-4604-b637-56670f53159e] Received event network-vif-plugged-c8787a16-cd6d-410e-8d37-425bdad344d6 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:44:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2454e627-428a-487c-becf-e0bd150e5e70 req-811064bc-3da1-4586-8a67-bf6351d06cf8 service nova] Acquiring lock "d60616bb-605e-4604-b637-56670f53159e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:44:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2454e627-428a-487c-becf-e0bd150e5e70 req-811064bc-3da1-4586-8a67-bf6351d06cf8 service nova] Lock "d60616bb-605e-4604-b637-56670f53159e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:44:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2454e627-428a-487c-becf-e0bd150e5e70 req-811064bc-3da1-4586-8a67-bf6351d06cf8 service nova] Lock "d60616bb-605e-4604-b637-56670f53159e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:44:25 user nova-compute[73391]: DEBUG nova.compute.manager [req-2454e627-428a-487c-becf-e0bd150e5e70 req-811064bc-3da1-4586-8a67-bf6351d06cf8 service nova] [instance: d60616bb-605e-4604-b637-56670f53159e] No waiting events found dispatching network-vif-plugged-c8787a16-cd6d-410e-8d37-425bdad344d6 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:44:25 user nova-compute[73391]: WARNING nova.compute.manager [req-2454e627-428a-487c-becf-e0bd150e5e70 req-811064bc-3da1-4586-8a67-bf6351d06cf8 service nova] [instance: d60616bb-605e-4604-b637-56670f53159e] Received unexpected event network-vif-plugged-c8787a16-cd6d-410e-8d37-425bdad344d6 for instance with vm_state rescued and task_state unrescuing.
Aug 15 05:44:25 user nova-compute[73391]: DEBUG nova.compute.manager [req-2454e627-428a-487c-becf-e0bd150e5e70 req-811064bc-3da1-4586-8a67-bf6351d06cf8 service nova] [instance: d60616bb-605e-4604-b637-56670f53159e] Received event network-vif-unplugged-c8787a16-cd6d-410e-8d37-425bdad344d6 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:44:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2454e627-428a-487c-becf-e0bd150e5e70 req-811064bc-3da1-4586-8a67-bf6351d06cf8 service nova] Acquiring lock "d60616bb-605e-4604-b637-56670f53159e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:44:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2454e627-428a-487c-becf-e0bd150e5e70 req-811064bc-3da1-4586-8a67-bf6351d06cf8 service nova] Lock "d60616bb-605e-4604-b637-56670f53159e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:44:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2454e627-428a-487c-becf-e0bd150e5e70 req-811064bc-3da1-4586-8a67-bf6351d06cf8 service nova] Lock "d60616bb-605e-4604-b637-56670f53159e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:44:25 user nova-compute[73391]: DEBUG nova.compute.manager [req-2454e627-428a-487c-becf-e0bd150e5e70 req-811064bc-3da1-4586-8a67-bf6351d06cf8 service nova] [instance: d60616bb-605e-4604-b637-56670f53159e] No waiting events found dispatching network-vif-unplugged-c8787a16-cd6d-410e-8d37-425bdad344d6 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:44:25 user nova-compute[73391]: WARNING nova.compute.manager [req-2454e627-428a-487c-becf-e0bd150e5e70 req-811064bc-3da1-4586-8a67-bf6351d06cf8 service nova] [instance: d60616bb-605e-4604-b637-56670f53159e] Received unexpected event network-vif-unplugged-c8787a16-cd6d-410e-8d37-425bdad344d6 for instance with vm_state rescued and task_state unrescuing.
Aug 15 05:44:25 user nova-compute[73391]: DEBUG nova.compute.manager [req-2454e627-428a-487c-becf-e0bd150e5e70 req-811064bc-3da1-4586-8a67-bf6351d06cf8 service nova] [instance: d60616bb-605e-4604-b637-56670f53159e] Received event network-vif-plugged-c8787a16-cd6d-410e-8d37-425bdad344d6 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:44:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2454e627-428a-487c-becf-e0bd150e5e70 req-811064bc-3da1-4586-8a67-bf6351d06cf8 service nova] Acquiring lock "d60616bb-605e-4604-b637-56670f53159e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:44:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2454e627-428a-487c-becf-e0bd150e5e70 req-811064bc-3da1-4586-8a67-bf6351d06cf8 service nova] Lock "d60616bb-605e-4604-b637-56670f53159e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:44:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2454e627-428a-487c-becf-e0bd150e5e70 req-811064bc-3da1-4586-8a67-bf6351d06cf8 service nova] Lock "d60616bb-605e-4604-b637-56670f53159e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:44:25 user nova-compute[73391]: DEBUG nova.compute.manager [req-2454e627-428a-487c-becf-e0bd150e5e70 req-811064bc-3da1-4586-8a67-bf6351d06cf8 service nova] [instance: d60616bb-605e-4604-b637-56670f53159e] No waiting events found dispatching network-vif-plugged-c8787a16-cd6d-410e-8d37-425bdad344d6 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:44:25 user nova-compute[73391]: WARNING nova.compute.manager [req-2454e627-428a-487c-becf-e0bd150e5e70 req-811064bc-3da1-4586-8a67-bf6351d06cf8 service nova] [instance: d60616bb-605e-4604-b637-56670f53159e] Received unexpected event network-vif-plugged-c8787a16-cd6d-410e-8d37-425bdad344d6 for instance with vm_state rescued and task_state unrescuing.
Aug 15 05:44:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue --force-share --output=json" returned: 0 in 0.223s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:44:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:44:25 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:44:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:44:25 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:44:27 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:27 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Removed pending event for d60616bb-605e-4604-b637-56670f53159e due to event {{(pid=73391) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 05:44:27 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078267.6115708, d60616bb-605e-4604-b637-56670f53159e => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:44:27 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: d60616bb-605e-4604-b637-56670f53159e] VM Resumed (Lifecycle Event)
Aug 15 05:44:27 user nova-compute[73391]: DEBUG nova.compute.manager [None req-a480caae-dd0d-46d1-bf93-682049564d85 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG nova.compute.manager [req-0a4ed544-e84f-44eb-966e-c8b1a2e384d0 req-1bf794db-485b-4bba-a491-abfae9920303 service nova] [instance: d60616bb-605e-4604-b637-56670f53159e] Received event network-vif-plugged-c8787a16-cd6d-410e-8d37-425bdad344d6 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-0a4ed544-e84f-44eb-966e-c8b1a2e384d0 req-1bf794db-485b-4bba-a491-abfae9920303 service nova] Acquiring lock "d60616bb-605e-4604-b637-56670f53159e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-0a4ed544-e84f-44eb-966e-c8b1a2e384d0 req-1bf794db-485b-4bba-a491-abfae9920303 service nova] Lock "d60616bb-605e-4604-b637-56670f53159e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-0a4ed544-e84f-44eb-966e-c8b1a2e384d0 req-1bf794db-485b-4bba-a491-abfae9920303 service nova] Lock "d60616bb-605e-4604-b637-56670f53159e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG nova.compute.manager [req-0a4ed544-e84f-44eb-966e-c8b1a2e384d0 req-1bf794db-485b-4bba-a491-abfae9920303 service nova] [instance: d60616bb-605e-4604-b637-56670f53159e] No waiting events found dispatching network-vif-plugged-c8787a16-cd6d-410e-8d37-425bdad344d6 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:44:28 user nova-compute[73391]: WARNING nova.compute.manager [req-0a4ed544-e84f-44eb-966e-c8b1a2e384d0 req-1bf794db-485b-4bba-a491-abfae9920303 service nova] [instance: d60616bb-605e-4604-b637-56670f53159e] Received unexpected event network-vif-plugged-c8787a16-cd6d-410e-8d37-425bdad344d6 for instance with vm_state rescued and task_state unrescuing.
Aug 15 05:44:28 user nova-compute[73391]: DEBUG nova.compute.manager [req-0a4ed544-e84f-44eb-966e-c8b1a2e384d0 req-1bf794db-485b-4bba-a491-abfae9920303 service nova] [instance: d60616bb-605e-4604-b637-56670f53159e] Received event network-vif-plugged-c8787a16-cd6d-410e-8d37-425bdad344d6 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-0a4ed544-e84f-44eb-966e-c8b1a2e384d0 req-1bf794db-485b-4bba-a491-abfae9920303 service nova] Acquiring lock "d60616bb-605e-4604-b637-56670f53159e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-0a4ed544-e84f-44eb-966e-c8b1a2e384d0 req-1bf794db-485b-4bba-a491-abfae9920303 service nova] Lock "d60616bb-605e-4604-b637-56670f53159e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-0a4ed544-e84f-44eb-966e-c8b1a2e384d0 req-1bf794db-485b-4bba-a491-abfae9920303 service nova] Lock "d60616bb-605e-4604-b637-56670f53159e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG nova.compute.manager [req-0a4ed544-e84f-44eb-966e-c8b1a2e384d0 req-1bf794db-485b-4bba-a491-abfae9920303 service nova] [instance: d60616bb-605e-4604-b637-56670f53159e] No waiting events found dispatching network-vif-plugged-c8787a16-cd6d-410e-8d37-425bdad344d6 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:44:28 user nova-compute[73391]: WARNING nova.compute.manager [req-0a4ed544-e84f-44eb-966e-c8b1a2e384d0 req-1bf794db-485b-4bba-a491-abfae9920303 service nova] [instance: d60616bb-605e-4604-b637-56670f53159e] Received unexpected event network-vif-plugged-c8787a16-cd6d-410e-8d37-425bdad344d6 for instance with vm_state rescued and task_state unrescuing.
Aug 15 05:44:28 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: d60616bb-605e-4604-b637-56670f53159e] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:44:28 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:44:28 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:44:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Hypervisor/Node resource view: name=user free_ram=7022MB free_disk=24.983539581298828GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: d60616bb-605e-4604-b637-56670f53159e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:44:28 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: d60616bb-605e-4604-b637-56670f53159e] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 15 05:44:28 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078267.6123228, d60616bb-605e-4604-b637-56670f53159e => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:44:28 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: d60616bb-605e-4604-b637-56670f53159e] VM Started (Lifecycle Event)
Aug 15 05:44:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Starting finish_revert_migration {{(pid=73391) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Start _get_guest_xml network_info=[{"id": "3e0cb01d-a82e-44d3-b8dd-723819ec6ffa", "address": "fa:16:3e:89:dc:93", "network": {"id": "11023df3-666d-44e5-955d-cc1fbde6972e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1848872765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "666428ad8c2f4f9cadcd180e498223f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0cb01d-a8", "ovs_interfaceid": "3e0cb01d-a82e-44d3-b8dd-723819ec6ffa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '191b1dad-305e-4d1c-9b15-515ec59a3278'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IWGBEMQx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '8991b32e-6c4b-4c66-a320-e734061f49ee', 'attached_at': '2023-08-15T05:44:28.000000', 'detached_at': '', 'volume_id': '5ac82e4f-fe64-4376-afab-0fe6cbb31bcf', 'serial': '5ac82e4f-fe64-4376-afab-0fe6cbb31bcf'}, 'attachment_id': '5ab47314-c30e-4f50-9b2d-167e874f2b58', 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:44:28 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:44:28 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:44:28 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: d60616bb-605e-4604-b637-56670f53159e] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: d60616bb-605e-4604-b637-56670f53159e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG nova.objects.instance [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8991b32e-6c4b-4c66-a320-e734061f49ee {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Applying migration context for instance dc657d66-c3f8-44e5-b30e-3d79e586a8f3 as it has an incoming, in-progress migration 68dd821e-9200-4f15-90ac-3b30802dd875. Migration status is finished {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Aug 15 05:44:28 user nova-compute[73391]: INFO nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Updating resource usage from migration 68dd821e-9200-4f15-90ac-3b30802dd875
Aug 15 05:44:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IWGBEMQx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:44:28 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:44:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:44:28 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:44:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:44:28 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 05:44:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 8f08782b-f793-415e-b0d6-5caad1c3d426 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 6ac9d5dc-56be-402f-b9d4-3327bdfd9220 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 6358e825-5705-45d6-86b6-3aacfa5a9bbb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance fee43642-30e8-451b-919c-aca4cd4c3f81 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 730890c6-6999-4a0f-b80c-e4745bff99ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 8ff2da51-5bfd-4cdc-8cef-330cdef93d97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance d60616bb-605e-4604-b637-56670f53159e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 8991b32e-6c4b-4c66-a320-e734061f49ee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Migration 68dd821e-9200-4f15-90ac-3b30802dd875 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance dc657d66-c3f8-44e5-b30e-3d79e586a8f3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance e8775490-2a9e-44ac-aad7-9450afa4c295 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance c5d5343f-b8f4-46b7-92fc-66452212192b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[72cd4762-ecc8-4db3-af40-fdcbafc13208]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 05:44:28 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96b5033-720c-402a-a6f9-6b8fd0ad3a5c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf] added
Aug 15 05:44:28 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39cfff1-b775-4694-b236-b7162341c7f2]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd50f9d-4787-4082-835f-e208a842ed71]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IWGBEMQx {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IWGBEMQx" returned: 0 in 0.028s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdeb5fb-7a55-4c52-bb0d-87007fd59b44]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IWGBEMQx'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6664eccf-ecaa-485d-a42f-d7871a01c30e]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[09949092-8691-4121-b903-fa1f828f4e41]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:44:28 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:44:28 user nova-compute[73391]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:44:28 user nova-compute[73391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)
Aug 15 05:44:28 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:44:28 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:44:28 user nova-compute[73391]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:44:28 user nova-compute[73391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)
Aug 15 05:44:28 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb796eb-789c-46a9-8170-c11f164f7125]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf, portal: 172.16.0.220,3260]
Aug 15 05:44:28 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf, portal: 172.16.0.220,3260] successful.
Aug 15 05:44:28 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ffcb0d-b00f-4a30-b927-3fbc65690cc8]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[691e95ef-4461-456c-9d32-58e8aea4f5e1]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:44:28 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:44:28 user nova-compute[73391]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:44:28 user nova-compute[73391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)
Aug 15 05:44:28 user nova-compute[73391]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)
Aug 15 05:44:28 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:44:28 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:44:28 user nova-compute[73391]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:44:28 user nova-compute[73391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)
Aug 15 05:44:28 user nova-compute[73391]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)
Aug 15 05:44:28 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.360s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c888c33c-ca00-4259-801c-041f6603f9a0]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: None {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Compute_service record updated for user:user {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 05:44:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.716s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:44:29 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:29 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:44:29 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IWGBEMQx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 05:44:29 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:44:29 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '26262653465356137', 'path': '/dev/sdb'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:44:29 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262653465356137', 'path': '/dev/sdb'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 05:44:29 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:38:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-845602872',display_name='tempest-ServerActionsTestOtherB-server-845602872',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-845602872',id=27,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCi9vkvcVQEbXmigHztv9LlDFuCnimhR/vNlP8kykjc1U9WtN+KwlQqW0CDVIHXojOPVLOC+TJRapzFB5aO8vw7udjudZbg8fWCON+jsBrd+VE/0PuYaOBBV7W22/iAKjg==',key_name='tempest-keypair-1001766799',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:42:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='666428ad8c2f4f9cadcd180e498223f7',ramdisk_id='',reservation_id='r-sady4pim',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-762584882',owner_user_name='tempest-ServerActionsTestOtherB-762584882-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:44:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b43158637026445496cc0030b6ce49a2',uuid=8991b32e-6c4b-4c66-a320-e734061f49ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "3e0cb01d-a82e-44d3-b8dd-723819ec6ffa", "address": "fa:16:3e:89:dc:93", "network": {"id": "11023df3-666d-44e5-955d-cc1fbde6972e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1848872765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "666428ad8c2f4f9cadcd180e498223f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0cb01d-a8", "ovs_interfaceid": "3e0cb01d-a82e-44d3-b8dd-723819ec6ffa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:44:29 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Converting VIF {"id": "3e0cb01d-a82e-44d3-b8dd-723819ec6ffa", "address": "fa:16:3e:89:dc:93", "network": {"id": "11023df3-666d-44e5-955d-cc1fbde6972e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1848872765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "666428ad8c2f4f9cadcd180e498223f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0cb01d-a8", "ovs_interfaceid": "3e0cb01d-a82e-44d3-b8dd-723819ec6ffa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:44:29 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:dc:93,bridge_name='br-int',has_traffic_filtering=True,id=3e0cb01d-a82e-44d3-b8dd-723819ec6ffa,network=Network(11023df3-666d-44e5-955d-cc1fbde6972e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e0cb01d-a8') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:44:29 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:44:29 user nova-compute[73391]:   <uuid>8991b32e-6c4b-4c66-a320-e734061f49ee</uuid>
Aug 15 05:44:29 user nova-compute[73391]:   <name>instance-0000001b</name>
Aug 15 05:44:29 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:44:29 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:44:29 user nova-compute[73391]:   <metadata>
Aug 15 05:44:29 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:44:29 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:44:29 user nova-compute[73391]:       <nova:name>tempest-ServerActionsTestOtherB-server-845602872</nova:name>
Aug 15 05:44:29 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:44:28</nova:creationTime>
Aug 15 05:44:29 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:44:29 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:44:29 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:44:29 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:44:29 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:44:29 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:44:29 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:44:29 user nova-compute[73391]:       <nova:owner>
Aug 15 05:44:29 user nova-compute[73391]:         <nova:user uuid="b43158637026445496cc0030b6ce49a2">tempest-ServerActionsTestOtherB-762584882-project-member</nova:user>
Aug 15 05:44:29 user nova-compute[73391]:         <nova:project uuid="666428ad8c2f4f9cadcd180e498223f7">tempest-ServerActionsTestOtherB-762584882</nova:project>
Aug 15 05:44:29 user nova-compute[73391]:       </nova:owner>
Aug 15 05:44:29 user nova-compute[73391]:       <nova:root type="image" uuid="191b1dad-305e-4d1c-9b15-515ec59a3278"/>
Aug 15 05:44:29 user nova-compute[73391]:       <nova:ports>
Aug 15 05:44:29 user nova-compute[73391]:         <nova:port uuid="3e0cb01d-a82e-44d3-b8dd-723819ec6ffa">
Aug 15 05:44:29 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Aug 15 05:44:29 user nova-compute[73391]:         </nova:port>
Aug 15 05:44:29 user nova-compute[73391]:       </nova:ports>
Aug 15 05:44:29 user nova-compute[73391]:     </nova:instance>
Aug 15 05:44:29 user nova-compute[73391]:   </metadata>
Aug 15 05:44:29 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:44:29 user nova-compute[73391]:     <system>
Aug 15 05:44:29 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:44:29 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:44:29 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:44:29 user nova-compute[73391]:       <entry name="serial">8991b32e-6c4b-4c66-a320-e734061f49ee</entry>
Aug 15 05:44:29 user nova-compute[73391]:       <entry name="uuid">8991b32e-6c4b-4c66-a320-e734061f49ee</entry>
Aug 15 05:44:29 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:44:29 user nova-compute[73391]:     </system>
Aug 15 05:44:29 user nova-compute[73391]:   </sysinfo>
Aug 15 05:44:29 user nova-compute[73391]:   <os>
Aug 15 05:44:29 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:44:29 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:44:29 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:44:29 user nova-compute[73391]:   </os>
Aug 15 05:44:29 user nova-compute[73391]:   <features>
Aug 15 05:44:29 user nova-compute[73391]:     <acpi/>
Aug 15 05:44:29 user nova-compute[73391]:     <apic/>
Aug 15 05:44:29 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:44:29 user nova-compute[73391]:   </features>
Aug 15 05:44:29 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:44:29 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:44:29 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:44:29 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:44:29 user nova-compute[73391]:   </clock>
Aug 15 05:44:29 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:44:29 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:44:29 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:44:29 user nova-compute[73391]:   </cpu>
Aug 15 05:44:29 user nova-compute[73391]:   <devices>
Aug 15 05:44:29 user nova-compute[73391]:     <disk type="file" device="disk">
Aug 15 05:44:29 user nova-compute[73391]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 05:44:29 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/disk"/>
Aug 15 05:44:29 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:44:29 user nova-compute[73391]:     </disk>
Aug 15 05:44:29 user nova-compute[73391]:     <disk type="block" device="disk">
Aug 15 05:44:29 user nova-compute[73391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:44:29 user nova-compute[73391]:       <source dev="/dev/sdb"/>
Aug 15 05:44:29 user nova-compute[73391]:       <target dev="vdb" bus="virtio"/>
Aug 15 05:44:29 user nova-compute[73391]:       <serial>5ac82e4f-fe64-4376-afab-0fe6cbb31bcf</serial>
Aug 15 05:44:29 user nova-compute[73391]:     </disk>
Aug 15 05:44:29 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:44:29 user nova-compute[73391]:       <mac address="fa:16:3e:89:dc:93"/>
Aug 15 05:44:29 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:44:29 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:44:29 user nova-compute[73391]:       <target dev="tap3e0cb01d-a8"/>
Aug 15 05:44:29 user nova-compute[73391]:     </interface>
Aug 15 05:44:29 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:44:29 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/console.log" append="off"/>
Aug 15 05:44:29 user nova-compute[73391]:     </serial>
Aug 15 05:44:29 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:44:29 user nova-compute[73391]:     <video>
Aug 15 05:44:29 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:44:29 user nova-compute[73391]:     </video>
Aug 15 05:44:29 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:44:29 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:44:29 user nova-compute[73391]:     </rng>
Aug 15 05:44:29 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:44:29 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:44:29 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:44:29 user nova-compute[73391]:     </memballoon>
Aug 15 05:44:29 user nova-compute[73391]:   </devices>
Aug 15 05:44:29 user nova-compute[73391]: </domain>
Aug 15 05:44:29 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:44:29 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:38:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-845602872',display_name='tempest-ServerActionsTestOtherB-server-845602872',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-845602872',id=27,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCi9vkvcVQEbXmigHztv9LlDFuCnimhR/vNlP8kykjc1U9WtN+KwlQqW0CDVIHXojOPVLOC+TJRapzFB5aO8vw7udjudZbg8fWCON+jsBrd+VE/0PuYaOBBV7W22/iAKjg==',key_name='tempest-keypair-1001766799',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:42:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='666428ad8c2f4f9cadcd180e498223f7',ramdisk_id='',reservation_id='r-sady4pim',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-762584882',owner_user_name='tempest-ServerActionsTestOtherB-762584882-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:44:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b43158637026445496cc0030b6ce49a2',uuid=8991b32e-6c4b-4c66-a320-e734061f49ee,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "3e0cb01d-a82e-44d3-b8dd-723819ec6ffa", "address": "fa:16:3e:89:dc:93", "network": {"id": "11023df3-666d-44e5-955d-cc1fbde6972e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1848872765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "666428ad8c2f4f9cadcd180e498223f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0cb01d-a8", "ovs_interfaceid": "3e0cb01d-a82e-44d3-b8dd-723819ec6ffa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:44:29 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Converting VIF {"id": "3e0cb01d-a82e-44d3-b8dd-723819ec6ffa", "address": "fa:16:3e:89:dc:93", "network": {"id": "11023df3-666d-44e5-955d-cc1fbde6972e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1848872765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "666428ad8c2f4f9cadcd180e498223f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0cb01d-a8", "ovs_interfaceid": "3e0cb01d-a82e-44d3-b8dd-723819ec6ffa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:44:29 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:dc:93,bridge_name='br-int',has_traffic_filtering=True,id=3e0cb01d-a82e-44d3-b8dd-723819ec6ffa,network=Network(11023df3-666d-44e5-955d-cc1fbde6972e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e0cb01d-a8') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:44:29 user nova-compute[73391]: DEBUG os_vif [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:dc:93,bridge_name='br-int',has_traffic_filtering=True,id=3e0cb01d-a82e-44d3-b8dd-723819ec6ffa,network=Network(11023df3-666d-44e5-955d-cc1fbde6972e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e0cb01d-a8') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:44:29 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:29 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:44:29 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:44:29 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:29 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e0cb01d-a8, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:44:29 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3e0cb01d-a8, col_values=(('external_ids', {'iface-id': '3e0cb01d-a82e-44d3-b8dd-723819ec6ffa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:dc:93', 'vm-uuid': '8991b32e-6c4b-4c66-a320-e734061f49ee'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:44:29 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:29 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:44:29 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:29 user nova-compute[73391]: INFO os_vif [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:dc:93,bridge_name='br-int',has_traffic_filtering=True,id=3e0cb01d-a82e-44d3-b8dd-723819ec6ffa,network=Network(11023df3-666d-44e5-955d-cc1fbde6972e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e0cb01d-a8')
Aug 15 05:44:30 user nova-compute[73391]: INFO nova.compute.manager [None req-084656f0-272d-4416-b17c-6cec37ab359f tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Unrescuing
Aug 15 05:44:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-084656f0-272d-4416-b17c-6cec37ab359f tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Acquiring lock "refresh_cache-730890c6-6999-4a0f-b80c-e4745bff99ab" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:44:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-084656f0-272d-4416-b17c-6cec37ab359f tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Acquired lock "refresh_cache-730890c6-6999-4a0f-b80c-e4745bff99ab" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:44:30 user nova-compute[73391]: DEBUG nova.network.neutron [None req-084656f0-272d-4416-b17c-6cec37ab359f tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:44:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:31 user nova-compute[73391]: DEBUG nova.compute.manager [req-aa7e802a-65e3-4063-974f-a23446df3ce1 req-4d9ffe12-0fab-4399-948c-2262ce616156 service nova] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Received event network-vif-plugged-3e0cb01d-a82e-44d3-b8dd-723819ec6ffa {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:44:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-aa7e802a-65e3-4063-974f-a23446df3ce1 req-4d9ffe12-0fab-4399-948c-2262ce616156 service nova] Acquiring lock "8991b32e-6c4b-4c66-a320-e734061f49ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:44:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-aa7e802a-65e3-4063-974f-a23446df3ce1 req-4d9ffe12-0fab-4399-948c-2262ce616156 service nova] Lock "8991b32e-6c4b-4c66-a320-e734061f49ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:44:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-aa7e802a-65e3-4063-974f-a23446df3ce1 req-4d9ffe12-0fab-4399-948c-2262ce616156 service nova] Lock "8991b32e-6c4b-4c66-a320-e734061f49ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:44:31 user nova-compute[73391]: DEBUG nova.compute.manager [req-aa7e802a-65e3-4063-974f-a23446df3ce1 req-4d9ffe12-0fab-4399-948c-2262ce616156 service nova] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] No waiting events found dispatching network-vif-plugged-3e0cb01d-a82e-44d3-b8dd-723819ec6ffa {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:44:31 user nova-compute[73391]: WARNING nova.compute.manager [req-aa7e802a-65e3-4063-974f-a23446df3ce1 req-4d9ffe12-0fab-4399-948c-2262ce616156 service nova] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Received unexpected event network-vif-plugged-3e0cb01d-a82e-44d3-b8dd-723819ec6ffa for instance with vm_state resized and task_state resize_reverting.
Aug 15 05:44:31 user nova-compute[73391]: DEBUG nova.network.neutron [None req-084656f0-272d-4416-b17c-6cec37ab359f tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Updating instance_info_cache with network_info: [{"id": "f598ee19-8c81-4cf2-a88d-8221516eb1cf", "address": "fa:16:3e:2e:da:40", "network": {"id": "bec69c6a-b2cb-4b0a-ba6e-ae6dae099818", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7da9448cc34b609120da564a01dba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf598ee19-8c", "ovs_interfaceid": "f598ee19-8c81-4cf2-a88d-8221516eb1cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:44:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-084656f0-272d-4416-b17c-6cec37ab359f tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Releasing lock "refresh_cache-730890c6-6999-4a0f-b80c-e4745bff99ab" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:44:31 user nova-compute[73391]: DEBUG nova.objects.instance [None req-084656f0-272d-4416-b17c-6cec37ab359f tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lazy-loading 'flavor' on Instance uuid 730890c6-6999-4a0f-b80c-e4745bff99ab {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:44:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:32 user nova-compute[73391]: DEBUG nova.compute.manager [req-92061072-dbbc-48f3-9295-193a37cd3151 req-668fab6c-4d15-46c8-8603-cd9ecddb0827 service nova] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Received event network-vif-unplugged-f598ee19-8c81-4cf2-a88d-8221516eb1cf {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:44:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-92061072-dbbc-48f3-9295-193a37cd3151 req-668fab6c-4d15-46c8-8603-cd9ecddb0827 service nova] Acquiring lock "730890c6-6999-4a0f-b80c-e4745bff99ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:44:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-92061072-dbbc-48f3-9295-193a37cd3151 req-668fab6c-4d15-46c8-8603-cd9ecddb0827 service nova] Lock "730890c6-6999-4a0f-b80c-e4745bff99ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:44:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-92061072-dbbc-48f3-9295-193a37cd3151 req-668fab6c-4d15-46c8-8603-cd9ecddb0827 service nova] Lock "730890c6-6999-4a0f-b80c-e4745bff99ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:44:32 user nova-compute[73391]: DEBUG nova.compute.manager [req-92061072-dbbc-48f3-9295-193a37cd3151 req-668fab6c-4d15-46c8-8603-cd9ecddb0827 service nova] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] No waiting events found dispatching network-vif-unplugged-f598ee19-8c81-4cf2-a88d-8221516eb1cf {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:44:32 user nova-compute[73391]: WARNING nova.compute.manager [req-92061072-dbbc-48f3-9295-193a37cd3151 req-668fab6c-4d15-46c8-8603-cd9ecddb0827 service nova] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Received unexpected event network-vif-unplugged-f598ee19-8c81-4cf2-a88d-8221516eb1cf for instance with vm_state rescued and task_state unrescuing.
Aug 15 05:44:32 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:32 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:32 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:32 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:32 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:32 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Instance destroyed successfully.
Aug 15 05:44:32 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:32 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:33 user nova-compute[73391]: DEBUG nova.compute.manager [req-95b281e0-af0f-43a4-bea3-9eecf3dbdc1e req-2810d1cb-3dbe-4375-aab8-cad4c7af93f4 service nova] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Received event network-vif-plugged-3e0cb01d-a82e-44d3-b8dd-723819ec6ffa {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:44:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-95b281e0-af0f-43a4-bea3-9eecf3dbdc1e req-2810d1cb-3dbe-4375-aab8-cad4c7af93f4 service nova] Acquiring lock "8991b32e-6c4b-4c66-a320-e734061f49ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:44:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-95b281e0-af0f-43a4-bea3-9eecf3dbdc1e req-2810d1cb-3dbe-4375-aab8-cad4c7af93f4 service nova] Lock "8991b32e-6c4b-4c66-a320-e734061f49ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:44:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-95b281e0-af0f-43a4-bea3-9eecf3dbdc1e req-2810d1cb-3dbe-4375-aab8-cad4c7af93f4 service nova] Lock "8991b32e-6c4b-4c66-a320-e734061f49ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:44:33 user nova-compute[73391]: DEBUG nova.compute.manager [req-95b281e0-af0f-43a4-bea3-9eecf3dbdc1e req-2810d1cb-3dbe-4375-aab8-cad4c7af93f4 service nova] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] No waiting events found dispatching network-vif-plugged-3e0cb01d-a82e-44d3-b8dd-723819ec6ffa {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:44:33 user nova-compute[73391]: WARNING nova.compute.manager [req-95b281e0-af0f-43a4-bea3-9eecf3dbdc1e req-2810d1cb-3dbe-4375-aab8-cad4c7af93f4 service nova] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Received unexpected event network-vif-plugged-3e0cb01d-a82e-44d3-b8dd-723819ec6ffa for instance with vm_state resized and task_state resize_reverting.
Aug 15 05:44:33 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:44:33 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:44:33 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Starting heal instance info cache {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 05:44:33 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078273.8378212, 8991b32e-6c4b-4c66-a320-e734061f49ee => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:44:33 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] VM Resumed (Lifecycle Event)
Aug 15 05:44:33 user nova-compute[73391]: DEBUG nova.compute.manager [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:44:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "refresh_cache-b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:44:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquired lock "refresh_cache-b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:44:33 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Forcefully refreshing network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 05:44:33 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:44:33 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Instance running successfully.
Aug 15 05:44:33 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] finish_revert_migration finished successfully. {{(pid=73391) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Aug 15 05:44:33 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:44:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:33 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 15 05:44:33 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078273.840191, 8991b32e-6c4b-4c66-a320-e734061f49ee => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:44:33 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] VM Started (Lifecycle Event)
Aug 15 05:44:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:33 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:44:34 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:44:34 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Aug 15 05:44:34 user nova-compute[73391]: DEBUG nova.compute.manager [req-e13c6663-db77-4f93-813a-0d4a4c385818 req-0bf2d45b-50e5-45ad-b9ee-548dd32712d5 service nova] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Received event network-vif-plugged-f598ee19-8c81-4cf2-a88d-8221516eb1cf {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:44:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e13c6663-db77-4f93-813a-0d4a4c385818 req-0bf2d45b-50e5-45ad-b9ee-548dd32712d5 service nova] Acquiring lock "730890c6-6999-4a0f-b80c-e4745bff99ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:44:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e13c6663-db77-4f93-813a-0d4a4c385818 req-0bf2d45b-50e5-45ad-b9ee-548dd32712d5 service nova] Lock "730890c6-6999-4a0f-b80c-e4745bff99ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:44:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e13c6663-db77-4f93-813a-0d4a4c385818 req-0bf2d45b-50e5-45ad-b9ee-548dd32712d5 service nova] Lock "730890c6-6999-4a0f-b80c-e4745bff99ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:44:34 user nova-compute[73391]: DEBUG nova.compute.manager [req-e13c6663-db77-4f93-813a-0d4a4c385818 req-0bf2d45b-50e5-45ad-b9ee-548dd32712d5 service nova] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] No waiting events found dispatching network-vif-plugged-f598ee19-8c81-4cf2-a88d-8221516eb1cf {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:44:34 user nova-compute[73391]: WARNING nova.compute.manager [req-e13c6663-db77-4f93-813a-0d4a4c385818 req-0bf2d45b-50e5-45ad-b9ee-548dd32712d5 service nova] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Received unexpected event network-vif-plugged-f598ee19-8c81-4cf2-a88d-8221516eb1cf for instance with vm_state rescued and task_state unrescuing.
Aug 15 05:44:34 user nova-compute[73391]: DEBUG nova.compute.manager [req-e13c6663-db77-4f93-813a-0d4a4c385818 req-0bf2d45b-50e5-45ad-b9ee-548dd32712d5 service nova] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Received event network-vif-plugged-f598ee19-8c81-4cf2-a88d-8221516eb1cf {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:44:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e13c6663-db77-4f93-813a-0d4a4c385818 req-0bf2d45b-50e5-45ad-b9ee-548dd32712d5 service nova] Acquiring lock "730890c6-6999-4a0f-b80c-e4745bff99ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:44:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e13c6663-db77-4f93-813a-0d4a4c385818 req-0bf2d45b-50e5-45ad-b9ee-548dd32712d5 service nova] Lock "730890c6-6999-4a0f-b80c-e4745bff99ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:44:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e13c6663-db77-4f93-813a-0d4a4c385818 req-0bf2d45b-50e5-45ad-b9ee-548dd32712d5 service nova] Lock "730890c6-6999-4a0f-b80c-e4745bff99ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:44:34 user nova-compute[73391]: DEBUG nova.compute.manager [req-e13c6663-db77-4f93-813a-0d4a4c385818 req-0bf2d45b-50e5-45ad-b9ee-548dd32712d5 service nova] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] No waiting events found dispatching network-vif-plugged-f598ee19-8c81-4cf2-a88d-8221516eb1cf {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:44:34 user nova-compute[73391]: WARNING nova.compute.manager [req-e13c6663-db77-4f93-813a-0d4a4c385818 req-0bf2d45b-50e5-45ad-b9ee-548dd32712d5 service nova] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Received unexpected event network-vif-plugged-f598ee19-8c81-4cf2-a88d-8221516eb1cf for instance with vm_state rescued and task_state unrescuing.
Aug 15 05:44:34 user nova-compute[73391]: DEBUG nova.compute.manager [req-e13c6663-db77-4f93-813a-0d4a4c385818 req-0bf2d45b-50e5-45ad-b9ee-548dd32712d5 service nova] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Received event network-vif-plugged-f598ee19-8c81-4cf2-a88d-8221516eb1cf {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:44:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e13c6663-db77-4f93-813a-0d4a4c385818 req-0bf2d45b-50e5-45ad-b9ee-548dd32712d5 service nova] Acquiring lock "730890c6-6999-4a0f-b80c-e4745bff99ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:44:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e13c6663-db77-4f93-813a-0d4a4c385818 req-0bf2d45b-50e5-45ad-b9ee-548dd32712d5 service nova] Lock "730890c6-6999-4a0f-b80c-e4745bff99ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:44:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e13c6663-db77-4f93-813a-0d4a4c385818 req-0bf2d45b-50e5-45ad-b9ee-548dd32712d5 service nova] Lock "730890c6-6999-4a0f-b80c-e4745bff99ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:44:34 user nova-compute[73391]: DEBUG nova.compute.manager [req-e13c6663-db77-4f93-813a-0d4a4c385818 req-0bf2d45b-50e5-45ad-b9ee-548dd32712d5 service nova] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] No waiting events found dispatching network-vif-plugged-f598ee19-8c81-4cf2-a88d-8221516eb1cf {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:44:34 user nova-compute[73391]: WARNING nova.compute.manager [req-e13c6663-db77-4f93-813a-0d4a4c385818 req-0bf2d45b-50e5-45ad-b9ee-548dd32712d5 service nova] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Received unexpected event network-vif-plugged-f598ee19-8c81-4cf2-a88d-8221516eb1cf for instance with vm_state rescued and task_state unrescuing.
Aug 15 05:44:34 user nova-compute[73391]: DEBUG nova.compute.manager [req-e13c6663-db77-4f93-813a-0d4a4c385818 req-0bf2d45b-50e5-45ad-b9ee-548dd32712d5 service nova] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Received event network-vif-unplugged-f598ee19-8c81-4cf2-a88d-8221516eb1cf {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:44:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e13c6663-db77-4f93-813a-0d4a4c385818 req-0bf2d45b-50e5-45ad-b9ee-548dd32712d5 service nova] Acquiring lock "730890c6-6999-4a0f-b80c-e4745bff99ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:44:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e13c6663-db77-4f93-813a-0d4a4c385818 req-0bf2d45b-50e5-45ad-b9ee-548dd32712d5 service nova] Lock "730890c6-6999-4a0f-b80c-e4745bff99ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:44:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e13c6663-db77-4f93-813a-0d4a4c385818 req-0bf2d45b-50e5-45ad-b9ee-548dd32712d5 service nova] Lock "730890c6-6999-4a0f-b80c-e4745bff99ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:44:34 user nova-compute[73391]: DEBUG nova.compute.manager [req-e13c6663-db77-4f93-813a-0d4a4c385818 req-0bf2d45b-50e5-45ad-b9ee-548dd32712d5 service nova] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] No waiting events found dispatching network-vif-unplugged-f598ee19-8c81-4cf2-a88d-8221516eb1cf {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:44:34 user nova-compute[73391]: WARNING nova.compute.manager [req-e13c6663-db77-4f93-813a-0d4a4c385818 req-0bf2d45b-50e5-45ad-b9ee-548dd32712d5 service nova] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Received unexpected event network-vif-unplugged-f598ee19-8c81-4cf2-a88d-8221516eb1cf for instance with vm_state rescued and task_state unrescuing.
Aug 15 05:44:34 user nova-compute[73391]: DEBUG nova.compute.manager [req-e13c6663-db77-4f93-813a-0d4a4c385818 req-0bf2d45b-50e5-45ad-b9ee-548dd32712d5 service nova] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Received event network-vif-plugged-f598ee19-8c81-4cf2-a88d-8221516eb1cf {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:44:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e13c6663-db77-4f93-813a-0d4a4c385818 req-0bf2d45b-50e5-45ad-b9ee-548dd32712d5 service nova] Acquiring lock "730890c6-6999-4a0f-b80c-e4745bff99ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:44:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e13c6663-db77-4f93-813a-0d4a4c385818 req-0bf2d45b-50e5-45ad-b9ee-548dd32712d5 service nova] Lock "730890c6-6999-4a0f-b80c-e4745bff99ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:44:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e13c6663-db77-4f93-813a-0d4a4c385818 req-0bf2d45b-50e5-45ad-b9ee-548dd32712d5 service nova] Lock "730890c6-6999-4a0f-b80c-e4745bff99ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:44:34 user nova-compute[73391]: DEBUG nova.compute.manager [req-e13c6663-db77-4f93-813a-0d4a4c385818 req-0bf2d45b-50e5-45ad-b9ee-548dd32712d5 service nova] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] No waiting events found dispatching network-vif-plugged-f598ee19-8c81-4cf2-a88d-8221516eb1cf {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:44:34 user nova-compute[73391]: WARNING nova.compute.manager [req-e13c6663-db77-4f93-813a-0d4a4c385818 req-0bf2d45b-50e5-45ad-b9ee-548dd32712d5 service nova] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Received unexpected event network-vif-plugged-f598ee19-8c81-4cf2-a88d-8221516eb1cf for instance with vm_state rescued and task_state unrescuing.
Aug 15 05:44:34 user nova-compute[73391]: INFO nova.compute.manager [None req-36819b25-c9d0-4e9d-a68c-b193b823e418 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Updating instance to original state: 'active'
Aug 15 05:44:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:34 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Updating instance_info_cache with network_info: [{"id": "662afb36-6d3a-415d-bc25-d319b7d5cf1a", "address": "fa:16:3e:d5:32:d3", "network": {"id": "70d88082-aea7-48bb-abb4-d77d264aaf01", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b9acbe11654053bb905e7c92558a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap662afb36-6d", "ovs_interfaceid": "662afb36-6d3a-415d-bc25-d319b7d5cf1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:44:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Releasing lock "refresh_cache-b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:44:34 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Updated the network info_cache for instance {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 05:44:34 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:44:34 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:44:34 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:44:34 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 05:44:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:36 user nova-compute[73391]: DEBUG nova.compute.manager [req-5aa1f059-6c00-49ce-8d57-5d1a9f779045 req-ab9231ab-0456-43be-a16d-659b98fd19e0 service nova] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Received event network-vif-plugged-f598ee19-8c81-4cf2-a88d-8221516eb1cf {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:44:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-5aa1f059-6c00-49ce-8d57-5d1a9f779045 req-ab9231ab-0456-43be-a16d-659b98fd19e0 service nova] Acquiring lock "730890c6-6999-4a0f-b80c-e4745bff99ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:44:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-5aa1f059-6c00-49ce-8d57-5d1a9f779045 req-ab9231ab-0456-43be-a16d-659b98fd19e0 service nova] Lock "730890c6-6999-4a0f-b80c-e4745bff99ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:44:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-5aa1f059-6c00-49ce-8d57-5d1a9f779045 req-ab9231ab-0456-43be-a16d-659b98fd19e0 service nova] Lock "730890c6-6999-4a0f-b80c-e4745bff99ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:44:36 user nova-compute[73391]: DEBUG nova.compute.manager [req-5aa1f059-6c00-49ce-8d57-5d1a9f779045 req-ab9231ab-0456-43be-a16d-659b98fd19e0 service nova] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] No waiting events found dispatching network-vif-plugged-f598ee19-8c81-4cf2-a88d-8221516eb1cf {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:44:36 user nova-compute[73391]: WARNING nova.compute.manager [req-5aa1f059-6c00-49ce-8d57-5d1a9f779045 req-ab9231ab-0456-43be-a16d-659b98fd19e0 service nova] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Received unexpected event network-vif-plugged-f598ee19-8c81-4cf2-a88d-8221516eb1cf for instance with vm_state rescued and task_state unrescuing.
Aug 15 05:44:36 user nova-compute[73391]: DEBUG nova.compute.manager [req-5aa1f059-6c00-49ce-8d57-5d1a9f779045 req-ab9231ab-0456-43be-a16d-659b98fd19e0 service nova] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Received event network-vif-plugged-f598ee19-8c81-4cf2-a88d-8221516eb1cf {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:44:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-5aa1f059-6c00-49ce-8d57-5d1a9f779045 req-ab9231ab-0456-43be-a16d-659b98fd19e0 service nova] Acquiring lock "730890c6-6999-4a0f-b80c-e4745bff99ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:44:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-5aa1f059-6c00-49ce-8d57-5d1a9f779045 req-ab9231ab-0456-43be-a16d-659b98fd19e0 service nova] Lock "730890c6-6999-4a0f-b80c-e4745bff99ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:44:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-5aa1f059-6c00-49ce-8d57-5d1a9f779045 req-ab9231ab-0456-43be-a16d-659b98fd19e0 service nova] Lock "730890c6-6999-4a0f-b80c-e4745bff99ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:44:36 user nova-compute[73391]: DEBUG nova.compute.manager [req-5aa1f059-6c00-49ce-8d57-5d1a9f779045 req-ab9231ab-0456-43be-a16d-659b98fd19e0 service nova] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] No waiting events found dispatching network-vif-plugged-f598ee19-8c81-4cf2-a88d-8221516eb1cf {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:44:36 user nova-compute[73391]: WARNING nova.compute.manager [req-5aa1f059-6c00-49ce-8d57-5d1a9f779045 req-ab9231ab-0456-43be-a16d-659b98fd19e0 service nova] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Received unexpected event network-vif-plugged-f598ee19-8c81-4cf2-a88d-8221516eb1cf for instance with vm_state rescued and task_state unrescuing.
Aug 15 05:44:36 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Removed pending event for 730890c6-6999-4a0f-b80c-e4745bff99ab due to event {{(pid=73391) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 05:44:36 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078276.436931, 730890c6-6999-4a0f-b80c-e4745bff99ab => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:44:36 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] VM Resumed (Lifecycle Event)
Aug 15 05:44:36 user nova-compute[73391]: DEBUG nova.compute.manager [None req-084656f0-272d-4416-b17c-6cec37ab359f tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:44:36 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:44:36 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:44:36 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 15 05:44:36 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078276.441683, 730890c6-6999-4a0f-b80c-e4745bff99ab => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:44:36 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] VM Started (Lifecycle Event)
Aug 15 05:44:36 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:44:36 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:44:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:44 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:44 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:49 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:49 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:50 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Acquiring lock "7521ed98-75ed-43eb-83a2-d41502698aec" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:44:50 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "7521ed98-75ed-43eb-83a2-d41502698aec" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:44:50 user nova-compute[73391]: DEBUG nova.compute.manager [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Starting instance... {{(pid=73391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 05:44:50 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:44:50 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:44:50 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 05:44:50 user nova-compute[73391]: INFO nova.compute.claims [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Claim successful on node user
Aug 15 05:44:51 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:44:51 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:44:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-65609eb8-112c-4da2-8314-34384d9fac2c tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquiring lock "dc657d66-c3f8-44e5-b30e-3d79e586a8f3" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:44:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-65609eb8-112c-4da2-8314-34384d9fac2c tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "dc657d66-c3f8-44e5-b30e-3d79e586a8f3" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:44:51 user nova-compute[73391]: DEBUG nova.compute.manager [None req-65609eb8-112c-4da2-8314-34384d9fac2c tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Going to confirm migration 2 {{(pid=73391) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Aug 15 05:44:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.518s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:44:51 user nova-compute[73391]: DEBUG nova.compute.manager [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Start building networks asynchronously for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 05:44:51 user nova-compute[73391]: DEBUG nova.compute.manager [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Allocating IP information in the background. {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 05:44:51 user nova-compute[73391]: DEBUG nova.network.neutron [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] allocate_for_instance() {{(pid=73391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 05:44:51 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 05:44:51 user nova-compute[73391]: DEBUG nova.compute.manager [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Start building block device mappings for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 05:44:51 user nova-compute[73391]: DEBUG nova.policy [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9779dfb796934195b206b8e0adc81ed3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae6fe94b9014479fbaff5131aefc8834', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73391) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 05:44:51 user nova-compute[73391]: DEBUG nova.compute.manager [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Start spawning the instance on the hypervisor. {{(pid=73391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 05:44:51 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Creating instance directory {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 05:44:51 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Creating image(s)
Aug 15 05:44:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Acquiring lock "/opt/stack/data/nova/instances/7521ed98-75ed-43eb-83a2-d41502698aec/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:44:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "/opt/stack/data/nova/instances/7521ed98-75ed-43eb-83a2-d41502698aec/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:44:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "/opt/stack/data/nova/instances/7521ed98-75ed-43eb-83a2-d41502698aec/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:44:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:44:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-65609eb8-112c-4da2-8314-34384d9fac2c tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquiring lock "refresh_cache-dc657d66-c3f8-44e5-b30e-3d79e586a8f3" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:44:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-65609eb8-112c-4da2-8314-34384d9fac2c tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquired lock "refresh_cache-dc657d66-c3f8-44e5-b30e-3d79e586a8f3" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:44:51 user nova-compute[73391]: DEBUG nova.network.neutron [None req-65609eb8-112c-4da2-8314-34384d9fac2c tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:44:51 user nova-compute[73391]: DEBUG nova.objects.instance [None req-65609eb8-112c-4da2-8314-34384d9fac2c tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lazy-loading 'info_cache' on Instance uuid dc657d66-c3f8-44e5-b30e-3d79e586a8f3 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:44:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.216s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:44:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Acquiring lock "999b315ba87151d8252d543312ae7790e7e1583b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:44:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:44:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:44:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.223s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:44:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/7521ed98-75ed-43eb-83a2-d41502698aec/disk 1073741824 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:44:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/7521ed98-75ed-43eb-83a2-d41502698aec/disk 1073741824" returned: 0 in 0.056s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:44:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:44:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:44:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.185s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:44:52 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7521ed98-75ed-43eb-83a2-d41502698aec/disk. size=1073741824 {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 05:44:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7521ed98-75ed-43eb-83a2-d41502698aec/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:44:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7521ed98-75ed-43eb-83a2-d41502698aec/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:44:52 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Cannot resize image /opt/stack/data/nova/instances/7521ed98-75ed-43eb-83a2-d41502698aec/disk to a smaller size. {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 05:44:52 user nova-compute[73391]: DEBUG nova.objects.instance [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lazy-loading 'migration_context' on Instance uuid 7521ed98-75ed-43eb-83a2-d41502698aec {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:44:52 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Created local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 05:44:52 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Ensure instance console log exists: /opt/stack/data/nova/instances/7521ed98-75ed-43eb-83a2-d41502698aec/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 05:44:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:44:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:44:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:44:52 user nova-compute[73391]: DEBUG nova.network.neutron [None req-65609eb8-112c-4da2-8314-34384d9fac2c tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Updating instance_info_cache with network_info: [{"id": "83a46e94-e5e7-41bb-803a-30000c4f9a02", "address": "fa:16:3e:ab:ac:be", "network": {"id": "610f78de-5741-4743-815d-d12ba05f8000", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1518164868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b01853a82243369bd71dc0dbedb5d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83a46e94-e5", "ovs_interfaceid": "83a46e94-e5e7-41bb-803a-30000c4f9a02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:44:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-65609eb8-112c-4da2-8314-34384d9fac2c tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Releasing lock "refresh_cache-dc657d66-c3f8-44e5-b30e-3d79e586a8f3" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:44:52 user nova-compute[73391]: DEBUG nova.objects.instance [None req-65609eb8-112c-4da2-8314-34384d9fac2c tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lazy-loading 'migration_context' on Instance uuid dc657d66-c3f8-44e5-b30e-3d79e586a8f3 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:44:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-65609eb8-112c-4da2-8314-34384d9fac2c tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:44:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-65609eb8-112c-4da2-8314-34384d9fac2c tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:44:52 user nova-compute[73391]: DEBUG nova.network.neutron [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Successfully created port: cbe16818-84cf-4b94-9e4a-bc40ea83946a {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 05:44:53 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-65609eb8-112c-4da2-8314-34384d9fac2c tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:44:53 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-65609eb8-112c-4da2-8314-34384d9fac2c tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:44:53 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-65609eb8-112c-4da2-8314-34384d9fac2c tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.500s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:44:53 user nova-compute[73391]: INFO nova.scheduler.client.report [None req-65609eb8-112c-4da2-8314-34384d9fac2c tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Deleted allocation for migration 68dd821e-9200-4f15-90ac-3b30802dd875
Aug 15 05:44:53 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-65609eb8-112c-4da2-8314-34384d9fac2c tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "dc657d66-c3f8-44e5-b30e-3d79e586a8f3" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.978s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:44:53 user nova-compute[73391]: DEBUG nova.network.neutron [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Successfully updated port: cbe16818-84cf-4b94-9e4a-bc40ea83946a {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:44:53 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Acquiring lock "refresh_cache-7521ed98-75ed-43eb-83a2-d41502698aec" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:44:53 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Acquired lock "refresh_cache-7521ed98-75ed-43eb-83a2-d41502698aec" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:44:53 user nova-compute[73391]: DEBUG nova.network.neutron [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:44:53 user nova-compute[73391]: DEBUG nova.network.neutron [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:44:53 user nova-compute[73391]: DEBUG nova.compute.manager [req-df696f23-e94f-43c3-b9fc-5227e46209fe req-4a0a3b0a-1c39-43b5-999e-fd535456b66c service nova] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Received event network-changed-cbe16818-84cf-4b94-9e4a-bc40ea83946a {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:44:53 user nova-compute[73391]: DEBUG nova.compute.manager [req-df696f23-e94f-43c3-b9fc-5227e46209fe req-4a0a3b0a-1c39-43b5-999e-fd535456b66c service nova] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Refreshing instance network info cache due to event network-changed-cbe16818-84cf-4b94-9e4a-bc40ea83946a. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:44:53 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-df696f23-e94f-43c3-b9fc-5227e46209fe req-4a0a3b0a-1c39-43b5-999e-fd535456b66c service nova] Acquiring lock "refresh_cache-7521ed98-75ed-43eb-83a2-d41502698aec" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:44:54 user nova-compute[73391]: DEBUG nova.network.neutron [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Updating instance_info_cache with network_info: [{"id": "cbe16818-84cf-4b94-9e4a-bc40ea83946a", "address": "fa:16:3e:c5:35:30", "network": {"id": "6757637c-358e-4fa8-b3c1-376d7892c884", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-577771159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae6fe94b9014479fbaff5131aefc8834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbe16818-84", "ovs_interfaceid": "cbe16818-84cf-4b94-9e4a-bc40ea83946a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:44:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Releasing lock "refresh_cache-7521ed98-75ed-43eb-83a2-d41502698aec" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:44:54 user nova-compute[73391]: DEBUG nova.compute.manager [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Instance network_info: |[{"id": "cbe16818-84cf-4b94-9e4a-bc40ea83946a", "address": "fa:16:3e:c5:35:30", "network": {"id": "6757637c-358e-4fa8-b3c1-376d7892c884", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-577771159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae6fe94b9014479fbaff5131aefc8834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbe16818-84", "ovs_interfaceid": "cbe16818-84cf-4b94-9e4a-bc40ea83946a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 05:44:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-df696f23-e94f-43c3-b9fc-5227e46209fe req-4a0a3b0a-1c39-43b5-999e-fd535456b66c service nova] Acquired lock "refresh_cache-7521ed98-75ed-43eb-83a2-d41502698aec" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:44:54 user nova-compute[73391]: DEBUG nova.network.neutron [req-df696f23-e94f-43c3-b9fc-5227e46209fe req-4a0a3b0a-1c39-43b5-999e-fd535456b66c service nova] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Refreshing network info cache for port cbe16818-84cf-4b94-9e4a-bc40ea83946a {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:44:54 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Start _get_guest_xml network_info=[{"id": "cbe16818-84cf-4b94-9e4a-bc40ea83946a", "address": "fa:16:3e:c5:35:30", "network": {"id": "6757637c-358e-4fa8-b3c1-376d7892c884", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-577771159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae6fe94b9014479fbaff5131aefc8834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbe16818-84", "ovs_interfaceid": "cbe16818-84cf-4b94-9e4a-bc40ea83946a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '191b1dad-305e-4d1c-9b15-515ec59a3278'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:44:54 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:44:54 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:44:54 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:44:54 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:44:54 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:44:54 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:44:54 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:44:54 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:44:54 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:44:54 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:44:54 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:44:54 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:44:54 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:44:54 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:44:54 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:44:54 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:44:54 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:44:54 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:44:54 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:44:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-496366586',display_name='tempest-VolumesSnapshotTestJSON-instance-496366586',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-496366586',id=34,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFZ85efv3P1n0AlZUkD9dpM0eEDPYPOR5HDFbKpoHxZj8TkyhAtkJ85K4GJbb9C9safdPOgLhqnvLsAuQBxT3jKQTLZBhGpgIwTQOMTV5rZfGKWGmiDLPSvYR0kPw8hHw==',key_name='tempest-keypair-773112726',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae6fe94b9014479fbaff5131aefc8834',ramdisk_id='',reservation_id='r-hnmzuh3t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1902565719',owner_user_name='tempest-VolumesSnapshotTestJSON-1902565719-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:44:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9779dfb796934195b206b8e0adc81ed3',uuid=7521ed98-75ed-43eb-83a2-d41502698aec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cbe16818-84cf-4b94-9e4a-bc40ea83946a", "address": "fa:16:3e:c5:35:30", "network": {"id": "6757637c-358e-4fa8-b3c1-376d7892c884", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-577771159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae6fe94b9014479fbaff5131aefc8834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbe16818-84", "ovs_interfaceid": "cbe16818-84cf-4b94-9e4a-bc40ea83946a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:44:54 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Converting VIF {"id": "cbe16818-84cf-4b94-9e4a-bc40ea83946a", "address": "fa:16:3e:c5:35:30", "network": {"id": "6757637c-358e-4fa8-b3c1-376d7892c884", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-577771159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae6fe94b9014479fbaff5131aefc8834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbe16818-84", "ovs_interfaceid": "cbe16818-84cf-4b94-9e4a-bc40ea83946a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:44:54 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:35:30,bridge_name='br-int',has_traffic_filtering=True,id=cbe16818-84cf-4b94-9e4a-bc40ea83946a,network=Network(6757637c-358e-4fa8-b3c1-376d7892c884),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbe16818-84') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:44:54 user nova-compute[73391]: DEBUG nova.objects.instance [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lazy-loading 'pci_devices' on Instance uuid 7521ed98-75ed-43eb-83a2-d41502698aec {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:44:54 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:44:54 user nova-compute[73391]:   <uuid>7521ed98-75ed-43eb-83a2-d41502698aec</uuid>
Aug 15 05:44:54 user nova-compute[73391]:   <name>instance-00000022</name>
Aug 15 05:44:54 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:44:54 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:44:54 user nova-compute[73391]:   <metadata>
Aug 15 05:44:54 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:44:54 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:44:54 user nova-compute[73391]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-496366586</nova:name>
Aug 15 05:44:54 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:44:54</nova:creationTime>
Aug 15 05:44:54 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:44:54 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:44:54 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:44:54 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:44:54 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:44:54 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:44:54 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:44:54 user nova-compute[73391]:       <nova:owner>
Aug 15 05:44:54 user nova-compute[73391]:         <nova:user uuid="9779dfb796934195b206b8e0adc81ed3">tempest-VolumesSnapshotTestJSON-1902565719-project-member</nova:user>
Aug 15 05:44:54 user nova-compute[73391]:         <nova:project uuid="ae6fe94b9014479fbaff5131aefc8834">tempest-VolumesSnapshotTestJSON-1902565719</nova:project>
Aug 15 05:44:54 user nova-compute[73391]:       </nova:owner>
Aug 15 05:44:54 user nova-compute[73391]:       <nova:root type="image" uuid="191b1dad-305e-4d1c-9b15-515ec59a3278"/>
Aug 15 05:44:54 user nova-compute[73391]:       <nova:ports>
Aug 15 05:44:54 user nova-compute[73391]:         <nova:port uuid="cbe16818-84cf-4b94-9e4a-bc40ea83946a">
Aug 15 05:44:54 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 05:44:54 user nova-compute[73391]:         </nova:port>
Aug 15 05:44:54 user nova-compute[73391]:       </nova:ports>
Aug 15 05:44:54 user nova-compute[73391]:     </nova:instance>
Aug 15 05:44:54 user nova-compute[73391]:   </metadata>
Aug 15 05:44:54 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:44:54 user nova-compute[73391]:     <system>
Aug 15 05:44:54 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:44:54 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:44:54 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:44:54 user nova-compute[73391]:       <entry name="serial">7521ed98-75ed-43eb-83a2-d41502698aec</entry>
Aug 15 05:44:54 user nova-compute[73391]:       <entry name="uuid">7521ed98-75ed-43eb-83a2-d41502698aec</entry>
Aug 15 05:44:54 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:44:54 user nova-compute[73391]:     </system>
Aug 15 05:44:54 user nova-compute[73391]:   </sysinfo>
Aug 15 05:44:54 user nova-compute[73391]:   <os>
Aug 15 05:44:54 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:44:54 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:44:54 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:44:54 user nova-compute[73391]:   </os>
Aug 15 05:44:54 user nova-compute[73391]:   <features>
Aug 15 05:44:54 user nova-compute[73391]:     <acpi/>
Aug 15 05:44:54 user nova-compute[73391]:     <apic/>
Aug 15 05:44:54 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:44:54 user nova-compute[73391]:   </features>
Aug 15 05:44:54 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:44:54 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:44:54 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:44:54 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:44:54 user nova-compute[73391]:   </clock>
Aug 15 05:44:54 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:44:54 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:44:54 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:44:54 user nova-compute[73391]:   </cpu>
Aug 15 05:44:54 user nova-compute[73391]:   <devices>
Aug 15 05:44:54 user nova-compute[73391]:     <disk type="file" device="disk">
Aug 15 05:44:54 user nova-compute[73391]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 05:44:54 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/7521ed98-75ed-43eb-83a2-d41502698aec/disk"/>
Aug 15 05:44:54 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:44:54 user nova-compute[73391]:     </disk>
Aug 15 05:44:54 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:44:54 user nova-compute[73391]:       <mac address="fa:16:3e:c5:35:30"/>
Aug 15 05:44:54 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:44:54 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:44:54 user nova-compute[73391]:       <target dev="tapcbe16818-84"/>
Aug 15 05:44:54 user nova-compute[73391]:     </interface>
Aug 15 05:44:54 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:44:54 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/7521ed98-75ed-43eb-83a2-d41502698aec/console.log" append="off"/>
Aug 15 05:44:54 user nova-compute[73391]:     </serial>
Aug 15 05:44:54 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:44:54 user nova-compute[73391]:     <video>
Aug 15 05:44:54 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:44:54 user nova-compute[73391]:     </video>
Aug 15 05:44:54 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:44:54 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:44:54 user nova-compute[73391]:     </rng>
Aug 15 05:44:54 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:44:54 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:44:54 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:44:54 user nova-compute[73391]:     </memballoon>
Aug 15 05:44:54 user nova-compute[73391]:   </devices>
Aug 15 05:44:54 user nova-compute[73391]: </domain>
Aug 15 05:44:54 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:44:54 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:44:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-496366586',display_name='tempest-VolumesSnapshotTestJSON-instance-496366586',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-496366586',id=34,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFZ85efv3P1n0AlZUkD9dpM0eEDPYPOR5HDFbKpoHxZj8TkyhAtkJ85K4GJbb9C9safdPOgLhqnvLsAuQBxT3jKQTLZBhGpgIwTQOMTV5rZfGKWGmiDLPSvYR0kPw8hHw==',key_name='tempest-keypair-773112726',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ae6fe94b9014479fbaff5131aefc8834',ramdisk_id='',reservation_id='r-hnmzuh3t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1902565719',owner_user_name='tempest-VolumesSnapshotTestJSON-1902565719-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:44:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9779dfb796934195b206b8e0adc81ed3',uuid=7521ed98-75ed-43eb-83a2-d41502698aec,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cbe16818-84cf-4b94-9e4a-bc40ea83946a", "address": "fa:16:3e:c5:35:30", "network": {"id": "6757637c-358e-4fa8-b3c1-376d7892c884", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-577771159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae6fe94b9014479fbaff5131aefc8834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbe16818-84", "ovs_interfaceid": "cbe16818-84cf-4b94-9e4a-bc40ea83946a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:44:54 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Converting VIF {"id": "cbe16818-84cf-4b94-9e4a-bc40ea83946a", "address": "fa:16:3e:c5:35:30", "network": {"id": "6757637c-358e-4fa8-b3c1-376d7892c884", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-577771159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae6fe94b9014479fbaff5131aefc8834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbe16818-84", "ovs_interfaceid": "cbe16818-84cf-4b94-9e4a-bc40ea83946a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:44:54 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:35:30,bridge_name='br-int',has_traffic_filtering=True,id=cbe16818-84cf-4b94-9e4a-bc40ea83946a,network=Network(6757637c-358e-4fa8-b3c1-376d7892c884),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbe16818-84') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:44:54 user nova-compute[73391]: DEBUG os_vif [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:35:30,bridge_name='br-int',has_traffic_filtering=True,id=cbe16818-84cf-4b94-9e4a-bc40ea83946a,network=Network(6757637c-358e-4fa8-b3c1-376d7892c884),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbe16818-84') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:44:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:44:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:44:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcbe16818-84, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:44:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcbe16818-84, col_values=(('external_ids', {'iface-id': 'cbe16818-84cf-4b94-9e4a-bc40ea83946a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:35:30', 'vm-uuid': '7521ed98-75ed-43eb-83a2-d41502698aec'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:44:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:44:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:54 user nova-compute[73391]: INFO os_vif [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:35:30,bridge_name='br-int',has_traffic_filtering=True,id=cbe16818-84cf-4b94-9e4a-bc40ea83946a,network=Network(6757637c-358e-4fa8-b3c1-376d7892c884),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbe16818-84')
Aug 15 05:44:54 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:44:54 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] No VIF found with MAC fa:16:3e:c5:35:30, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:44:54 user nova-compute[73391]: DEBUG nova.network.neutron [req-df696f23-e94f-43c3-b9fc-5227e46209fe req-4a0a3b0a-1c39-43b5-999e-fd535456b66c service nova] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Updated VIF entry in instance network info cache for port cbe16818-84cf-4b94-9e4a-bc40ea83946a. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:44:54 user nova-compute[73391]: DEBUG nova.network.neutron [req-df696f23-e94f-43c3-b9fc-5227e46209fe req-4a0a3b0a-1c39-43b5-999e-fd535456b66c service nova] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Updating instance_info_cache with network_info: [{"id": "cbe16818-84cf-4b94-9e4a-bc40ea83946a", "address": "fa:16:3e:c5:35:30", "network": {"id": "6757637c-358e-4fa8-b3c1-376d7892c884", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-577771159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae6fe94b9014479fbaff5131aefc8834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbe16818-84", "ovs_interfaceid": "cbe16818-84cf-4b94-9e4a-bc40ea83946a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:44:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-df696f23-e94f-43c3-b9fc-5227e46209fe req-4a0a3b0a-1c39-43b5-999e-fd535456b66c service nova] Releasing lock "refresh_cache-7521ed98-75ed-43eb-83a2-d41502698aec" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:44:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:55 user nova-compute[73391]: DEBUG nova.compute.manager [req-a9208f5b-3190-4ec9-8342-a067bc04eb5b req-f80ace55-629d-4b97-a36e-244ba77f73d9 service nova] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Received event network-vif-plugged-cbe16818-84cf-4b94-9e4a-bc40ea83946a {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:44:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-a9208f5b-3190-4ec9-8342-a067bc04eb5b req-f80ace55-629d-4b97-a36e-244ba77f73d9 service nova] Acquiring lock "7521ed98-75ed-43eb-83a2-d41502698aec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:44:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-a9208f5b-3190-4ec9-8342-a067bc04eb5b req-f80ace55-629d-4b97-a36e-244ba77f73d9 service nova] Lock "7521ed98-75ed-43eb-83a2-d41502698aec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:44:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-a9208f5b-3190-4ec9-8342-a067bc04eb5b req-f80ace55-629d-4b97-a36e-244ba77f73d9 service nova] Lock "7521ed98-75ed-43eb-83a2-d41502698aec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:44:55 user nova-compute[73391]: DEBUG nova.compute.manager [req-a9208f5b-3190-4ec9-8342-a067bc04eb5b req-f80ace55-629d-4b97-a36e-244ba77f73d9 service nova] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] No waiting events found dispatching network-vif-plugged-cbe16818-84cf-4b94-9e4a-bc40ea83946a {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:44:55 user nova-compute[73391]: WARNING nova.compute.manager [req-a9208f5b-3190-4ec9-8342-a067bc04eb5b req-f80ace55-629d-4b97-a36e-244ba77f73d9 service nova] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Received unexpected event network-vif-plugged-cbe16818-84cf-4b94-9e4a-bc40ea83946a for instance with vm_state building and task_state spawning.
Aug 15 05:44:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:57 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078297.9731152, 7521ed98-75ed-43eb-83a2-d41502698aec => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:44:57 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] VM Resumed (Lifecycle Event)
Aug 15 05:44:57 user nova-compute[73391]: DEBUG nova.compute.manager [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:44:57 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Guest created on hypervisor {{(pid=73391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 05:44:57 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Instance spawned successfully.
Aug 15 05:44:57 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 05:44:57 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:44:58 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:44:58 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Found default for hw_cdrom_bus of ide {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:44:58 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Found default for hw_disk_bus of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:44:58 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Found default for hw_input_bus of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:44:58 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Found default for hw_pointer_model of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:44:58 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Found default for hw_video_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:44:58 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Found default for hw_vif_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:44:58 user nova-compute[73391]: DEBUG nova.compute.manager [req-70d569b2-4e10-411d-ae5d-ba089fea59fe req-0f7f4ca3-3c62-4ce7-9534-a6a77ec876fa service nova] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Received event network-vif-plugged-cbe16818-84cf-4b94-9e4a-bc40ea83946a {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:44:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-70d569b2-4e10-411d-ae5d-ba089fea59fe req-0f7f4ca3-3c62-4ce7-9534-a6a77ec876fa service nova] Acquiring lock "7521ed98-75ed-43eb-83a2-d41502698aec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:44:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-70d569b2-4e10-411d-ae5d-ba089fea59fe req-0f7f4ca3-3c62-4ce7-9534-a6a77ec876fa service nova] Lock "7521ed98-75ed-43eb-83a2-d41502698aec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:44:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-70d569b2-4e10-411d-ae5d-ba089fea59fe req-0f7f4ca3-3c62-4ce7-9534-a6a77ec876fa service nova] Lock "7521ed98-75ed-43eb-83a2-d41502698aec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:44:58 user nova-compute[73391]: DEBUG nova.compute.manager [req-70d569b2-4e10-411d-ae5d-ba089fea59fe req-0f7f4ca3-3c62-4ce7-9534-a6a77ec876fa service nova] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] No waiting events found dispatching network-vif-plugged-cbe16818-84cf-4b94-9e4a-bc40ea83946a {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:44:58 user nova-compute[73391]: WARNING nova.compute.manager [req-70d569b2-4e10-411d-ae5d-ba089fea59fe req-0f7f4ca3-3c62-4ce7-9534-a6a77ec876fa service nova] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Received unexpected event network-vif-plugged-cbe16818-84cf-4b94-9e4a-bc40ea83946a for instance with vm_state building and task_state spawning.
Aug 15 05:44:58 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:44:58 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078297.974585, 7521ed98-75ed-43eb-83a2-d41502698aec => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:44:58 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] VM Started (Lifecycle Event)
Aug 15 05:44:58 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:44:58 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:44:58 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:44:58 user nova-compute[73391]: INFO nova.compute.manager [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Took 6.40 seconds to spawn the instance on the hypervisor.
Aug 15 05:44:58 user nova-compute[73391]: DEBUG nova.compute.manager [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:44:58 user nova-compute[73391]: INFO nova.compute.manager [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Took 7.28 seconds to build instance.
Aug 15 05:44:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f56b2c9c-7069-4bf5-bffc-952d4ba5d9db tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "7521ed98-75ed-43eb-83a2-d41502698aec" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.402s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:44:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:44:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:45:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:45:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:45:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:45:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:45:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-31b11d52-9651-4c58-93a8-8c6196ebc618 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Acquiring lock "fee43642-30e8-451b-919c-aca4cd4c3f81" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:45:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-31b11d52-9651-4c58-93a8-8c6196ebc618 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "fee43642-30e8-451b-919c-aca4cd4c3f81" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:45:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-31b11d52-9651-4c58-93a8-8c6196ebc618 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Acquiring lock "fee43642-30e8-451b-919c-aca4cd4c3f81-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:45:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-31b11d52-9651-4c58-93a8-8c6196ebc618 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "fee43642-30e8-451b-919c-aca4cd4c3f81-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:45:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-31b11d52-9651-4c58-93a8-8c6196ebc618 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "fee43642-30e8-451b-919c-aca4cd4c3f81-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:45:10 user nova-compute[73391]: INFO nova.compute.manager [None req-31b11d52-9651-4c58-93a8-8c6196ebc618 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Terminating instance
Aug 15 05:45:10 user nova-compute[73391]: DEBUG nova.compute.manager [None req-31b11d52-9651-4c58-93a8-8c6196ebc618 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Start destroying the instance on the hypervisor. {{(pid=73391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 05:45:10 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:45:10 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:45:10 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:45:10 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:45:11 user nova-compute[73391]: DEBUG nova.compute.manager [req-9119f27e-c8bc-4973-b190-c9df16dcdbed req-d3695379-9c48-49a8-8882-0a542354fd8c service nova] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Received event network-vif-unplugged-fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:45:11 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-9119f27e-c8bc-4973-b190-c9df16dcdbed req-d3695379-9c48-49a8-8882-0a542354fd8c service nova] Acquiring lock "fee43642-30e8-451b-919c-aca4cd4c3f81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:45:11 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-9119f27e-c8bc-4973-b190-c9df16dcdbed req-d3695379-9c48-49a8-8882-0a542354fd8c service nova] Lock "fee43642-30e8-451b-919c-aca4cd4c3f81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:45:11 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-9119f27e-c8bc-4973-b190-c9df16dcdbed req-d3695379-9c48-49a8-8882-0a542354fd8c service nova] Lock "fee43642-30e8-451b-919c-aca4cd4c3f81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:45:11 user nova-compute[73391]: DEBUG nova.compute.manager [req-9119f27e-c8bc-4973-b190-c9df16dcdbed req-d3695379-9c48-49a8-8882-0a542354fd8c service nova] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] No waiting events found dispatching network-vif-unplugged-fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:45:11 user nova-compute[73391]: DEBUG nova.compute.manager [req-9119f27e-c8bc-4973-b190-c9df16dcdbed req-d3695379-9c48-49a8-8882-0a542354fd8c service nova] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Received event network-vif-unplugged-fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 05:45:11 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Instance destroyed successfully.
Aug 15 05:45:11 user nova-compute[73391]: DEBUG nova.objects.instance [None req-31b11d52-9651-4c58-93a8-8c6196ebc618 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lazy-loading 'resources' on Instance uuid fee43642-30e8-451b-919c-aca4cd4c3f81 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:45:11 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-31b11d52-9651-4c58-93a8-8c6196ebc618 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:35:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1959427232',display_name='tempest-AttachVolumeTestJSON-server-1959427232',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1959427232',id=20,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8c2c+HY2uFg0muioXJ/Qd76WkrwYok3JhcRUo8JvSmW81H3Mw3KqkIDK8NtlIVnkKC4J9LmhNxEjXRZXc6sdj/CKTHFaHD2NbzzeyvSOZNMRKn7xfyQEj9gzmcW7J5qQ==',key_name='tempest-keypair-769603990',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:35:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f88922b3c294aea9efa3d80909a171a',ramdisk_id='',reservation_id='r-9kpn3uxf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-629721707',owner_user_name='tempest-AttachVolumeTestJSON-629721707-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:43:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='02352e5b84f04d0e9975b8b8e5594b92',uuid=fee43642-30e8-451b-919c-aca4cd4c3f81,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b", "address": "fa:16:3e:57:a8:64", "network": {"id": "c94dfbf4-6803-458e-b2c6-231298da7bc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090354282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f88922b3c294aea9efa3d80909a171a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdb4ce86-9a", "ovs_interfaceid": "fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:45:11 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-31b11d52-9651-4c58-93a8-8c6196ebc618 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Converting VIF {"id": "fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b", "address": "fa:16:3e:57:a8:64", "network": {"id": "c94dfbf4-6803-458e-b2c6-231298da7bc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090354282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f88922b3c294aea9efa3d80909a171a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfdb4ce86-9a", "ovs_interfaceid": "fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:45:11 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-31b11d52-9651-4c58-93a8-8c6196ebc618 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:57:a8:64,bridge_name='br-int',has_traffic_filtering=True,id=fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b,network=Network(c94dfbf4-6803-458e-b2c6-231298da7bc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdb4ce86-9a') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:45:11 user nova-compute[73391]: DEBUG os_vif [None req-31b11d52-9651-4c58-93a8-8c6196ebc618 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:a8:64,bridge_name='br-int',has_traffic_filtering=True,id=fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b,network=Network(c94dfbf4-6803-458e-b2c6-231298da7bc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdb4ce86-9a') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:45:11 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:45:11 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfdb4ce86-9a, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:45:11 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:45:11 user nova-compute[73391]: INFO os_vif [None req-31b11d52-9651-4c58-93a8-8c6196ebc618 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:57:a8:64,bridge_name='br-int',has_traffic_filtering=True,id=fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b,network=Network(c94dfbf4-6803-458e-b2c6-231298da7bc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfdb4ce86-9a')
Aug 15 05:45:11 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-31b11d52-9651-4c58-93a8-8c6196ebc618 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Deleting instance files /opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81_del
Aug 15 05:45:11 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-31b11d52-9651-4c58-93a8-8c6196ebc618 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Deletion of /opt/stack/data/nova/instances/fee43642-30e8-451b-919c-aca4cd4c3f81_del complete
Aug 15 05:45:11 user nova-compute[73391]: INFO nova.compute.manager [None req-31b11d52-9651-4c58-93a8-8c6196ebc618 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Took 0.99 seconds to destroy the instance on the hypervisor.
Aug 15 05:45:11 user nova-compute[73391]: DEBUG oslo.service.loopingcall [None req-31b11d52-9651-4c58-93a8-8c6196ebc618 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 05:45:11 user nova-compute[73391]: DEBUG nova.compute.manager [-] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Deallocating network for instance {{(pid=73391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 05:45:11 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] deallocate_for_instance() {{(pid=73391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 05:45:12 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:45:12 user nova-compute[73391]: DEBUG nova.compute.manager [req-a2305434-4c7e-49bc-bc15-c1ed8ca386ea req-c831ca70-c46b-4e2f-ae33-32d6e94e03f5 service nova] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Received event network-vif-deleted-fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:45:12 user nova-compute[73391]: INFO nova.compute.manager [req-a2305434-4c7e-49bc-bc15-c1ed8ca386ea req-c831ca70-c46b-4e2f-ae33-32d6e94e03f5 service nova] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Neutron deleted interface fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b; detaching it from the instance and deleting it from the info cache
Aug 15 05:45:12 user nova-compute[73391]: DEBUG nova.network.neutron [req-a2305434-4c7e-49bc-bc15-c1ed8ca386ea req-c831ca70-c46b-4e2f-ae33-32d6e94e03f5 service nova] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:45:12 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Took 1.16 seconds to deallocate network for instance.
Aug 15 05:45:12 user nova-compute[73391]: DEBUG nova.compute.manager [req-a2305434-4c7e-49bc-bc15-c1ed8ca386ea req-c831ca70-c46b-4e2f-ae33-32d6e94e03f5 service nova] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Detach interface failed, port_id=fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b, reason: Instance fee43642-30e8-451b-919c-aca4cd4c3f81 could not be found. {{(pid=73391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 05:45:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-31b11d52-9651-4c58-93a8-8c6196ebc618 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:45:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-31b11d52-9651-4c58-93a8-8c6196ebc618 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:45:13 user nova-compute[73391]: DEBUG nova.compute.manager [req-90796786-93a6-445f-b886-ee2b6de292fa req-9c0c6a64-94c3-4e72-b561-6a75c39ceb89 service nova] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Received event network-vif-plugged-fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:45:13 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-90796786-93a6-445f-b886-ee2b6de292fa req-9c0c6a64-94c3-4e72-b561-6a75c39ceb89 service nova] Acquiring lock "fee43642-30e8-451b-919c-aca4cd4c3f81-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:45:13 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-90796786-93a6-445f-b886-ee2b6de292fa req-9c0c6a64-94c3-4e72-b561-6a75c39ceb89 service nova] Lock "fee43642-30e8-451b-919c-aca4cd4c3f81-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:45:13 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-90796786-93a6-445f-b886-ee2b6de292fa req-9c0c6a64-94c3-4e72-b561-6a75c39ceb89 service nova] Lock "fee43642-30e8-451b-919c-aca4cd4c3f81-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:45:13 user nova-compute[73391]: DEBUG nova.compute.manager [req-90796786-93a6-445f-b886-ee2b6de292fa req-9c0c6a64-94c3-4e72-b561-6a75c39ceb89 service nova] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] No waiting events found dispatching network-vif-plugged-fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:45:13 user nova-compute[73391]: WARNING nova.compute.manager [req-90796786-93a6-445f-b886-ee2b6de292fa req-9c0c6a64-94c3-4e72-b561-6a75c39ceb89 service nova] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Received unexpected event network-vif-plugged-fdb4ce86-9ae4-4be6-a142-aba4fd2b0e8b for instance with vm_state deleted and task_state None.
Aug 15 05:45:13 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-31b11d52-9651-4c58-93a8-8c6196ebc618 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:45:13 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-31b11d52-9651-4c58-93a8-8c6196ebc618 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:45:13 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-31b11d52-9651-4c58-93a8-8c6196ebc618 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.609s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:45:13 user nova-compute[73391]: INFO nova.scheduler.client.report [None req-31b11d52-9651-4c58-93a8-8c6196ebc618 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Deleted allocations for instance fee43642-30e8-451b-919c-aca4cd4c3f81
Aug 15 05:45:13 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-31b11d52-9651-4c58-93a8-8c6196ebc618 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "fee43642-30e8-451b-919c-aca4cd4c3f81" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.024s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:45:13 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:45:13 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Cleaning up deleted instances {{(pid=73391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 05:45:13 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] There are 0 instances to clean {{(pid=73391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 05:45:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:45:16 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:45:17 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:45:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:45:19 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:45:20 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:45:20 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:45:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:45:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:45:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:45:20 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Auditing locally available compute resources for user (node: user) {{(pid=73391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 05:45:20 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:45:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8775490-2a9e-44ac-aad7-9450afa4c295/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8775490-2a9e-44ac-aad7-9450afa4c295/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:45:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8775490-2a9e-44ac-aad7-9450afa4c295/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8775490-2a9e-44ac-aad7-9450afa4c295/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:45:21 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:45:21 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:45:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7521ed98-75ed-43eb-83a2-d41502698aec/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:21 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:45:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7521ed98-75ed-43eb-83a2-d41502698aec/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:45:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7521ed98-75ed-43eb-83a2-d41502698aec/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7521ed98-75ed-43eb-83a2-d41502698aec/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:45:21 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:45:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:45:21 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:22 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:45:22 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:45:22 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:22 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:45:22 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:22 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:45:22 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:22 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:45:22 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:22 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:45:22 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:23 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:45:23 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:23 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:45:23 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:23 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:45:23 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:23 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:45:23 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:23 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:45:23 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:45:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:45:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:45:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:45:24 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:45:24 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:45:24 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Hypervisor/Node resource view: name=user free_ram=6940MB free_disk=24.991687774658203GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 05:45:24 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:45:24 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:45:25 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 8f08782b-f793-415e-b0d6-5caad1c3d426 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:45:25 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 6ac9d5dc-56be-402f-b9d4-3327bdfd9220 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:45:25 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 6358e825-5705-45d6-86b6-3aacfa5a9bbb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:45:25 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:45:25 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 730890c6-6999-4a0f-b80c-e4745bff99ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:45:25 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 8ff2da51-5bfd-4cdc-8cef-330cdef93d97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:45:25 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance d60616bb-605e-4604-b637-56670f53159e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:45:25 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 8991b32e-6c4b-4c66-a320-e734061f49ee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:45:25 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance dc657d66-c3f8-44e5-b30e-3d79e586a8f3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:45:25 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance e8775490-2a9e-44ac-aad7-9450afa4c295 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:45:25 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance c5d5343f-b8f4-46b7-92fc-66452212192b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:45:25 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 7521ed98-75ed-43eb-83a2-d41502698aec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:45:25 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 05:45:25 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 05:45:25 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:45:25 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:45:25 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Compute_service record updated for user:user {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 05:45:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.706s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:45:26 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692078311.4793293, fee43642-30e8-451b-919c-aca4cd4c3f81 => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:45:26 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] VM Stopped (Lifecycle Event)
Aug 15 05:45:26 user nova-compute[73391]: DEBUG nova.compute.manager [None req-4dc4896f-4ad1-46d7-b345-5dafb7a401e9 None None] [instance: fee43642-30e8-451b-919c-aca4cd4c3f81] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:45:26 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:45:26 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:45:26 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:45:26 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:45:26 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:45:27 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:45:27 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Starting heal instance info cache {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 05:45:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "refresh_cache-730890c6-6999-4a0f-b80c-e4745bff99ab" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:45:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquired lock "refresh_cache-730890c6-6999-4a0f-b80c-e4745bff99ab" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:45:27 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Forcefully refreshing network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 05:45:28 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Updating instance_info_cache with network_info: [{"id": "f598ee19-8c81-4cf2-a88d-8221516eb1cf", "address": "fa:16:3e:2e:da:40", "network": {"id": "bec69c6a-b2cb-4b0a-ba6e-ae6dae099818", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7da9448cc34b609120da564a01dba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf598ee19-8c", "ovs_interfaceid": "f598ee19-8c81-4cf2-a88d-8221516eb1cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:45:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Releasing lock "refresh_cache-730890c6-6999-4a0f-b80c-e4745bff99ab" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:45:28 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Updated the network info_cache for instance {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 05:45:28 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:45:28 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:45:28 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 05:45:29 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:45:30 user nova-compute[73391]: DEBUG nova.compute.manager [req-7f7e60f4-c595-4a0e-90f8-47119277d46d req-8542dcc5-a0f5-47ff-a26e-bc8f256cbebb service nova] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Received event network-changed-3dc39268-abd9-42ad-8f0d-75b567aa7ec9 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:45:30 user nova-compute[73391]: DEBUG nova.compute.manager [req-7f7e60f4-c595-4a0e-90f8-47119277d46d req-8542dcc5-a0f5-47ff-a26e-bc8f256cbebb service nova] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Refreshing instance network info cache due to event network-changed-3dc39268-abd9-42ad-8f0d-75b567aa7ec9. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:45:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-7f7e60f4-c595-4a0e-90f8-47119277d46d req-8542dcc5-a0f5-47ff-a26e-bc8f256cbebb service nova] Acquiring lock "refresh_cache-e8775490-2a9e-44ac-aad7-9450afa4c295" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:45:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-7f7e60f4-c595-4a0e-90f8-47119277d46d req-8542dcc5-a0f5-47ff-a26e-bc8f256cbebb service nova] Acquired lock "refresh_cache-e8775490-2a9e-44ac-aad7-9450afa4c295" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:45:30 user nova-compute[73391]: DEBUG nova.network.neutron [req-7f7e60f4-c595-4a0e-90f8-47119277d46d req-8542dcc5-a0f5-47ff-a26e-bc8f256cbebb service nova] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Refreshing network info cache for port 3dc39268-abd9-42ad-8f0d-75b567aa7ec9 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:45:30 user nova-compute[73391]: DEBUG nova.network.neutron [req-7f7e60f4-c595-4a0e-90f8-47119277d46d req-8542dcc5-a0f5-47ff-a26e-bc8f256cbebb service nova] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Updated VIF entry in instance network info cache for port 3dc39268-abd9-42ad-8f0d-75b567aa7ec9. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:45:30 user nova-compute[73391]: DEBUG nova.network.neutron [req-7f7e60f4-c595-4a0e-90f8-47119277d46d req-8542dcc5-a0f5-47ff-a26e-bc8f256cbebb service nova] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Updating instance_info_cache with network_info: [{"id": "3dc39268-abd9-42ad-8f0d-75b567aa7ec9", "address": "fa:16:3e:74:c3:08", "network": {"id": "c7ff2e30-7396-4af7-bd21-e9157804987e", "bridge": "br-int", "label": "tempest-TestStampPattern-2022602784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "623d93149e574954839e469432f24fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dc39268-ab", "ovs_interfaceid": "3dc39268-abd9-42ad-8f0d-75b567aa7ec9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:45:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-7f7e60f4-c595-4a0e-90f8-47119277d46d req-8542dcc5-a0f5-47ff-a26e-bc8f256cbebb service nova] Releasing lock "refresh_cache-e8775490-2a9e-44ac-aad7-9450afa4c295" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:45:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2563c0f7-3f86-4004-a6f4-aeb3ca5aba37 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Acquiring lock "e8775490-2a9e-44ac-aad7-9450afa4c295" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:45:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2563c0f7-3f86-4004-a6f4-aeb3ca5aba37 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lock "e8775490-2a9e-44ac-aad7-9450afa4c295" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:45:30 user nova-compute[73391]: DEBUG nova.compute.manager [req-7e156cdb-abd3-4888-9d35-c0b95bdce9b4 req-2c584943-2f3b-47f7-b852-090ec2b9a85a service nova] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Received event network-changed-38e26266-d25b-4bbd-a6f1-00e0e81a1546 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:45:30 user nova-compute[73391]: DEBUG nova.compute.manager [req-7e156cdb-abd3-4888-9d35-c0b95bdce9b4 req-2c584943-2f3b-47f7-b852-090ec2b9a85a service nova] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Refreshing instance network info cache due to event network-changed-38e26266-d25b-4bbd-a6f1-00e0e81a1546. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:45:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-7e156cdb-abd3-4888-9d35-c0b95bdce9b4 req-2c584943-2f3b-47f7-b852-090ec2b9a85a service nova] Acquiring lock "refresh_cache-c5d5343f-b8f4-46b7-92fc-66452212192b" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:45:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-7e156cdb-abd3-4888-9d35-c0b95bdce9b4 req-2c584943-2f3b-47f7-b852-090ec2b9a85a service nova] Acquired lock "refresh_cache-c5d5343f-b8f4-46b7-92fc-66452212192b" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:45:30 user nova-compute[73391]: DEBUG nova.network.neutron [req-7e156cdb-abd3-4888-9d35-c0b95bdce9b4 req-2c584943-2f3b-47f7-b852-090ec2b9a85a service nova] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Refreshing network info cache for port 38e26266-d25b-4bbd-a6f1-00e0e81a1546 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:45:30 user nova-compute[73391]: DEBUG nova.objects.instance [None req-2563c0f7-3f86-4004-a6f4-aeb3ca5aba37 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lazy-loading 'flavor' on Instance uuid e8775490-2a9e-44ac-aad7-9450afa4c295 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:45:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2563c0f7-3f86-4004-a6f4-aeb3ca5aba37 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lock "e8775490-2a9e-44ac-aad7-9450afa4c295" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:45:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2563c0f7-3f86-4004-a6f4-aeb3ca5aba37 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Acquiring lock "e8775490-2a9e-44ac-aad7-9450afa4c295" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:45:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2563c0f7-3f86-4004-a6f4-aeb3ca5aba37 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lock "e8775490-2a9e-44ac-aad7-9450afa4c295" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:45:30 user nova-compute[73391]: INFO nova.compute.manager [None req-2563c0f7-3f86-4004-a6f4-aeb3ca5aba37 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Attaching volume 1f94463e-e977-424f-a121-3ed82ec86b36 to /dev/vdb
Aug 15 05:45:30 user nova-compute[73391]: DEBUG os_brick.utils [None req-2563c0f7-3f86-4004-a6f4-aeb3ca5aba37 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:45:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:45:30 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f5a2a4-f37f-4970-a075-178b8fde50af]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:45:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:45:30 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[788f1ae7-0310-4502-ab59-f65fe8d83462]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:45:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:45:30 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5eafc4a-70aa-48c5-803f-7ef659d89c59]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:45:30 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[99f7c1ff-8549-452b-abf0-1717077333ec]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:45:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-2563c0f7-3f86-4004-a6f4-aeb3ca5aba37 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-2563c0f7-3f86-4004-a6f4-aeb3ca5aba37 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:45:30 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2563c0f7-3f86-4004-a6f4-aeb3ca5aba37 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 05:45:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:45:30 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 05:45:30 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[701631e7-499f-42db-a2a4-8f42ebcb1590]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:45:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-2563c0f7-3f86-4004-a6f4-aeb3ca5aba37 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 05:45:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-2563c0f7-3f86-4004-a6f4-aeb3ca5aba37 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 05:45:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-2563c0f7-3f86-4004-a6f4-aeb3ca5aba37 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 05:45:31 user nova-compute[73391]: DEBUG os_brick.utils [None req-2563c0f7-3f86-4004-a6f4-aeb3ca5aba37 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:45:31 user nova-compute[73391]: DEBUG nova.virt.block_device [None req-2563c0f7-3f86-4004-a6f4-aeb3ca5aba37 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Updating existing volume attachment record: e0d64760-b472-4245-998a-7cf5ca32f678 {{(pid=73391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 05:45:31 user nova-compute[73391]: DEBUG nova.network.neutron [req-7e156cdb-abd3-4888-9d35-c0b95bdce9b4 req-2c584943-2f3b-47f7-b852-090ec2b9a85a service nova] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Updated VIF entry in instance network info cache for port 38e26266-d25b-4bbd-a6f1-00e0e81a1546. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:45:31 user nova-compute[73391]: DEBUG nova.network.neutron [req-7e156cdb-abd3-4888-9d35-c0b95bdce9b4 req-2c584943-2f3b-47f7-b852-090ec2b9a85a service nova] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Updating instance_info_cache with network_info: [{"id": "38e26266-d25b-4bbd-a6f1-00e0e81a1546", "address": "fa:16:3e:ce:22:5a", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38e26266-d2", "ovs_interfaceid": "38e26266-d25b-4bbd-a6f1-00e0e81a1546", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:45:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-7e156cdb-abd3-4888-9d35-c0b95bdce9b4 req-2c584943-2f3b-47f7-b852-090ec2b9a85a service nova] Releasing lock "refresh_cache-c5d5343f-b8f4-46b7-92fc-66452212192b" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:45:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:45:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:45:36 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:45:37 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:45:37 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73391) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 05:45:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:45:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:45:41 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2563c0f7-3f86-4004-a6f4-aeb3ca5aba37 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 05:45:41 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2563c0f7-3f86-4004-a6f4-aeb3ca5aba37 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:1f94463e-e977-424f-a121-3ed82ec86b36'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SOIRrbAV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:45:41 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-2563c0f7-3f86-4004-a6f4-aeb3ca5aba37 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:45:41 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-2563c0f7-3f86-4004-a6f4-aeb3ca5aba37 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:45:41 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-2563c0f7-3f86-4004-a6f4-aeb3ca5aba37 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:45:41 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-2563c0f7-3f86-4004-a6f4-aeb3ca5aba37 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:45:41 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-2563c0f7-3f86-4004-a6f4-aeb3ca5aba37 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f94463e-e977-424f-a121-3ed82ec86b36" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:45:41 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-2563c0f7-3f86-4004-a6f4-aeb3ca5aba37 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f94463e-e977-424f-a121-3ed82ec86b36" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:45:41 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-2563c0f7-3f86-4004-a6f4-aeb3ca5aba37 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 05:45:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f94463e-e977-424f-a121-3ed82ec86b36 -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f94463e-e977-424f-a121-3ed82ec86b36 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:45:41 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2ea3b4-b4e1-4fcb-b894-eb19d6dd0751]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:45:41 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2563c0f7-3f86-4004-a6f4-aeb3ca5aba37 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 05:45:41 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:45:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f94463e-e977-424f-a121-3ed82ec86b36 -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f94463e-e977-424f-a121-3ed82ec86b36 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:45:41 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[09254fa8-4ebc-4ae0-844b-6388b292b7f1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f94463e-e977-424f-a121-3ed82ec86b36] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:45:41 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2563c0f7-3f86-4004-a6f4-aeb3ca5aba37 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1f94463e-e977-424f-a121-3ed82ec86b36] added
Aug 15 05:45:41 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:45:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f94463e-e977-424f-a121-3ed82ec86b36 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f94463e-e977-424f-a121-3ed82ec86b36 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:45:41 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c7808bd-20ec-40fe-b076-1d81491c18c6]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:45:41 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2563c0f7-3f86-4004-a6f4-aeb3ca5aba37 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:45:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f94463e-e977-424f-a121-3ed82ec86b36 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f94463e-e977-424f-a121-3ed82ec86b36 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:45:41 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[49609faf-98c5-4b7a-bfc9-44493a9f2f9a]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:45:41 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2563c0f7-3f86-4004-a6f4-aeb3ca5aba37 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:45:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f94463e-e977-424f-a121-3ed82ec86b36 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SOIRrbAV {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f94463e-e977-424f-a121-3ed82ec86b36 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SOIRrbAV" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:45:41 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3851df-de7a-46f4-91c1-0409de46ebf8]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:45:41 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2563c0f7-3f86-4004-a6f4-aeb3ca5aba37 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SOIRrbAV'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:45:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f94463e-e977-424f-a121-3ed82ec86b36 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f94463e-e977-424f-a121-3ed82ec86b36 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:45:41 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b981c2-c004-47f5-9ae8-3e78e4a3de30]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:45:41 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2563c0f7-3f86-4004-a6f4-aeb3ca5aba37 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:45:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:45:41 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[90fb070f-6dc6-4bf8-af04-a453f1e995f3]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:45:41 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2563c0f7-3f86-4004-a6f4-aeb3ca5aba37 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:45:41 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:45:41 user nova-compute[73391]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:45:41 user nova-compute[73391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)
Aug 15 05:45:41 user nova-compute[73391]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)
Aug 15 05:45:41 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:45:41 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2563c0f7-3f86-4004-a6f4-aeb3ca5aba37 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:45:41 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:45:41 user nova-compute[73391]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:45:41 user nova-compute[73391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)
Aug 15 05:45:41 user nova-compute[73391]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)
Aug 15 05:45:41 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:45:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f94463e-e977-424f-a121-3ed82ec86b36 -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f94463e-e977-424f-a121-3ed82ec86b36 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:45:41 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[743c9aa4-e46c-443a-a5d8-85a3de840319]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f94463e-e977-424f-a121-3ed82ec86b36, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1f94463e-e977-424f-a121-3ed82ec86b36, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:45:41 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2563c0f7-3f86-4004-a6f4-aeb3ca5aba37 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1f94463e-e977-424f-a121-3ed82ec86b36, portal: 172.16.0.220,3260]
Aug 15 05:45:41 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:1f94463e-e977-424f-a121-3ed82ec86b36, portal: 172.16.0.220,3260] successful.
Aug 15 05:45:41 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:45:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f94463e-e977-424f-a121-3ed82ec86b36 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f94463e-e977-424f-a121-3ed82ec86b36 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:45:41 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6a4a9e-b0a6-45c3-9d36-4345827a2a2e]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:45:41 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2563c0f7-3f86-4004-a6f4-aeb3ca5aba37 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:45:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:45:41 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[200f098d-02a8-4c25-9935-99ec22332bed]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f94463e-e977-424f-a121-3ed82ec86b36 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:45:41 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2563c0f7-3f86-4004-a6f4-aeb3ca5aba37 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:45:41 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:45:41 user nova-compute[73391]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:45:41 user nova-compute[73391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)
Aug 15 05:45:41 user nova-compute[73391]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)
Aug 15 05:45:41 user nova-compute[73391]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f94463e-e977-424f-a121-3ed82ec86b36 (non-flash)
Aug 15 05:45:41 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:45:41 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2563c0f7-3f86-4004-a6f4-aeb3ca5aba37 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:45:41 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:45:41 user nova-compute[73391]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:45:41 user nova-compute[73391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)
Aug 15 05:45:41 user nova-compute[73391]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)
Aug 15 05:45:41 user nova-compute[73391]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f94463e-e977-424f-a121-3ed82ec86b36 (non-flash)
Aug 15 05:45:41 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:45:41 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-2563c0f7-3f86-4004-a6f4-aeb3ca5aba37 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1f94463e-e977-424f-a121-3ed82ec86b36" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:45:41 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2563c0f7-3f86-4004-a6f4-aeb3ca5aba37 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 05:45:41 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-2563c0f7-3f86-4004-a6f4-aeb3ca5aba37 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] HCTL ('36', '-', '-', 0) found on session 45 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 05:45:41 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-2563c0f7-3f86-4004-a6f4-aeb3ca5aba37 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 05:45:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:45:41 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b111ea6-cb0c-41d1-9bdb-f22f80b2042b]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:45:41 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-2563c0f7-3f86-4004-a6f4-aeb3ca5aba37 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Searching for a device in session 45 and hctl ['36', '*', '*', 0] yield: None {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:45:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:45:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:45:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:45:42 user nova-compute[73391]: DEBUG nova.compute.manager [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Starting instance... {{(pid=73391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 05:45:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:45:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:45:42 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 05:45:42 user nova-compute[73391]: INFO nova.compute.claims [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Claim successful on node user
Aug 15 05:45:42 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-2563c0f7-3f86-4004-a6f4-aeb3ca5aba37 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Searching for a device in session 45 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:45:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2563c0f7-3f86-4004-a6f4-aeb3ca5aba37 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SOIRrbAV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 05:45:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-2563c0f7-3f86-4004-a6f4-aeb3ca5aba37 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:45:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-2563c0f7-3f86-4004-a6f4-aeb3ca5aba37 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '26237646636386337', 'path': '/dev/sde'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:45:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2563c0f7-3f86-4004-a6f4-aeb3ca5aba37 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26237646636386337', 'path': '/dev/sde'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 05:45:42 user nova-compute[73391]: DEBUG nova.objects.instance [None req-2563c0f7-3f86-4004-a6f4-aeb3ca5aba37 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lazy-loading 'flavor' on Instance uuid e8775490-2a9e-44ac-aad7-9450afa4c295 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:45:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-2563c0f7-3f86-4004-a6f4-aeb3ca5aba37 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 05:45:42 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:45:42 user nova-compute[73391]:   <source dev="/dev/sde"/>
Aug 15 05:45:42 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:45:42 user nova-compute[73391]:   <serial>1f94463e-e977-424f-a121-3ed82ec86b36</serial>
Aug 15 05:45:42 user nova-compute[73391]: </disk>
Aug 15 05:45:42 user nova-compute[73391]:  {{(pid=73391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 05:45:42 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:45:42 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:45:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.491s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:45:42 user nova-compute[73391]: DEBUG nova.compute.manager [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Start building networks asynchronously for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 05:45:42 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 05:45:42 user nova-compute[73391]: DEBUG nova.compute.manager [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Allocating IP information in the background. {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 05:45:42 user nova-compute[73391]: DEBUG nova.network.neutron [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] allocate_for_instance() {{(pid=73391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 05:45:42 user nova-compute[73391]: DEBUG nova.compute.manager [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Start building block device mappings for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 05:45:42 user nova-compute[73391]: INFO nova.virt.block_device [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Booting with volume snapshot 5cdea111-047b-405f-bc09-6aad30a51ae6 at /dev/vda
Aug 15 05:45:42 user nova-compute[73391]: DEBUG nova.policy [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aefb6ccab586465dbe56e71a40bcf1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8188c2e8ca34ef1982faa49f1058bb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73391) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 05:45:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-2563c0f7-3f86-4004-a6f4-aeb3ca5aba37 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:45:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-2563c0f7-3f86-4004-a6f4-aeb3ca5aba37 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:45:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-2563c0f7-3f86-4004-a6f4-aeb3ca5aba37 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] No VIF found with MAC fa:16:3e:74:c3:08, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:45:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2563c0f7-3f86-4004-a6f4-aeb3ca5aba37 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lock "e8775490-2a9e-44ac-aad7-9450afa4c295" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.321s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:45:43 user nova-compute[73391]: DEBUG nova.network.neutron [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Successfully created port: 30308440-5072-4c10-a968-c834a87e5e31 {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 05:45:44 user nova-compute[73391]: DEBUG nova.network.neutron [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Successfully updated port: 30308440-5072-4c10-a968-c834a87e5e31 {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:45:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "refresh_cache-b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:45:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquired lock "refresh_cache-b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:45:44 user nova-compute[73391]: DEBUG nova.network.neutron [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:45:44 user nova-compute[73391]: DEBUG nova.compute.manager [req-94c04d44-25ec-4b37-8709-438697bc3e01 req-282e9d8d-ae36-4714-8352-40b594068897 service nova] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Received event network-changed-30308440-5072-4c10-a968-c834a87e5e31 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:45:44 user nova-compute[73391]: DEBUG nova.compute.manager [req-94c04d44-25ec-4b37-8709-438697bc3e01 req-282e9d8d-ae36-4714-8352-40b594068897 service nova] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Refreshing instance network info cache due to event network-changed-30308440-5072-4c10-a968-c834a87e5e31. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:45:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-94c04d44-25ec-4b37-8709-438697bc3e01 req-282e9d8d-ae36-4714-8352-40b594068897 service nova] Acquiring lock "refresh_cache-b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:45:44 user nova-compute[73391]: DEBUG nova.network.neutron [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:45:44 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:45:44 user nova-compute[73391]: DEBUG nova.network.neutron [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Updating instance_info_cache with network_info: [{"id": "30308440-5072-4c10-a968-c834a87e5e31", "address": "fa:16:3e:bb:29:c4", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30308440-50", "ovs_interfaceid": "30308440-5072-4c10-a968-c834a87e5e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:45:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Releasing lock "refresh_cache-b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:45:44 user nova-compute[73391]: DEBUG nova.compute.manager [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Instance network_info: |[{"id": "30308440-5072-4c10-a968-c834a87e5e31", "address": "fa:16:3e:bb:29:c4", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30308440-50", "ovs_interfaceid": "30308440-5072-4c10-a968-c834a87e5e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 05:45:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-94c04d44-25ec-4b37-8709-438697bc3e01 req-282e9d8d-ae36-4714-8352-40b594068897 service nova] Acquired lock "refresh_cache-b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:45:44 user nova-compute[73391]: DEBUG nova.network.neutron [req-94c04d44-25ec-4b37-8709-438697bc3e01 req-282e9d8d-ae36-4714-8352-40b594068897 service nova] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Refreshing network info cache for port 30308440-5072-4c10-a968-c834a87e5e31 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:45:45 user nova-compute[73391]: DEBUG nova.network.neutron [req-94c04d44-25ec-4b37-8709-438697bc3e01 req-282e9d8d-ae36-4714-8352-40b594068897 service nova] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Updated VIF entry in instance network info cache for port 30308440-5072-4c10-a968-c834a87e5e31. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:45:45 user nova-compute[73391]: DEBUG nova.network.neutron [req-94c04d44-25ec-4b37-8709-438697bc3e01 req-282e9d8d-ae36-4714-8352-40b594068897 service nova] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Updating instance_info_cache with network_info: [{"id": "30308440-5072-4c10-a968-c834a87e5e31", "address": "fa:16:3e:bb:29:c4", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30308440-50", "ovs_interfaceid": "30308440-5072-4c10-a968-c834a87e5e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:45:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-94c04d44-25ec-4b37-8709-438697bc3e01 req-282e9d8d-ae36-4714-8352-40b594068897 service nova] Releasing lock "refresh_cache-b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:45:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f8cb3614-e9a1-46a9-9910-a6fffd4a60b2 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Acquiring lock "e8775490-2a9e-44ac-aad7-9450afa4c295" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:45:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f8cb3614-e9a1-46a9-9910-a6fffd4a60b2 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lock "e8775490-2a9e-44ac-aad7-9450afa4c295" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:45:45 user nova-compute[73391]: INFO nova.compute.manager [None req-f8cb3614-e9a1-46a9-9910-a6fffd4a60b2 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Detaching volume 1f94463e-e977-424f-a121-3ed82ec86b36
Aug 15 05:45:45 user nova-compute[73391]: INFO nova.virt.block_device [None req-f8cb3614-e9a1-46a9-9910-a6fffd4a60b2 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Attempting to driver detach volume 1f94463e-e977-424f-a121-3ed82ec86b36 from mountpoint /dev/vdb
Aug 15 05:45:45 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f8cb3614-e9a1-46a9-9910-a6fffd4a60b2 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Attempting to detach device vdb from instance e8775490-2a9e-44ac-aad7-9450afa4c295 from the persistent domain config. {{(pid=73391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 05:45:45 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-f8cb3614-e9a1-46a9-9910-a6fffd4a60b2 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 05:45:45 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:45:45 user nova-compute[73391]:   <source dev="/dev/sde"/>
Aug 15 05:45:45 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:45:45 user nova-compute[73391]:   <serial>1f94463e-e977-424f-a121-3ed82ec86b36</serial>
Aug 15 05:45:45 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 05:45:45 user nova-compute[73391]: </disk>
Aug 15 05:45:45 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 05:45:45 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-f8cb3614-e9a1-46a9-9910-a6fffd4a60b2 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Successfully detached device vdb from instance e8775490-2a9e-44ac-aad7-9450afa4c295 from the persistent domain config.
Aug 15 05:45:45 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f8cb3614-e9a1-46a9-9910-a6fffd4a60b2 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e8775490-2a9e-44ac-aad7-9450afa4c295 from the live domain config. {{(pid=73391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 05:45:45 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-f8cb3614-e9a1-46a9-9910-a6fffd4a60b2 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 05:45:45 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:45:45 user nova-compute[73391]:   <source dev="/dev/sde"/>
Aug 15 05:45:45 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:45:45 user nova-compute[73391]:   <serial>1f94463e-e977-424f-a121-3ed82ec86b36</serial>
Aug 15 05:45:45 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 05:45:45 user nova-compute[73391]: </disk>
Aug 15 05:45:45 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 05:45:46 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Received event <DeviceRemovedEvent: 1692078346.1057057, e8775490-2a9e-44ac-aad7-9450afa4c295 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73391) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 05:45:46 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f8cb3614-e9a1-46a9-9910-a6fffd4a60b2 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e8775490-2a9e-44ac-aad7-9450afa4c295 {{(pid=73391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 05:45:46 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-f8cb3614-e9a1-46a9-9910-a6fffd4a60b2 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Successfully detached device vdb from instance e8775490-2a9e-44ac-aad7-9450afa4c295 from the live domain config.
Aug 15 05:45:46 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8cb3614-e9a1-46a9-9910-a6fffd4a60b2 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 05:45:46 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8cb3614-e9a1-46a9-9910-a6fffd4a60b2 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:1f94463e-e977-424f-a121-3ed82ec86b36'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SOIRrbAV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:45:46 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-f8cb3614-e9a1-46a9-9910-a6fffd4a60b2 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:45:46 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-f8cb3614-e9a1-46a9-9910-a6fffd4a60b2 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:45:46 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-f8cb3614-e9a1-46a9-9910-a6fffd4a60b2 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:45:46 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8cb3614-e9a1-46a9-9910-a6fffd4a60b2 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f94463e-e977-424f-a121-3ed82ec86b36', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 05:45:46 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:46 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:45:46 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[03fc7ff1-494c-4209-a584-e1703de8bc8e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1f94463e-e977-424f-a121-3ed82ec86b36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:45:46 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:46 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:45:46 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[defdf830-065d-4608-8242-76b388051022]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f94463e-e977-424f-a121-3ed82ec86b36 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:45:46 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8cb3614-e9a1-46a9-9910-a6fffd4a60b2 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:45:46 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:45:46 user nova-compute[73391]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:45:46 user nova-compute[73391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)
Aug 15 05:45:46 user nova-compute[73391]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)
Aug 15 05:45:46 user nova-compute[73391]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f94463e-e977-424f-a121-3ed82ec86b36 (non-flash)
Aug 15 05:45:46 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:45:46 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8cb3614-e9a1-46a9-9910-a6fffd4a60b2 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:45:46 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:45:46 user nova-compute[73391]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:45:46 user nova-compute[73391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)
Aug 15 05:45:46 user nova-compute[73391]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)
Aug 15 05:45:46 user nova-compute[73391]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1f94463e-e977-424f-a121-3ed82ec86b36 (non-flash)
Aug 15 05:45:46 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:45:46 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8cb3614-e9a1-46a9-9910-a6fffd4a60b2 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77282d08b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f94463e-e977-424f-a121-3ed82ec86b36'): ({'sde'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 05:45:46 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-f8cb3614-e9a1-46a9-9910-a6fffd4a60b2 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Removing single pathed devices sde {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 05:45:46 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:46 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:45:46 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a69e8e-f810-47d8-8b23-a276cb4fd764]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:45:46 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:46 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:45:46 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d930d92-922a-47a8-bb24-9e876caaff13]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:45:46 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-f8cb3614-e9a1-46a9-9910-a6fffd4a60b2 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Flushing IO for device /dev/sde {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 05:45:46 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:46 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:45:46 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[15629f84-785a-4d56-bec4-d2812f2ad58a]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:45:46 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-f8cb3614-e9a1-46a9-9910-a6fffd4a60b2 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 05:45:46 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:46 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.031s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:45:46 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41f14a5-3c99-4b24-be2e-2d8c73aa0639]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:45:46 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-f8cb3614-e9a1-46a9-9910-a6fffd4a60b2 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 05:45:46 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-f8cb3614-e9a1-46a9-9910-a6fffd4a60b2 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] SCSI volumes sde have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 05:45:46 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8cb3614-e9a1-46a9-9910-a6fffd4a60b2 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1f94463e-e977-424f-a121-3ed82ec86b36')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 05:45:46 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f94463e-e977-424f-a121-3ed82ec86b36 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:46 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f94463e-e977-424f-a121-3ed82ec86b36 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:45:46 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d33d8ac-5f20-43ff-a786-4fd28bff6799]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:45:46 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8cb3614-e9a1-46a9-9910-a6fffd4a60b2 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:45:46 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f94463e-e977-424f-a121-3ed82ec86b36 -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:46 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f94463e-e977-424f-a121-3ed82ec86b36 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:45:46 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[13773123-131b-4578-92cf-acd7e29d848c]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:1f94463e-e977-424f-a121-3ed82ec86b36, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:1f94463e-e977-424f-a121-3ed82ec86b36, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:45:46 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8cb3614-e9a1-46a9-9910-a6fffd4a60b2 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:1f94463e-e977-424f-a121-3ed82ec86b36, portal: 172.16.0.220,3260]
Aug 15 05:45:46 user nova-compute[73391]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:1f94463e-e977-424f-a121-3ed82ec86b36, portal: 172.16.0.220,3260] successful.
Aug 15 05:45:46 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:45:46 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1f94463e-e977-424f-a121-3ed82ec86b36 -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:46 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1f94463e-e977-424f-a121-3ed82ec86b36 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:45:46 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c2b2b4-ab83-4fa5-944f-c01f7d057230]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:45:46 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8cb3614-e9a1-46a9-9910-a6fffd4a60b2 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:45:46 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-f8cb3614-e9a1-46a9-9910-a6fffd4a60b2 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:45:46 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-f8cb3614-e9a1-46a9-9910-a6fffd4a60b2 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] <== disconnect_volume: return (285ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:45:46 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f8cb3614-e9a1-46a9-9910-a6fffd4a60b2 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 05:45:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:45:47 user nova-compute[73391]: DEBUG nova.objects.instance [None req-f8cb3614-e9a1-46a9-9910-a6fffd4a60b2 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lazy-loading 'flavor' on Instance uuid e8775490-2a9e-44ac-aad7-9450afa4c295 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:45:47 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f8cb3614-e9a1-46a9-9910-a6fffd4a60b2 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lock "e8775490-2a9e-44ac-aad7-9450afa4c295" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.649s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:45:48 user nova-compute[73391]: DEBUG os_brick.utils [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:45:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:45:48 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2104f80f-c9a4-4c00-a718-03cd3f9c354b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:45:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:45:48 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e906dc9f-21d8-468d-ae9e-4fb2ac319cde]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:45:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:45:48 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d84fa5-fe8f-4ce8-8120-f2b2affe318c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:45:48 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[457fd12b-4297-4f1f-af03-efa3ba275fa3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:45:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:45:48 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 05:45:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:48 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:45:48 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 05:45:48 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[baba950c-4281-4f6c-bd7a-601955fc70b9]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:45:48 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 05:45:48 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 05:45:48 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 05:45:48 user nova-compute[73391]: DEBUG os_brick.utils [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:45:48 user nova-compute[73391]: DEBUG nova.virt.block_device [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Updating existing volume attachment record: 5384f069-6fab-4900-b295-7de10273db27 {{(pid=73391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 05:45:49 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:45:49 user nova-compute[73391]: WARNING nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] While synchronizing instance power states, found 13 instances in the database and 12 instances on the hypervisor.
Aug 15 05:45:49 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Triggering sync for uuid 8f08782b-f793-415e-b0d6-5caad1c3d426 {{(pid=73391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 05:45:49 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Triggering sync for uuid 6ac9d5dc-56be-402f-b9d4-3327bdfd9220 {{(pid=73391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 05:45:49 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Triggering sync for uuid 6358e825-5705-45d6-86b6-3aacfa5a9bbb {{(pid=73391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 05:45:49 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Triggering sync for uuid b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1 {{(pid=73391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 05:45:49 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Triggering sync for uuid 730890c6-6999-4a0f-b80c-e4745bff99ab {{(pid=73391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 05:45:49 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Triggering sync for uuid 8ff2da51-5bfd-4cdc-8cef-330cdef93d97 {{(pid=73391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 05:45:49 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Triggering sync for uuid 8991b32e-6c4b-4c66-a320-e734061f49ee {{(pid=73391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 05:45:49 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Triggering sync for uuid d60616bb-605e-4604-b637-56670f53159e {{(pid=73391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 05:45:49 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Triggering sync for uuid dc657d66-c3f8-44e5-b30e-3d79e586a8f3 {{(pid=73391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 05:45:49 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Triggering sync for uuid e8775490-2a9e-44ac-aad7-9450afa4c295 {{(pid=73391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 05:45:49 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Triggering sync for uuid c5d5343f-b8f4-46b7-92fc-66452212192b {{(pid=73391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 05:45:49 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Triggering sync for uuid 7521ed98-75ed-43eb-83a2-d41502698aec {{(pid=73391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 05:45:49 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Triggering sync for uuid b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1 {{(pid=73391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 05:45:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "8f08782b-f793-415e-b0d6-5caad1c3d426" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:45:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "8f08782b-f793-415e-b0d6-5caad1c3d426" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:45:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "6ac9d5dc-56be-402f-b9d4-3327bdfd9220" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:45:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "6ac9d5dc-56be-402f-b9d4-3327bdfd9220" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:45:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "6358e825-5705-45d6-86b6-3aacfa5a9bbb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:45:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "6358e825-5705-45d6-86b6-3aacfa5a9bbb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:45:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:45:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:45:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "730890c6-6999-4a0f-b80c-e4745bff99ab" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:45:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "730890c6-6999-4a0f-b80c-e4745bff99ab" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:45:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "8ff2da51-5bfd-4cdc-8cef-330cdef93d97" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:45:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "8ff2da51-5bfd-4cdc-8cef-330cdef93d97" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:45:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "8991b32e-6c4b-4c66-a320-e734061f49ee" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:45:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "8991b32e-6c4b-4c66-a320-e734061f49ee" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:45:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "d60616bb-605e-4604-b637-56670f53159e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:45:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "d60616bb-605e-4604-b637-56670f53159e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:45:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "dc657d66-c3f8-44e5-b30e-3d79e586a8f3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:45:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "dc657d66-c3f8-44e5-b30e-3d79e586a8f3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:45:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "e8775490-2a9e-44ac-aad7-9450afa4c295" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:45:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "e8775490-2a9e-44ac-aad7-9450afa4c295" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:45:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "c5d5343f-b8f4-46b7-92fc-66452212192b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:45:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "c5d5343f-b8f4-46b7-92fc-66452212192b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:45:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "7521ed98-75ed-43eb-83a2-d41502698aec" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:45:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "7521ed98-75ed-43eb-83a2-d41502698aec" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:45:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:45:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "6ac9d5dc-56be-402f-b9d4-3327bdfd9220" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:45:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "8f08782b-f793-415e-b0d6-5caad1c3d426" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:45:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "6358e825-5705-45d6-86b6-3aacfa5a9bbb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:45:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "8ff2da51-5bfd-4cdc-8cef-330cdef93d97" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:45:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "730890c6-6999-4a0f-b80c-e4745bff99ab" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:45:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:45:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "d60616bb-605e-4604-b637-56670f53159e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:45:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "dc657d66-c3f8-44e5-b30e-3d79e586a8f3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.073s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:45:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "8991b32e-6c4b-4c66-a320-e734061f49ee" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:45:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "e8775490-2a9e-44ac-aad7-9450afa4c295" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:45:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "c5d5343f-b8f4-46b7-92fc-66452212192b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.090s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:45:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "7521ed98-75ed-43eb-83a2-d41502698aec" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.095s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:45:49 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:45:51 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:45:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG nova.compute.manager [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Start spawning the instance on the hypervisor. {{(pid=73391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Creating instance directory {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 05:45:58 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Creating image(s)
Aug 15 05:45:58 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Did not create local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Ensure instance console log exists: /opt/stack/data/nova/instances/b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Start _get_guest_xml network_info=[{"id": "30308440-5072-4c10-a968-c834a87e5e31", "address": "fa:16:3e:bb:29:c4", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30308440-50", "ovs_interfaceid": "30308440-5072-4c10-a968-c834a87e5e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-15T05:45:32Z,direct_url=<?>,disk_format='qcow2',id=54e1959e-4a91-4611-b4c3-b99f47b3ee68,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-37978367',owner='a8188c2e8ca34ef1982faa49f1058bb7',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-15T05:45:34Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hcagjUZR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1', 'attached_at': '', 'detached_at': '', 'volume_id': '3743fc93-2f89-4c1e-b125-25a8de5c4be6', 'serial': '3743fc93-2f89-4c1e-b125-25a8de5c4be6'}, 'attachment_id': '5384f069-6fab-4900-b295-7de10273db27', 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'volume_type': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:45:58 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:45:58 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:45:58 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-08-15T05:45:32Z,direct_url=<?>,disk_format='qcow2',id=54e1959e-4a91-4611-b4c3-b99f47b3ee68,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-37978367',owner='a8188c2e8ca34ef1982faa49f1058bb7',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-08-15T05:45:34Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hcagjUZR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:45:58 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:45:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:45:58 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:45:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:45:58 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 05:45:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6 -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5214ccae-7c5d-4447-9dff-b660e4f53824]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 05:45:58 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6 -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[69758429-9aa2-4008-945e-ea97d05794c5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6] added
Aug 15 05:45:58 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b8de7aa-e6be-4687-9b83-db181171a800]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dafc2c9-9a9c-426e-bf62-7fa0757976ac]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hcagjUZR {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hcagjUZR" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e4e584b-9f26-4ad0-867a-eeee8eaebe9a]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hcagjUZR'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f1c729-78c5-4f6b-94fb-4009562b6612]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec038842-5a91-41b3-a9b6-aa53fd57c7ab]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:45:58 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:45:58 user nova-compute[73391]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:45:58 user nova-compute[73391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)
Aug 15 05:45:58 user nova-compute[73391]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)
Aug 15 05:45:58 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:45:58 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:45:58 user nova-compute[73391]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:45:58 user nova-compute[73391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)
Aug 15 05:45:58 user nova-compute[73391]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)
Aug 15 05:45:58 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6 -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9dc375-fee5-4208-b306-0c3334d4be3e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6, portal: 172.16.0.220,3260]
Aug 15 05:45:58 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6, portal: 172.16.0.220,3260] successful.
Aug 15 05:45:58 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[82454548-a0d7-4e14-bc73-ad92b1b1101b]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[119563dd-14a3-4c5d-9c18-9e83ca055d9c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:45:58 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:45:58 user nova-compute[73391]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:45:58 user nova-compute[73391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)
Aug 15 05:45:58 user nova-compute[73391]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)
Aug 15 05:45:58 user nova-compute[73391]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6 (non-flash)
Aug 15 05:45:58 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:45:58 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:45:58 user nova-compute[73391]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:45:58 user nova-compute[73391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)
Aug 15 05:45:58 user nova-compute[73391]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)
Aug 15 05:45:58 user nova-compute[73391]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6 (non-flash)
Aug 15 05:45:58 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] HCTL ('36', '-', '-', 0) found on session 46 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8e62e9-a369-45e1-bdcf-c55e6e74f748]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:45:58 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Searching for a device in session 46 and hctl ['36', '*', '*', 0] yield: None {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:45:59 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Searching for a device in session 46 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:45:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hcagjUZR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 05:45:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:45:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '26235376537623431', 'path': '/dev/sde'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:45:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235376537623431', 'path': '/dev/sde'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 05:45:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:45:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1287006649',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1287006649',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1287006649',id=35,image_ref='54e1959e-4a91-4611-b4c3-b99f47b3ee68',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBELgb49ZFbiL7eRPZflWHjY7cSOKPk07ofv15CxT2Yf4tzqX2ZgQkBYwrBPYBlD0623h5S4vhuR2ueG0ksiGIG5cyRM5y5Q0Cdj0ARyMTqBhwXZJob+w/aT/dTv424B3tA==',key_name='tempest-keypair-1789217056',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8188c2e8ca34ef1982faa49f1058bb7',ramdisk_id='',reservation_id='r-mk61302f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1834029963',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1834029963-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1834029963',owner_user_name='tempest-TestVolumeBootPattern-1834029963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:45:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aefb6ccab586465dbe56e71a40bcf1f0',uuid=b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30308440-5072-4c10-a968-c834a87e5e31", "address": "fa:16:3e:bb:29:c4", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30308440-50", "ovs_interfaceid": "30308440-5072-4c10-a968-c834a87e5e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:45:59 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Converting VIF {"id": "30308440-5072-4c10-a968-c834a87e5e31", "address": "fa:16:3e:bb:29:c4", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30308440-50", "ovs_interfaceid": "30308440-5072-4c10-a968-c834a87e5e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:45:59 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:29:c4,bridge_name='br-int',has_traffic_filtering=True,id=30308440-5072-4c10-a968-c834a87e5e31,network=Network(fae0e46a-88e4-499d-bcff-5b7df55eab4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30308440-50') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:45:59 user nova-compute[73391]: DEBUG nova.objects.instance [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lazy-loading 'pci_devices' on Instance uuid b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:45:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:45:59 user nova-compute[73391]:   <uuid>b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1</uuid>
Aug 15 05:45:59 user nova-compute[73391]:   <name>instance-00000023</name>
Aug 15 05:45:59 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:45:59 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:45:59 user nova-compute[73391]:   <metadata>
Aug 15 05:45:59 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:45:59 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:45:59 user nova-compute[73391]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1287006649</nova:name>
Aug 15 05:45:59 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:45:58</nova:creationTime>
Aug 15 05:45:59 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:45:59 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:45:59 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:45:59 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:45:59 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:45:59 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:45:59 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:45:59 user nova-compute[73391]:       <nova:owner>
Aug 15 05:45:59 user nova-compute[73391]:         <nova:user uuid="aefb6ccab586465dbe56e71a40bcf1f0">tempest-TestVolumeBootPattern-1834029963-project-member</nova:user>
Aug 15 05:45:59 user nova-compute[73391]:         <nova:project uuid="a8188c2e8ca34ef1982faa49f1058bb7">tempest-TestVolumeBootPattern-1834029963</nova:project>
Aug 15 05:45:59 user nova-compute[73391]:       </nova:owner>
Aug 15 05:45:59 user nova-compute[73391]:       <nova:root type="image" uuid="54e1959e-4a91-4611-b4c3-b99f47b3ee68"/>
Aug 15 05:45:59 user nova-compute[73391]:       <nova:ports>
Aug 15 05:45:59 user nova-compute[73391]:         <nova:port uuid="30308440-5072-4c10-a968-c834a87e5e31">
Aug 15 05:45:59 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 05:45:59 user nova-compute[73391]:         </nova:port>
Aug 15 05:45:59 user nova-compute[73391]:       </nova:ports>
Aug 15 05:45:59 user nova-compute[73391]:     </nova:instance>
Aug 15 05:45:59 user nova-compute[73391]:   </metadata>
Aug 15 05:45:59 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:45:59 user nova-compute[73391]:     <system>
Aug 15 05:45:59 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:45:59 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:45:59 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:45:59 user nova-compute[73391]:       <entry name="serial">b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1</entry>
Aug 15 05:45:59 user nova-compute[73391]:       <entry name="uuid">b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1</entry>
Aug 15 05:45:59 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:45:59 user nova-compute[73391]:     </system>
Aug 15 05:45:59 user nova-compute[73391]:   </sysinfo>
Aug 15 05:45:59 user nova-compute[73391]:   <os>
Aug 15 05:45:59 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:45:59 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:45:59 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:45:59 user nova-compute[73391]:   </os>
Aug 15 05:45:59 user nova-compute[73391]:   <features>
Aug 15 05:45:59 user nova-compute[73391]:     <acpi/>
Aug 15 05:45:59 user nova-compute[73391]:     <apic/>
Aug 15 05:45:59 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:45:59 user nova-compute[73391]:   </features>
Aug 15 05:45:59 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:45:59 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:45:59 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:45:59 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:45:59 user nova-compute[73391]:   </clock>
Aug 15 05:45:59 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:45:59 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:45:59 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:45:59 user nova-compute[73391]:   </cpu>
Aug 15 05:45:59 user nova-compute[73391]:   <devices>
Aug 15 05:45:59 user nova-compute[73391]:     <disk type="block" device="disk">
Aug 15 05:45:59 user nova-compute[73391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:45:59 user nova-compute[73391]:       <source dev="/dev/sde"/>
Aug 15 05:45:59 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:45:59 user nova-compute[73391]:       <serial>3743fc93-2f89-4c1e-b125-25a8de5c4be6</serial>
Aug 15 05:45:59 user nova-compute[73391]:     </disk>
Aug 15 05:45:59 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:45:59 user nova-compute[73391]:       <mac address="fa:16:3e:bb:29:c4"/>
Aug 15 05:45:59 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:45:59 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:45:59 user nova-compute[73391]:       <target dev="tap30308440-50"/>
Aug 15 05:45:59 user nova-compute[73391]:     </interface>
Aug 15 05:45:59 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:45:59 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1/console.log" append="off"/>
Aug 15 05:45:59 user nova-compute[73391]:     </serial>
Aug 15 05:45:59 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:45:59 user nova-compute[73391]:     <video>
Aug 15 05:45:59 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:45:59 user nova-compute[73391]:     </video>
Aug 15 05:45:59 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:45:59 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:45:59 user nova-compute[73391]:     </rng>
Aug 15 05:45:59 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:45:59 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:45:59 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:45:59 user nova-compute[73391]:     </memballoon>
Aug 15 05:45:59 user nova-compute[73391]:   </devices>
Aug 15 05:45:59 user nova-compute[73391]: </domain>
Aug 15 05:45:59 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:45:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:45:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1287006649',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1287006649',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1287006649',id=35,image_ref='54e1959e-4a91-4611-b4c3-b99f47b3ee68',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBELgb49ZFbiL7eRPZflWHjY7cSOKPk07ofv15CxT2Yf4tzqX2ZgQkBYwrBPYBlD0623h5S4vhuR2ueG0ksiGIG5cyRM5y5Q0Cdj0ARyMTqBhwXZJob+w/aT/dTv424B3tA==',key_name='tempest-keypair-1789217056',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8188c2e8ca34ef1982faa49f1058bb7',ramdisk_id='',reservation_id='r-mk61302f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1834029963',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1834029963-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1834029963',owner_user_name='tempest-TestVolumeBootPattern-1834029963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:45:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aefb6ccab586465dbe56e71a40bcf1f0',uuid=b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "30308440-5072-4c10-a968-c834a87e5e31", "address": "fa:16:3e:bb:29:c4", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30308440-50", "ovs_interfaceid": "30308440-5072-4c10-a968-c834a87e5e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:45:59 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Converting VIF {"id": "30308440-5072-4c10-a968-c834a87e5e31", "address": "fa:16:3e:bb:29:c4", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30308440-50", "ovs_interfaceid": "30308440-5072-4c10-a968-c834a87e5e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:45:59 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:29:c4,bridge_name='br-int',has_traffic_filtering=True,id=30308440-5072-4c10-a968-c834a87e5e31,network=Network(fae0e46a-88e4-499d-bcff-5b7df55eab4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30308440-50') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:45:59 user nova-compute[73391]: DEBUG os_vif [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:29:c4,bridge_name='br-int',has_traffic_filtering=True,id=30308440-5072-4c10-a968-c834a87e5e31,network=Network(fae0e46a-88e4-499d-bcff-5b7df55eab4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30308440-50') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:45:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:45:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:45:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:45:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:45:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap30308440-50, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:45:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap30308440-50, col_values=(('external_ids', {'iface-id': '30308440-5072-4c10-a968-c834a87e5e31', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:29:c4', 'vm-uuid': 'b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:45:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:45:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:45:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:45:59 user nova-compute[73391]: INFO os_vif [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:29:c4,bridge_name='br-int',has_traffic_filtering=True,id=30308440-5072-4c10-a968-c834a87e5e31,network=Network(fae0e46a-88e4-499d-bcff-5b7df55eab4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30308440-50')
Aug 15 05:45:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:45:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] No VIF found with MAC fa:16:3e:bb:29:c4, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:46:01 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:01 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:01 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:01 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:01 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:01 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:01 user nova-compute[73391]: DEBUG nova.compute.manager [req-57239369-09aa-4409-a68b-f4ec8eef322c req-2d91d518-d727-4a1b-a7da-c32a1e9feeba service nova] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Received event network-vif-plugged-30308440-5072-4c10-a968-c834a87e5e31 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:46:01 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-57239369-09aa-4409-a68b-f4ec8eef322c req-2d91d518-d727-4a1b-a7da-c32a1e9feeba service nova] Acquiring lock "b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:46:01 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-57239369-09aa-4409-a68b-f4ec8eef322c req-2d91d518-d727-4a1b-a7da-c32a1e9feeba service nova] Lock "b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:46:01 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-57239369-09aa-4409-a68b-f4ec8eef322c req-2d91d518-d727-4a1b-a7da-c32a1e9feeba service nova] Lock "b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:46:01 user nova-compute[73391]: DEBUG nova.compute.manager [req-57239369-09aa-4409-a68b-f4ec8eef322c req-2d91d518-d727-4a1b-a7da-c32a1e9feeba service nova] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] No waiting events found dispatching network-vif-plugged-30308440-5072-4c10-a968-c834a87e5e31 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:46:01 user nova-compute[73391]: WARNING nova.compute.manager [req-57239369-09aa-4409-a68b-f4ec8eef322c req-2d91d518-d727-4a1b-a7da-c32a1e9feeba service nova] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Received unexpected event network-vif-plugged-30308440-5072-4c10-a968-c834a87e5e31 for instance with vm_state building and task_state spawning.
Aug 15 05:46:03 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078363.3174474, b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1 => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:46:03 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] VM Resumed (Lifecycle Event)
Aug 15 05:46:03 user nova-compute[73391]: DEBUG nova.compute.manager [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:46:03 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Guest created on hypervisor {{(pid=73391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 05:46:03 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Instance spawned successfully.
Aug 15 05:46:03 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 05:46:03 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Found default for hw_input_bus of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:46:03 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Found default for hw_pointer_model of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:46:03 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:46:03 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:46:03 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:46:03 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078363.3191998, b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1 => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:46:03 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] VM Started (Lifecycle Event)
Aug 15 05:46:03 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:46:03 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:46:03 user nova-compute[73391]: INFO nova.compute.manager [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Took 5.02 seconds to spawn the instance on the hypervisor.
Aug 15 05:46:03 user nova-compute[73391]: DEBUG nova.compute.manager [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:46:03 user nova-compute[73391]: DEBUG nova.compute.manager [req-954470de-1a25-4229-a5dd-2922688f4307 req-77867246-385d-4815-9431-4dfd0c766451 service nova] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Received event network-vif-plugged-30308440-5072-4c10-a968-c834a87e5e31 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:46:03 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-954470de-1a25-4229-a5dd-2922688f4307 req-77867246-385d-4815-9431-4dfd0c766451 service nova] Acquiring lock "b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:46:03 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-954470de-1a25-4229-a5dd-2922688f4307 req-77867246-385d-4815-9431-4dfd0c766451 service nova] Lock "b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:46:03 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-954470de-1a25-4229-a5dd-2922688f4307 req-77867246-385d-4815-9431-4dfd0c766451 service nova] Lock "b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:46:03 user nova-compute[73391]: DEBUG nova.compute.manager [req-954470de-1a25-4229-a5dd-2922688f4307 req-77867246-385d-4815-9431-4dfd0c766451 service nova] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] No waiting events found dispatching network-vif-plugged-30308440-5072-4c10-a968-c834a87e5e31 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:46:03 user nova-compute[73391]: WARNING nova.compute.manager [req-954470de-1a25-4229-a5dd-2922688f4307 req-77867246-385d-4815-9431-4dfd0c766451 service nova] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Received unexpected event network-vif-plugged-30308440-5072-4c10-a968-c834a87e5e31 for instance with vm_state building and task_state spawning.
Aug 15 05:46:03 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:46:03 user nova-compute[73391]: INFO nova.compute.manager [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Took 21.30 seconds to build instance.
Aug 15 05:46:03 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7f303989-a71a-40e7-9949-d08b3fbe79f2 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.388s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:46:03 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 14.262s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:46:03 user nova-compute[73391]: INFO nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Aug 15 05:46:03 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:46:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Acquiring lock "c043ca2f-6468-4b32-ae53-40da261fd1fa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:46:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "c043ca2f-6468-4b32-ae53-40da261fd1fa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:46:04 user nova-compute[73391]: DEBUG nova.compute.manager [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Starting instance... {{(pid=73391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 05:46:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:46:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:46:04 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 05:46:04 user nova-compute[73391]: INFO nova.compute.claims [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Claim successful on node user
Aug 15 05:46:04 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Refreshing inventories for resource provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 05:46:04 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Updating ProviderTree inventory for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 05:46:04 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Updating inventory in ProviderTree for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 05:46:04 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Refreshing aggregate associations for resource provider 771708bd-6a2a-4e0c-9869-46d45e6b1896, aggregates: None {{(pid=73391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 05:46:04 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Refreshing trait associations for resource provider 771708bd-6a2a-4e0c-9869-46d45e6b1896, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=73391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 05:46:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:05 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:46:05 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:46:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.603s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:46:05 user nova-compute[73391]: DEBUG nova.compute.manager [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Start building networks asynchronously for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 05:46:05 user nova-compute[73391]: DEBUG nova.compute.manager [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Allocating IP information in the background. {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 05:46:05 user nova-compute[73391]: DEBUG nova.network.neutron [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] allocate_for_instance() {{(pid=73391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 05:46:05 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 05:46:05 user nova-compute[73391]: DEBUG nova.compute.manager [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Start building block device mappings for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 05:46:05 user nova-compute[73391]: DEBUG nova.policy [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '02352e5b84f04d0e9975b8b8e5594b92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f88922b3c294aea9efa3d80909a171a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73391) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 05:46:05 user nova-compute[73391]: DEBUG nova.compute.manager [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Start spawning the instance on the hypervisor. {{(pid=73391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 05:46:05 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Creating instance directory {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 05:46:05 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Creating image(s)
Aug 15 05:46:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Acquiring lock "/opt/stack/data/nova/instances/c043ca2f-6468-4b32-ae53-40da261fd1fa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:46:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "/opt/stack/data/nova/instances/c043ca2f-6468-4b32-ae53-40da261fd1fa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:46:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "/opt/stack/data/nova/instances/c043ca2f-6468-4b32-ae53-40da261fd1fa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:46:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.194s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Acquiring lock "999b315ba87151d8252d543312ae7790e7e1583b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:46:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:46:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.181s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/c043ca2f-6468-4b32-ae53-40da261fd1fa/disk 1073741824 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/c043ca2f-6468-4b32-ae53-40da261fd1fa/disk 1073741824" returned: 0 in 0.052s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.240s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:46:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.190s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:05 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c043ca2f-6468-4b32-ae53-40da261fd1fa/disk. size=1073741824 {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 05:46:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c043ca2f-6468-4b32-ae53-40da261fd1fa/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:05 user nova-compute[73391]: DEBUG nova.network.neutron [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Successfully created port: 8919b46b-766f-4499-8179-1d8538dba72e {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 05:46:06 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c043ca2f-6468-4b32-ae53-40da261fd1fa/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:06 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Cannot resize image /opt/stack/data/nova/instances/c043ca2f-6468-4b32-ae53-40da261fd1fa/disk to a smaller size. {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 05:46:06 user nova-compute[73391]: DEBUG nova.objects.instance [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lazy-loading 'migration_context' on Instance uuid c043ca2f-6468-4b32-ae53-40da261fd1fa {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:46:06 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Created local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 05:46:06 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Ensure instance console log exists: /opt/stack/data/nova/instances/c043ca2f-6468-4b32-ae53-40da261fd1fa/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 05:46:06 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:46:06 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:46:06 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:46:06 user nova-compute[73391]: DEBUG nova.network.neutron [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Successfully updated port: 8919b46b-766f-4499-8179-1d8538dba72e {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:46:06 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Acquiring lock "refresh_cache-c043ca2f-6468-4b32-ae53-40da261fd1fa" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:46:06 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Acquired lock "refresh_cache-c043ca2f-6468-4b32-ae53-40da261fd1fa" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:46:06 user nova-compute[73391]: DEBUG nova.network.neutron [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:46:06 user nova-compute[73391]: DEBUG nova.compute.manager [req-7cdb5e04-b4f2-4785-8a04-d218a082c793 req-7939fa21-49f6-4c20-a099-f6e3f25b1b37 service nova] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Received event network-changed-8919b46b-766f-4499-8179-1d8538dba72e {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:46:06 user nova-compute[73391]: DEBUG nova.compute.manager [req-7cdb5e04-b4f2-4785-8a04-d218a082c793 req-7939fa21-49f6-4c20-a099-f6e3f25b1b37 service nova] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Refreshing instance network info cache due to event network-changed-8919b46b-766f-4499-8179-1d8538dba72e. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:46:06 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-7cdb5e04-b4f2-4785-8a04-d218a082c793 req-7939fa21-49f6-4c20-a099-f6e3f25b1b37 service nova] Acquiring lock "refresh_cache-c043ca2f-6468-4b32-ae53-40da261fd1fa" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:46:06 user nova-compute[73391]: DEBUG nova.network.neutron [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:46:07 user nova-compute[73391]: DEBUG nova.network.neutron [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Updating instance_info_cache with network_info: [{"id": "8919b46b-766f-4499-8179-1d8538dba72e", "address": "fa:16:3e:56:33:74", "network": {"id": "c94dfbf4-6803-458e-b2c6-231298da7bc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090354282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f88922b3c294aea9efa3d80909a171a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8919b46b-76", "ovs_interfaceid": "8919b46b-766f-4499-8179-1d8538dba72e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:46:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Releasing lock "refresh_cache-c043ca2f-6468-4b32-ae53-40da261fd1fa" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:46:07 user nova-compute[73391]: DEBUG nova.compute.manager [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Instance network_info: |[{"id": "8919b46b-766f-4499-8179-1d8538dba72e", "address": "fa:16:3e:56:33:74", "network": {"id": "c94dfbf4-6803-458e-b2c6-231298da7bc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090354282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f88922b3c294aea9efa3d80909a171a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8919b46b-76", "ovs_interfaceid": "8919b46b-766f-4499-8179-1d8538dba72e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 05:46:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-7cdb5e04-b4f2-4785-8a04-d218a082c793 req-7939fa21-49f6-4c20-a099-f6e3f25b1b37 service nova] Acquired lock "refresh_cache-c043ca2f-6468-4b32-ae53-40da261fd1fa" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:46:07 user nova-compute[73391]: DEBUG nova.network.neutron [req-7cdb5e04-b4f2-4785-8a04-d218a082c793 req-7939fa21-49f6-4c20-a099-f6e3f25b1b37 service nova] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Refreshing network info cache for port 8919b46b-766f-4499-8179-1d8538dba72e {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:46:07 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Start _get_guest_xml network_info=[{"id": "8919b46b-766f-4499-8179-1d8538dba72e", "address": "fa:16:3e:56:33:74", "network": {"id": "c94dfbf4-6803-458e-b2c6-231298da7bc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090354282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f88922b3c294aea9efa3d80909a171a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8919b46b-76", "ovs_interfaceid": "8919b46b-766f-4499-8179-1d8538dba72e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '191b1dad-305e-4d1c-9b15-515ec59a3278'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:46:07 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:46:07 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:46:07 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:46:07 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:46:07 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:46:07 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:46:07 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:46:07 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:46:07 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:46:07 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:46:07 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:46:07 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:46:07 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:46:07 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:46:07 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:46:07 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:46:07 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:46:07 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:46:07 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:46:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-496164599',display_name='tempest-AttachVolumeTestJSON-server-496164599',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-496164599',id=36,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBElvPkTX4381T4Wb55ypwBw8/CJ1olD+kxdnn30P0DQ3o/nxtf0e9aCDlGQ9X6LUsMvM0abg1mcHFH2ya++sTl/qlW8tjZ0A1o/PTJ9H6ifvsi7j4RpokC3s4TVPAq9mWA==',key_name='tempest-keypair-608359081',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f88922b3c294aea9efa3d80909a171a',ramdisk_id='',reservation_id='r-fheq6edc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-629721707',owner_user_name='tempest-AttachVolumeTestJSON-629721707-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:46:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='02352e5b84f04d0e9975b8b8e5594b92',uuid=c043ca2f-6468-4b32-ae53-40da261fd1fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8919b46b-766f-4499-8179-1d8538dba72e", "address": "fa:16:3e:56:33:74", "network": {"id": "c94dfbf4-6803-458e-b2c6-231298da7bc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090354282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f88922b3c294aea9efa3d80909a171a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8919b46b-76", "ovs_interfaceid": "8919b46b-766f-4499-8179-1d8538dba72e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:46:07 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Converting VIF {"id": "8919b46b-766f-4499-8179-1d8538dba72e", "address": "fa:16:3e:56:33:74", "network": {"id": "c94dfbf4-6803-458e-b2c6-231298da7bc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090354282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f88922b3c294aea9efa3d80909a171a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8919b46b-76", "ovs_interfaceid": "8919b46b-766f-4499-8179-1d8538dba72e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:46:07 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:33:74,bridge_name='br-int',has_traffic_filtering=True,id=8919b46b-766f-4499-8179-1d8538dba72e,network=Network(c94dfbf4-6803-458e-b2c6-231298da7bc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8919b46b-76') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:46:07 user nova-compute[73391]: DEBUG nova.objects.instance [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lazy-loading 'pci_devices' on Instance uuid c043ca2f-6468-4b32-ae53-40da261fd1fa {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:46:07 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:46:07 user nova-compute[73391]:   <uuid>c043ca2f-6468-4b32-ae53-40da261fd1fa</uuid>
Aug 15 05:46:07 user nova-compute[73391]:   <name>instance-00000024</name>
Aug 15 05:46:07 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:46:07 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:46:07 user nova-compute[73391]:   <metadata>
Aug 15 05:46:07 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:46:07 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:46:07 user nova-compute[73391]:       <nova:name>tempest-AttachVolumeTestJSON-server-496164599</nova:name>
Aug 15 05:46:07 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:46:07</nova:creationTime>
Aug 15 05:46:07 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:46:07 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:46:07 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:46:07 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:46:07 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:46:07 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:46:07 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:46:07 user nova-compute[73391]:       <nova:owner>
Aug 15 05:46:07 user nova-compute[73391]:         <nova:user uuid="02352e5b84f04d0e9975b8b8e5594b92">tempest-AttachVolumeTestJSON-629721707-project-member</nova:user>
Aug 15 05:46:07 user nova-compute[73391]:         <nova:project uuid="9f88922b3c294aea9efa3d80909a171a">tempest-AttachVolumeTestJSON-629721707</nova:project>
Aug 15 05:46:07 user nova-compute[73391]:       </nova:owner>
Aug 15 05:46:07 user nova-compute[73391]:       <nova:root type="image" uuid="191b1dad-305e-4d1c-9b15-515ec59a3278"/>
Aug 15 05:46:07 user nova-compute[73391]:       <nova:ports>
Aug 15 05:46:07 user nova-compute[73391]:         <nova:port uuid="8919b46b-766f-4499-8179-1d8538dba72e">
Aug 15 05:46:07 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Aug 15 05:46:07 user nova-compute[73391]:         </nova:port>
Aug 15 05:46:07 user nova-compute[73391]:       </nova:ports>
Aug 15 05:46:07 user nova-compute[73391]:     </nova:instance>
Aug 15 05:46:07 user nova-compute[73391]:   </metadata>
Aug 15 05:46:07 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:46:07 user nova-compute[73391]:     <system>
Aug 15 05:46:07 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:46:07 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:46:07 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:46:07 user nova-compute[73391]:       <entry name="serial">c043ca2f-6468-4b32-ae53-40da261fd1fa</entry>
Aug 15 05:46:07 user nova-compute[73391]:       <entry name="uuid">c043ca2f-6468-4b32-ae53-40da261fd1fa</entry>
Aug 15 05:46:07 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:46:07 user nova-compute[73391]:     </system>
Aug 15 05:46:07 user nova-compute[73391]:   </sysinfo>
Aug 15 05:46:07 user nova-compute[73391]:   <os>
Aug 15 05:46:07 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:46:07 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:46:07 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:46:07 user nova-compute[73391]:   </os>
Aug 15 05:46:07 user nova-compute[73391]:   <features>
Aug 15 05:46:07 user nova-compute[73391]:     <acpi/>
Aug 15 05:46:07 user nova-compute[73391]:     <apic/>
Aug 15 05:46:07 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:46:07 user nova-compute[73391]:   </features>
Aug 15 05:46:07 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:46:07 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:46:07 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:46:07 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:46:07 user nova-compute[73391]:   </clock>
Aug 15 05:46:07 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:46:07 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:46:07 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:46:07 user nova-compute[73391]:   </cpu>
Aug 15 05:46:07 user nova-compute[73391]:   <devices>
Aug 15 05:46:07 user nova-compute[73391]:     <disk type="file" device="disk">
Aug 15 05:46:07 user nova-compute[73391]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 05:46:07 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/c043ca2f-6468-4b32-ae53-40da261fd1fa/disk"/>
Aug 15 05:46:07 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:46:07 user nova-compute[73391]:     </disk>
Aug 15 05:46:07 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:46:07 user nova-compute[73391]:       <mac address="fa:16:3e:56:33:74"/>
Aug 15 05:46:07 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:46:07 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:46:07 user nova-compute[73391]:       <target dev="tap8919b46b-76"/>
Aug 15 05:46:07 user nova-compute[73391]:     </interface>
Aug 15 05:46:07 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:46:07 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/c043ca2f-6468-4b32-ae53-40da261fd1fa/console.log" append="off"/>
Aug 15 05:46:07 user nova-compute[73391]:     </serial>
Aug 15 05:46:07 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:46:07 user nova-compute[73391]:     <video>
Aug 15 05:46:07 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:46:07 user nova-compute[73391]:     </video>
Aug 15 05:46:07 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:46:07 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:46:07 user nova-compute[73391]:     </rng>
Aug 15 05:46:07 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:46:07 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:46:07 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:46:07 user nova-compute[73391]:     </memballoon>
Aug 15 05:46:07 user nova-compute[73391]:   </devices>
Aug 15 05:46:07 user nova-compute[73391]: </domain>
Aug 15 05:46:07 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:46:07 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:46:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-496164599',display_name='tempest-AttachVolumeTestJSON-server-496164599',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-496164599',id=36,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBElvPkTX4381T4Wb55ypwBw8/CJ1olD+kxdnn30P0DQ3o/nxtf0e9aCDlGQ9X6LUsMvM0abg1mcHFH2ya++sTl/qlW8tjZ0A1o/PTJ9H6ifvsi7j4RpokC3s4TVPAq9mWA==',key_name='tempest-keypair-608359081',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f88922b3c294aea9efa3d80909a171a',ramdisk_id='',reservation_id='r-fheq6edc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-629721707',owner_user_name='tempest-AttachVolumeTestJSON-629721707-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:46:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='02352e5b84f04d0e9975b8b8e5594b92',uuid=c043ca2f-6468-4b32-ae53-40da261fd1fa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8919b46b-766f-4499-8179-1d8538dba72e", "address": "fa:16:3e:56:33:74", "network": {"id": "c94dfbf4-6803-458e-b2c6-231298da7bc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090354282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f88922b3c294aea9efa3d80909a171a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8919b46b-76", "ovs_interfaceid": "8919b46b-766f-4499-8179-1d8538dba72e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:46:07 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Converting VIF {"id": "8919b46b-766f-4499-8179-1d8538dba72e", "address": "fa:16:3e:56:33:74", "network": {"id": "c94dfbf4-6803-458e-b2c6-231298da7bc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090354282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f88922b3c294aea9efa3d80909a171a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8919b46b-76", "ovs_interfaceid": "8919b46b-766f-4499-8179-1d8538dba72e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:46:07 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:33:74,bridge_name='br-int',has_traffic_filtering=True,id=8919b46b-766f-4499-8179-1d8538dba72e,network=Network(c94dfbf4-6803-458e-b2c6-231298da7bc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8919b46b-76') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:46:07 user nova-compute[73391]: DEBUG os_vif [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:33:74,bridge_name='br-int',has_traffic_filtering=True,id=8919b46b-766f-4499-8179-1d8538dba72e,network=Network(c94dfbf4-6803-458e-b2c6-231298da7bc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8919b46b-76') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:46:07 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:07 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:46:07 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:46:07 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:07 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8919b46b-76, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:46:07 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8919b46b-76, col_values=(('external_ids', {'iface-id': '8919b46b-766f-4499-8179-1d8538dba72e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:33:74', 'vm-uuid': 'c043ca2f-6468-4b32-ae53-40da261fd1fa'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:46:07 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:07 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:46:07 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:07 user nova-compute[73391]: INFO os_vif [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:33:74,bridge_name='br-int',has_traffic_filtering=True,id=8919b46b-766f-4499-8179-1d8538dba72e,network=Network(c94dfbf4-6803-458e-b2c6-231298da7bc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8919b46b-76')
Aug 15 05:46:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:46:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] No VIF found with MAC fa:16:3e:56:33:74, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:46:08 user nova-compute[73391]: DEBUG nova.network.neutron [req-7cdb5e04-b4f2-4785-8a04-d218a082c793 req-7939fa21-49f6-4c20-a099-f6e3f25b1b37 service nova] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Updated VIF entry in instance network info cache for port 8919b46b-766f-4499-8179-1d8538dba72e. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:46:08 user nova-compute[73391]: DEBUG nova.network.neutron [req-7cdb5e04-b4f2-4785-8a04-d218a082c793 req-7939fa21-49f6-4c20-a099-f6e3f25b1b37 service nova] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Updating instance_info_cache with network_info: [{"id": "8919b46b-766f-4499-8179-1d8538dba72e", "address": "fa:16:3e:56:33:74", "network": {"id": "c94dfbf4-6803-458e-b2c6-231298da7bc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090354282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f88922b3c294aea9efa3d80909a171a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8919b46b-76", "ovs_interfaceid": "8919b46b-766f-4499-8179-1d8538dba72e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:46:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-7cdb5e04-b4f2-4785-8a04-d218a082c793 req-7939fa21-49f6-4c20-a099-f6e3f25b1b37 service nova] Releasing lock "refresh_cache-c043ca2f-6468-4b32-ae53-40da261fd1fa" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:46:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:10 user nova-compute[73391]: DEBUG nova.compute.manager [req-d7b6904b-625a-42f0-bec6-8abefbfe38d6 req-87a3466b-3521-4210-a91f-b15ad114e68d service nova] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Received event network-vif-plugged-8919b46b-766f-4499-8179-1d8538dba72e {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:46:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d7b6904b-625a-42f0-bec6-8abefbfe38d6 req-87a3466b-3521-4210-a91f-b15ad114e68d service nova] Acquiring lock "c043ca2f-6468-4b32-ae53-40da261fd1fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:46:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d7b6904b-625a-42f0-bec6-8abefbfe38d6 req-87a3466b-3521-4210-a91f-b15ad114e68d service nova] Lock "c043ca2f-6468-4b32-ae53-40da261fd1fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:46:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d7b6904b-625a-42f0-bec6-8abefbfe38d6 req-87a3466b-3521-4210-a91f-b15ad114e68d service nova] Lock "c043ca2f-6468-4b32-ae53-40da261fd1fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:46:10 user nova-compute[73391]: DEBUG nova.compute.manager [req-d7b6904b-625a-42f0-bec6-8abefbfe38d6 req-87a3466b-3521-4210-a91f-b15ad114e68d service nova] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] No waiting events found dispatching network-vif-plugged-8919b46b-766f-4499-8179-1d8538dba72e {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:46:10 user nova-compute[73391]: WARNING nova.compute.manager [req-d7b6904b-625a-42f0-bec6-8abefbfe38d6 req-87a3466b-3521-4210-a91f-b15ad114e68d service nova] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Received unexpected event network-vif-plugged-8919b46b-766f-4499-8179-1d8538dba72e for instance with vm_state building and task_state spawning.
Aug 15 05:46:10 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:10 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:10 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:10 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:11 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078371.61407, c043ca2f-6468-4b32-ae53-40da261fd1fa => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:46:11 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] VM Resumed (Lifecycle Event)
Aug 15 05:46:11 user nova-compute[73391]: DEBUG nova.compute.manager [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:46:11 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Guest created on hypervisor {{(pid=73391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 05:46:11 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Instance spawned successfully.
Aug 15 05:46:11 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 05:46:11 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:46:11 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Found default for hw_cdrom_bus of ide {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:46:11 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Found default for hw_disk_bus of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:46:11 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Found default for hw_input_bus of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:46:11 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Found default for hw_pointer_model of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:46:11 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Found default for hw_video_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:46:11 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Found default for hw_vif_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:46:11 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:46:11 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:46:11 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078371.6163623, c043ca2f-6468-4b32-ae53-40da261fd1fa => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:46:11 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] VM Started (Lifecycle Event)
Aug 15 05:46:11 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:46:11 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:46:11 user nova-compute[73391]: INFO nova.compute.manager [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Took 6.46 seconds to spawn the instance on the hypervisor.
Aug 15 05:46:11 user nova-compute[73391]: DEBUG nova.compute.manager [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:46:11 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:46:11 user nova-compute[73391]: INFO nova.compute.manager [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Took 7.37 seconds to build instance.
Aug 15 05:46:11 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8f101f2a-bd55-458b-b769-a2c64fc6393b tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "c043ca2f-6468-4b32-ae53-40da261fd1fa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.459s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:46:12 user nova-compute[73391]: DEBUG nova.compute.manager [req-e98abbff-90b8-4e30-b6e4-d99b154ccaa3 req-5ed19701-e1a5-4678-90d8-3863913c89c3 service nova] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Received event network-vif-plugged-8919b46b-766f-4499-8179-1d8538dba72e {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:46:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e98abbff-90b8-4e30-b6e4-d99b154ccaa3 req-5ed19701-e1a5-4678-90d8-3863913c89c3 service nova] Acquiring lock "c043ca2f-6468-4b32-ae53-40da261fd1fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:46:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e98abbff-90b8-4e30-b6e4-d99b154ccaa3 req-5ed19701-e1a5-4678-90d8-3863913c89c3 service nova] Lock "c043ca2f-6468-4b32-ae53-40da261fd1fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:46:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e98abbff-90b8-4e30-b6e4-d99b154ccaa3 req-5ed19701-e1a5-4678-90d8-3863913c89c3 service nova] Lock "c043ca2f-6468-4b32-ae53-40da261fd1fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:46:12 user nova-compute[73391]: DEBUG nova.compute.manager [req-e98abbff-90b8-4e30-b6e4-d99b154ccaa3 req-5ed19701-e1a5-4678-90d8-3863913c89c3 service nova] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] No waiting events found dispatching network-vif-plugged-8919b46b-766f-4499-8179-1d8538dba72e {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:46:12 user nova-compute[73391]: WARNING nova.compute.manager [req-e98abbff-90b8-4e30-b6e4-d99b154ccaa3 req-5ed19701-e1a5-4678-90d8-3863913c89c3 service nova] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Received unexpected event network-vif-plugged-8919b46b-766f-4499-8179-1d8538dba72e for instance with vm_state active and task_state None.
Aug 15 05:46:12 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:13 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-9c214053-2d00-407c-b2e1-b917ead591d2 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquiring lock "d60616bb-605e-4604-b637-56670f53159e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:46:13 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-9c214053-2d00-407c-b2e1-b917ead591d2 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "d60616bb-605e-4604-b637-56670f53159e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.019s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:46:13 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-9c214053-2d00-407c-b2e1-b917ead591d2 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquiring lock "d60616bb-605e-4604-b637-56670f53159e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:46:13 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-9c214053-2d00-407c-b2e1-b917ead591d2 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "d60616bb-605e-4604-b637-56670f53159e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:46:13 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-9c214053-2d00-407c-b2e1-b917ead591d2 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "d60616bb-605e-4604-b637-56670f53159e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:46:13 user nova-compute[73391]: INFO nova.compute.manager [None req-9c214053-2d00-407c-b2e1-b917ead591d2 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] Terminating instance
Aug 15 05:46:13 user nova-compute[73391]: DEBUG nova.compute.manager [None req-9c214053-2d00-407c-b2e1-b917ead591d2 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] Start destroying the instance on the hypervisor. {{(pid=73391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 05:46:13 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:13 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:13 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:13 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG nova.compute.manager [req-d6b281b5-b1ba-4861-bf7c-9f33f063e03f req-caad2127-1fbd-4695-9ead-967016213744 service nova] [instance: d60616bb-605e-4604-b637-56670f53159e] Received event network-vif-unplugged-c8787a16-cd6d-410e-8d37-425bdad344d6 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d6b281b5-b1ba-4861-bf7c-9f33f063e03f req-caad2127-1fbd-4695-9ead-967016213744 service nova] Acquiring lock "d60616bb-605e-4604-b637-56670f53159e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d6b281b5-b1ba-4861-bf7c-9f33f063e03f req-caad2127-1fbd-4695-9ead-967016213744 service nova] Lock "d60616bb-605e-4604-b637-56670f53159e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d6b281b5-b1ba-4861-bf7c-9f33f063e03f req-caad2127-1fbd-4695-9ead-967016213744 service nova] Lock "d60616bb-605e-4604-b637-56670f53159e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG nova.compute.manager [req-d6b281b5-b1ba-4861-bf7c-9f33f063e03f req-caad2127-1fbd-4695-9ead-967016213744 service nova] [instance: d60616bb-605e-4604-b637-56670f53159e] No waiting events found dispatching network-vif-unplugged-c8787a16-cd6d-410e-8d37-425bdad344d6 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG nova.compute.manager [req-d6b281b5-b1ba-4861-bf7c-9f33f063e03f req-caad2127-1fbd-4695-9ead-967016213744 service nova] [instance: d60616bb-605e-4604-b637-56670f53159e] Received event network-vif-unplugged-c8787a16-cd6d-410e-8d37-425bdad344d6 for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG nova.compute.manager [req-d6b281b5-b1ba-4861-bf7c-9f33f063e03f req-caad2127-1fbd-4695-9ead-967016213744 service nova] [instance: d60616bb-605e-4604-b637-56670f53159e] Received event network-vif-plugged-c8787a16-cd6d-410e-8d37-425bdad344d6 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d6b281b5-b1ba-4861-bf7c-9f33f063e03f req-caad2127-1fbd-4695-9ead-967016213744 service nova] Acquiring lock "d60616bb-605e-4604-b637-56670f53159e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d6b281b5-b1ba-4861-bf7c-9f33f063e03f req-caad2127-1fbd-4695-9ead-967016213744 service nova] Lock "d60616bb-605e-4604-b637-56670f53159e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d6b281b5-b1ba-4861-bf7c-9f33f063e03f req-caad2127-1fbd-4695-9ead-967016213744 service nova] Lock "d60616bb-605e-4604-b637-56670f53159e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG nova.compute.manager [req-d6b281b5-b1ba-4861-bf7c-9f33f063e03f req-caad2127-1fbd-4695-9ead-967016213744 service nova] [instance: d60616bb-605e-4604-b637-56670f53159e] No waiting events found dispatching network-vif-plugged-c8787a16-cd6d-410e-8d37-425bdad344d6 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:46:14 user nova-compute[73391]: WARNING nova.compute.manager [req-d6b281b5-b1ba-4861-bf7c-9f33f063e03f req-caad2127-1fbd-4695-9ead-967016213744 service nova] [instance: d60616bb-605e-4604-b637-56670f53159e] Received unexpected event network-vif-plugged-c8787a16-cd6d-410e-8d37-425bdad344d6 for instance with vm_state active and task_state deleting.
Aug 15 05:46:14 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: d60616bb-605e-4604-b637-56670f53159e] Instance destroyed successfully.
Aug 15 05:46:14 user nova-compute[73391]: DEBUG nova.objects.instance [None req-9c214053-2d00-407c-b2e1-b917ead591d2 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lazy-loading 'resources' on Instance uuid d60616bb-605e-4604-b637-56670f53159e {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-9c214053-2d00-407c-b2e1-b917ead591d2 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:40:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-173546372',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-173546372',id=30,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:42:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83b9acbe11654053bb905e7c92558a35',ramdisk_id='',reservation_id='r-c3nfsozy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1045163116',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:44:28Z,user_data=None,user_id='887f0846cf554e12acf92a663f5ab266',uuid=d60616bb-605e-4604-b637-56670f53159e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c8787a16-cd6d-410e-8d37-425bdad344d6", "address": "fa:16:3e:f9:58:41", "network": {"id": "70d88082-aea7-48bb-abb4-d77d264aaf01", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b9acbe11654053bb905e7c92558a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8787a16-cd", "ovs_interfaceid": "c8787a16-cd6d-410e-8d37-425bdad344d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-9c214053-2d00-407c-b2e1-b917ead591d2 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Converting VIF {"id": "c8787a16-cd6d-410e-8d37-425bdad344d6", "address": "fa:16:3e:f9:58:41", "network": {"id": "70d88082-aea7-48bb-abb4-d77d264aaf01", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b9acbe11654053bb905e7c92558a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8787a16-cd", "ovs_interfaceid": "c8787a16-cd6d-410e-8d37-425bdad344d6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-9c214053-2d00-407c-b2e1-b917ead591d2 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f9:58:41,bridge_name='br-int',has_traffic_filtering=True,id=c8787a16-cd6d-410e-8d37-425bdad344d6,network=Network(70d88082-aea7-48bb-abb4-d77d264aaf01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8787a16-cd') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG os_vif [None req-9c214053-2d00-407c-b2e1-b917ead591d2 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:58:41,bridge_name='br-int',has_traffic_filtering=True,id=c8787a16-cd6d-410e-8d37-425bdad344d6,network=Network(70d88082-aea7-48bb-abb4-d77d264aaf01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8787a16-cd') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc8787a16-cd, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:14 user nova-compute[73391]: INFO os_vif [None req-9c214053-2d00-407c-b2e1-b917ead591d2 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f9:58:41,bridge_name='br-int',has_traffic_filtering=True,id=c8787a16-cd6d-410e-8d37-425bdad344d6,network=Network(70d88082-aea7-48bb-abb4-d77d264aaf01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8787a16-cd')
Aug 15 05:46:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c214053-2d00-407c-b2e1-b917ead591d2 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c214053-2d00-407c-b2e1-b917ead591d2 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GSuaqwUj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:46:14 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-9c214053-2d00-407c-b2e1-b917ead591d2 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:46:14 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-9c214053-2d00-407c-b2e1-b917ead591d2 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-9c214053-2d00-407c-b2e1-b917ead591d2 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c214053-2d00-407c-b2e1-b917ead591d2 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a14704-db43-40df-8458-b501e8292f3d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9397cfb-5dda-4cde-819d-f1a33be69112]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c214053-2d00-407c-b2e1-b917ead591d2 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:46:14 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:46:14 user nova-compute[73391]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:46:14 user nova-compute[73391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)
Aug 15 05:46:14 user nova-compute[73391]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)
Aug 15 05:46:14 user nova-compute[73391]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6 (non-flash)
Aug 15 05:46:14 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c214053-2d00-407c-b2e1-b917ead591d2 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:46:14 user nova-compute[73391]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb (non-flash)
Aug 15 05:46:14 user nova-compute[73391]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:46:14 user nova-compute[73391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)
Aug 15 05:46:14 user nova-compute[73391]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)
Aug 15 05:46:14 user nova-compute[73391]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6 (non-flash)
Aug 15 05:46:14 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c214053-2d00-407c-b2e1-b917ead591d2 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77282a23b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb'): ({'sdg'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-9c214053-2d00-407c-b2e1-b917ead591d2 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Removing single pathed devices sdg {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3845f64c-6c16-4966-9337-3b47b28bc05f]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[417c5d00-1ba2-4d4d-87df-1866bab42b8a]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-9c214053-2d00-407c-b2e1-b917ead591d2 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Flushing IO for device /dev/sdg {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b703c448-bb0c-4baf-869f-a869d04edd93]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-9c214053-2d00-407c-b2e1-b917ead591d2 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.063s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6404d451-5466-49fb-9375-a731e4ef93ec]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-9c214053-2d00-407c-b2e1-b917ead591d2 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-9c214053-2d00-407c-b2e1-b917ead591d2 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] SCSI volumes sdg have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26131396232663036', '/dev/disk/by-id/scsi-1SCST_BIOd76e0655-a19b2f0649b1d60a', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_d76e0655') {{(pid=84527) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b66ad3f1-eaa0-4b3d-a6b1-afb64cd48571]: (4, None) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c214053-2d00-407c-b2e1-b917ead591d2 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.105s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8174875d-3663-4fff-a926-7717049cbc22]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c214053-2d00-407c-b2e1-b917ead591d2 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb -p 172.16.0.220:3260 --logout" returned: 0 in 0.106s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[14004ebf-fe72-4955-9d46-823adaddf89c]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c214053-2d00-407c-b2e1-b917ead591d2 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb, portal: 172.16.0.220,3260]
Aug 15 05:46:14 user nova-compute[73391]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb, portal: 172.16.0.220,3260] successful.
Aug 15 05:46:14 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:911dca0b-7771-4c68-9daf-70cae57028cb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64044b8-231e-4d02-a021-7d89a349000b]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c214053-2d00-407c-b2e1-b917ead591d2 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-9c214053-2d00-407c-b2e1-b917ead591d2 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.470s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c214053-2d00-407c-b2e1-b917ead591d2 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] <== disconnect_volume: return (472ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c214053-2d00-407c-b2e1-b917ead591d2 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 05:46:14 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-9c214053-2d00-407c-b2e1-b917ead591d2 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] Deleting instance files /opt/stack/data/nova/instances/d60616bb-605e-4604-b637-56670f53159e_del
Aug 15 05:46:14 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-9c214053-2d00-407c-b2e1-b917ead591d2 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] Deletion of /opt/stack/data/nova/instances/d60616bb-605e-4604-b637-56670f53159e_del complete
Aug 15 05:46:14 user nova-compute[73391]: INFO nova.compute.manager [None req-9c214053-2d00-407c-b2e1-b917ead591d2 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] Took 1.50 seconds to destroy the instance on the hypervisor.
Aug 15 05:46:14 user nova-compute[73391]: DEBUG oslo.service.loopingcall [None req-9c214053-2d00-407c-b2e1-b917ead591d2 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG nova.compute.manager [-] [instance: d60616bb-605e-4604-b637-56670f53159e] Deallocating network for instance {{(pid=73391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 05:46:14 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: d60616bb-605e-4604-b637-56670f53159e] deallocate_for_instance() {{(pid=73391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 05:46:15 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: d60616bb-605e-4604-b637-56670f53159e] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:46:15 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: d60616bb-605e-4604-b637-56670f53159e] Took 0.70 seconds to deallocate network for instance.
Aug 15 05:46:15 user nova-compute[73391]: DEBUG nova.compute.manager [req-b25fd380-c07b-456d-ac17-b036a5fd686e req-32d5a82a-4420-40cd-929a-c382da1babe7 service nova] [instance: d60616bb-605e-4604-b637-56670f53159e] Received event network-vif-deleted-c8787a16-cd6d-410e-8d37-425bdad344d6 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:46:15 user nova-compute[73391]: INFO nova.compute.manager [req-b25fd380-c07b-456d-ac17-b036a5fd686e req-32d5a82a-4420-40cd-929a-c382da1babe7 service nova] [instance: d60616bb-605e-4604-b637-56670f53159e] Neutron deleted interface c8787a16-cd6d-410e-8d37-425bdad344d6; detaching it from the instance and deleting it from the info cache
Aug 15 05:46:15 user nova-compute[73391]: DEBUG nova.network.neutron [req-b25fd380-c07b-456d-ac17-b036a5fd686e req-32d5a82a-4420-40cd-929a-c382da1babe7 service nova] [instance: d60616bb-605e-4604-b637-56670f53159e] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:46:15 user nova-compute[73391]: DEBUG nova.compute.manager [req-b25fd380-c07b-456d-ac17-b036a5fd686e req-32d5a82a-4420-40cd-929a-c382da1babe7 service nova] [instance: d60616bb-605e-4604-b637-56670f53159e] Detach interface failed, port_id=c8787a16-cd6d-410e-8d37-425bdad344d6, reason: Instance d60616bb-605e-4604-b637-56670f53159e could not be found. {{(pid=73391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 05:46:16 user nova-compute[73391]: INFO nova.compute.manager [None req-9c214053-2d00-407c-b2e1-b917ead591d2 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: d60616bb-605e-4604-b637-56670f53159e] Took 0.78 seconds to detach 1 volumes for instance.
Aug 15 05:46:16 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-9c214053-2d00-407c-b2e1-b917ead591d2 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:46:16 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-9c214053-2d00-407c-b2e1-b917ead591d2 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:46:16 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-9c214053-2d00-407c-b2e1-b917ead591d2 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:46:16 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-9c214053-2d00-407c-b2e1-b917ead591d2 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:46:16 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-9c214053-2d00-407c-b2e1-b917ead591d2 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.426s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:46:16 user nova-compute[73391]: INFO nova.scheduler.client.report [None req-9c214053-2d00-407c-b2e1-b917ead591d2 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Deleted allocations for instance d60616bb-605e-4604-b637-56670f53159e
Aug 15 05:46:16 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-9c214053-2d00-407c-b2e1-b917ead591d2 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "d60616bb-605e-4604-b637-56670f53159e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.602s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:46:17 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:46:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:20 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:46:22 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:46:22 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:46:22 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:46:22 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:46:22 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Auditing locally available compute resources for user (node: user) {{(pid=73391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 05:46:22 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:46:22 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8775490-2a9e-44ac-aad7-9450afa4c295/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:23 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8775490-2a9e-44ac-aad7-9450afa4c295/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:23 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8775490-2a9e-44ac-aad7-9450afa4c295/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:23 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8775490-2a9e-44ac-aad7-9450afa4c295/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:23 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:46:23 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:46:23 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7521ed98-75ed-43eb-83a2-d41502698aec/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:23 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7521ed98-75ed-43eb-83a2-d41502698aec/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:23 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7521ed98-75ed-43eb-83a2-d41502698aec/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:23 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7521ed98-75ed-43eb-83a2-d41502698aec/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:23 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:23 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:23 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:24 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:46:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:25 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:46:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c043ca2f-6468-4b32-ae53-40da261fd1fa/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c043ca2f-6468-4b32-ae53-40da261fd1fa/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c043ca2f-6468-4b32-ae53-40da261fd1fa/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c043ca2f-6468-4b32-ae53-40da261fd1fa/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:27 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:46:27 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:46:27 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Hypervisor/Node resource view: name=user free_ram=7055MB free_disk=24.97756576538086GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 05:46:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:46:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:46:27 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 8f08782b-f793-415e-b0d6-5caad1c3d426 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:46:27 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 6ac9d5dc-56be-402f-b9d4-3327bdfd9220 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:46:27 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 6358e825-5705-45d6-86b6-3aacfa5a9bbb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:46:27 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:46:27 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 730890c6-6999-4a0f-b80c-e4745bff99ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:46:27 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 8ff2da51-5bfd-4cdc-8cef-330cdef93d97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:46:27 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 8991b32e-6c4b-4c66-a320-e734061f49ee actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:46:27 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance dc657d66-c3f8-44e5-b30e-3d79e586a8f3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:46:27 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance e8775490-2a9e-44ac-aad7-9450afa4c295 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:46:27 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance c5d5343f-b8f4-46b7-92fc-66452212192b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:46:27 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 7521ed98-75ed-43eb-83a2-d41502698aec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:46:27 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:46:27 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance c043ca2f-6468-4b32-ae53-40da261fd1fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:46:27 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 05:46:27 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 05:46:27 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:46:27 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:46:27 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Compute_service record updated for user:user {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 05:46:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.557s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:46:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Acquiring lock "d85a919d-7f44-4093-b89a-51397ad5cedb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:46:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "d85a919d-7f44-4093-b89a-51397ad5cedb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:46:28 user nova-compute[73391]: DEBUG nova.compute.manager [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Starting instance... {{(pid=73391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 05:46:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:46:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:46:28 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 05:46:28 user nova-compute[73391]: INFO nova.compute.claims [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Claim successful on node user
Aug 15 05:46:28 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:46:28 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:46:28 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Starting heal instance info cache {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 05:46:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "refresh_cache-8ff2da51-5bfd-4cdc-8cef-330cdef93d97" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:46:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquired lock "refresh_cache-8ff2da51-5bfd-4cdc-8cef-330cdef93d97" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:46:29 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Forcefully refreshing network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 05:46:29 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692078374.1713312, d60616bb-605e-4604-b637-56670f53159e => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:46:29 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: d60616bb-605e-4604-b637-56670f53159e] VM Stopped (Lifecycle Event)
Aug 15 05:46:29 user nova-compute[73391]: DEBUG nova.compute.manager [None req-6e0fa5bf-3ed7-4057-82b2-8d966b19046d None None] [instance: d60616bb-605e-4604-b637-56670f53159e] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:46:29 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:29 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:46:29 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:46:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.606s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:46:29 user nova-compute[73391]: DEBUG nova.compute.manager [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Start building networks asynchronously for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 05:46:29 user nova-compute[73391]: DEBUG nova.compute.manager [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Allocating IP information in the background. {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 05:46:29 user nova-compute[73391]: DEBUG nova.network.neutron [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] allocate_for_instance() {{(pid=73391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 05:46:29 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 05:46:29 user nova-compute[73391]: DEBUG nova.compute.manager [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Start building block device mappings for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 05:46:29 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Updating instance_info_cache with network_info: [{"id": "075b72cf-5f6f-443c-a0e1-dd3744944e5b", "address": "fa:16:3e:88:63:d4", "network": {"id": "bec69c6a-b2cb-4b0a-ba6e-ae6dae099818", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7da9448cc34b609120da564a01dba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap075b72cf-5f", "ovs_interfaceid": "075b72cf-5f6f-443c-a0e1-dd3744944e5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:46:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Releasing lock "refresh_cache-8ff2da51-5bfd-4cdc-8cef-330cdef93d97" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:46:29 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Updated the network info_cache for instance {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 05:46:29 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:46:29 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:46:29 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:46:29 user nova-compute[73391]: DEBUG nova.policy [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1f0f5888b8c44188a17202fad2725256', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a7da9448cc34b609120da564a01dba4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73391) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 05:46:29 user nova-compute[73391]: DEBUG nova.compute.manager [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Start spawning the instance on the hypervisor. {{(pid=73391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 05:46:29 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Creating instance directory {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 05:46:29 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Creating image(s)
Aug 15 05:46:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Acquiring lock "/opt/stack/data/nova/instances/d85a919d-7f44-4093-b89a-51397ad5cedb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:46:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "/opt/stack/data/nova/instances/d85a919d-7f44-4093-b89a-51397ad5cedb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:46:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "/opt/stack/data/nova/instances/d85a919d-7f44-4093-b89a-51397ad5cedb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:46:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:29 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:29 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:46:29 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 05:46:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.195s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Acquiring lock "999b315ba87151d8252d543312ae7790e7e1583b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:46:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:46:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.190s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/d85a919d-7f44-4093-b89a-51397ad5cedb/disk 1073741824 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/d85a919d-7f44-4093-b89a-51397ad5cedb/disk 1073741824" returned: 0 in 0.061s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:46:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:30 user nova-compute[73391]: DEBUG nova.network.neutron [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Successfully created port: d9ae0be2-05e7-4009-b909-713c8c52e5e5 {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 05:46:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.181s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:30 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d85a919d-7f44-4093-b89a-51397ad5cedb/disk. size=1073741824 {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 05:46:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85a919d-7f44-4093-b89a-51397ad5cedb/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85a919d-7f44-4093-b89a-51397ad5cedb/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:30 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Cannot resize image /opt/stack/data/nova/instances/d85a919d-7f44-4093-b89a-51397ad5cedb/disk to a smaller size. {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 05:46:30 user nova-compute[73391]: DEBUG nova.objects.instance [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lazy-loading 'migration_context' on Instance uuid d85a919d-7f44-4093-b89a-51397ad5cedb {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:46:30 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Created local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 05:46:30 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Ensure instance console log exists: /opt/stack/data/nova/instances/d85a919d-7f44-4093-b89a-51397ad5cedb/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 05:46:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:46:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:46:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:46:30 user nova-compute[73391]: DEBUG nova.network.neutron [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Successfully updated port: d9ae0be2-05e7-4009-b909-713c8c52e5e5 {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:46:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Acquiring lock "refresh_cache-d85a919d-7f44-4093-b89a-51397ad5cedb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:46:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Acquired lock "refresh_cache-d85a919d-7f44-4093-b89a-51397ad5cedb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:46:30 user nova-compute[73391]: DEBUG nova.network.neutron [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:46:31 user nova-compute[73391]: DEBUG nova.compute.manager [req-b747e9f4-079b-41db-8ed3-a6c4d6ae22a3 req-382c0a71-e7e2-4018-9487-47b70a49c297 service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Received event network-changed-d9ae0be2-05e7-4009-b909-713c8c52e5e5 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:46:31 user nova-compute[73391]: DEBUG nova.compute.manager [req-b747e9f4-079b-41db-8ed3-a6c4d6ae22a3 req-382c0a71-e7e2-4018-9487-47b70a49c297 service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Refreshing instance network info cache due to event network-changed-d9ae0be2-05e7-4009-b909-713c8c52e5e5. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:46:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-b747e9f4-079b-41db-8ed3-a6c4d6ae22a3 req-382c0a71-e7e2-4018-9487-47b70a49c297 service nova] Acquiring lock "refresh_cache-d85a919d-7f44-4093-b89a-51397ad5cedb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:46:31 user nova-compute[73391]: DEBUG nova.network.neutron [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:46:31 user nova-compute[73391]: DEBUG nova.network.neutron [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Updating instance_info_cache with network_info: [{"id": "d9ae0be2-05e7-4009-b909-713c8c52e5e5", "address": "fa:16:3e:8a:49:2b", "network": {"id": "bec69c6a-b2cb-4b0a-ba6e-ae6dae099818", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7da9448cc34b609120da564a01dba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ae0be2-05", "ovs_interfaceid": "d9ae0be2-05e7-4009-b909-713c8c52e5e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:46:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Releasing lock "refresh_cache-d85a919d-7f44-4093-b89a-51397ad5cedb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:46:31 user nova-compute[73391]: DEBUG nova.compute.manager [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Instance network_info: |[{"id": "d9ae0be2-05e7-4009-b909-713c8c52e5e5", "address": "fa:16:3e:8a:49:2b", "network": {"id": "bec69c6a-b2cb-4b0a-ba6e-ae6dae099818", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7da9448cc34b609120da564a01dba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ae0be2-05", "ovs_interfaceid": "d9ae0be2-05e7-4009-b909-713c8c52e5e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 05:46:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-b747e9f4-079b-41db-8ed3-a6c4d6ae22a3 req-382c0a71-e7e2-4018-9487-47b70a49c297 service nova] Acquired lock "refresh_cache-d85a919d-7f44-4093-b89a-51397ad5cedb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:46:31 user nova-compute[73391]: DEBUG nova.network.neutron [req-b747e9f4-079b-41db-8ed3-a6c4d6ae22a3 req-382c0a71-e7e2-4018-9487-47b70a49c297 service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Refreshing network info cache for port d9ae0be2-05e7-4009-b909-713c8c52e5e5 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:46:31 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Start _get_guest_xml network_info=[{"id": "d9ae0be2-05e7-4009-b909-713c8c52e5e5", "address": "fa:16:3e:8a:49:2b", "network": {"id": "bec69c6a-b2cb-4b0a-ba6e-ae6dae099818", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7da9448cc34b609120da564a01dba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ae0be2-05", "ovs_interfaceid": "d9ae0be2-05e7-4009-b909-713c8c52e5e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '191b1dad-305e-4d1c-9b15-515ec59a3278'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:46:31 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:46:31 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:46:31 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:46:31 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:46:31 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:46:31 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:46:31 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:46:31 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:46:31 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:46:31 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:46:31 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:46:31 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:46:31 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:46:31 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:46:31 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:46:31 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:46:31 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:46:31 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:46:31 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:46:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1368685045',display_name='tempest-ServerRescueNegativeTestJSON-server-1368685045',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1368685045',id=37,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/6kD3X/Xv8slYXv0KKsJUu8EUECfySzGbYnbQQRqQcPLeD+XN0ODX8guUaAA8SajiP5mAzTEd6NFbpNb6KjPhN8DRWtXs7H08aTDfPvvGUYtwQtRlR6eUlj+qqgyrQ+g==',key_name='tempest-keypair-624447654',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a7da9448cc34b609120da564a01dba4',ramdisk_id='',reservation_id='r-hd23d0uc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1933442633',owner_user_name='tempest-ServerRescueNegativeTestJSON-1933442633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:46:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f0f5888b8c44188a17202fad2725256',uuid=d85a919d-7f44-4093-b89a-51397ad5cedb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9ae0be2-05e7-4009-b909-713c8c52e5e5", "address": "fa:16:3e:8a:49:2b", "network": {"id": "bec69c6a-b2cb-4b0a-ba6e-ae6dae099818", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7da9448cc34b609120da564a01dba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ae0be2-05", "ovs_interfaceid": "d9ae0be2-05e7-4009-b909-713c8c52e5e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:46:31 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Converting VIF {"id": "d9ae0be2-05e7-4009-b909-713c8c52e5e5", "address": "fa:16:3e:8a:49:2b", "network": {"id": "bec69c6a-b2cb-4b0a-ba6e-ae6dae099818", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7da9448cc34b609120da564a01dba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ae0be2-05", "ovs_interfaceid": "d9ae0be2-05e7-4009-b909-713c8c52e5e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:46:31 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:49:2b,bridge_name='br-int',has_traffic_filtering=True,id=d9ae0be2-05e7-4009-b909-713c8c52e5e5,network=Network(bec69c6a-b2cb-4b0a-ba6e-ae6dae099818),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9ae0be2-05') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:46:31 user nova-compute[73391]: DEBUG nova.objects.instance [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lazy-loading 'pci_devices' on Instance uuid d85a919d-7f44-4093-b89a-51397ad5cedb {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:46:31 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:46:31 user nova-compute[73391]:   <uuid>d85a919d-7f44-4093-b89a-51397ad5cedb</uuid>
Aug 15 05:46:31 user nova-compute[73391]:   <name>instance-00000025</name>
Aug 15 05:46:31 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:46:31 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:46:31 user nova-compute[73391]:   <metadata>
Aug 15 05:46:31 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:46:31 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:46:31 user nova-compute[73391]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1368685045</nova:name>
Aug 15 05:46:31 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:46:31</nova:creationTime>
Aug 15 05:46:31 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:46:31 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:46:31 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:46:31 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:46:31 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:46:31 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:46:31 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:46:31 user nova-compute[73391]:       <nova:owner>
Aug 15 05:46:31 user nova-compute[73391]:         <nova:user uuid="1f0f5888b8c44188a17202fad2725256">tempest-ServerRescueNegativeTestJSON-1933442633-project-member</nova:user>
Aug 15 05:46:31 user nova-compute[73391]:         <nova:project uuid="5a7da9448cc34b609120da564a01dba4">tempest-ServerRescueNegativeTestJSON-1933442633</nova:project>
Aug 15 05:46:31 user nova-compute[73391]:       </nova:owner>
Aug 15 05:46:31 user nova-compute[73391]:       <nova:root type="image" uuid="191b1dad-305e-4d1c-9b15-515ec59a3278"/>
Aug 15 05:46:31 user nova-compute[73391]:       <nova:ports>
Aug 15 05:46:31 user nova-compute[73391]:         <nova:port uuid="d9ae0be2-05e7-4009-b909-713c8c52e5e5">
Aug 15 05:46:31 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 05:46:31 user nova-compute[73391]:         </nova:port>
Aug 15 05:46:31 user nova-compute[73391]:       </nova:ports>
Aug 15 05:46:31 user nova-compute[73391]:     </nova:instance>
Aug 15 05:46:31 user nova-compute[73391]:   </metadata>
Aug 15 05:46:31 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:46:31 user nova-compute[73391]:     <system>
Aug 15 05:46:31 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:46:31 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:46:31 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:46:31 user nova-compute[73391]:       <entry name="serial">d85a919d-7f44-4093-b89a-51397ad5cedb</entry>
Aug 15 05:46:31 user nova-compute[73391]:       <entry name="uuid">d85a919d-7f44-4093-b89a-51397ad5cedb</entry>
Aug 15 05:46:31 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:46:31 user nova-compute[73391]:     </system>
Aug 15 05:46:31 user nova-compute[73391]:   </sysinfo>
Aug 15 05:46:31 user nova-compute[73391]:   <os>
Aug 15 05:46:31 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:46:31 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:46:31 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:46:31 user nova-compute[73391]:   </os>
Aug 15 05:46:31 user nova-compute[73391]:   <features>
Aug 15 05:46:31 user nova-compute[73391]:     <acpi/>
Aug 15 05:46:31 user nova-compute[73391]:     <apic/>
Aug 15 05:46:31 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:46:31 user nova-compute[73391]:   </features>
Aug 15 05:46:31 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:46:31 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:46:31 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:46:31 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:46:31 user nova-compute[73391]:   </clock>
Aug 15 05:46:31 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:46:31 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:46:31 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:46:31 user nova-compute[73391]:   </cpu>
Aug 15 05:46:31 user nova-compute[73391]:   <devices>
Aug 15 05:46:31 user nova-compute[73391]:     <disk type="file" device="disk">
Aug 15 05:46:31 user nova-compute[73391]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 05:46:31 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/d85a919d-7f44-4093-b89a-51397ad5cedb/disk"/>
Aug 15 05:46:31 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:46:31 user nova-compute[73391]:     </disk>
Aug 15 05:46:31 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:46:31 user nova-compute[73391]:       <mac address="fa:16:3e:8a:49:2b"/>
Aug 15 05:46:31 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:46:31 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:46:31 user nova-compute[73391]:       <target dev="tapd9ae0be2-05"/>
Aug 15 05:46:31 user nova-compute[73391]:     </interface>
Aug 15 05:46:31 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:46:31 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/d85a919d-7f44-4093-b89a-51397ad5cedb/console.log" append="off"/>
Aug 15 05:46:31 user nova-compute[73391]:     </serial>
Aug 15 05:46:31 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:46:31 user nova-compute[73391]:     <video>
Aug 15 05:46:31 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:46:31 user nova-compute[73391]:     </video>
Aug 15 05:46:31 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:46:31 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:46:31 user nova-compute[73391]:     </rng>
Aug 15 05:46:31 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:46:31 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:46:31 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:46:31 user nova-compute[73391]:     </memballoon>
Aug 15 05:46:31 user nova-compute[73391]:   </devices>
Aug 15 05:46:31 user nova-compute[73391]: </domain>
Aug 15 05:46:31 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:46:31 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:46:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1368685045',display_name='tempest-ServerRescueNegativeTestJSON-server-1368685045',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1368685045',id=37,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/6kD3X/Xv8slYXv0KKsJUu8EUECfySzGbYnbQQRqQcPLeD+XN0ODX8guUaAA8SajiP5mAzTEd6NFbpNb6KjPhN8DRWtXs7H08aTDfPvvGUYtwQtRlR6eUlj+qqgyrQ+g==',key_name='tempest-keypair-624447654',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a7da9448cc34b609120da564a01dba4',ramdisk_id='',reservation_id='r-hd23d0uc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1933442633',owner_user_name='tempest-ServerRescueNegativeTestJSON-1933442633-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:46:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f0f5888b8c44188a17202fad2725256',uuid=d85a919d-7f44-4093-b89a-51397ad5cedb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9ae0be2-05e7-4009-b909-713c8c52e5e5", "address": "fa:16:3e:8a:49:2b", "network": {"id": "bec69c6a-b2cb-4b0a-ba6e-ae6dae099818", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7da9448cc34b609120da564a01dba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ae0be2-05", "ovs_interfaceid": "d9ae0be2-05e7-4009-b909-713c8c52e5e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:46:31 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Converting VIF {"id": "d9ae0be2-05e7-4009-b909-713c8c52e5e5", "address": "fa:16:3e:8a:49:2b", "network": {"id": "bec69c6a-b2cb-4b0a-ba6e-ae6dae099818", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7da9448cc34b609120da564a01dba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ae0be2-05", "ovs_interfaceid": "d9ae0be2-05e7-4009-b909-713c8c52e5e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:46:31 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:49:2b,bridge_name='br-int',has_traffic_filtering=True,id=d9ae0be2-05e7-4009-b909-713c8c52e5e5,network=Network(bec69c6a-b2cb-4b0a-ba6e-ae6dae099818),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9ae0be2-05') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:46:31 user nova-compute[73391]: DEBUG os_vif [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:49:2b,bridge_name='br-int',has_traffic_filtering=True,id=d9ae0be2-05e7-4009-b909-713c8c52e5e5,network=Network(bec69c6a-b2cb-4b0a-ba6e-ae6dae099818),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9ae0be2-05') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:46:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:46:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:46:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd9ae0be2-05, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:46:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd9ae0be2-05, col_values=(('external_ids', {'iface-id': 'd9ae0be2-05e7-4009-b909-713c8c52e5e5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:49:2b', 'vm-uuid': 'd85a919d-7f44-4093-b89a-51397ad5cedb'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:46:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:46:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:31 user nova-compute[73391]: INFO os_vif [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:49:2b,bridge_name='br-int',has_traffic_filtering=True,id=d9ae0be2-05e7-4009-b909-713c8c52e5e5,network=Network(bec69c6a-b2cb-4b0a-ba6e-ae6dae099818),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9ae0be2-05')
Aug 15 05:46:31 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:46:31 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] No VIF found with MAC fa:16:3e:8a:49:2b, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:46:31 user nova-compute[73391]: DEBUG nova.network.neutron [req-b747e9f4-079b-41db-8ed3-a6c4d6ae22a3 req-382c0a71-e7e2-4018-9487-47b70a49c297 service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Updated VIF entry in instance network info cache for port d9ae0be2-05e7-4009-b909-713c8c52e5e5. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:46:31 user nova-compute[73391]: DEBUG nova.network.neutron [req-b747e9f4-079b-41db-8ed3-a6c4d6ae22a3 req-382c0a71-e7e2-4018-9487-47b70a49c297 service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Updating instance_info_cache with network_info: [{"id": "d9ae0be2-05e7-4009-b909-713c8c52e5e5", "address": "fa:16:3e:8a:49:2b", "network": {"id": "bec69c6a-b2cb-4b0a-ba6e-ae6dae099818", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7da9448cc34b609120da564a01dba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ae0be2-05", "ovs_interfaceid": "d9ae0be2-05e7-4009-b909-713c8c52e5e5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:46:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-b747e9f4-079b-41db-8ed3-a6c4d6ae22a3 req-382c0a71-e7e2-4018-9487-47b70a49c297 service nova] Releasing lock "refresh_cache-d85a919d-7f44-4093-b89a-51397ad5cedb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:46:32 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:32 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:32 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:32 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:33 user nova-compute[73391]: DEBUG nova.compute.manager [req-22a72b48-2611-4409-9eaa-e04b1fe509dc req-9e48c054-fbc4-4a5f-bb33-794fb4f3aa10 service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Received event network-vif-plugged-d9ae0be2-05e7-4009-b909-713c8c52e5e5 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:46:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-22a72b48-2611-4409-9eaa-e04b1fe509dc req-9e48c054-fbc4-4a5f-bb33-794fb4f3aa10 service nova] Acquiring lock "d85a919d-7f44-4093-b89a-51397ad5cedb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:46:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-22a72b48-2611-4409-9eaa-e04b1fe509dc req-9e48c054-fbc4-4a5f-bb33-794fb4f3aa10 service nova] Lock "d85a919d-7f44-4093-b89a-51397ad5cedb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:46:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-22a72b48-2611-4409-9eaa-e04b1fe509dc req-9e48c054-fbc4-4a5f-bb33-794fb4f3aa10 service nova] Lock "d85a919d-7f44-4093-b89a-51397ad5cedb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:46:33 user nova-compute[73391]: DEBUG nova.compute.manager [req-22a72b48-2611-4409-9eaa-e04b1fe509dc req-9e48c054-fbc4-4a5f-bb33-794fb4f3aa10 service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] No waiting events found dispatching network-vif-plugged-d9ae0be2-05e7-4009-b909-713c8c52e5e5 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:46:33 user nova-compute[73391]: WARNING nova.compute.manager [req-22a72b48-2611-4409-9eaa-e04b1fe509dc req-9e48c054-fbc4-4a5f-bb33-794fb4f3aa10 service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Received unexpected event network-vif-plugged-d9ae0be2-05e7-4009-b909-713c8c52e5e5 for instance with vm_state building and task_state spawning.
Aug 15 05:46:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:35 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078395.114598, d85a919d-7f44-4093-b89a-51397ad5cedb => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:46:35 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] VM Resumed (Lifecycle Event)
Aug 15 05:46:35 user nova-compute[73391]: DEBUG nova.compute.manager [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:46:35 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Guest created on hypervisor {{(pid=73391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 05:46:35 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Instance spawned successfully.
Aug 15 05:46:35 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 05:46:35 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:46:35 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:46:35 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Found default for hw_cdrom_bus of ide {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:46:35 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Found default for hw_disk_bus of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:46:35 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Found default for hw_input_bus of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:46:35 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Found default for hw_pointer_model of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:46:35 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Found default for hw_video_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:46:35 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Found default for hw_vif_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:46:35 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:46:35 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078395.1162663, d85a919d-7f44-4093-b89a-51397ad5cedb => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:46:35 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] VM Started (Lifecycle Event)
Aug 15 05:46:35 user nova-compute[73391]: DEBUG nova.compute.manager [req-83a451df-a8c3-473b-8593-503bea8cd00d req-52959425-2f7f-425f-959a-04d740ed86be service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Received event network-vif-plugged-d9ae0be2-05e7-4009-b909-713c8c52e5e5 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:46:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-83a451df-a8c3-473b-8593-503bea8cd00d req-52959425-2f7f-425f-959a-04d740ed86be service nova] Acquiring lock "d85a919d-7f44-4093-b89a-51397ad5cedb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:46:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-83a451df-a8c3-473b-8593-503bea8cd00d req-52959425-2f7f-425f-959a-04d740ed86be service nova] Lock "d85a919d-7f44-4093-b89a-51397ad5cedb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:46:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-83a451df-a8c3-473b-8593-503bea8cd00d req-52959425-2f7f-425f-959a-04d740ed86be service nova] Lock "d85a919d-7f44-4093-b89a-51397ad5cedb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:46:35 user nova-compute[73391]: DEBUG nova.compute.manager [req-83a451df-a8c3-473b-8593-503bea8cd00d req-52959425-2f7f-425f-959a-04d740ed86be service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] No waiting events found dispatching network-vif-plugged-d9ae0be2-05e7-4009-b909-713c8c52e5e5 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:46:35 user nova-compute[73391]: WARNING nova.compute.manager [req-83a451df-a8c3-473b-8593-503bea8cd00d req-52959425-2f7f-425f-959a-04d740ed86be service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Received unexpected event network-vif-plugged-d9ae0be2-05e7-4009-b909-713c8c52e5e5 for instance with vm_state building and task_state spawning.
Aug 15 05:46:35 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:46:35 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:46:35 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:46:35 user nova-compute[73391]: INFO nova.compute.manager [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Took 5.63 seconds to spawn the instance on the hypervisor.
Aug 15 05:46:35 user nova-compute[73391]: DEBUG nova.compute.manager [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:46:35 user nova-compute[73391]: INFO nova.compute.manager [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Took 6.57 seconds to build instance.
Aug 15 05:46:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-42bc18fc-8ee9-4f06-9486-c979aae15fb8 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "d85a919d-7f44-4093-b89a-51397ad5cedb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.665s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:46:36 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:42 user nova-compute[73391]: DEBUG nova.compute.manager [req-7dd7f4ea-dfd7-425e-abbd-9bdf97f62d67 req-ad0a9127-c9a5-42ad-b9c7-1a9220f0d820 service nova] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Received event network-changed-cbe16818-84cf-4b94-9e4a-bc40ea83946a {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:46:42 user nova-compute[73391]: DEBUG nova.compute.manager [req-7dd7f4ea-dfd7-425e-abbd-9bdf97f62d67 req-ad0a9127-c9a5-42ad-b9c7-1a9220f0d820 service nova] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Refreshing instance network info cache due to event network-changed-cbe16818-84cf-4b94-9e4a-bc40ea83946a. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:46:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-7dd7f4ea-dfd7-425e-abbd-9bdf97f62d67 req-ad0a9127-c9a5-42ad-b9c7-1a9220f0d820 service nova] Acquiring lock "refresh_cache-7521ed98-75ed-43eb-83a2-d41502698aec" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:46:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-7dd7f4ea-dfd7-425e-abbd-9bdf97f62d67 req-ad0a9127-c9a5-42ad-b9c7-1a9220f0d820 service nova] Acquired lock "refresh_cache-7521ed98-75ed-43eb-83a2-d41502698aec" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:46:42 user nova-compute[73391]: DEBUG nova.network.neutron [req-7dd7f4ea-dfd7-425e-abbd-9bdf97f62d67 req-ad0a9127-c9a5-42ad-b9c7-1a9220f0d820 service nova] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Refreshing network info cache for port cbe16818-84cf-4b94-9e4a-bc40ea83946a {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:46:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-909f0be3-4dcb-4be9-8f45-b1ff32238a1b tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Acquiring lock "7521ed98-75ed-43eb-83a2-d41502698aec" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:46:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-909f0be3-4dcb-4be9-8f45-b1ff32238a1b tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "7521ed98-75ed-43eb-83a2-d41502698aec" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:46:42 user nova-compute[73391]: DEBUG nova.objects.instance [None req-909f0be3-4dcb-4be9-8f45-b1ff32238a1b tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lazy-loading 'flavor' on Instance uuid 7521ed98-75ed-43eb-83a2-d41502698aec {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:46:42 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-909f0be3-4dcb-4be9-8f45-b1ff32238a1b tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Ignoring supplied device name: /dev/vdb
Aug 15 05:46:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-909f0be3-4dcb-4be9-8f45-b1ff32238a1b tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "7521ed98-75ed-43eb-83a2-d41502698aec" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:46:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-909f0be3-4dcb-4be9-8f45-b1ff32238a1b tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Acquiring lock "7521ed98-75ed-43eb-83a2-d41502698aec" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:46:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-909f0be3-4dcb-4be9-8f45-b1ff32238a1b tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "7521ed98-75ed-43eb-83a2-d41502698aec" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:46:42 user nova-compute[73391]: INFO nova.compute.manager [None req-909f0be3-4dcb-4be9-8f45-b1ff32238a1b tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Attaching volume 26e6a3c8-b419-47e0-8256-322f47904a96 to /dev/vdb
Aug 15 05:46:42 user nova-compute[73391]: INFO nova.compute.manager [None req-1b7f5b9b-3393-4b22-bbc8-4d7536a3faab tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Get console output
Aug 15 05:46:42 user nova-compute[73391]: DEBUG os_brick.utils [None req-909f0be3-4dcb-4be9-8f45-b1ff32238a1b tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:46:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5014edf-4b7d-4bae-962f-218989b1e475]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:46:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8c144f-9dab-415b-ad9f-a6206b8ba580]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:46:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ae6aaa-b7ef-48bc-a706-f05dc729ecea]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:46:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2deeb5-fae0-4165-872a-2bca17546df4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:46:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-909f0be3-4dcb-4be9-8f45-b1ff32238a1b tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-909f0be3-4dcb-4be9-8f45-b1ff32238a1b tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:46:42 user nova-compute[73391]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Aug 15 05:46:42 user nova-compute[73391]: DEBUG nova.network.neutron [req-7dd7f4ea-dfd7-425e-abbd-9bdf97f62d67 req-ad0a9127-c9a5-42ad-b9c7-1a9220f0d820 service nova] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Updated VIF entry in instance network info cache for port cbe16818-84cf-4b94-9e4a-bc40ea83946a. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:46:42 user nova-compute[73391]: DEBUG nova.network.neutron [req-7dd7f4ea-dfd7-425e-abbd-9bdf97f62d67 req-ad0a9127-c9a5-42ad-b9c7-1a9220f0d820 service nova] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Updating instance_info_cache with network_info: [{"id": "cbe16818-84cf-4b94-9e4a-bc40ea83946a", "address": "fa:16:3e:c5:35:30", "network": {"id": "6757637c-358e-4fa8-b3c1-376d7892c884", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-577771159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae6fe94b9014479fbaff5131aefc8834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbe16818-84", "ovs_interfaceid": "cbe16818-84cf-4b94-9e4a-bc40ea83946a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:46:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-909f0be3-4dcb-4be9-8f45-b1ff32238a1b tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 05:46:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:46:42 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 05:46:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[07000750-56fb-4d08-b48a-31da6921e563]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:46:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-909f0be3-4dcb-4be9-8f45-b1ff32238a1b tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 05:46:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-909f0be3-4dcb-4be9-8f45-b1ff32238a1b tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 05:46:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-909f0be3-4dcb-4be9-8f45-b1ff32238a1b tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 05:46:42 user nova-compute[73391]: DEBUG os_brick.utils [None req-909f0be3-4dcb-4be9-8f45-b1ff32238a1b tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] <== get_connector_properties: return (170ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:46:42 user nova-compute[73391]: DEBUG nova.virt.block_device [None req-909f0be3-4dcb-4be9-8f45-b1ff32238a1b tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Updating existing volume attachment record: 0104f171-ab7c-4610-9133-3fd672093ce8 {{(pid=73391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 05:46:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-7dd7f4ea-dfd7-425e-abbd-9bdf97f62d67 req-ad0a9127-c9a5-42ad-b9c7-1a9220f0d820 service nova] Releasing lock "refresh_cache-7521ed98-75ed-43eb-83a2-d41502698aec" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:46:44 user nova-compute[73391]: DEBUG nova.compute.manager [None req-8e71c0b8-faae-4c9c-9662-2a1b8ab249f2 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:46:44 user nova-compute[73391]: INFO nova.compute.manager [None req-8e71c0b8-faae-4c9c-9662-2a1b8ab249f2 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] instance snapshotting
Aug 15 05:46:44 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-8e71c0b8-faae-4c9c-9662-2a1b8ab249f2 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Beginning live snapshot process
Aug 15 05:46:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-8e71c0b8-faae-4c9c-9662-2a1b8ab249f2 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8775490-2a9e-44ac-aad7-9450afa4c295/disk --force-share --output=json -f qcow2 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-8e71c0b8-faae-4c9c-9662-2a1b8ab249f2 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8775490-2a9e-44ac-aad7-9450afa4c295/disk --force-share --output=json -f qcow2" returned: 0 in 0.192s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-8e71c0b8-faae-4c9c-9662-2a1b8ab249f2 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8775490-2a9e-44ac-aad7-9450afa4c295/disk --force-share --output=json -f qcow2 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:44 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-8e71c0b8-faae-4c9c-9662-2a1b8ab249f2 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8775490-2a9e-44ac-aad7-9450afa4c295/disk --force-share --output=json -f qcow2" returned: 0 in 0.173s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-8e71c0b8-faae-4c9c-9662-2a1b8ab249f2 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:45 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-8e71c0b8-faae-4c9c-9662-2a1b8ab249f2 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.195s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:45 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-8e71c0b8-faae-4c9c-9662-2a1b8ab249f2 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmphqubmf8f/a673a86daece4588ada639855c92bad7.delta 1073741824 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:45 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-8e71c0b8-faae-4c9c-9662-2a1b8ab249f2 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmphqubmf8f/a673a86daece4588ada639855c92bad7.delta 1073741824" returned: 0 in 0.066s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:45 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-8e71c0b8-faae-4c9c-9662-2a1b8ab249f2 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 15 05:46:45 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-8e71c0b8-faae-4c9c-9662-2a1b8ab249f2 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=73391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 05:46:46 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-8e71c0b8-faae-4c9c-9662-2a1b8ab249f2 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] COPY block job progress, current cursor: 25362432 final cursor: 75563008 {{(pid=73391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 05:46:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:46 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-8e71c0b8-faae-4c9c-9662-2a1b8ab249f2 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=73391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 05:46:46 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-8e71c0b8-faae-4c9c-9662-2a1b8ab249f2 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 15 05:46:46 user nova-compute[73391]: DEBUG nova.privsep.utils [None req-8e71c0b8-faae-4c9c-9662-2a1b8ab249f2 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73391) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 05:46:46 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-8e71c0b8-faae-4c9c-9662-2a1b8ab249f2 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmphqubmf8f/a673a86daece4588ada639855c92bad7.delta /opt/stack/data/nova/instances/snapshots/tmphqubmf8f/a673a86daece4588ada639855c92bad7 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-8e71c0b8-faae-4c9c-9662-2a1b8ab249f2 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmphqubmf8f/a673a86daece4588ada639855c92bad7.delta /opt/stack/data/nova/instances/snapshots/tmphqubmf8f/a673a86daece4588ada639855c92bad7" returned: 0 in 0.608s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:47 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-8e71c0b8-faae-4c9c-9662-2a1b8ab249f2 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Snapshot extracted, beginning image upload
Aug 15 05:46:49 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:50 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-8e71c0b8-faae-4c9c-9662-2a1b8ab249f2 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Snapshot image upload complete
Aug 15 05:46:50 user nova-compute[73391]: INFO nova.compute.manager [None req-8e71c0b8-faae-4c9c-9662-2a1b8ab249f2 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Took 5.84 seconds to snapshot the instance on the hypervisor.
Aug 15 05:46:51 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Acquiring lock "fecde5f1-88fb-48b0-b039-93fdb285c93c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:46:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lock "fecde5f1-88fb-48b0-b039-93fdb285c93c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:46:51 user nova-compute[73391]: DEBUG nova.compute.manager [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Starting instance... {{(pid=73391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 05:46:52 user nova-compute[73391]: INFO nova.compute.claims [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Claim successful on node user
Aug 15 05:46:52 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-909f0be3-4dcb-4be9-8f45-b1ff32238a1b tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-909f0be3-4dcb-4be9-8f45-b1ff32238a1b tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:26e6a3c8-b419-47e0-8256-322f47904a96'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zPVAyDHE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:46:52 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-909f0be3-4dcb-4be9-8f45-b1ff32238a1b tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:46:52 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-909f0be3-4dcb-4be9-8f45-b1ff32238a1b tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-909f0be3-4dcb-4be9-8f45-b1ff32238a1b tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:46:52 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-909f0be3-4dcb-4be9-8f45-b1ff32238a1b tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:46:52 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-909f0be3-4dcb-4be9-8f45-b1ff32238a1b tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26e6a3c8-b419-47e0-8256-322f47904a96" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-909f0be3-4dcb-4be9-8f45-b1ff32238a1b tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26e6a3c8-b419-47e0-8256-322f47904a96" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:46:52 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-909f0be3-4dcb-4be9-8f45-b1ff32238a1b tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 05:46:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26e6a3c8-b419-47e0-8256-322f47904a96 -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26e6a3c8-b419-47e0-8256-322f47904a96 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9113ca32-84b9-4aea-b94f-62321f0b2933]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-909f0be3-4dcb-4be9-8f45-b1ff32238a1b tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 05:46:52 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26e6a3c8-b419-47e0-8256-322f47904a96 -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26e6a3c8-b419-47e0-8256-322f47904a96 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6200d2be-7adf-405a-bc15-fbf344341911]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26e6a3c8-b419-47e0-8256-322f47904a96] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-909f0be3-4dcb-4be9-8f45-b1ff32238a1b tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:26e6a3c8-b419-47e0-8256-322f47904a96] added
Aug 15 05:46:52 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26e6a3c8-b419-47e0-8256-322f47904a96 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26e6a3c8-b419-47e0-8256-322f47904a96 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6600b33a-370d-4bd1-8539-4a3a108fced6]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-909f0be3-4dcb-4be9-8f45-b1ff32238a1b tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26e6a3c8-b419-47e0-8256-322f47904a96 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26e6a3c8-b419-47e0-8256-322f47904a96 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[057289d1-cef1-4bc2-add4-1d8e89ca181f]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-909f0be3-4dcb-4be9-8f45-b1ff32238a1b tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26e6a3c8-b419-47e0-8256-322f47904a96 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zPVAyDHE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26e6a3c8-b419-47e0-8256-322f47904a96 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zPVAyDHE" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[138fba9c-ab3e-4220-967e-b9dd32b03e00]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-909f0be3-4dcb-4be9-8f45-b1ff32238a1b tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zPVAyDHE'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26e6a3c8-b419-47e0-8256-322f47904a96 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26e6a3c8-b419-47e0-8256-322f47904a96 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd7e552-592a-43f2-8a70-9967ae0afccb]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-909f0be3-4dcb-4be9-8f45-b1ff32238a1b tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[176335f8-3ce9-4e50-980d-c55ab405dc67]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-909f0be3-4dcb-4be9-8f45-b1ff32238a1b tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:46:52 user nova-compute[73391]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:46:52 user nova-compute[73391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)
Aug 15 05:46:52 user nova-compute[73391]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)
Aug 15 05:46:52 user nova-compute[73391]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6 (non-flash)
Aug 15 05:46:52 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-909f0be3-4dcb-4be9-8f45-b1ff32238a1b tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:46:52 user nova-compute[73391]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:46:52 user nova-compute[73391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)
Aug 15 05:46:52 user nova-compute[73391]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)
Aug 15 05:46:52 user nova-compute[73391]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6 (non-flash)
Aug 15 05:46:52 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26e6a3c8-b419-47e0-8256-322f47904a96 -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26e6a3c8-b419-47e0-8256-322f47904a96 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2406615c-0e85-4316-a81a-d2f1b00e5555]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:26e6a3c8-b419-47e0-8256-322f47904a96, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:26e6a3c8-b419-47e0-8256-322f47904a96, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-909f0be3-4dcb-4be9-8f45-b1ff32238a1b tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:26e6a3c8-b419-47e0-8256-322f47904a96, portal: 172.16.0.220,3260]
Aug 15 05:46:52 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:26e6a3c8-b419-47e0-8256-322f47904a96, portal: 172.16.0.220,3260] successful.
Aug 15 05:46:52 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26e6a3c8-b419-47e0-8256-322f47904a96 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26e6a3c8-b419-47e0-8256-322f47904a96 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff115adf-3425-4478-85f9-f75ad7f19891]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-909f0be3-4dcb-4be9-8f45-b1ff32238a1b tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08031a2-bf22-4436-ac6d-d1a95dd85bc3]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26e6a3c8-b419-47e0-8256-322f47904a96 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-909f0be3-4dcb-4be9-8f45-b1ff32238a1b tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:46:52 user nova-compute[73391]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:46:52 user nova-compute[73391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)
Aug 15 05:46:52 user nova-compute[73391]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)
Aug 15 05:46:52 user nova-compute[73391]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6 (non-flash)
Aug 15 05:46:52 user nova-compute[73391]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26e6a3c8-b419-47e0-8256-322f47904a96 (non-flash)
Aug 15 05:46:52 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-909f0be3-4dcb-4be9-8f45-b1ff32238a1b tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:46:52 user nova-compute[73391]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:46:52 user nova-compute[73391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)
Aug 15 05:46:52 user nova-compute[73391]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)
Aug 15 05:46:52 user nova-compute[73391]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6 (non-flash)
Aug 15 05:46:52 user nova-compute[73391]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26e6a3c8-b419-47e0-8256-322f47904a96 (non-flash)
Aug 15 05:46:52 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-909f0be3-4dcb-4be9-8f45-b1ff32238a1b tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:26e6a3c8-b419-47e0-8256-322f47904a96" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-909f0be3-4dcb-4be9-8f45-b1ff32238a1b tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-909f0be3-4dcb-4be9-8f45-b1ff32238a1b tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] HCTL ('38', '-', '-', 0) found on session 47 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-909f0be3-4dcb-4be9-8f45-b1ff32238a1b tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[74dee99e-77da-4afd-a152-aa7b52cacfc1]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-909f0be3-4dcb-4be9-8f45-b1ff32238a1b tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Searching for a device in session 47 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-909f0be3-4dcb-4be9-8f45-b1ff32238a1b tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Connected to sdg using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zPVAyDHE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.528s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG nova.compute.manager [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Start building networks asynchronously for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG nova.compute.manager [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Allocating IP information in the background. {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG nova.network.neutron [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] allocate_for_instance() {{(pid=73391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 05:46:52 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 05:46:52 user nova-compute[73391]: DEBUG nova.compute.manager [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Start building block device mappings for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG nova.policy [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5f88c49b60b5427bb5c07323e4312b14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '623d93149e574954839e469432f24fc8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73391) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG nova.compute.manager [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Start spawning the instance on the hypervisor. {{(pid=73391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Creating instance directory {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 05:46:52 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Creating image(s)
Aug 15 05:46:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Acquiring lock "/opt/stack/data/nova/instances/fecde5f1-88fb-48b0-b039-93fdb285c93c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lock "/opt/stack/data/nova/instances/fecde5f1-88fb-48b0-b039-93fdb285c93c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lock "/opt/stack/data/nova/instances/fecde5f1-88fb-48b0-b039-93fdb285c93c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Acquiring lock "83623054bf8d0ebe996f41ab1bf625e0990bf441" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:46:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lock "83623054bf8d0ebe996f41ab1bf625e0990bf441" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:46:53 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83623054bf8d0ebe996f41ab1bf625e0990bf441.part --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:53 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-909f0be3-4dcb-4be9-8f45-b1ff32238a1b tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.840s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:46:53 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-909f0be3-4dcb-4be9-8f45-b1ff32238a1b tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] <== connect_volume: return (1843ms) {'type': 'block', 'scsi_wwn': '23230363230643738', 'path': '/dev/sdg'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:46:53 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-909f0be3-4dcb-4be9-8f45-b1ff32238a1b tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23230363230643738', 'path': '/dev/sdg'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 05:46:53 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:53 user nova-compute[73391]: DEBUG nova.network.neutron [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Successfully created port: b884b795-4023-4343-b6dd-9cf6e5dd880a {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 05:46:53 user nova-compute[73391]: DEBUG nova.objects.instance [None req-909f0be3-4dcb-4be9-8f45-b1ff32238a1b tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lazy-loading 'flavor' on Instance uuid 7521ed98-75ed-43eb-83a2-d41502698aec {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:46:54 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-909f0be3-4dcb-4be9-8f45-b1ff32238a1b tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 05:46:54 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:46:54 user nova-compute[73391]:   <source dev="/dev/sdg"/>
Aug 15 05:46:54 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:46:54 user nova-compute[73391]:   <serial>26e6a3c8-b419-47e0-8256-322f47904a96</serial>
Aug 15 05:46:54 user nova-compute[73391]: </disk>
Aug 15 05:46:54 user nova-compute[73391]:  {{(pid=73391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 05:46:54 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83623054bf8d0ebe996f41ab1bf625e0990bf441.part --force-share --output=json" returned: 0 in 0.187s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:54 user nova-compute[73391]: DEBUG nova.virt.images [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] bfa322eb-e7e2-4d69-a0db-ebbf2aec1b33 was qcow2, converting to raw {{(pid=73391) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 05:46:54 user nova-compute[73391]: DEBUG nova.privsep.utils [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73391) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 05:46:54 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/83623054bf8d0ebe996f41ab1bf625e0990bf441.part /opt/stack/data/nova/instances/_base/83623054bf8d0ebe996f41ab1bf625e0990bf441.converted {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:54 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-909f0be3-4dcb-4be9-8f45-b1ff32238a1b tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:46:54 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-909f0be3-4dcb-4be9-8f45-b1ff32238a1b tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:46:54 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-909f0be3-4dcb-4be9-8f45-b1ff32238a1b tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] No VIF found with MAC fa:16:3e:c5:35:30, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:46:54 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/83623054bf8d0ebe996f41ab1bf625e0990bf441.part /opt/stack/data/nova/instances/_base/83623054bf8d0ebe996f41ab1bf625e0990bf441.converted" returned: 0 in 0.749s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:54 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83623054bf8d0ebe996f41ab1bf625e0990bf441.converted --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-909f0be3-4dcb-4be9-8f45-b1ff32238a1b tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "7521ed98-75ed-43eb-83a2-d41502698aec" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.366s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:46:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83623054bf8d0ebe996f41ab1bf625e0990bf441.converted --force-share --output=json" returned: 0 in 0.183s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lock "83623054bf8d0ebe996f41ab1bf625e0990bf441" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.197s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:46:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83623054bf8d0ebe996f41ab1bf625e0990bf441 --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83623054bf8d0ebe996f41ab1bf625e0990bf441 --force-share --output=json" returned: 0 in 0.170s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Acquiring lock "83623054bf8d0ebe996f41ab1bf625e0990bf441" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:46:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lock "83623054bf8d0ebe996f41ab1bf625e0990bf441" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:46:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83623054bf8d0ebe996f41ab1bf625e0990bf441 --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:55 user nova-compute[73391]: DEBUG nova.network.neutron [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Successfully updated port: b884b795-4023-4343-b6dd-9cf6e5dd880a {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:46:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83623054bf8d0ebe996f41ab1bf625e0990bf441 --force-share --output=json" returned: 0 in 0.176s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83623054bf8d0ebe996f41ab1bf625e0990bf441,backing_fmt=raw /opt/stack/data/nova/instances/fecde5f1-88fb-48b0-b039-93fdb285c93c/disk 1073741824 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Acquiring lock "refresh_cache-fecde5f1-88fb-48b0-b039-93fdb285c93c" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:46:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Acquired lock "refresh_cache-fecde5f1-88fb-48b0-b039-93fdb285c93c" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:46:55 user nova-compute[73391]: DEBUG nova.network.neutron [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:46:55 user nova-compute[73391]: DEBUG nova.compute.manager [req-50e1ce46-1053-4d73-a61a-d46b807497e7 req-dedbb85b-1d29-4efe-9b66-e60fd65f4c84 service nova] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Received event network-changed-b884b795-4023-4343-b6dd-9cf6e5dd880a {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:46:55 user nova-compute[73391]: DEBUG nova.compute.manager [req-50e1ce46-1053-4d73-a61a-d46b807497e7 req-dedbb85b-1d29-4efe-9b66-e60fd65f4c84 service nova] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Refreshing instance network info cache due to event network-changed-b884b795-4023-4343-b6dd-9cf6e5dd880a. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:46:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-50e1ce46-1053-4d73-a61a-d46b807497e7 req-dedbb85b-1d29-4efe-9b66-e60fd65f4c84 service nova] Acquiring lock "refresh_cache-fecde5f1-88fb-48b0-b039-93fdb285c93c" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:46:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/83623054bf8d0ebe996f41ab1bf625e0990bf441,backing_fmt=raw /opt/stack/data/nova/instances/fecde5f1-88fb-48b0-b039-93fdb285c93c/disk 1073741824" returned: 0 in 0.059s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lock "83623054bf8d0ebe996f41ab1bf625e0990bf441" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:46:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83623054bf8d0ebe996f41ab1bf625e0990bf441 --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-aee39476-3a09-4c1d-972d-08ceba3d58b7 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Acquiring lock "8991b32e-6c4b-4c66-a320-e734061f49ee" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:46:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-aee39476-3a09-4c1d-972d-08ceba3d58b7 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lock "8991b32e-6c4b-4c66-a320-e734061f49ee" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:46:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-aee39476-3a09-4c1d-972d-08ceba3d58b7 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Acquiring lock "8991b32e-6c4b-4c66-a320-e734061f49ee-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:46:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-aee39476-3a09-4c1d-972d-08ceba3d58b7 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lock "8991b32e-6c4b-4c66-a320-e734061f49ee-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:46:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-aee39476-3a09-4c1d-972d-08ceba3d58b7 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lock "8991b32e-6c4b-4c66-a320-e734061f49ee-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:46:55 user nova-compute[73391]: INFO nova.compute.manager [None req-aee39476-3a09-4c1d-972d-08ceba3d58b7 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Terminating instance
Aug 15 05:46:55 user nova-compute[73391]: DEBUG nova.compute.manager [None req-aee39476-3a09-4c1d-972d-08ceba3d58b7 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Start destroying the instance on the hypervisor. {{(pid=73391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 05:46:55 user nova-compute[73391]: DEBUG nova.network.neutron [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:46:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/83623054bf8d0ebe996f41ab1bf625e0990bf441 --force-share --output=json" returned: 0 in 0.197s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:55 user nova-compute[73391]: DEBUG nova.objects.instance [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lazy-loading 'migration_context' on Instance uuid fecde5f1-88fb-48b0-b039-93fdb285c93c {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:46:55 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Created local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 05:46:55 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Ensure instance console log exists: /opt/stack/data/nova/instances/fecde5f1-88fb-48b0-b039-93fdb285c93c/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 05:46:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:46:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:46:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:46:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:55 user nova-compute[73391]: DEBUG nova.compute.manager [req-6660e45c-ce38-4840-bce2-cc6b57abfd1c req-bd8c3cc9-8ec9-4e02-a465-59a1a477bdd1 service nova] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Received event network-vif-unplugged-3e0cb01d-a82e-44d3-b8dd-723819ec6ffa {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:46:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-6660e45c-ce38-4840-bce2-cc6b57abfd1c req-bd8c3cc9-8ec9-4e02-a465-59a1a477bdd1 service nova] Acquiring lock "8991b32e-6c4b-4c66-a320-e734061f49ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:46:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-6660e45c-ce38-4840-bce2-cc6b57abfd1c req-bd8c3cc9-8ec9-4e02-a465-59a1a477bdd1 service nova] Lock "8991b32e-6c4b-4c66-a320-e734061f49ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:46:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-6660e45c-ce38-4840-bce2-cc6b57abfd1c req-bd8c3cc9-8ec9-4e02-a465-59a1a477bdd1 service nova] Lock "8991b32e-6c4b-4c66-a320-e734061f49ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:46:55 user nova-compute[73391]: DEBUG nova.compute.manager [req-6660e45c-ce38-4840-bce2-cc6b57abfd1c req-bd8c3cc9-8ec9-4e02-a465-59a1a477bdd1 service nova] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] No waiting events found dispatching network-vif-unplugged-3e0cb01d-a82e-44d3-b8dd-723819ec6ffa {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:46:55 user nova-compute[73391]: DEBUG nova.compute.manager [req-6660e45c-ce38-4840-bce2-cc6b57abfd1c req-bd8c3cc9-8ec9-4e02-a465-59a1a477bdd1 service nova] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Received event network-vif-unplugged-3e0cb01d-a82e-44d3-b8dd-723819ec6ffa for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG nova.network.neutron [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Updating instance_info_cache with network_info: [{"id": "b884b795-4023-4343-b6dd-9cf6e5dd880a", "address": "fa:16:3e:66:e9:85", "network": {"id": "c7ff2e30-7396-4af7-bd21-e9157804987e", "bridge": "br-int", "label": "tempest-TestStampPattern-2022602784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "623d93149e574954839e469432f24fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb884b795-40", "ovs_interfaceid": "b884b795-4023-4343-b6dd-9cf6e5dd880a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Releasing lock "refresh_cache-fecde5f1-88fb-48b0-b039-93fdb285c93c" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG nova.compute.manager [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Instance network_info: |[{"id": "b884b795-4023-4343-b6dd-9cf6e5dd880a", "address": "fa:16:3e:66:e9:85", "network": {"id": "c7ff2e30-7396-4af7-bd21-e9157804987e", "bridge": "br-int", "label": "tempest-TestStampPattern-2022602784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "623d93149e574954839e469432f24fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb884b795-40", "ovs_interfaceid": "b884b795-4023-4343-b6dd-9cf6e5dd880a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-50e1ce46-1053-4d73-a61a-d46b807497e7 req-dedbb85b-1d29-4efe-9b66-e60fd65f4c84 service nova] Acquired lock "refresh_cache-fecde5f1-88fb-48b0-b039-93fdb285c93c" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG nova.network.neutron [req-50e1ce46-1053-4d73-a61a-d46b807497e7 req-dedbb85b-1d29-4efe-9b66-e60fd65f4c84 service nova] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Refreshing network info cache for port b884b795-4023-4343-b6dd-9cf6e5dd880a {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Start _get_guest_xml network_info=[{"id": "b884b795-4023-4343-b6dd-9cf6e5dd880a", "address": "fa:16:3e:66:e9:85", "network": {"id": "c7ff2e30-7396-4af7-bd21-e9157804987e", "bridge": "br-int", "label": "tempest-TestStampPattern-2022602784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "623d93149e574954839e469432f24fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb884b795-40", "ovs_interfaceid": "b884b795-4023-4343-b6dd-9cf6e5dd880a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c0d67a6bf293c412968870d03c6709f7',container_format='bare',created_at=2023-08-15T05:46:44Z,direct_url=<?>,disk_format='qcow2',id=bfa322eb-e7e2-4d69-a0db-ebbf2aec1b33,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1710693952',owner='623d93149e574954839e469432f24fc8',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-15T05:46:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': 'bfa322eb-e7e2-4d69-a0db-ebbf2aec1b33'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:46:56 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:46:56 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:46:56 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c0d67a6bf293c412968870d03c6709f7',container_format='bare',created_at=2023-08-15T05:46:44Z,direct_url=<?>,disk_format='qcow2',id=bfa322eb-e7e2-4d69-a0db-ebbf2aec1b33,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1710693952',owner='623d93149e574954839e469432f24fc8',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-08-15T05:46:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:46:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-758061833',display_name='tempest-TestStampPattern-server-758061833',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-758061833',id=38,image_ref='bfa322eb-e7e2-4d69-a0db-ebbf2aec1b33',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQQVWOeuc6yJ6EmMw2rWLVsGpBPeA9gFNl5HRrfI/TUHS+ncoxmVN1359pxZR2y8M4qFx49b4zMDH1GSzjx/6CrvC6kH/thvZ4QYbb7yiE9dJlfo8ha6chN1RxR3KNG5w==',key_name='tempest-TestStampPattern-1501428928',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='623d93149e574954839e469432f24fc8',ramdisk_id='',reservation_id='r-1hk4sx36',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='e8775490-2a9e-44ac-aad7-9450afa4c295',image_min_disk='1',image_min_ram='0',image_owner_id='623d93149e574954839e469432f24fc8',image_owner_project_name='tempest-TestStampPattern-1421231515',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1421231515-project-member',image_user_id='5f88c49b60b5427bb5c07323e4312b14',network_allocated='True',owner_project_name='tempest-TestStampPattern-1421231515',owner_user_name='tempest-TestStampPattern-1421231515-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:46:53Z,user_data=None,user_id='5f88c49b60b5427bb5c07323e4312b14',uuid=fecde5f1-88fb-48b0-b039-93fdb285c93c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b884b795-4023-4343-b6dd-9cf6e5dd880a", "address": "fa:16:3e:66:e9:85", "network": {"id": "c7ff2e30-7396-4af7-bd21-e9157804987e", "bridge": "br-int", "label": "tempest-TestStampPattern-2022602784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "623d93149e574954839e469432f24fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb884b795-40", "ovs_interfaceid": "b884b795-4023-4343-b6dd-9cf6e5dd880a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Converting VIF {"id": "b884b795-4023-4343-b6dd-9cf6e5dd880a", "address": "fa:16:3e:66:e9:85", "network": {"id": "c7ff2e30-7396-4af7-bd21-e9157804987e", "bridge": "br-int", "label": "tempest-TestStampPattern-2022602784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "623d93149e574954839e469432f24fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb884b795-40", "ovs_interfaceid": "b884b795-4023-4343-b6dd-9cf6e5dd880a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:e9:85,bridge_name='br-int',has_traffic_filtering=True,id=b884b795-4023-4343-b6dd-9cf6e5dd880a,network=Network(c7ff2e30-7396-4af7-bd21-e9157804987e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb884b795-40') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG nova.objects.instance [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lazy-loading 'pci_devices' on Instance uuid fecde5f1-88fb-48b0-b039-93fdb285c93c {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:46:56 user nova-compute[73391]:   <uuid>fecde5f1-88fb-48b0-b039-93fdb285c93c</uuid>
Aug 15 05:46:56 user nova-compute[73391]:   <name>instance-00000026</name>
Aug 15 05:46:56 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:46:56 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:46:56 user nova-compute[73391]:   <metadata>
Aug 15 05:46:56 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:46:56 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:46:56 user nova-compute[73391]:       <nova:name>tempest-TestStampPattern-server-758061833</nova:name>
Aug 15 05:46:56 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:46:56</nova:creationTime>
Aug 15 05:46:56 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:46:56 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:46:56 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:46:56 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:46:56 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:46:56 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:46:56 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:46:56 user nova-compute[73391]:       <nova:owner>
Aug 15 05:46:56 user nova-compute[73391]:         <nova:user uuid="5f88c49b60b5427bb5c07323e4312b14">tempest-TestStampPattern-1421231515-project-member</nova:user>
Aug 15 05:46:56 user nova-compute[73391]:         <nova:project uuid="623d93149e574954839e469432f24fc8">tempest-TestStampPattern-1421231515</nova:project>
Aug 15 05:46:56 user nova-compute[73391]:       </nova:owner>
Aug 15 05:46:56 user nova-compute[73391]:       <nova:root type="image" uuid="bfa322eb-e7e2-4d69-a0db-ebbf2aec1b33"/>
Aug 15 05:46:56 user nova-compute[73391]:       <nova:ports>
Aug 15 05:46:56 user nova-compute[73391]:         <nova:port uuid="b884b795-4023-4343-b6dd-9cf6e5dd880a">
Aug 15 05:46:56 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 05:46:56 user nova-compute[73391]:         </nova:port>
Aug 15 05:46:56 user nova-compute[73391]:       </nova:ports>
Aug 15 05:46:56 user nova-compute[73391]:     </nova:instance>
Aug 15 05:46:56 user nova-compute[73391]:   </metadata>
Aug 15 05:46:56 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:46:56 user nova-compute[73391]:     <system>
Aug 15 05:46:56 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:46:56 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:46:56 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:46:56 user nova-compute[73391]:       <entry name="serial">fecde5f1-88fb-48b0-b039-93fdb285c93c</entry>
Aug 15 05:46:56 user nova-compute[73391]:       <entry name="uuid">fecde5f1-88fb-48b0-b039-93fdb285c93c</entry>
Aug 15 05:46:56 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:46:56 user nova-compute[73391]:     </system>
Aug 15 05:46:56 user nova-compute[73391]:   </sysinfo>
Aug 15 05:46:56 user nova-compute[73391]:   <os>
Aug 15 05:46:56 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:46:56 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:46:56 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:46:56 user nova-compute[73391]:   </os>
Aug 15 05:46:56 user nova-compute[73391]:   <features>
Aug 15 05:46:56 user nova-compute[73391]:     <acpi/>
Aug 15 05:46:56 user nova-compute[73391]:     <apic/>
Aug 15 05:46:56 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:46:56 user nova-compute[73391]:   </features>
Aug 15 05:46:56 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:46:56 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:46:56 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:46:56 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:46:56 user nova-compute[73391]:   </clock>
Aug 15 05:46:56 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:46:56 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:46:56 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:46:56 user nova-compute[73391]:   </cpu>
Aug 15 05:46:56 user nova-compute[73391]:   <devices>
Aug 15 05:46:56 user nova-compute[73391]:     <disk type="file" device="disk">
Aug 15 05:46:56 user nova-compute[73391]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 05:46:56 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/fecde5f1-88fb-48b0-b039-93fdb285c93c/disk"/>
Aug 15 05:46:56 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:46:56 user nova-compute[73391]:     </disk>
Aug 15 05:46:56 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:46:56 user nova-compute[73391]:       <mac address="fa:16:3e:66:e9:85"/>
Aug 15 05:46:56 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:46:56 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:46:56 user nova-compute[73391]:       <target dev="tapb884b795-40"/>
Aug 15 05:46:56 user nova-compute[73391]:     </interface>
Aug 15 05:46:56 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:46:56 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/fecde5f1-88fb-48b0-b039-93fdb285c93c/console.log" append="off"/>
Aug 15 05:46:56 user nova-compute[73391]:     </serial>
Aug 15 05:46:56 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:46:56 user nova-compute[73391]:     <video>
Aug 15 05:46:56 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:46:56 user nova-compute[73391]:     </video>
Aug 15 05:46:56 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:46:56 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:46:56 user nova-compute[73391]:     </rng>
Aug 15 05:46:56 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:46:56 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:46:56 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:46:56 user nova-compute[73391]:     </memballoon>
Aug 15 05:46:56 user nova-compute[73391]:   </devices>
Aug 15 05:46:56 user nova-compute[73391]: </domain>
Aug 15 05:46:56 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:46:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-758061833',display_name='tempest-TestStampPattern-server-758061833',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-758061833',id=38,image_ref='bfa322eb-e7e2-4d69-a0db-ebbf2aec1b33',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQQVWOeuc6yJ6EmMw2rWLVsGpBPeA9gFNl5HRrfI/TUHS+ncoxmVN1359pxZR2y8M4qFx49b4zMDH1GSzjx/6CrvC6kH/thvZ4QYbb7yiE9dJlfo8ha6chN1RxR3KNG5w==',key_name='tempest-TestStampPattern-1501428928',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='623d93149e574954839e469432f24fc8',ramdisk_id='',reservation_id='r-1hk4sx36',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='e8775490-2a9e-44ac-aad7-9450afa4c295',image_min_disk='1',image_min_ram='0',image_owner_id='623d93149e574954839e469432f24fc8',image_owner_project_name='tempest-TestStampPattern-1421231515',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1421231515-project-member',image_user_id='5f88c49b60b5427bb5c07323e4312b14',network_allocated='True',owner_project_name='tempest-TestStampPattern-1421231515',owner_user_name='tempest-TestStampPattern-1421231515-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:46:53Z,user_data=None,user_id='5f88c49b60b5427bb5c07323e4312b14',uuid=fecde5f1-88fb-48b0-b039-93fdb285c93c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b884b795-4023-4343-b6dd-9cf6e5dd880a", "address": "fa:16:3e:66:e9:85", "network": {"id": "c7ff2e30-7396-4af7-bd21-e9157804987e", "bridge": "br-int", "label": "tempest-TestStampPattern-2022602784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "623d93149e574954839e469432f24fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb884b795-40", "ovs_interfaceid": "b884b795-4023-4343-b6dd-9cf6e5dd880a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Converting VIF {"id": "b884b795-4023-4343-b6dd-9cf6e5dd880a", "address": "fa:16:3e:66:e9:85", "network": {"id": "c7ff2e30-7396-4af7-bd21-e9157804987e", "bridge": "br-int", "label": "tempest-TestStampPattern-2022602784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "623d93149e574954839e469432f24fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb884b795-40", "ovs_interfaceid": "b884b795-4023-4343-b6dd-9cf6e5dd880a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:e9:85,bridge_name='br-int',has_traffic_filtering=True,id=b884b795-4023-4343-b6dd-9cf6e5dd880a,network=Network(c7ff2e30-7396-4af7-bd21-e9157804987e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb884b795-40') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG os_vif [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:e9:85,bridge_name='br-int',has_traffic_filtering=True,id=b884b795-4023-4343-b6dd-9cf6e5dd880a,network=Network(c7ff2e30-7396-4af7-bd21-e9157804987e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb884b795-40') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb884b795-40, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb884b795-40, col_values=(('external_ids', {'iface-id': 'b884b795-4023-4343-b6dd-9cf6e5dd880a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:e9:85', 'vm-uuid': 'fecde5f1-88fb-48b0-b039-93fdb285c93c'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:56 user nova-compute[73391]: INFO os_vif [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:e9:85,bridge_name='br-int',has_traffic_filtering=True,id=b884b795-4023-4343-b6dd-9cf6e5dd880a,network=Network(c7ff2e30-7396-4af7-bd21-e9157804987e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb884b795-40')
Aug 15 05:46:56 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] No VIF found with MAC fa:16:3e:66:e9:85, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG nova.network.neutron [req-50e1ce46-1053-4d73-a61a-d46b807497e7 req-dedbb85b-1d29-4efe-9b66-e60fd65f4c84 service nova] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Updated VIF entry in instance network info cache for port b884b795-4023-4343-b6dd-9cf6e5dd880a. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG nova.network.neutron [req-50e1ce46-1053-4d73-a61a-d46b807497e7 req-dedbb85b-1d29-4efe-9b66-e60fd65f4c84 service nova] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Updating instance_info_cache with network_info: [{"id": "b884b795-4023-4343-b6dd-9cf6e5dd880a", "address": "fa:16:3e:66:e9:85", "network": {"id": "c7ff2e30-7396-4af7-bd21-e9157804987e", "bridge": "br-int", "label": "tempest-TestStampPattern-2022602784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "623d93149e574954839e469432f24fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb884b795-40", "ovs_interfaceid": "b884b795-4023-4343-b6dd-9cf6e5dd880a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-50e1ce46-1053-4d73-a61a-d46b807497e7 req-dedbb85b-1d29-4efe-9b66-e60fd65f4c84 service nova] Releasing lock "refresh_cache-fecde5f1-88fb-48b0-b039-93fdb285c93c" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:46:56 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Instance destroyed successfully.
Aug 15 05:46:56 user nova-compute[73391]: DEBUG nova.objects.instance [None req-aee39476-3a09-4c1d-972d-08ceba3d58b7 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lazy-loading 'resources' on Instance uuid 8991b32e-6c4b-4c66-a320-e734061f49ee {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-aee39476-3a09-4c1d-972d-08ceba3d58b7 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:38:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-845602872',display_name='tempest-ServerActionsTestOtherB-server-845602872',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-845602872',id=27,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCi9vkvcVQEbXmigHztv9LlDFuCnimhR/vNlP8kykjc1U9WtN+KwlQqW0CDVIHXojOPVLOC+TJRapzFB5aO8vw7udjudZbg8fWCON+jsBrd+VE/0PuYaOBBV7W22/iAKjg==',key_name='tempest-keypair-1001766799',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:44:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='666428ad8c2f4f9cadcd180e498223f7',ramdisk_id='',reservation_id='r-sady4pim',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-762584882',owner_user_name='tempest-ServerActionsTestOtherB-762584882-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:44:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b43158637026445496cc0030b6ce49a2',uuid=8991b32e-6c4b-4c66-a320-e734061f49ee,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e0cb01d-a82e-44d3-b8dd-723819ec6ffa", "address": "fa:16:3e:89:dc:93", "network": {"id": "11023df3-666d-44e5-955d-cc1fbde6972e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1848872765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "666428ad8c2f4f9cadcd180e498223f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0cb01d-a8", "ovs_interfaceid": "3e0cb01d-a82e-44d3-b8dd-723819ec6ffa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-aee39476-3a09-4c1d-972d-08ceba3d58b7 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Converting VIF {"id": "3e0cb01d-a82e-44d3-b8dd-723819ec6ffa", "address": "fa:16:3e:89:dc:93", "network": {"id": "11023df3-666d-44e5-955d-cc1fbde6972e", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1848872765-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.211", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "666428ad8c2f4f9cadcd180e498223f7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0cb01d-a8", "ovs_interfaceid": "3e0cb01d-a82e-44d3-b8dd-723819ec6ffa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-aee39476-3a09-4c1d-972d-08ceba3d58b7 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:dc:93,bridge_name='br-int',has_traffic_filtering=True,id=3e0cb01d-a82e-44d3-b8dd-723819ec6ffa,network=Network(11023df3-666d-44e5-955d-cc1fbde6972e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e0cb01d-a8') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG os_vif [None req-aee39476-3a09-4c1d-972d-08ceba3d58b7 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:dc:93,bridge_name='br-int',has_traffic_filtering=True,id=3e0cb01d-a82e-44d3-b8dd-723819ec6ffa,network=Network(11023df3-666d-44e5-955d-cc1fbde6972e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e0cb01d-a8') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e0cb01d-a8, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:56 user nova-compute[73391]: INFO os_vif [None req-aee39476-3a09-4c1d-972d-08ceba3d58b7 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:dc:93,bridge_name='br-int',has_traffic_filtering=True,id=3e0cb01d-a82e-44d3-b8dd-723819ec6ffa,network=Network(11023df3-666d-44e5-955d-cc1fbde6972e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e0cb01d-a8')
Aug 15 05:46:56 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aee39476-3a09-4c1d-972d-08ceba3d58b7 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee39476-3a09-4c1d-972d-08ceba3d58b7 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IWGBEMQx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:46:56 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-aee39476-3a09-4c1d-972d-08ceba3d58b7 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:46:56 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-aee39476-3a09-4c1d-972d-08ceba3d58b7 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-aee39476-3a09-4c1d-972d-08ceba3d58b7 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee39476-3a09-4c1d-972d-08ceba3d58b7 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[75459b80-24a9-4352-b2ce-dd8fca5b56fd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26e6a3c8-b419-47e0-8256-322f47904a96\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7392d96-6b9d-4587-b561-7dc1a2204b0b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26e6a3c8-b419-47e0-8256-322f47904a96 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee39476-3a09-4c1d-972d-08ceba3d58b7 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:46:56 user nova-compute[73391]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:46:56 user nova-compute[73391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)
Aug 15 05:46:56 user nova-compute[73391]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)
Aug 15 05:46:56 user nova-compute[73391]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6 (non-flash)
Aug 15 05:46:56 user nova-compute[73391]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26e6a3c8-b419-47e0-8256-322f47904a96 (non-flash)
Aug 15 05:46:56 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee39476-3a09-4c1d-972d-08ceba3d58b7 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:46:56 user nova-compute[73391]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:46:56 user nova-compute[73391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)
Aug 15 05:46:56 user nova-compute[73391]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf (non-flash)
Aug 15 05:46:56 user nova-compute[73391]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6 (non-flash)
Aug 15 05:46:56 user nova-compute[73391]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26e6a3c8-b419-47e0-8256-322f47904a96 (non-flash)
Aug 15 05:46:56 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee39476-3a09-4c1d-972d-08ceba3d58b7 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77282f53f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf'): ({'sdb'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-aee39476-3a09-4c1d-972d-08ceba3d58b7 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Removing single pathed devices sdb {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[892136c0-a1b0-44b4-8b5a-335e34e0fcc4]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cefbbab4-88a8-4768-b51d-8cc51a8ff0d7]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-aee39476-3a09-4c1d-972d-08ceba3d58b7 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Flushing IO for device /dev/sdb {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[258bdfbf-121c-4d22-90a0-6cdb5040fcfc]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-aee39476-3a09-4c1d-972d-08ceba3d58b7 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1734bb-65f9-48a0-8d57-7aded0a7dc42]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-aee39476-3a09-4c1d-972d-08ceba3d58b7 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-aee39476-3a09-4c1d-972d-08ceba3d58b7 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] SCSI volumes sdb have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee39476-3a09-4c1d-972d-08ceba3d58b7 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8b92ba-0142-493c-9f49-ad7c48773ef5]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee39476-3a09-4c1d-972d-08ceba3d58b7 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae6015a-1929-4051-8b24-1c2e784dd0a2]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee39476-3a09-4c1d-972d-08ceba3d58b7 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf, portal: 172.16.0.220,3260]
Aug 15 05:46:56 user nova-compute[73391]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf, portal: 172.16.0.220,3260] successful.
Aug 15 05:46:56 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:46:56 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:46:57 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5ac82e4f-fe64-4376-afab-0fe6cbb31bcf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:46:57 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe38a72-546b-441b-b9be-69cdfa20a3ab]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:46:57 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee39476-3a09-4c1d-972d-08ceba3d58b7 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:46:57 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-aee39476-3a09-4c1d-972d-08ceba3d58b7 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:46:57 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-aee39476-3a09-4c1d-972d-08ceba3d58b7 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] <== disconnect_volume: return (333ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:46:57 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-aee39476-3a09-4c1d-972d-08ceba3d58b7 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 05:46:57 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-aee39476-3a09-4c1d-972d-08ceba3d58b7 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Deleting instance files /opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee_del
Aug 15 05:46:57 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-aee39476-3a09-4c1d-972d-08ceba3d58b7 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Deletion of /opt/stack/data/nova/instances/8991b32e-6c4b-4c66-a320-e734061f49ee_del complete
Aug 15 05:46:57 user nova-compute[73391]: INFO nova.compute.manager [None req-aee39476-3a09-4c1d-972d-08ceba3d58b7 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Took 1.55 seconds to destroy the instance on the hypervisor.
Aug 15 05:46:57 user nova-compute[73391]: DEBUG oslo.service.loopingcall [None req-aee39476-3a09-4c1d-972d-08ceba3d58b7 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 05:46:57 user nova-compute[73391]: DEBUG nova.compute.manager [-] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Deallocating network for instance {{(pid=73391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 05:46:57 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] deallocate_for_instance() {{(pid=73391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 05:46:57 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:57 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:57 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:57 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:57 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:57 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:57 user nova-compute[73391]: DEBUG nova.compute.manager [req-edaa5af9-1e40-4c7e-bfe3-8a569f002519 req-abf540c0-d557-4699-8f26-5df57a490e93 service nova] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Received event network-vif-plugged-3e0cb01d-a82e-44d3-b8dd-723819ec6ffa {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:46:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-edaa5af9-1e40-4c7e-bfe3-8a569f002519 req-abf540c0-d557-4699-8f26-5df57a490e93 service nova] Acquiring lock "8991b32e-6c4b-4c66-a320-e734061f49ee-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:46:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-edaa5af9-1e40-4c7e-bfe3-8a569f002519 req-abf540c0-d557-4699-8f26-5df57a490e93 service nova] Lock "8991b32e-6c4b-4c66-a320-e734061f49ee-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:46:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-edaa5af9-1e40-4c7e-bfe3-8a569f002519 req-abf540c0-d557-4699-8f26-5df57a490e93 service nova] Lock "8991b32e-6c4b-4c66-a320-e734061f49ee-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:46:57 user nova-compute[73391]: DEBUG nova.compute.manager [req-edaa5af9-1e40-4c7e-bfe3-8a569f002519 req-abf540c0-d557-4699-8f26-5df57a490e93 service nova] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] No waiting events found dispatching network-vif-plugged-3e0cb01d-a82e-44d3-b8dd-723819ec6ffa {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:46:57 user nova-compute[73391]: WARNING nova.compute.manager [req-edaa5af9-1e40-4c7e-bfe3-8a569f002519 req-abf540c0-d557-4699-8f26-5df57a490e93 service nova] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Received unexpected event network-vif-plugged-3e0cb01d-a82e-44d3-b8dd-723819ec6ffa for instance with vm_state active and task_state deleting.
Aug 15 05:46:58 user nova-compute[73391]: DEBUG nova.compute.manager [req-7f12a7ce-cefd-41cf-8eee-dfb947c52704 req-592a33aa-b329-4d21-8d5a-e6b37cfecc57 service nova] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Received event network-vif-plugged-b884b795-4023-4343-b6dd-9cf6e5dd880a {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:46:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-7f12a7ce-cefd-41cf-8eee-dfb947c52704 req-592a33aa-b329-4d21-8d5a-e6b37cfecc57 service nova] Acquiring lock "fecde5f1-88fb-48b0-b039-93fdb285c93c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:46:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-7f12a7ce-cefd-41cf-8eee-dfb947c52704 req-592a33aa-b329-4d21-8d5a-e6b37cfecc57 service nova] Lock "fecde5f1-88fb-48b0-b039-93fdb285c93c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:46:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-7f12a7ce-cefd-41cf-8eee-dfb947c52704 req-592a33aa-b329-4d21-8d5a-e6b37cfecc57 service nova] Lock "fecde5f1-88fb-48b0-b039-93fdb285c93c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:46:58 user nova-compute[73391]: DEBUG nova.compute.manager [req-7f12a7ce-cefd-41cf-8eee-dfb947c52704 req-592a33aa-b329-4d21-8d5a-e6b37cfecc57 service nova] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] No waiting events found dispatching network-vif-plugged-b884b795-4023-4343-b6dd-9cf6e5dd880a {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:46:58 user nova-compute[73391]: WARNING nova.compute.manager [req-7f12a7ce-cefd-41cf-8eee-dfb947c52704 req-592a33aa-b329-4d21-8d5a-e6b37cfecc57 service nova] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Received unexpected event network-vif-plugged-b884b795-4023-4343-b6dd-9cf6e5dd880a for instance with vm_state building and task_state spawning.
Aug 15 05:46:58 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:46:58 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Took 1.21 seconds to deallocate network for instance.
Aug 15 05:46:59 user nova-compute[73391]: INFO nova.compute.manager [None req-aee39476-3a09-4c1d-972d-08ceba3d58b7 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Took 0.75 seconds to detach 1 volumes for instance.
Aug 15 05:46:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-aee39476-3a09-4c1d-972d-08ceba3d58b7 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:46:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-aee39476-3a09-4c1d-972d-08ceba3d58b7 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:46:59 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-aee39476-3a09-4c1d-972d-08ceba3d58b7 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:46:59 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-aee39476-3a09-4c1d-972d-08ceba3d58b7 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:46:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-aee39476-3a09-4c1d-972d-08ceba3d58b7 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.422s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:46:59 user nova-compute[73391]: INFO nova.scheduler.client.report [None req-aee39476-3a09-4c1d-972d-08ceba3d58b7 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Deleted allocations for instance 8991b32e-6c4b-4c66-a320-e734061f49ee
Aug 15 05:46:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-aee39476-3a09-4c1d-972d-08ceba3d58b7 tempest-ServerActionsTestOtherB-762584882 tempest-ServerActionsTestOtherB-762584882-project-member] Lock "8991b32e-6c4b-4c66-a320-e734061f49ee" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.157s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:46:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:46:59 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078419.8928723, fecde5f1-88fb-48b0-b039-93fdb285c93c => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:46:59 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] VM Resumed (Lifecycle Event)
Aug 15 05:46:59 user nova-compute[73391]: DEBUG nova.compute.manager [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:46:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Guest created on hypervisor {{(pid=73391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 05:46:59 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Instance spawned successfully.
Aug 15 05:46:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 05:46:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Found default for hw_input_bus of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:46:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Found default for hw_pointer_model of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:46:59 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:46:59 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:46:59 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:46:59 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078419.896498, fecde5f1-88fb-48b0-b039-93fdb285c93c => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:46:59 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] VM Started (Lifecycle Event)
Aug 15 05:46:59 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:47:00 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:47:00 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:47:00 user nova-compute[73391]: DEBUG nova.compute.manager [req-fb458028-b113-4631-8818-f9320fd110a0 req-cd720840-c74a-4469-9eea-1e042b4144e9 service nova] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Received event network-vif-deleted-3e0cb01d-a82e-44d3-b8dd-723819ec6ffa {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:47:00 user nova-compute[73391]: DEBUG nova.compute.manager [req-fb458028-b113-4631-8818-f9320fd110a0 req-cd720840-c74a-4469-9eea-1e042b4144e9 service nova] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Received event network-vif-plugged-b884b795-4023-4343-b6dd-9cf6e5dd880a {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:47:00 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-fb458028-b113-4631-8818-f9320fd110a0 req-cd720840-c74a-4469-9eea-1e042b4144e9 service nova] Acquiring lock "fecde5f1-88fb-48b0-b039-93fdb285c93c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:47:00 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-fb458028-b113-4631-8818-f9320fd110a0 req-cd720840-c74a-4469-9eea-1e042b4144e9 service nova] Lock "fecde5f1-88fb-48b0-b039-93fdb285c93c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:47:00 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-fb458028-b113-4631-8818-f9320fd110a0 req-cd720840-c74a-4469-9eea-1e042b4144e9 service nova] Lock "fecde5f1-88fb-48b0-b039-93fdb285c93c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:47:00 user nova-compute[73391]: DEBUG nova.compute.manager [req-fb458028-b113-4631-8818-f9320fd110a0 req-cd720840-c74a-4469-9eea-1e042b4144e9 service nova] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] No waiting events found dispatching network-vif-plugged-b884b795-4023-4343-b6dd-9cf6e5dd880a {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:47:00 user nova-compute[73391]: WARNING nova.compute.manager [req-fb458028-b113-4631-8818-f9320fd110a0 req-cd720840-c74a-4469-9eea-1e042b4144e9 service nova] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Received unexpected event network-vif-plugged-b884b795-4023-4343-b6dd-9cf6e5dd880a for instance with vm_state building and task_state spawning.
Aug 15 05:47:00 user nova-compute[73391]: INFO nova.compute.manager [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Took 7.51 seconds to spawn the instance on the hypervisor.
Aug 15 05:47:00 user nova-compute[73391]: DEBUG nova.compute.manager [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:47:00 user nova-compute[73391]: INFO nova.compute.manager [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Took 8.47 seconds to build instance.
Aug 15 05:47:00 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-ff52a01f-5b31-41cc-b6cb-976625d963b0 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lock "fecde5f1-88fb-48b0-b039-93fdb285c93c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.623s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:47:01 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:47:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6ad02c21-59d7-488f-a331-d0d923b538ad tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquiring lock "b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:47:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6ad02c21-59d7-488f-a331-d0d923b538ad tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:47:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6ad02c21-59d7-488f-a331-d0d923b538ad tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquiring lock "b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:47:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6ad02c21-59d7-488f-a331-d0d923b538ad tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:47:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6ad02c21-59d7-488f-a331-d0d923b538ad tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:47:04 user nova-compute[73391]: INFO nova.compute.manager [None req-6ad02c21-59d7-488f-a331-d0d923b538ad tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Terminating instance
Aug 15 05:47:04 user nova-compute[73391]: DEBUG nova.compute.manager [None req-6ad02c21-59d7-488f-a331-d0d923b538ad tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Start destroying the instance on the hypervisor. {{(pid=73391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 05:47:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:47:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:47:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:47:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:47:04 user nova-compute[73391]: DEBUG nova.compute.manager [req-1ce4a387-160d-49ee-9131-11fa65aeee14 req-489cb8ad-3157-45e0-bda1-5ac179ee60e6 service nova] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Received event network-vif-unplugged-662afb36-6d3a-415d-bc25-d319b7d5cf1a {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:47:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-1ce4a387-160d-49ee-9131-11fa65aeee14 req-489cb8ad-3157-45e0-bda1-5ac179ee60e6 service nova] Acquiring lock "b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:47:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-1ce4a387-160d-49ee-9131-11fa65aeee14 req-489cb8ad-3157-45e0-bda1-5ac179ee60e6 service nova] Lock "b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:47:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-1ce4a387-160d-49ee-9131-11fa65aeee14 req-489cb8ad-3157-45e0-bda1-5ac179ee60e6 service nova] Lock "b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:47:04 user nova-compute[73391]: DEBUG nova.compute.manager [req-1ce4a387-160d-49ee-9131-11fa65aeee14 req-489cb8ad-3157-45e0-bda1-5ac179ee60e6 service nova] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] No waiting events found dispatching network-vif-unplugged-662afb36-6d3a-415d-bc25-d319b7d5cf1a {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:47:04 user nova-compute[73391]: DEBUG nova.compute.manager [req-1ce4a387-160d-49ee-9131-11fa65aeee14 req-489cb8ad-3157-45e0-bda1-5ac179ee60e6 service nova] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Received event network-vif-unplugged-662afb36-6d3a-415d-bc25-d319b7d5cf1a for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 05:47:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:47:04 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Instance destroyed successfully.
Aug 15 05:47:04 user nova-compute[73391]: DEBUG nova.objects.instance [None req-6ad02c21-59d7-488f-a331-d0d923b538ad tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lazy-loading 'resources' on Instance uuid b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:47:04 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-6ad02c21-59d7-488f-a331-d0d923b538ad tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:37:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2061552665',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2061552665',id=23,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:37:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83b9acbe11654053bb905e7c92558a35',ramdisk_id='',reservation_id='r-j0zhhtni',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1045163116',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:39:37Z,user_data=None,user_id='887f0846cf554e12acf92a663f5ab266',uuid=b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "662afb36-6d3a-415d-bc25-d319b7d5cf1a", "address": "fa:16:3e:d5:32:d3", "network": {"id": "70d88082-aea7-48bb-abb4-d77d264aaf01", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b9acbe11654053bb905e7c92558a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap662afb36-6d", "ovs_interfaceid": "662afb36-6d3a-415d-bc25-d319b7d5cf1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:47:04 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-6ad02c21-59d7-488f-a331-d0d923b538ad tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Converting VIF {"id": "662afb36-6d3a-415d-bc25-d319b7d5cf1a", "address": "fa:16:3e:d5:32:d3", "network": {"id": "70d88082-aea7-48bb-abb4-d77d264aaf01", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b9acbe11654053bb905e7c92558a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap662afb36-6d", "ovs_interfaceid": "662afb36-6d3a-415d-bc25-d319b7d5cf1a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:47:04 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-6ad02c21-59d7-488f-a331-d0d923b538ad tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:32:d3,bridge_name='br-int',has_traffic_filtering=True,id=662afb36-6d3a-415d-bc25-d319b7d5cf1a,network=Network(70d88082-aea7-48bb-abb4-d77d264aaf01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap662afb36-6d') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:47:04 user nova-compute[73391]: DEBUG os_vif [None req-6ad02c21-59d7-488f-a331-d0d923b538ad tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:32:d3,bridge_name='br-int',has_traffic_filtering=True,id=662afb36-6d3a-415d-bc25-d319b7d5cf1a,network=Network(70d88082-aea7-48bb-abb4-d77d264aaf01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap662afb36-6d') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:47:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:47:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap662afb36-6d, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:47:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:47:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:47:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:47:04 user nova-compute[73391]: INFO os_vif [None req-6ad02c21-59d7-488f-a331-d0d923b538ad tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:32:d3,bridge_name='br-int',has_traffic_filtering=True,id=662afb36-6d3a-415d-bc25-d319b7d5cf1a,network=Network(70d88082-aea7-48bb-abb4-d77d264aaf01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap662afb36-6d')
Aug 15 05:47:04 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-6ad02c21-59d7-488f-a331-d0d923b538ad tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Deleting instance files /opt/stack/data/nova/instances/b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1_del
Aug 15 05:47:04 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-6ad02c21-59d7-488f-a331-d0d923b538ad tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Deletion of /opt/stack/data/nova/instances/b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1_del complete
Aug 15 05:47:05 user nova-compute[73391]: INFO nova.compute.manager [None req-6ad02c21-59d7-488f-a331-d0d923b538ad tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Took 0.90 seconds to destroy the instance on the hypervisor.
Aug 15 05:47:05 user nova-compute[73391]: DEBUG oslo.service.loopingcall [None req-6ad02c21-59d7-488f-a331-d0d923b538ad tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 05:47:05 user nova-compute[73391]: DEBUG nova.compute.manager [-] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Deallocating network for instance {{(pid=73391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 05:47:05 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] deallocate_for_instance() {{(pid=73391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 05:47:05 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:47:05 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Took 0.51 seconds to deallocate network for instance.
Aug 15 05:47:05 user nova-compute[73391]: DEBUG nova.compute.manager [req-16859a62-cda8-41d8-8fd4-cc71b11b645f req-11ec8fbc-8718-4280-aab2-d91c7175a3ab service nova] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Received event network-vif-deleted-662afb36-6d3a-415d-bc25-d319b7d5cf1a {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:47:05 user nova-compute[73391]: INFO nova.compute.manager [req-16859a62-cda8-41d8-8fd4-cc71b11b645f req-11ec8fbc-8718-4280-aab2-d91c7175a3ab service nova] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Neutron deleted interface 662afb36-6d3a-415d-bc25-d319b7d5cf1a; detaching it from the instance and deleting it from the info cache
Aug 15 05:47:05 user nova-compute[73391]: DEBUG nova.network.neutron [req-16859a62-cda8-41d8-8fd4-cc71b11b645f req-11ec8fbc-8718-4280-aab2-d91c7175a3ab service nova] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:47:05 user nova-compute[73391]: DEBUG nova.compute.manager [req-16859a62-cda8-41d8-8fd4-cc71b11b645f req-11ec8fbc-8718-4280-aab2-d91c7175a3ab service nova] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Detach interface failed, port_id=662afb36-6d3a-415d-bc25-d319b7d5cf1a, reason: Instance b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1 could not be found. {{(pid=73391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 05:47:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6ad02c21-59d7-488f-a331-d0d923b538ad tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:47:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6ad02c21-59d7-488f-a331-d0d923b538ad tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:47:05 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-6ad02c21-59d7-488f-a331-d0d923b538ad tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:47:05 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-6ad02c21-59d7-488f-a331-d0d923b538ad tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:47:06 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6ad02c21-59d7-488f-a331-d0d923b538ad tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.410s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:47:06 user nova-compute[73391]: INFO nova.scheduler.client.report [None req-6ad02c21-59d7-488f-a331-d0d923b538ad tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Deleted allocations for instance b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1
Aug 15 05:47:06 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6ad02c21-59d7-488f-a331-d0d923b538ad tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.034s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:47:06 user nova-compute[73391]: DEBUG nova.compute.manager [req-d610a6c7-0e00-4ac1-8d9d-f6a73c56bf23 req-28ac6e3b-9b52-4f1c-8dfb-da643b6a0ad9 service nova] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Received event network-vif-plugged-662afb36-6d3a-415d-bc25-d319b7d5cf1a {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:47:06 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d610a6c7-0e00-4ac1-8d9d-f6a73c56bf23 req-28ac6e3b-9b52-4f1c-8dfb-da643b6a0ad9 service nova] Acquiring lock "b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:47:06 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d610a6c7-0e00-4ac1-8d9d-f6a73c56bf23 req-28ac6e3b-9b52-4f1c-8dfb-da643b6a0ad9 service nova] Lock "b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:47:06 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d610a6c7-0e00-4ac1-8d9d-f6a73c56bf23 req-28ac6e3b-9b52-4f1c-8dfb-da643b6a0ad9 service nova] Lock "b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:47:06 user nova-compute[73391]: DEBUG nova.compute.manager [req-d610a6c7-0e00-4ac1-8d9d-f6a73c56bf23 req-28ac6e3b-9b52-4f1c-8dfb-da643b6a0ad9 service nova] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] No waiting events found dispatching network-vif-plugged-662afb36-6d3a-415d-bc25-d319b7d5cf1a {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:47:06 user nova-compute[73391]: WARNING nova.compute.manager [req-d610a6c7-0e00-4ac1-8d9d-f6a73c56bf23 req-28ac6e3b-9b52-4f1c-8dfb-da643b6a0ad9 service nova] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Received unexpected event network-vif-plugged-662afb36-6d3a-415d-bc25-d319b7d5cf1a for instance with vm_state deleted and task_state None.
Aug 15 05:47:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:47:11 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692078416.6402192, 8991b32e-6c4b-4c66-a320-e734061f49ee => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:47:11 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] VM Stopped (Lifecycle Event)
Aug 15 05:47:11 user nova-compute[73391]: DEBUG nova.compute.manager [None req-b3a3abdf-2849-49e5-a60e-3e2171c3e940 None None] [instance: 8991b32e-6c4b-4c66-a320-e734061f49ee] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:47:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:47:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:47:17 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:47:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:47:19 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692078424.9087877, b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1 => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:47:19 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] VM Stopped (Lifecycle Event)
Aug 15 05:47:19 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3f30d726-261b-4f58-842e-36f4de49cb1c None None] [instance: b7b1b6bd-b315-4ef9-a2c6-fa1053cc80a1] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:47:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:47:21 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:47:23 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:47:23 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:47:23 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:47:23 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:47:23 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Auditing locally available compute resources for user (node: user) {{(pid=73391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 05:47:23 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:47:23 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fecde5f1-88fb-48b0-b039-93fdb285c93c/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fecde5f1-88fb-48b0-b039-93fdb285c93c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fecde5f1-88fb-48b0-b039-93fdb285c93c/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fecde5f1-88fb-48b0-b039-93fdb285c93c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8775490-2a9e-44ac-aad7-9450afa4c295/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8775490-2a9e-44ac-aad7-9450afa4c295/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8775490-2a9e-44ac-aad7-9450afa4c295/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8775490-2a9e-44ac-aad7-9450afa4c295/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:24 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:47:24 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:47:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7521ed98-75ed-43eb-83a2-d41502698aec/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:47:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7521ed98-75ed-43eb-83a2-d41502698aec/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7521ed98-75ed-43eb-83a2-d41502698aec/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:47:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7521ed98-75ed-43eb-83a2-d41502698aec/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:25 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:47:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:25 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:47:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85a919d-7f44-4093-b89a-51397ad5cedb/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85a919d-7f44-4093-b89a-51397ad5cedb/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85a919d-7f44-4093-b89a-51397ad5cedb/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85a919d-7f44-4093-b89a-51397ad5cedb/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-cd8ec15b-e012-432e-8c5e-e7525ddb326d tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Acquiring lock "7521ed98-75ed-43eb-83a2-d41502698aec" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:47:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-cd8ec15b-e012-432e-8c5e-e7525ddb326d tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "7521ed98-75ed-43eb-83a2-d41502698aec" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:47:27 user nova-compute[73391]: INFO nova.compute.manager [None req-cd8ec15b-e012-432e-8c5e-e7525ddb326d tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Detaching volume 26e6a3c8-b419-47e0-8256-322f47904a96
Aug 15 05:47:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7013c0ae-419e-4e28-ba41-2f4e619d22fb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Acquiring lock "7521ed98-75ed-43eb-83a2-d41502698aec" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:47:27 user nova-compute[73391]: INFO nova.virt.block_device [None req-cd8ec15b-e012-432e-8c5e-e7525ddb326d tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Attempting to driver detach volume 26e6a3c8-b419-47e0-8256-322f47904a96 from mountpoint /dev/vdb
Aug 15 05:47:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c043ca2f-6468-4b32-ae53-40da261fd1fa/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:27 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-cd8ec15b-e012-432e-8c5e-e7525ddb326d tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Attempting to detach device vdb from instance 7521ed98-75ed-43eb-83a2-d41502698aec from the persistent domain config. {{(pid=73391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 05:47:27 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-cd8ec15b-e012-432e-8c5e-e7525ddb326d tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 05:47:27 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:47:27 user nova-compute[73391]:   <source dev="/dev/sdg"/>
Aug 15 05:47:27 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:47:27 user nova-compute[73391]:   <serial>26e6a3c8-b419-47e0-8256-322f47904a96</serial>
Aug 15 05:47:27 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 05:47:27 user nova-compute[73391]: </disk>
Aug 15 05:47:27 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 05:47:27 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-cd8ec15b-e012-432e-8c5e-e7525ddb326d tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Successfully detached device vdb from instance 7521ed98-75ed-43eb-83a2-d41502698aec from the persistent domain config.
Aug 15 05:47:27 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-cd8ec15b-e012-432e-8c5e-e7525ddb326d tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7521ed98-75ed-43eb-83a2-d41502698aec from the live domain config. {{(pid=73391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 05:47:27 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-cd8ec15b-e012-432e-8c5e-e7525ddb326d tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 05:47:27 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:47:27 user nova-compute[73391]:   <source dev="/dev/sdg"/>
Aug 15 05:47:27 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:47:27 user nova-compute[73391]:   <serial>26e6a3c8-b419-47e0-8256-322f47904a96</serial>
Aug 15 05:47:27 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 05:47:27 user nova-compute[73391]: </disk>
Aug 15 05:47:27 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 05:47:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c043ca2f-6468-4b32-ae53-40da261fd1fa/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c043ca2f-6468-4b32-ae53-40da261fd1fa/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c043ca2f-6468-4b32-ae53-40da261fd1fa/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Received event <DeviceRemovedEvent: 1692078447.8833957, 7521ed98-75ed-43eb-83a2-d41502698aec => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73391) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-cd8ec15b-e012-432e-8c5e-e7525ddb326d tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7521ed98-75ed-43eb-83a2-d41502698aec {{(pid=73391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 05:47:28 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-cd8ec15b-e012-432e-8c5e-e7525ddb326d tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Successfully detached device vdb from instance 7521ed98-75ed-43eb-83a2-d41502698aec from the live domain config.
Aug 15 05:47:28 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:47:28 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:47:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Hypervisor/Node resource view: name=user free_ram=6971MB free_disk=24.927043914794922GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd8ec15b-e012-432e-8c5e-e7525ddb326d tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8ec15b-e012-432e-8c5e-e7525ddb326d tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:26e6a3c8-b419-47e0-8256-322f47904a96'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zPVAyDHE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:47:28 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-cd8ec15b-e012-432e-8c5e-e7525ddb326d tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:47:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-cd8ec15b-e012-432e-8c5e-e7525ddb326d tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-cd8ec15b-e012-432e-8c5e-e7525ddb326d tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8ec15b-e012-432e-8c5e-e7525ddb326d tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26e6a3c8-b419-47e0-8256-322f47904a96', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[31717995-63c0-4c10-862d-60980aef8f68]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:26e6a3c8-b419-47e0-8256-322f47904a96\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b772bb3-6cdc-455c-b5d2-89d3bf684785]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26e6a3c8-b419-47e0-8256-322f47904a96 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8ec15b-e012-432e-8c5e-e7525ddb326d tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:47:28 user nova-compute[73391]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:47:28 user nova-compute[73391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)
Aug 15 05:47:28 user nova-compute[73391]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6 (non-flash)
Aug 15 05:47:28 user nova-compute[73391]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26e6a3c8-b419-47e0-8256-322f47904a96 (non-flash)
Aug 15 05:47:28 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8ec15b-e012-432e-8c5e-e7525ddb326d tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:47:28 user nova-compute[73391]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:47:28 user nova-compute[73391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)
Aug 15 05:47:28 user nova-compute[73391]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6 (non-flash)
Aug 15 05:47:28 user nova-compute[73391]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:26e6a3c8-b419-47e0-8256-322f47904a96 (non-flash)
Aug 15 05:47:28 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8ec15b-e012-432e-8c5e-e7525ddb326d tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f774812fac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26e6a3c8-b419-47e0-8256-322f47904a96'): ({'sdg'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-cd8ec15b-e012-432e-8c5e-e7525ddb326d tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Removing single pathed devices sdg {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b650523-4e7e-4a0a-b708-f5e8914317d9]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[81244b3f-c4ab-459a-8c59-63bd66ceb584]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-cd8ec15b-e012-432e-8c5e-e7525ddb326d tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Flushing IO for device /dev/sdg {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7f1495-4de3-40af-aa5e-84bd136ef271]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-cd8ec15b-e012-432e-8c5e-e7525ddb326d tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 8f08782b-f793-415e-b0d6-5caad1c3d426 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 6ac9d5dc-56be-402f-b9d4-3327bdfd9220 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 6358e825-5705-45d6-86b6-3aacfa5a9bbb actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 730890c6-6999-4a0f-b80c-e4745bff99ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 8ff2da51-5bfd-4cdc-8cef-330cdef93d97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance dc657d66-c3f8-44e5-b30e-3d79e586a8f3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance e8775490-2a9e-44ac-aad7-9450afa4c295 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance c5d5343f-b8f4-46b7-92fc-66452212192b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 7521ed98-75ed-43eb-83a2-d41502698aec actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance c043ca2f-6468-4b32-ae53-40da261fd1fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance d85a919d-7f44-4093-b89a-51397ad5cedb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance fecde5f1-88fb-48b0-b039-93fdb285c93c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.045s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a06c2a-0d22-4da8-aed1-94bfbb384bc1]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-cd8ec15b-e012-432e-8c5e-e7525ddb326d tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-cd8ec15b-e012-432e-8c5e-e7525ddb326d tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] SCSI volumes sdg have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8ec15b-e012-432e-8c5e-e7525ddb326d tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26e6a3c8-b419-47e0-8256-322f47904a96')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26e6a3c8-b419-47e0-8256-322f47904a96 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26e6a3c8-b419-47e0-8256-322f47904a96 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5e2281-064b-4a87-9579-07558ba71324]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8ec15b-e012-432e-8c5e-e7525ddb326d tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26e6a3c8-b419-47e0-8256-322f47904a96 -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26e6a3c8-b419-47e0-8256-322f47904a96 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede8fbe3-19c7-4e98-a5cd-e322d01ab56f]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:26e6a3c8-b419-47e0-8256-322f47904a96, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:26e6a3c8-b419-47e0-8256-322f47904a96, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8ec15b-e012-432e-8c5e-e7525ddb326d tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:26e6a3c8-b419-47e0-8256-322f47904a96, portal: 172.16.0.220,3260]
Aug 15 05:47:28 user nova-compute[73391]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:26e6a3c8-b419-47e0-8256-322f47904a96, portal: 172.16.0.220,3260] successful.
Aug 15 05:47:28 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:26e6a3c8-b419-47e0-8256-322f47904a96 -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:26e6a3c8-b419-47e0-8256-322f47904a96 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f1b6fe-5eba-4c4a-84e5-1872548fd7cd]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8ec15b-e012-432e-8c5e-e7525ddb326d tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-cd8ec15b-e012-432e-8c5e-e7525ddb326d tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8ec15b-e012-432e-8c5e-e7525ddb326d tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] <== disconnect_volume: return (333ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd8ec15b-e012-432e-8c5e-e7525ddb326d tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Compute_service record updated for user:user {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 05:47:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.560s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:47:29 user nova-compute[73391]: DEBUG nova.objects.instance [None req-cd8ec15b-e012-432e-8c5e-e7525ddb326d tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lazy-loading 'flavor' on Instance uuid 7521ed98-75ed-43eb-83a2-d41502698aec {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:47:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-cd8ec15b-e012-432e-8c5e-e7525ddb326d tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "7521ed98-75ed-43eb-83a2-d41502698aec" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.325s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:47:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7013c0ae-419e-4e28-ba41-2f4e619d22fb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "7521ed98-75ed-43eb-83a2-d41502698aec" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 2.246s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:47:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7013c0ae-419e-4e28-ba41-2f4e619d22fb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Acquiring lock "7521ed98-75ed-43eb-83a2-d41502698aec-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:47:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7013c0ae-419e-4e28-ba41-2f4e619d22fb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "7521ed98-75ed-43eb-83a2-d41502698aec-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:47:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7013c0ae-419e-4e28-ba41-2f4e619d22fb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "7521ed98-75ed-43eb-83a2-d41502698aec-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:47:29 user nova-compute[73391]: INFO nova.compute.manager [None req-7013c0ae-419e-4e28-ba41-2f4e619d22fb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Terminating instance
Aug 15 05:47:29 user nova-compute[73391]: DEBUG nova.compute.manager [None req-7013c0ae-419e-4e28-ba41-2f4e619d22fb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Start destroying the instance on the hypervisor. {{(pid=73391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 05:47:29 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:47:29 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:47:29 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:47:29 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:47:29 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:47:29 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:47:29 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:47:29 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Starting heal instance info cache {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 05:47:29 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Didn't find any instances for network info cache update. {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 05:47:29 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:47:29 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:47:29 user nova-compute[73391]: DEBUG nova.compute.manager [req-191adb81-f4b3-4338-b3b2-283225b93546 req-fcfcfa80-578a-4d49-8958-b77414c2de58 service nova] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Received event network-vif-unplugged-cbe16818-84cf-4b94-9e4a-bc40ea83946a {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:47:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-191adb81-f4b3-4338-b3b2-283225b93546 req-fcfcfa80-578a-4d49-8958-b77414c2de58 service nova] Acquiring lock "7521ed98-75ed-43eb-83a2-d41502698aec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:47:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-191adb81-f4b3-4338-b3b2-283225b93546 req-fcfcfa80-578a-4d49-8958-b77414c2de58 service nova] Lock "7521ed98-75ed-43eb-83a2-d41502698aec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:47:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-191adb81-f4b3-4338-b3b2-283225b93546 req-fcfcfa80-578a-4d49-8958-b77414c2de58 service nova] Lock "7521ed98-75ed-43eb-83a2-d41502698aec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:47:29 user nova-compute[73391]: DEBUG nova.compute.manager [req-191adb81-f4b3-4338-b3b2-283225b93546 req-fcfcfa80-578a-4d49-8958-b77414c2de58 service nova] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] No waiting events found dispatching network-vif-unplugged-cbe16818-84cf-4b94-9e4a-bc40ea83946a {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:47:29 user nova-compute[73391]: DEBUG nova.compute.manager [req-191adb81-f4b3-4338-b3b2-283225b93546 req-fcfcfa80-578a-4d49-8958-b77414c2de58 service nova] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Received event network-vif-unplugged-cbe16818-84cf-4b94-9e4a-bc40ea83946a for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 05:47:29 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:47:30 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Instance destroyed successfully.
Aug 15 05:47:30 user nova-compute[73391]: DEBUG nova.objects.instance [None req-7013c0ae-419e-4e28-ba41-2f4e619d22fb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lazy-loading 'resources' on Instance uuid 7521ed98-75ed-43eb-83a2-d41502698aec {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:47:30 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-7013c0ae-419e-4e28-ba41-2f4e619d22fb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:44:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-496366586',display_name='tempest-VolumesSnapshotTestJSON-instance-496366586',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-496366586',id=34,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFZ85efv3P1n0AlZUkD9dpM0eEDPYPOR5HDFbKpoHxZj8TkyhAtkJ85K4GJbb9C9safdPOgLhqnvLsAuQBxT3jKQTLZBhGpgIwTQOMTV5rZfGKWGmiDLPSvYR0kPw8hHw==',key_name='tempest-keypair-773112726',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:44:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ae6fe94b9014479fbaff5131aefc8834',ramdisk_id='',reservation_id='r-hnmzuh3t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1902565719',owner_user_name='tempest-VolumesSnapshotTestJSON-1902565719-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:44:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9779dfb796934195b206b8e0adc81ed3',uuid=7521ed98-75ed-43eb-83a2-d41502698aec,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cbe16818-84cf-4b94-9e4a-bc40ea83946a", "address": "fa:16:3e:c5:35:30", "network": {"id": "6757637c-358e-4fa8-b3c1-376d7892c884", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-577771159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae6fe94b9014479fbaff5131aefc8834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbe16818-84", "ovs_interfaceid": "cbe16818-84cf-4b94-9e4a-bc40ea83946a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:47:30 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-7013c0ae-419e-4e28-ba41-2f4e619d22fb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Converting VIF {"id": "cbe16818-84cf-4b94-9e4a-bc40ea83946a", "address": "fa:16:3e:c5:35:30", "network": {"id": "6757637c-358e-4fa8-b3c1-376d7892c884", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-577771159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.109", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ae6fe94b9014479fbaff5131aefc8834", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcbe16818-84", "ovs_interfaceid": "cbe16818-84cf-4b94-9e4a-bc40ea83946a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:47:30 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-7013c0ae-419e-4e28-ba41-2f4e619d22fb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:35:30,bridge_name='br-int',has_traffic_filtering=True,id=cbe16818-84cf-4b94-9e4a-bc40ea83946a,network=Network(6757637c-358e-4fa8-b3c1-376d7892c884),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbe16818-84') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:47:30 user nova-compute[73391]: DEBUG os_vif [None req-7013c0ae-419e-4e28-ba41-2f4e619d22fb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:35:30,bridge_name='br-int',has_traffic_filtering=True,id=cbe16818-84cf-4b94-9e4a-bc40ea83946a,network=Network(6757637c-358e-4fa8-b3c1-376d7892c884),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbe16818-84') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:47:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:47:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcbe16818-84, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:47:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:47:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:47:30 user nova-compute[73391]: INFO os_vif [None req-7013c0ae-419e-4e28-ba41-2f4e619d22fb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:35:30,bridge_name='br-int',has_traffic_filtering=True,id=cbe16818-84cf-4b94-9e4a-bc40ea83946a,network=Network(6757637c-358e-4fa8-b3c1-376d7892c884),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcbe16818-84')
Aug 15 05:47:30 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7013c0ae-419e-4e28-ba41-2f4e619d22fb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 05:47:30 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7013c0ae-419e-4e28-ba41-2f4e619d22fb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:26e6a3c8-b419-47e0-8256-322f47904a96'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zPVAyDHE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:47:30 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-7013c0ae-419e-4e28-ba41-2f4e619d22fb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:47:30 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-7013c0ae-419e-4e28-ba41-2f4e619d22fb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:47:30 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-7013c0ae-419e-4e28-ba41-2f4e619d22fb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:47:30 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7013c0ae-419e-4e28-ba41-2f4e619d22fb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:26e6a3c8-b419-47e0-8256-322f47904a96', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 05:47:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:30 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[77e27031-ef18-463f-a95f-05dd58a8ac86]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:47:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:30 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4055d10-a1d8-415d-80a7-19ba818b24f8]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:47:30 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7013c0ae-419e-4e28-ba41-2f4e619d22fb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:47:30 user nova-compute[73391]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:47:30 user nova-compute[73391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)
Aug 15 05:47:30 user nova-compute[73391]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6 (non-flash)
Aug 15 05:47:30 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:47:30 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7013c0ae-419e-4e28-ba41-2f4e619d22fb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:47:30 user nova-compute[73391]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:47:30 user nova-compute[73391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)
Aug 15 05:47:30 user nova-compute[73391]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6 (non-flash)
Aug 15 05:47:30 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:47:30 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7013c0ae-419e-4e28-ba41-2f4e619d22fb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7748223b50>, {}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 05:47:30 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7013c0ae-419e-4e28-ba41-2f4e619d22fb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Disconnecting from: [] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 05:47:30 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-7013c0ae-419e-4e28-ba41-2f4e619d22fb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.050s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:47:30 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7013c0ae-419e-4e28-ba41-2f4e619d22fb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] <== disconnect_volume: return (52ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:47:30 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7013c0ae-419e-4e28-ba41-2f4e619d22fb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 05:47:30 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-7013c0ae-419e-4e28-ba41-2f4e619d22fb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Deleting instance files /opt/stack/data/nova/instances/7521ed98-75ed-43eb-83a2-d41502698aec_del
Aug 15 05:47:30 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-7013c0ae-419e-4e28-ba41-2f4e619d22fb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Deletion of /opt/stack/data/nova/instances/7521ed98-75ed-43eb-83a2-d41502698aec_del complete
Aug 15 05:47:30 user nova-compute[73391]: INFO nova.compute.manager [None req-7013c0ae-419e-4e28-ba41-2f4e619d22fb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Took 0.91 seconds to destroy the instance on the hypervisor.
Aug 15 05:47:30 user nova-compute[73391]: DEBUG oslo.service.loopingcall [None req-7013c0ae-419e-4e28-ba41-2f4e619d22fb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 05:47:30 user nova-compute[73391]: DEBUG nova.compute.manager [-] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Deallocating network for instance {{(pid=73391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 05:47:30 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] deallocate_for_instance() {{(pid=73391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 05:47:30 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:47:30 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:47:30 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:47:30 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 05:47:31 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:47:31 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Took 0.83 seconds to deallocate network for instance.
Aug 15 05:47:31 user nova-compute[73391]: DEBUG nova.compute.manager [req-e42073ae-45d3-4395-8639-5ce7b313a677 req-ba0a5bbd-602c-4563-86ce-9ee957199c4c service nova] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Received event network-vif-deleted-cbe16818-84cf-4b94-9e4a-bc40ea83946a {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:47:31 user nova-compute[73391]: INFO nova.compute.manager [req-e42073ae-45d3-4395-8639-5ce7b313a677 req-ba0a5bbd-602c-4563-86ce-9ee957199c4c service nova] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Neutron deleted interface cbe16818-84cf-4b94-9e4a-bc40ea83946a; detaching it from the instance and deleting it from the info cache
Aug 15 05:47:31 user nova-compute[73391]: DEBUG nova.network.neutron [req-e42073ae-45d3-4395-8639-5ce7b313a677 req-ba0a5bbd-602c-4563-86ce-9ee957199c4c service nova] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:47:31 user nova-compute[73391]: DEBUG nova.compute.manager [req-e42073ae-45d3-4395-8639-5ce7b313a677 req-ba0a5bbd-602c-4563-86ce-9ee957199c4c service nova] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Detach interface failed, port_id=cbe16818-84cf-4b94-9e4a-bc40ea83946a, reason: Instance 7521ed98-75ed-43eb-83a2-d41502698aec could not be found. {{(pid=73391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 05:47:31 user nova-compute[73391]: WARNING nova.volume.cinder [None req-7013c0ae-419e-4e28-ba41-2f4e619d22fb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Attachment 0104f171-ab7c-4610-9133-3fd672093ce8 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 0104f171-ab7c-4610-9133-3fd672093ce8. (HTTP 404) (Request-ID: req-02a1e4ee-5f94-405f-86ac-8bc35a95cca7)
Aug 15 05:47:31 user nova-compute[73391]: INFO nova.compute.manager [None req-7013c0ae-419e-4e28-ba41-2f4e619d22fb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Took 0.03 seconds to detach 1 volumes for instance.
Aug 15 05:47:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7013c0ae-419e-4e28-ba41-2f4e619d22fb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:47:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7013c0ae-419e-4e28-ba41-2f4e619d22fb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:47:31 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-7013c0ae-419e-4e28-ba41-2f4e619d22fb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:47:31 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-7013c0ae-419e-4e28-ba41-2f4e619d22fb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:47:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7013c0ae-419e-4e28-ba41-2f4e619d22fb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.433s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:47:31 user nova-compute[73391]: DEBUG nova.compute.manager [req-2343f671-4bc4-4c21-b2bf-3668fa5a16ca req-b5cbfbfe-78f6-43ca-887c-4096298d316c service nova] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Received event network-vif-plugged-cbe16818-84cf-4b94-9e4a-bc40ea83946a {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:47:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2343f671-4bc4-4c21-b2bf-3668fa5a16ca req-b5cbfbfe-78f6-43ca-887c-4096298d316c service nova] Acquiring lock "7521ed98-75ed-43eb-83a2-d41502698aec-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:47:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2343f671-4bc4-4c21-b2bf-3668fa5a16ca req-b5cbfbfe-78f6-43ca-887c-4096298d316c service nova] Lock "7521ed98-75ed-43eb-83a2-d41502698aec-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:47:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2343f671-4bc4-4c21-b2bf-3668fa5a16ca req-b5cbfbfe-78f6-43ca-887c-4096298d316c service nova] Lock "7521ed98-75ed-43eb-83a2-d41502698aec-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:47:31 user nova-compute[73391]: DEBUG nova.compute.manager [req-2343f671-4bc4-4c21-b2bf-3668fa5a16ca req-b5cbfbfe-78f6-43ca-887c-4096298d316c service nova] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] No waiting events found dispatching network-vif-plugged-cbe16818-84cf-4b94-9e4a-bc40ea83946a {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:47:31 user nova-compute[73391]: WARNING nova.compute.manager [req-2343f671-4bc4-4c21-b2bf-3668fa5a16ca req-b5cbfbfe-78f6-43ca-887c-4096298d316c service nova] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Received unexpected event network-vif-plugged-cbe16818-84cf-4b94-9e4a-bc40ea83946a for instance with vm_state deleted and task_state None.
Aug 15 05:47:31 user nova-compute[73391]: INFO nova.scheduler.client.report [None req-7013c0ae-419e-4e28-ba41-2f4e619d22fb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Deleted allocations for instance 7521ed98-75ed-43eb-83a2-d41502698aec
Aug 15 05:47:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7013c0ae-419e-4e28-ba41-2f4e619d22fb tempest-VolumesSnapshotTestJSON-1902565719 tempest-VolumesSnapshotTestJSON-1902565719-project-member] Lock "7521ed98-75ed-43eb-83a2-d41502698aec" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.465s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:47:33 user nova-compute[73391]: DEBUG nova.compute.manager [req-84ea62c7-e971-458d-8209-d6e8c12ef510 req-5deaf82c-1350-4e6b-b39a-c7060c7b9bc0 service nova] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Received event network-changed-30308440-5072-4c10-a968-c834a87e5e31 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:47:33 user nova-compute[73391]: DEBUG nova.compute.manager [req-84ea62c7-e971-458d-8209-d6e8c12ef510 req-5deaf82c-1350-4e6b-b39a-c7060c7b9bc0 service nova] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Refreshing instance network info cache due to event network-changed-30308440-5072-4c10-a968-c834a87e5e31. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:47:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-84ea62c7-e971-458d-8209-d6e8c12ef510 req-5deaf82c-1350-4e6b-b39a-c7060c7b9bc0 service nova] Acquiring lock "refresh_cache-b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:47:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-84ea62c7-e971-458d-8209-d6e8c12ef510 req-5deaf82c-1350-4e6b-b39a-c7060c7b9bc0 service nova] Acquired lock "refresh_cache-b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:47:33 user nova-compute[73391]: DEBUG nova.network.neutron [req-84ea62c7-e971-458d-8209-d6e8c12ef510 req-5deaf82c-1350-4e6b-b39a-c7060c7b9bc0 service nova] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Refreshing network info cache for port 30308440-5072-4c10-a968-c834a87e5e31 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:47:33 user nova-compute[73391]: DEBUG nova.network.neutron [req-84ea62c7-e971-458d-8209-d6e8c12ef510 req-5deaf82c-1350-4e6b-b39a-c7060c7b9bc0 service nova] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Updated VIF entry in instance network info cache for port 30308440-5072-4c10-a968-c834a87e5e31. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:47:33 user nova-compute[73391]: DEBUG nova.network.neutron [req-84ea62c7-e971-458d-8209-d6e8c12ef510 req-5deaf82c-1350-4e6b-b39a-c7060c7b9bc0 service nova] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Updating instance_info_cache with network_info: [{"id": "30308440-5072-4c10-a968-c834a87e5e31", "address": "fa:16:3e:bb:29:c4", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.239", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30308440-50", "ovs_interfaceid": "30308440-5072-4c10-a968-c834a87e5e31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:47:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-84ea62c7-e971-458d-8209-d6e8c12ef510 req-5deaf82c-1350-4e6b-b39a-c7060c7b9bc0 service nova] Releasing lock "refresh_cache-b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:47:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-5ce41756-c14f-4b0e-bf83-96920d860d1f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:47:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-5ce41756-c14f-4b0e-bf83-96920d860d1f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:47:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-5ce41756-c14f-4b0e-bf83-96920d860d1f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:47:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-5ce41756-c14f-4b0e-bf83-96920d860d1f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:47:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-5ce41756-c14f-4b0e-bf83-96920d860d1f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:47:33 user nova-compute[73391]: INFO nova.compute.manager [None req-5ce41756-c14f-4b0e-bf83-96920d860d1f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Terminating instance
Aug 15 05:47:33 user nova-compute[73391]: DEBUG nova.compute.manager [None req-5ce41756-c14f-4b0e-bf83-96920d860d1f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Start destroying the instance on the hypervisor. {{(pid=73391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 05:47:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG nova.compute.manager [req-a24cfe54-f3a5-478b-8988-4efbd43573ba req-911f1256-5403-45d1-9ae9-9b3766fec14f service nova] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Received event network-vif-unplugged-30308440-5072-4c10-a968-c834a87e5e31 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-a24cfe54-f3a5-478b-8988-4efbd43573ba req-911f1256-5403-45d1-9ae9-9b3766fec14f service nova] Acquiring lock "b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-a24cfe54-f3a5-478b-8988-4efbd43573ba req-911f1256-5403-45d1-9ae9-9b3766fec14f service nova] Lock "b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-a24cfe54-f3a5-478b-8988-4efbd43573ba req-911f1256-5403-45d1-9ae9-9b3766fec14f service nova] Lock "b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG nova.compute.manager [req-a24cfe54-f3a5-478b-8988-4efbd43573ba req-911f1256-5403-45d1-9ae9-9b3766fec14f service nova] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] No waiting events found dispatching network-vif-unplugged-30308440-5072-4c10-a968-c834a87e5e31 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG nova.compute.manager [req-a24cfe54-f3a5-478b-8988-4efbd43573ba req-911f1256-5403-45d1-9ae9-9b3766fec14f service nova] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Received event network-vif-unplugged-30308440-5072-4c10-a968-c834a87e5e31 for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:47:34 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Instance destroyed successfully.
Aug 15 05:47:34 user nova-compute[73391]: DEBUG nova.objects.instance [None req-5ce41756-c14f-4b0e-bf83-96920d860d1f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lazy-loading 'resources' on Instance uuid b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-5ce41756-c14f-4b0e-bf83-96920d860d1f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:45:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1287006649',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1287006649',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1287006649',id=35,image_ref='54e1959e-4a91-4611-b4c3-b99f47b3ee68',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBELgb49ZFbiL7eRPZflWHjY7cSOKPk07ofv15CxT2Yf4tzqX2ZgQkBYwrBPYBlD0623h5S4vhuR2ueG0ksiGIG5cyRM5y5Q0Cdj0ARyMTqBhwXZJob+w/aT/dTv424B3tA==',key_name='tempest-keypair-1789217056',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:46:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8188c2e8ca34ef1982faa49f1058bb7',ramdisk_id='',reservation_id='r-mk61302f',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1834029963',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1834029963-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1834029963',owner_user_name='tempest-TestVolumeBootPattern-1834029963-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:46:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aefb6ccab586465dbe56e71a40bcf1f0',uuid=b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "30308440-5072-4c10-a968-c834a87e5e31", "address": "fa:16:3e:bb:29:c4", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30308440-50", "ovs_interfaceid": "30308440-5072-4c10-a968-c834a87e5e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-5ce41756-c14f-4b0e-bf83-96920d860d1f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Converting VIF {"id": "30308440-5072-4c10-a968-c834a87e5e31", "address": "fa:16:3e:bb:29:c4", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap30308440-50", "ovs_interfaceid": "30308440-5072-4c10-a968-c834a87e5e31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-5ce41756-c14f-4b0e-bf83-96920d860d1f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:29:c4,bridge_name='br-int',has_traffic_filtering=True,id=30308440-5072-4c10-a968-c834a87e5e31,network=Network(fae0e46a-88e4-499d-bcff-5b7df55eab4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30308440-50') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG os_vif [None req-5ce41756-c14f-4b0e-bf83-96920d860d1f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:29:c4,bridge_name='br-int',has_traffic_filtering=True,id=30308440-5072-4c10-a968-c834a87e5e31,network=Network(fae0e46a-88e4-499d-bcff-5b7df55eab4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30308440-50') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap30308440-50, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:47:34 user nova-compute[73391]: INFO os_vif [None req-5ce41756-c14f-4b0e-bf83-96920d860d1f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:29:c4,bridge_name='br-int',has_traffic_filtering=True,id=30308440-5072-4c10-a968-c834a87e5e31,network=Network(fae0e46a-88e4-499d-bcff-5b7df55eab4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap30308440-50')
Aug 15 05:47:34 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ce41756-c14f-4b0e-bf83-96920d860d1f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce41756-c14f-4b0e-bf83-96920d860d1f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hcagjUZR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:47:34 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-5ce41756-c14f-4b0e-bf83-96920d860d1f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:47:34 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-5ce41756-c14f-4b0e-bf83-96920d860d1f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-5ce41756-c14f-4b0e-bf83-96920d860d1f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce41756-c14f-4b0e-bf83-96920d860d1f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c8c11a6-2162-4900-a230-637f542e8cde]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22b9c72-4ba4-4292-b8a9-17ce88f97385]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce41756-c14f-4b0e-bf83-96920d860d1f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:47:34 user nova-compute[73391]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:47:34 user nova-compute[73391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)
Aug 15 05:47:34 user nova-compute[73391]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6 (non-flash)
Aug 15 05:47:34 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce41756-c14f-4b0e-bf83-96920d860d1f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:47:34 user nova-compute[73391]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:47:34 user nova-compute[73391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)
Aug 15 05:47:34 user nova-compute[73391]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6 (non-flash)
Aug 15 05:47:34 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce41756-c14f-4b0e-bf83-96920d860d1f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77484c6440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6'): ({'sde'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-5ce41756-c14f-4b0e-bf83-96920d860d1f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Removing single pathed devices sde {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.037s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e805bb5f-f28e-4749-9ea0-1a52033d2105]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b50b41-2374-45f8-9f45-7119bad04930]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-5ce41756-c14f-4b0e-bf83-96920d860d1f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Flushing IO for device /dev/sde {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f058a55a-a5d3-4206-b65b-9869b77bdd6f]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-5ce41756-c14f-4b0e-bf83-96920d860d1f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a010d2-7f9b-48cb-9f77-faa1d9b455e9]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-5ce41756-c14f-4b0e-bf83-96920d860d1f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-5ce41756-c14f-4b0e-bf83-96920d860d1f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] SCSI volumes sde have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_aec47a05', '/dev/disk/by-id/scsi-1SCST_BIOaec47a05-b57e7b416551633f', '/dev/disk/by-id/scsi-26235376537623431') {{(pid=84527) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 15 05:47:34 user nova-compute[73391]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_aec47a05
Aug 15 05:47:34 user nova-compute[73391]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOaec47a05-b57e7b416551633f
Aug 15 05:47:34 user nova-compute[73391]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26235376537623431
Aug 15 05:47:34 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a453a6-da1a-4ea7-afa3-5d1856384ed8]: (4, None) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce41756-c14f-4b0e-bf83-96920d860d1f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9cd1a4d-bbf7-4e41-9a6b-188307baa635]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce41756-c14f-4b0e-bf83-96920d860d1f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6 -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e515311f-b795-42fe-96be-2fce07d1a202]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce41756-c14f-4b0e-bf83-96920d860d1f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6, portal: 172.16.0.220,3260]
Aug 15 05:47:34 user nova-compute[73391]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6, portal: 172.16.0.220,3260] successful.
Aug 15 05:47:34 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6 -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3743fc93-2f89-4c1e-b125-25a8de5c4be6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee4786e9-b496-4a44-ae65-25cfde3ff781]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce41756-c14f-4b0e-bf83-96920d860d1f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-5ce41756-c14f-4b0e-bf83-96920d860d1f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ce41756-c14f-4b0e-bf83-96920d860d1f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] <== disconnect_volume: return (313ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:47:34 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ce41756-c14f-4b0e-bf83-96920d860d1f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 05:47:34 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-5ce41756-c14f-4b0e-bf83-96920d860d1f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Deleting instance files /opt/stack/data/nova/instances/b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1_del
Aug 15 05:47:34 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-5ce41756-c14f-4b0e-bf83-96920d860d1f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Deletion of /opt/stack/data/nova/instances/b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1_del complete
Aug 15 05:47:35 user nova-compute[73391]: INFO nova.compute.manager [None req-5ce41756-c14f-4b0e-bf83-96920d860d1f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Took 1.13 seconds to destroy the instance on the hypervisor.
Aug 15 05:47:35 user nova-compute[73391]: DEBUG oslo.service.loopingcall [None req-5ce41756-c14f-4b0e-bf83-96920d860d1f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 05:47:35 user nova-compute[73391]: DEBUG nova.compute.manager [-] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Deallocating network for instance {{(pid=73391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 05:47:35 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] deallocate_for_instance() {{(pid=73391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 05:47:35 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:47:35 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Took 0.86 seconds to deallocate network for instance.
Aug 15 05:47:36 user nova-compute[73391]: DEBUG nova.compute.manager [req-241b53f5-23f3-475b-bbc6-8fcd4580ba71 req-103bb3dc-d372-4660-b9e8-d716981796c8 service nova] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Received event network-vif-plugged-30308440-5072-4c10-a968-c834a87e5e31 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:47:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-241b53f5-23f3-475b-bbc6-8fcd4580ba71 req-103bb3dc-d372-4660-b9e8-d716981796c8 service nova] Acquiring lock "b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:47:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-241b53f5-23f3-475b-bbc6-8fcd4580ba71 req-103bb3dc-d372-4660-b9e8-d716981796c8 service nova] Lock "b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:47:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-241b53f5-23f3-475b-bbc6-8fcd4580ba71 req-103bb3dc-d372-4660-b9e8-d716981796c8 service nova] Lock "b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:47:36 user nova-compute[73391]: DEBUG nova.compute.manager [req-241b53f5-23f3-475b-bbc6-8fcd4580ba71 req-103bb3dc-d372-4660-b9e8-d716981796c8 service nova] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] No waiting events found dispatching network-vif-plugged-30308440-5072-4c10-a968-c834a87e5e31 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:47:36 user nova-compute[73391]: WARNING nova.compute.manager [req-241b53f5-23f3-475b-bbc6-8fcd4580ba71 req-103bb3dc-d372-4660-b9e8-d716981796c8 service nova] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Received unexpected event network-vif-plugged-30308440-5072-4c10-a968-c834a87e5e31 for instance with vm_state active and task_state deleting.
Aug 15 05:47:36 user nova-compute[73391]: DEBUG nova.compute.manager [req-241b53f5-23f3-475b-bbc6-8fcd4580ba71 req-103bb3dc-d372-4660-b9e8-d716981796c8 service nova] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Received event network-vif-deleted-30308440-5072-4c10-a968-c834a87e5e31 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:47:36 user nova-compute[73391]: INFO nova.compute.manager [None req-5ce41756-c14f-4b0e-bf83-96920d860d1f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Took 0.74 seconds to detach 1 volumes for instance.
Aug 15 05:47:36 user nova-compute[73391]: DEBUG nova.compute.manager [None req-5ce41756-c14f-4b0e-bf83-96920d860d1f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Deleting volume: 3743fc93-2f89-4c1e-b125-25a8de5c4be6 {{(pid=73391) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 15 05:47:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-5ce41756-c14f-4b0e-bf83-96920d860d1f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:47:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-5ce41756-c14f-4b0e-bf83-96920d860d1f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:47:37 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-5ce41756-c14f-4b0e-bf83-96920d860d1f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:47:37 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-5ce41756-c14f-4b0e-bf83-96920d860d1f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:47:37 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-5ce41756-c14f-4b0e-bf83-96920d860d1f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.357s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:47:37 user nova-compute[73391]: INFO nova.scheduler.client.report [None req-5ce41756-c14f-4b0e-bf83-96920d860d1f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Deleted allocations for instance b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1
Aug 15 05:47:37 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-5ce41756-c14f-4b0e-bf83-96920d860d1f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.333s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:47:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:47:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-341ec0cb-c8fe-4186-b4b3-f18e7df06dc6 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquiring lock "dc657d66-c3f8-44e5-b30e-3d79e586a8f3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:47:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-341ec0cb-c8fe-4186-b4b3-f18e7df06dc6 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "dc657d66-c3f8-44e5-b30e-3d79e586a8f3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:47:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-341ec0cb-c8fe-4186-b4b3-f18e7df06dc6 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquiring lock "dc657d66-c3f8-44e5-b30e-3d79e586a8f3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:47:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-341ec0cb-c8fe-4186-b4b3-f18e7df06dc6 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "dc657d66-c3f8-44e5-b30e-3d79e586a8f3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:47:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-341ec0cb-c8fe-4186-b4b3-f18e7df06dc6 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "dc657d66-c3f8-44e5-b30e-3d79e586a8f3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:47:43 user nova-compute[73391]: INFO nova.compute.manager [None req-341ec0cb-c8fe-4186-b4b3-f18e7df06dc6 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Terminating instance
Aug 15 05:47:43 user nova-compute[73391]: DEBUG nova.compute.manager [None req-341ec0cb-c8fe-4186-b4b3-f18e7df06dc6 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Start destroying the instance on the hypervisor. {{(pid=73391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 05:47:43 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:47:43 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:47:43 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:47:43 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:47:43 user nova-compute[73391]: DEBUG nova.compute.manager [req-ca324dbe-93e3-4f9c-a8f0-185e2a119ac3 req-d7f46044-b3a2-4401-9cf1-595418218478 service nova] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Received event network-vif-unplugged-83a46e94-e5e7-41bb-803a-30000c4f9a02 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:47:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ca324dbe-93e3-4f9c-a8f0-185e2a119ac3 req-d7f46044-b3a2-4401-9cf1-595418218478 service nova] Acquiring lock "dc657d66-c3f8-44e5-b30e-3d79e586a8f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:47:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ca324dbe-93e3-4f9c-a8f0-185e2a119ac3 req-d7f46044-b3a2-4401-9cf1-595418218478 service nova] Lock "dc657d66-c3f8-44e5-b30e-3d79e586a8f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:47:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ca324dbe-93e3-4f9c-a8f0-185e2a119ac3 req-d7f46044-b3a2-4401-9cf1-595418218478 service nova] Lock "dc657d66-c3f8-44e5-b30e-3d79e586a8f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:47:43 user nova-compute[73391]: DEBUG nova.compute.manager [req-ca324dbe-93e3-4f9c-a8f0-185e2a119ac3 req-d7f46044-b3a2-4401-9cf1-595418218478 service nova] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] No waiting events found dispatching network-vif-unplugged-83a46e94-e5e7-41bb-803a-30000c4f9a02 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:47:43 user nova-compute[73391]: DEBUG nova.compute.manager [req-ca324dbe-93e3-4f9c-a8f0-185e2a119ac3 req-d7f46044-b3a2-4401-9cf1-595418218478 service nova] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Received event network-vif-unplugged-83a46e94-e5e7-41bb-803a-30000c4f9a02 for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 05:47:44 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Instance destroyed successfully.
Aug 15 05:47:44 user nova-compute[73391]: DEBUG nova.objects.instance [None req-341ec0cb-c8fe-4186-b4b3-f18e7df06dc6 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lazy-loading 'resources' on Instance uuid dc657d66-c3f8-44e5-b30e-3d79e586a8f3 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:47:44 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-341ec0cb-c8fe-4186-b4b3-f18e7df06dc6 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:41:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-156136201',display_name='tempest-ServerActionsTestOtherA-server-156136201',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-156136201',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNF3pif1QWXVpHrEIxShzB1xE/c22B7LSOZtRDzcmt7Dk63BIrH6/RWzxjN8WpKbyeDl3Aa13tDu+mUrmV6NfezccRAEecdR4P4btA7xRgsBIkQydnisHIujmlpX6Glrow==',key_name='tempest-keypair-512432776',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:43:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60b01853a82243369bd71dc0dbedb5d6',ramdisk_id='',reservation_id='r-lrepebad',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1927429987',owner_user_name='tempest-ServerActionsTestOtherA-1927429987-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:44:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='124dcfde552147e2978970386274c70a',uuid=dc657d66-c3f8-44e5-b30e-3d79e586a8f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "83a46e94-e5e7-41bb-803a-30000c4f9a02", "address": "fa:16:3e:ab:ac:be", "network": {"id": "610f78de-5741-4743-815d-d12ba05f8000", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1518164868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b01853a82243369bd71dc0dbedb5d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83a46e94-e5", "ovs_interfaceid": "83a46e94-e5e7-41bb-803a-30000c4f9a02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:47:44 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-341ec0cb-c8fe-4186-b4b3-f18e7df06dc6 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Converting VIF {"id": "83a46e94-e5e7-41bb-803a-30000c4f9a02", "address": "fa:16:3e:ab:ac:be", "network": {"id": "610f78de-5741-4743-815d-d12ba05f8000", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1518164868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b01853a82243369bd71dc0dbedb5d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap83a46e94-e5", "ovs_interfaceid": "83a46e94-e5e7-41bb-803a-30000c4f9a02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:47:44 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-341ec0cb-c8fe-4186-b4b3-f18e7df06dc6 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ab:ac:be,bridge_name='br-int',has_traffic_filtering=True,id=83a46e94-e5e7-41bb-803a-30000c4f9a02,network=Network(610f78de-5741-4743-815d-d12ba05f8000),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83a46e94-e5') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:47:44 user nova-compute[73391]: DEBUG os_vif [None req-341ec0cb-c8fe-4186-b4b3-f18e7df06dc6 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:ac:be,bridge_name='br-int',has_traffic_filtering=True,id=83a46e94-e5e7-41bb-803a-30000c4f9a02,network=Network(610f78de-5741-4743-815d-d12ba05f8000),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83a46e94-e5') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:47:44 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:47:44 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap83a46e94-e5, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:47:44 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:47:44 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:47:44 user nova-compute[73391]: INFO os_vif [None req-341ec0cb-c8fe-4186-b4b3-f18e7df06dc6 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:ac:be,bridge_name='br-int',has_traffic_filtering=True,id=83a46e94-e5e7-41bb-803a-30000c4f9a02,network=Network(610f78de-5741-4743-815d-d12ba05f8000),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap83a46e94-e5')
Aug 15 05:47:44 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-341ec0cb-c8fe-4186-b4b3-f18e7df06dc6 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 05:47:44 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-341ec0cb-c8fe-4186-b4b3-f18e7df06dc6 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tXCnbYNK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:47:44 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-341ec0cb-c8fe-4186-b4b3-f18e7df06dc6 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:47:44 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-341ec0cb-c8fe-4186-b4b3-f18e7df06dc6 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:47:44 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-341ec0cb-c8fe-4186-b4b3-f18e7df06dc6 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:47:44 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-341ec0cb-c8fe-4186-b4b3-f18e7df06dc6 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 05:47:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:44 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbed3741-2671-4902-8ec0-88d4c986fd9e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:47:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:44 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84e5641-00b0-48dd-ab5b-c728e9b81b97]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:47:44 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-341ec0cb-c8fe-4186-b4b3-f18e7df06dc6 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:47:44 user nova-compute[73391]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:47:44 user nova-compute[73391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)
Aug 15 05:47:44 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:47:44 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-341ec0cb-c8fe-4186-b4b3-f18e7df06dc6 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:47:44 user nova-compute[73391]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c (non-flash)
Aug 15 05:47:44 user nova-compute[73391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)
Aug 15 05:47:44 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:47:44 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-341ec0cb-c8fe-4186-b4b3-f18e7df06dc6 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77484227a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c'): ({'sdc'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 05:47:44 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-341ec0cb-c8fe-4186-b4b3-f18e7df06dc6 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Removing single pathed devices sdc {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 05:47:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:44 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[861590d7-e5b9-4717-8794-e065fb003ef3]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:47:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:44 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[66042c1c-84d5-4288-be19-65e47b92968d]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:47:44 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-341ec0cb-c8fe-4186-b4b3-f18e7df06dc6 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Flushing IO for device /dev/sdc {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 05:47:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:44 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97e1401-1dfe-4451-938c-7e165609f79b]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:47:44 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-341ec0cb-c8fe-4186-b4b3-f18e7df06dc6 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 05:47:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:44 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f0bbc0-e91a-4fd5-a1f9-169e33d69c89]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:47:44 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-341ec0cb-c8fe-4186-b4b3-f18e7df06dc6 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 05:47:44 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-341ec0cb-c8fe-4186-b4b3-f18e7df06dc6 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] SCSI volumes sdc have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 05:47:44 user nova-compute[73391]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO2157f67e-7ea106d8f762fc60', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_2157f67e', '/dev/disk/by-id/scsi-23765613130366438') {{(pid=84527) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 15 05:47:44 user nova-compute[73391]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIO2157f67e-7ea106d8f762fc60
Aug 15 05:47:44 user nova-compute[73391]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_2157f67e
Aug 15 05:47:44 user nova-compute[73391]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-23765613130366438
Aug 15 05:47:44 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6833a988-a406-4ab2-9e60-f64889c009db]: (4, None) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:47:44 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-341ec0cb-c8fe-4186-b4b3-f18e7df06dc6 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 05:47:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:44 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b537c986-a1b3-48a3-b7e3-fc92086bab7f]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:47:44 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-341ec0cb-c8fe-4186-b4b3-f18e7df06dc6 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:47:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:44 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7786390f-cfd4-408c-a2d5-7d7d0fd23abe]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:47:44 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-341ec0cb-c8fe-4186-b4b3-f18e7df06dc6 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c, portal: 172.16.0.220,3260]
Aug 15 05:47:44 user nova-compute[73391]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c, portal: 172.16.0.220,3260] successful.
Aug 15 05:47:44 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:47:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:40b1b33d-a14c-44fe-b274-6004c350d53c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:44 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7315a790-b795-4969-af20-2b3b6dfdebca]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:47:44 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-341ec0cb-c8fe-4186-b4b3-f18e7df06dc6 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:47:44 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-341ec0cb-c8fe-4186-b4b3-f18e7df06dc6 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:47:44 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-341ec0cb-c8fe-4186-b4b3-f18e7df06dc6 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] <== disconnect_volume: return (310ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:47:44 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-341ec0cb-c8fe-4186-b4b3-f18e7df06dc6 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 05:47:44 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-341ec0cb-c8fe-4186-b4b3-f18e7df06dc6 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Deleting instance files /opt/stack/data/nova/instances/dc657d66-c3f8-44e5-b30e-3d79e586a8f3_del
Aug 15 05:47:44 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-341ec0cb-c8fe-4186-b4b3-f18e7df06dc6 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Deletion of /opt/stack/data/nova/instances/dc657d66-c3f8-44e5-b30e-3d79e586a8f3_del complete
Aug 15 05:47:44 user nova-compute[73391]: INFO nova.compute.manager [None req-341ec0cb-c8fe-4186-b4b3-f18e7df06dc6 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Took 1.37 seconds to destroy the instance on the hypervisor.
Aug 15 05:47:44 user nova-compute[73391]: DEBUG oslo.service.loopingcall [None req-341ec0cb-c8fe-4186-b4b3-f18e7df06dc6 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 05:47:44 user nova-compute[73391]: DEBUG nova.compute.manager [-] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Deallocating network for instance {{(pid=73391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 05:47:44 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] deallocate_for_instance() {{(pid=73391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 05:47:45 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692078450.3249702, 7521ed98-75ed-43eb-83a2-d41502698aec => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:47:45 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] VM Stopped (Lifecycle Event)
Aug 15 05:47:45 user nova-compute[73391]: DEBUG nova.compute.manager [None req-125e71d7-792b-4c93-91fe-b37fc2328fcd None None] [instance: 7521ed98-75ed-43eb-83a2-d41502698aec] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:47:45 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:47:45 user nova-compute[73391]: DEBUG nova.compute.manager [req-6bda2e30-5c5f-4078-af59-23f27fb69dbb req-2cf9d027-3886-448b-bb5c-d26933461427 service nova] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Received event network-vif-deleted-83a46e94-e5e7-41bb-803a-30000c4f9a02 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:47:45 user nova-compute[73391]: INFO nova.compute.manager [req-6bda2e30-5c5f-4078-af59-23f27fb69dbb req-2cf9d027-3886-448b-bb5c-d26933461427 service nova] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Neutron deleted interface 83a46e94-e5e7-41bb-803a-30000c4f9a02; detaching it from the instance and deleting it from the info cache
Aug 15 05:47:45 user nova-compute[73391]: DEBUG nova.network.neutron [req-6bda2e30-5c5f-4078-af59-23f27fb69dbb req-2cf9d027-3886-448b-bb5c-d26933461427 service nova] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:47:45 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Took 0.88 seconds to deallocate network for instance.
Aug 15 05:47:45 user nova-compute[73391]: DEBUG nova.compute.manager [req-6bda2e30-5c5f-4078-af59-23f27fb69dbb req-2cf9d027-3886-448b-bb5c-d26933461427 service nova] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Detach interface failed, port_id=83a46e94-e5e7-41bb-803a-30000c4f9a02, reason: Instance dc657d66-c3f8-44e5-b30e-3d79e586a8f3 could not be found. {{(pid=73391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 05:47:45 user nova-compute[73391]: DEBUG nova.compute.manager [req-5e881fea-f560-44d4-ac78-760c4d93eed5 req-df252c49-9553-484b-abef-ef9fd4de9b8b service nova] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Received event network-vif-plugged-83a46e94-e5e7-41bb-803a-30000c4f9a02 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:47:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-5e881fea-f560-44d4-ac78-760c4d93eed5 req-df252c49-9553-484b-abef-ef9fd4de9b8b service nova] Acquiring lock "dc657d66-c3f8-44e5-b30e-3d79e586a8f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:47:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-5e881fea-f560-44d4-ac78-760c4d93eed5 req-df252c49-9553-484b-abef-ef9fd4de9b8b service nova] Lock "dc657d66-c3f8-44e5-b30e-3d79e586a8f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:47:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-5e881fea-f560-44d4-ac78-760c4d93eed5 req-df252c49-9553-484b-abef-ef9fd4de9b8b service nova] Lock "dc657d66-c3f8-44e5-b30e-3d79e586a8f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:47:45 user nova-compute[73391]: DEBUG nova.compute.manager [req-5e881fea-f560-44d4-ac78-760c4d93eed5 req-df252c49-9553-484b-abef-ef9fd4de9b8b service nova] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] No waiting events found dispatching network-vif-plugged-83a46e94-e5e7-41bb-803a-30000c4f9a02 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:47:45 user nova-compute[73391]: WARNING nova.compute.manager [req-5e881fea-f560-44d4-ac78-760c4d93eed5 req-df252c49-9553-484b-abef-ef9fd4de9b8b service nova] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Received unexpected event network-vif-plugged-83a46e94-e5e7-41bb-803a-30000c4f9a02 for instance with vm_state active and task_state deleting.
Aug 15 05:47:46 user nova-compute[73391]: INFO nova.compute.manager [None req-341ec0cb-c8fe-4186-b4b3-f18e7df06dc6 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Took 0.74 seconds to detach 1 volumes for instance.
Aug 15 05:47:46 user nova-compute[73391]: DEBUG nova.compute.manager [None req-341ec0cb-c8fe-4186-b4b3-f18e7df06dc6 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Deleting volume: 40b1b33d-a14c-44fe-b274-6004c350d53c {{(pid=73391) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 15 05:47:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-341ec0cb-c8fe-4186-b4b3-f18e7df06dc6 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:47:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-341ec0cb-c8fe-4186-b4b3-f18e7df06dc6 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:47:46 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-341ec0cb-c8fe-4186-b4b3-f18e7df06dc6 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:47:46 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-341ec0cb-c8fe-4186-b4b3-f18e7df06dc6 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:47:47 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-341ec0cb-c8fe-4186-b4b3-f18e7df06dc6 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.467s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:47:47 user nova-compute[73391]: INFO nova.scheduler.client.report [None req-341ec0cb-c8fe-4186-b4b3-f18e7df06dc6 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Deleted allocations for instance dc657d66-c3f8-44e5-b30e-3d79e586a8f3
Aug 15 05:47:47 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-341ec0cb-c8fe-4186-b4b3-f18e7df06dc6 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "dc657d66-c3f8-44e5-b30e-3d79e586a8f3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.821s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:47:49 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:47:49 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692078454.6267748, b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1 => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:47:49 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] VM Stopped (Lifecycle Event)
Aug 15 05:47:49 user nova-compute[73391]: DEBUG nova.compute.manager [None req-82937b71-d991-419f-b315-18b3a08ffbc2 None None] [instance: b2e73c4c-5c6e-4231-afb0-2cb8ad1fade1] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:47:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:47:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:47:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 05:47:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 05:47:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 05:47:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:47:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c11eab77-cd2b-40f1-a48f-149d383ffa06 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquiring lock "6358e825-5705-45d6-86b6-3aacfa5a9bbb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:47:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c11eab77-cd2b-40f1-a48f-149d383ffa06 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "6358e825-5705-45d6-86b6-3aacfa5a9bbb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:47:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c11eab77-cd2b-40f1-a48f-149d383ffa06 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquiring lock "6358e825-5705-45d6-86b6-3aacfa5a9bbb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:47:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c11eab77-cd2b-40f1-a48f-149d383ffa06 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "6358e825-5705-45d6-86b6-3aacfa5a9bbb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:47:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c11eab77-cd2b-40f1-a48f-149d383ffa06 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "6358e825-5705-45d6-86b6-3aacfa5a9bbb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:47:54 user nova-compute[73391]: INFO nova.compute.manager [None req-c11eab77-cd2b-40f1-a48f-149d383ffa06 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Terminating instance
Aug 15 05:47:54 user nova-compute[73391]: DEBUG nova.compute.manager [None req-c11eab77-cd2b-40f1-a48f-149d383ffa06 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Start destroying the instance on the hypervisor. {{(pid=73391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 05:47:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:47:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG nova.compute.manager [req-83858f92-1043-437b-a5e2-91ee2de0cf6d req-ca5d12f6-37bc-400e-b364-5618b0dc657e service nova] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Received event network-vif-unplugged-3b77e3e1-84f9-470a-b684-e8bdc4996c68 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-83858f92-1043-437b-a5e2-91ee2de0cf6d req-ca5d12f6-37bc-400e-b364-5618b0dc657e service nova] Acquiring lock "6358e825-5705-45d6-86b6-3aacfa5a9bbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-83858f92-1043-437b-a5e2-91ee2de0cf6d req-ca5d12f6-37bc-400e-b364-5618b0dc657e service nova] Lock "6358e825-5705-45d6-86b6-3aacfa5a9bbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-83858f92-1043-437b-a5e2-91ee2de0cf6d req-ca5d12f6-37bc-400e-b364-5618b0dc657e service nova] Lock "6358e825-5705-45d6-86b6-3aacfa5a9bbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG nova.compute.manager [req-83858f92-1043-437b-a5e2-91ee2de0cf6d req-ca5d12f6-37bc-400e-b364-5618b0dc657e service nova] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] No waiting events found dispatching network-vif-unplugged-3b77e3e1-84f9-470a-b684-e8bdc4996c68 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG nova.compute.manager [req-83858f92-1043-437b-a5e2-91ee2de0cf6d req-ca5d12f6-37bc-400e-b364-5618b0dc657e service nova] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Received event network-vif-unplugged-3b77e3e1-84f9-470a-b684-e8bdc4996c68 for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 05:47:55 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Instance destroyed successfully.
Aug 15 05:47:55 user nova-compute[73391]: DEBUG nova.objects.instance [None req-c11eab77-cd2b-40f1-a48f-149d383ffa06 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lazy-loading 'resources' on Instance uuid 6358e825-5705-45d6-86b6-3aacfa5a9bbb {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-c11eab77-cd2b-40f1-a48f-149d383ffa06 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:32:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-668367840',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-668367840',id=12,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:34:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83b9acbe11654053bb905e7c92558a35',ramdisk_id='',reservation_id='r-t0vgeqpl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1045163116',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:35:53Z,user_data=None,user_id='887f0846cf554e12acf92a663f5ab266',uuid=6358e825-5705-45d6-86b6-3aacfa5a9bbb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b77e3e1-84f9-470a-b684-e8bdc4996c68", "address": "fa:16:3e:68:b6:f9", "network": {"id": "70d88082-aea7-48bb-abb4-d77d264aaf01", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b9acbe11654053bb905e7c92558a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b77e3e1-84", "ovs_interfaceid": "3b77e3e1-84f9-470a-b684-e8bdc4996c68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-c11eab77-cd2b-40f1-a48f-149d383ffa06 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Converting VIF {"id": "3b77e3e1-84f9-470a-b684-e8bdc4996c68", "address": "fa:16:3e:68:b6:f9", "network": {"id": "70d88082-aea7-48bb-abb4-d77d264aaf01", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b9acbe11654053bb905e7c92558a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b77e3e1-84", "ovs_interfaceid": "3b77e3e1-84f9-470a-b684-e8bdc4996c68", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-c11eab77-cd2b-40f1-a48f-149d383ffa06 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:68:b6:f9,bridge_name='br-int',has_traffic_filtering=True,id=3b77e3e1-84f9-470a-b684-e8bdc4996c68,network=Network(70d88082-aea7-48bb-abb4-d77d264aaf01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b77e3e1-84') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG os_vif [None req-c11eab77-cd2b-40f1-a48f-149d383ffa06 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:b6:f9,bridge_name='br-int',has_traffic_filtering=True,id=3b77e3e1-84f9-470a-b684-e8bdc4996c68,network=Network(70d88082-aea7-48bb-abb4-d77d264aaf01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b77e3e1-84') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b77e3e1-84, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:47:55 user nova-compute[73391]: INFO os_vif [None req-c11eab77-cd2b-40f1-a48f-149d383ffa06 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:68:b6:f9,bridge_name='br-int',has_traffic_filtering=True,id=3b77e3e1-84f9-470a-b684-e8bdc4996c68,network=Network(70d88082-aea7-48bb-abb4-d77d264aaf01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b77e3e1-84')
Aug 15 05:47:55 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c11eab77-cd2b-40f1-a48f-149d383ffa06 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c11eab77-cd2b-40f1-a48f-149d383ffa06 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yNsuhABc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:47:55 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-c11eab77-cd2b-40f1-a48f-149d383ffa06 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:47:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-c11eab77-cd2b-40f1-a48f-149d383ffa06 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-c11eab77-cd2b-40f1-a48f-149d383ffa06 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c11eab77-cd2b-40f1-a48f-149d383ffa06 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a2fd46-b299-4b67-afc8-1862e7f6adf5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[50646a77-a4dc-4724-aa94-aa0d744d585e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c11eab77-cd2b-40f1-a48f-149d383ffa06 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:47:55 user nova-compute[73391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)
Aug 15 05:47:55 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c11eab77-cd2b-40f1-a48f-149d383ffa06 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e (non-flash)
Aug 15 05:47:55 user nova-compute[73391]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)
Aug 15 05:47:55 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c11eab77-cd2b-40f1-a48f-149d383ffa06 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77484c51b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e'): ({'sdf'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-c11eab77-cd2b-40f1-a48f-149d383ffa06 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Removing single pathed devices sdf {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1661700c-40f0-4c89-aaad-ad8157528d43]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[60f6623a-a42b-46e1-880e-df326f2d515b]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-c11eab77-cd2b-40f1-a48f-149d383ffa06 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Flushing IO for device /dev/sdf {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f46848-bb1f-4384-a092-1e3f069561c3]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-c11eab77-cd2b-40f1-a48f-149d383ffa06 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG nova.compute.manager [req-98acb9b5-e26b-4cc9-9a9f-f499726c68ff req-6f55bd37-e432-4160-baff-a54aed088d8f service nova] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Received event network-changed-8919b46b-766f-4499-8179-1d8538dba72e {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG nova.compute.manager [req-98acb9b5-e26b-4cc9-9a9f-f499726c68ff req-6f55bd37-e432-4160-baff-a54aed088d8f service nova] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Refreshing instance network info cache due to event network-changed-8919b46b-766f-4499-8179-1d8538dba72e. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-98acb9b5-e26b-4cc9-9a9f-f499726c68ff req-6f55bd37-e432-4160-baff-a54aed088d8f service nova] Acquiring lock "refresh_cache-c043ca2f-6468-4b32-ae53-40da261fd1fa" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-98acb9b5-e26b-4cc9-9a9f-f499726c68ff req-6f55bd37-e432-4160-baff-a54aed088d8f service nova] Acquired lock "refresh_cache-c043ca2f-6468-4b32-ae53-40da261fd1fa" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG nova.network.neutron [req-98acb9b5-e26b-4cc9-9a9f-f499726c68ff req-6f55bd37-e432-4160-baff-a54aed088d8f service nova] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Refreshing network info cache for port 8919b46b-766f-4499-8179-1d8538dba72e {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a046d5f-f599-4b94-b252-c17d1b0e2060]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-c11eab77-cd2b-40f1-a48f-149d383ffa06 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-c11eab77-cd2b-40f1-a48f-149d383ffa06 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] SCSI volumes sdf have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c11eab77-cd2b-40f1-a48f-149d383ffa06 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4317a10-2d0a-42f0-9baa-12e6097b8dc5]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c11eab77-cd2b-40f1-a48f-149d383ffa06 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0341b299-8965-4fb7-ae65-542046466fa7]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c11eab77-cd2b-40f1-a48f-149d383ffa06 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e, portal: 172.16.0.220,3260]
Aug 15 05:47:55 user nova-compute[73391]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e, portal: 172.16.0.220,3260] successful.
Aug 15 05:47:55 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:80371ba5-8b71-45bc-b67d-43676d63163e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1479d8d-db76-48c7-a697-b7cbd6b24881]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c11eab77-cd2b-40f1-a48f-149d383ffa06 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-c11eab77-cd2b-40f1-a48f-149d383ffa06 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c11eab77-cd2b-40f1-a48f-149d383ffa06 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] <== disconnect_volume: return (310ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:47:55 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c11eab77-cd2b-40f1-a48f-149d383ffa06 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 05:47:55 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-c11eab77-cd2b-40f1-a48f-149d383ffa06 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Deleting instance files /opt/stack/data/nova/instances/6358e825-5705-45d6-86b6-3aacfa5a9bbb_del
Aug 15 05:47:55 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-c11eab77-cd2b-40f1-a48f-149d383ffa06 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Deletion of /opt/stack/data/nova/instances/6358e825-5705-45d6-86b6-3aacfa5a9bbb_del complete
Aug 15 05:47:56 user nova-compute[73391]: INFO nova.compute.manager [None req-c11eab77-cd2b-40f1-a48f-149d383ffa06 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Took 1.19 seconds to destroy the instance on the hypervisor.
Aug 15 05:47:56 user nova-compute[73391]: DEBUG oslo.service.loopingcall [None req-c11eab77-cd2b-40f1-a48f-149d383ffa06 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 05:47:56 user nova-compute[73391]: DEBUG nova.compute.manager [-] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Deallocating network for instance {{(pid=73391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 05:47:56 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] deallocate_for_instance() {{(pid=73391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 05:47:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:47:56 user nova-compute[73391]: DEBUG nova.network.neutron [req-98acb9b5-e26b-4cc9-9a9f-f499726c68ff req-6f55bd37-e432-4160-baff-a54aed088d8f service nova] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Updated VIF entry in instance network info cache for port 8919b46b-766f-4499-8179-1d8538dba72e. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:47:56 user nova-compute[73391]: DEBUG nova.network.neutron [req-98acb9b5-e26b-4cc9-9a9f-f499726c68ff req-6f55bd37-e432-4160-baff-a54aed088d8f service nova] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Updating instance_info_cache with network_info: [{"id": "8919b46b-766f-4499-8179-1d8538dba72e", "address": "fa:16:3e:56:33:74", "network": {"id": "c94dfbf4-6803-458e-b2c6-231298da7bc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090354282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f88922b3c294aea9efa3d80909a171a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8919b46b-76", "ovs_interfaceid": "8919b46b-766f-4499-8179-1d8538dba72e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:47:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-98acb9b5-e26b-4cc9-9a9f-f499726c68ff req-6f55bd37-e432-4160-baff-a54aed088d8f service nova] Releasing lock "refresh_cache-c043ca2f-6468-4b32-ae53-40da261fd1fa" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:47:56 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:47:56 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Took 0.94 seconds to deallocate network for instance.
Aug 15 05:47:56 user nova-compute[73391]: DEBUG nova.compute.manager [req-dd2d45f0-be6d-44e1-80c5-79560ed4f339 req-42b7a4df-7c8d-4fe8-bfea-e057453a14b9 service nova] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Received event network-vif-deleted-3b77e3e1-84f9-470a-b684-e8bdc4996c68 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:47:56 user nova-compute[73391]: INFO nova.compute.manager [req-dd2d45f0-be6d-44e1-80c5-79560ed4f339 req-42b7a4df-7c8d-4fe8-bfea-e057453a14b9 service nova] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Neutron deleted interface 3b77e3e1-84f9-470a-b684-e8bdc4996c68; detaching it from the instance and deleting it from the info cache
Aug 15 05:47:56 user nova-compute[73391]: DEBUG nova.network.neutron [req-dd2d45f0-be6d-44e1-80c5-79560ed4f339 req-42b7a4df-7c8d-4fe8-bfea-e057453a14b9 service nova] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:47:57 user nova-compute[73391]: DEBUG nova.compute.manager [req-dd2d45f0-be6d-44e1-80c5-79560ed4f339 req-42b7a4df-7c8d-4fe8-bfea-e057453a14b9 service nova] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Detach interface failed, port_id=3b77e3e1-84f9-470a-b684-e8bdc4996c68, reason: Instance 6358e825-5705-45d6-86b6-3aacfa5a9bbb could not be found. {{(pid=73391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 05:47:57 user nova-compute[73391]: DEBUG nova.compute.manager [req-3f26c06c-abda-4303-81d0-98dbc5e01af3 req-c50ed56c-c7ff-4235-878f-b30a77900c87 service nova] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Received event network-vif-plugged-3b77e3e1-84f9-470a-b684-e8bdc4996c68 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:47:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-3f26c06c-abda-4303-81d0-98dbc5e01af3 req-c50ed56c-c7ff-4235-878f-b30a77900c87 service nova] Acquiring lock "6358e825-5705-45d6-86b6-3aacfa5a9bbb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:47:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-3f26c06c-abda-4303-81d0-98dbc5e01af3 req-c50ed56c-c7ff-4235-878f-b30a77900c87 service nova] Lock "6358e825-5705-45d6-86b6-3aacfa5a9bbb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:47:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-3f26c06c-abda-4303-81d0-98dbc5e01af3 req-c50ed56c-c7ff-4235-878f-b30a77900c87 service nova] Lock "6358e825-5705-45d6-86b6-3aacfa5a9bbb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:47:57 user nova-compute[73391]: DEBUG nova.compute.manager [req-3f26c06c-abda-4303-81d0-98dbc5e01af3 req-c50ed56c-c7ff-4235-878f-b30a77900c87 service nova] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] No waiting events found dispatching network-vif-plugged-3b77e3e1-84f9-470a-b684-e8bdc4996c68 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:47:57 user nova-compute[73391]: WARNING nova.compute.manager [req-3f26c06c-abda-4303-81d0-98dbc5e01af3 req-c50ed56c-c7ff-4235-878f-b30a77900c87 service nova] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Received unexpected event network-vif-plugged-3b77e3e1-84f9-470a-b684-e8bdc4996c68 for instance with vm_state active and task_state deleting.
Aug 15 05:47:57 user nova-compute[73391]: INFO nova.compute.manager [None req-c11eab77-cd2b-40f1-a48f-149d383ffa06 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Took 0.72 seconds to detach 1 volumes for instance.
Aug 15 05:47:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c11eab77-cd2b-40f1-a48f-149d383ffa06 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:47:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c11eab77-cd2b-40f1-a48f-149d383ffa06 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:47:58 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-c11eab77-cd2b-40f1-a48f-149d383ffa06 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:47:58 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-c11eab77-cd2b-40f1-a48f-149d383ffa06 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:47:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c11eab77-cd2b-40f1-a48f-149d383ffa06 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.325s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:47:58 user nova-compute[73391]: INFO nova.scheduler.client.report [None req-c11eab77-cd2b-40f1-a48f-149d383ffa06 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Deleted allocations for instance 6358e825-5705-45d6-86b6-3aacfa5a9bbb
Aug 15 05:47:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c11eab77-cd2b-40f1-a48f-149d383ffa06 tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "6358e825-5705-45d6-86b6-3aacfa5a9bbb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.385s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:47:59 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692078464.2107031, dc657d66-c3f8-44e5-b30e-3d79e586a8f3 => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:47:59 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] VM Stopped (Lifecycle Event)
Aug 15 05:47:59 user nova-compute[73391]: DEBUG nova.compute.manager [None req-8953e5a4-7994-40e3-ad12-3ca49e4366af None None] [instance: dc657d66-c3f8-44e5-b30e-3d79e586a8f3] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:47:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6b07200e-29e9-44d7-b955-847745c23636 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Acquiring lock "c043ca2f-6468-4b32-ae53-40da261fd1fa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:47:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6b07200e-29e9-44d7-b955-847745c23636 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "c043ca2f-6468-4b32-ae53-40da261fd1fa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:47:59 user nova-compute[73391]: DEBUG nova.objects.instance [None req-6b07200e-29e9-44d7-b955-847745c23636 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lazy-loading 'flavor' on Instance uuid c043ca2f-6468-4b32-ae53-40da261fd1fa {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:47:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6b07200e-29e9-44d7-b955-847745c23636 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "c043ca2f-6468-4b32-ae53-40da261fd1fa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:47:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:47:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6b07200e-29e9-44d7-b955-847745c23636 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Acquiring lock "c043ca2f-6468-4b32-ae53-40da261fd1fa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:47:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6b07200e-29e9-44d7-b955-847745c23636 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "c043ca2f-6468-4b32-ae53-40da261fd1fa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:47:59 user nova-compute[73391]: INFO nova.compute.manager [None req-6b07200e-29e9-44d7-b955-847745c23636 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Attaching volume ffbb80ff-9421-4e66-ab2c-91d3c28e364b to /dev/vdb
Aug 15 05:47:59 user nova-compute[73391]: DEBUG os_brick.utils [None req-6b07200e-29e9-44d7-b955-847745c23636 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:47:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:59 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c946952-c1f3-451e-8e0e-d7aadb3233fc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:47:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:59 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cafbf90-c8ea-4219-b17c-b96bc406772a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:47:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:47:59 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[10028b42-7f3c-4ace-85a5-ac3ed4250af9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:47:59 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58d4d89-6888-462b-a97d-e9ae7b93edd0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:47:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-6b07200e-29e9-44d7-b955-847745c23636 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-6b07200e-29e9-44d7-b955-847745c23636 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:47:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6b07200e-29e9-44d7-b955-847745c23636 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 05:47:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:47:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:47:59 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 05:47:59 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[824d5703-998f-4bf3-81de-a21e56716bf9]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:47:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-6b07200e-29e9-44d7-b955-847745c23636 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 05:47:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-6b07200e-29e9-44d7-b955-847745c23636 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 05:47:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-6b07200e-29e9-44d7-b955-847745c23636 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 05:47:59 user nova-compute[73391]: DEBUG os_brick.utils [None req-6b07200e-29e9-44d7-b955-847745c23636 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:47:59 user nova-compute[73391]: DEBUG nova.virt.block_device [None req-6b07200e-29e9-44d7-b955-847745c23636 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Updating existing volume attachment record: e90d7a92-a5b5-4712-89b6-9ff48c3880fc {{(pid=73391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 05:48:00 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:48:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:48:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:48:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b07200e-29e9-44d7-b955-847745c23636 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 05:48:08 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b07200e-29e9-44d7-b955-847745c23636 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:ffbb80ff-9421-4e66-ab2c-91d3c28e364b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZvAbJtMn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:48:08 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-6b07200e-29e9-44d7-b955-847745c23636 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:48:08 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-6b07200e-29e9-44d7-b955-847745c23636 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:48:08 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-6b07200e-29e9-44d7-b955-847745c23636 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:48:08 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-6b07200e-29e9-44d7-b955-847745c23636 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:48:08 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-6b07200e-29e9-44d7-b955-847745c23636 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ffbb80ff-9421-4e66-ab2c-91d3c28e364b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:48:08 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-6b07200e-29e9-44d7-b955-847745c23636 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ffbb80ff-9421-4e66-ab2c-91d3c28e364b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:48:08 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-6b07200e-29e9-44d7-b955-847745c23636 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 05:48:08 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffbb80ff-9421-4e66-ab2c-91d3c28e364b -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:08 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffbb80ff-9421-4e66-ab2c-91d3c28e364b -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:08 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40fc28f-e609-41fd-9a4a-f98c5bd1b24f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:08 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b07200e-29e9-44d7-b955-847745c23636 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 05:48:08 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:48:08 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffbb80ff-9421-4e66-ab2c-91d3c28e364b -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:08 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffbb80ff-9421-4e66-ab2c-91d3c28e364b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:08 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fb99728-6f3c-4951-9592-9a279d8cfb7b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ffbb80ff-9421-4e66-ab2c-91d3c28e364b] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:08 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b07200e-29e9-44d7-b955-847745c23636 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ffbb80ff-9421-4e66-ab2c-91d3c28e364b] added
Aug 15 05:48:08 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:48:08 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffbb80ff-9421-4e66-ab2c-91d3c28e364b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:08 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffbb80ff-9421-4e66-ab2c-91d3c28e364b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:08 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd6bad1-f8b7-46bd-a791-a80badcdfc76]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:08 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b07200e-29e9-44d7-b955-847745c23636 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:48:08 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffbb80ff-9421-4e66-ab2c-91d3c28e364b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:08 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffbb80ff-9421-4e66-ab2c-91d3c28e364b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:08 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c50bb4c-f3d8-419a-b9cb-473840d867bd]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:08 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b07200e-29e9-44d7-b955-847745c23636 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:48:08 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffbb80ff-9421-4e66-ab2c-91d3c28e364b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZvAbJtMn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:08 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffbb80ff-9421-4e66-ab2c-91d3c28e364b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZvAbJtMn" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:08 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[88679f17-ac66-4b8d-ae45-a5ec142660b8]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:08 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b07200e-29e9-44d7-b955-847745c23636 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZvAbJtMn'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:48:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffbb80ff-9421-4e66-ab2c-91d3c28e364b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffbb80ff-9421-4e66-ab2c-91d3c28e364b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:09 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[052597c4-5642-4188-b528-46142a2f0b6a]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b07200e-29e9-44d7-b955-847745c23636 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:48:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:09 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76d78b9-32a7-4b5f-ab74-3d9bfd0ade5a]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b07200e-29e9-44d7-b955-847745c23636 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)
Aug 15 05:48:09 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:48:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b07200e-29e9-44d7-b955-847745c23636 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)
Aug 15 05:48:09 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:48:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffbb80ff-9421-4e66-ab2c-91d3c28e364b -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffbb80ff-9421-4e66-ab2c-91d3c28e364b -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:09 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ec9d6c1-d58d-4033-8aa6-ec4b335fb064]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ffbb80ff-9421-4e66-ab2c-91d3c28e364b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ffbb80ff-9421-4e66-ab2c-91d3c28e364b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b07200e-29e9-44d7-b955-847745c23636 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ffbb80ff-9421-4e66-ab2c-91d3c28e364b, portal: 172.16.0.220,3260]
Aug 15 05:48:09 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:ffbb80ff-9421-4e66-ab2c-91d3c28e364b, portal: 172.16.0.220,3260] successful.
Aug 15 05:48:09 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:48:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffbb80ff-9421-4e66-ab2c-91d3c28e364b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffbb80ff-9421-4e66-ab2c-91d3c28e364b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:09 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1c9698-33f0-480c-889e-f9500880ff25]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b07200e-29e9-44d7-b955-847745c23636 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:48:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:09 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb1cd6e-eff6-4c3e-9101-886c6ce5aac4]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbb80ff-9421-4e66-ab2c-91d3c28e364b (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b07200e-29e9-44d7-b955-847745c23636 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)
Aug 15 05:48:09 user nova-compute[73391]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbb80ff-9421-4e66-ab2c-91d3c28e364b (non-flash)
Aug 15 05:48:09 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:48:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b07200e-29e9-44d7-b955-847745c23636 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)
Aug 15 05:48:09 user nova-compute[73391]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbb80ff-9421-4e66-ab2c-91d3c28e364b (non-flash)
Aug 15 05:48:09 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:48:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-6b07200e-29e9-44d7-b955-847745c23636 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ffbb80ff-9421-4e66-ab2c-91d3c28e364b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:48:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b07200e-29e9-44d7-b955-847745c23636 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 05:48:09 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-6b07200e-29e9-44d7-b955-847745c23636 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 05:48:09 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-6b07200e-29e9-44d7-b955-847745c23636 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 05:48:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:09 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6c829b-fde5-4c53-80dc-3c95e0787914]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:09 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-6b07200e-29e9-44d7-b955-847745c23636 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:48:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b07200e-29e9-44d7-b955-847745c23636 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZvAbJtMn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 05:48:10 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-6b07200e-29e9-44d7-b955-847745c23636 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:48:10 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6b07200e-29e9-44d7-b955-847745c23636 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23435353530343066', 'path': '/dev/sdb'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:48:10 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6b07200e-29e9-44d7-b955-847745c23636 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23435353530343066', 'path': '/dev/sdb'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 05:48:10 user nova-compute[73391]: DEBUG nova.objects.instance [None req-6b07200e-29e9-44d7-b955-847745c23636 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lazy-loading 'flavor' on Instance uuid c043ca2f-6468-4b32-ae53-40da261fd1fa {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:48:10 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-6b07200e-29e9-44d7-b955-847745c23636 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 05:48:10 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:48:10 user nova-compute[73391]:   <source dev="/dev/sdb"/>
Aug 15 05:48:10 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:48:10 user nova-compute[73391]:   <serial>ffbb80ff-9421-4e66-ab2c-91d3c28e364b</serial>
Aug 15 05:48:10 user nova-compute[73391]: </disk>
Aug 15 05:48:10 user nova-compute[73391]:  {{(pid=73391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 05:48:10 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692078475.602301, 6358e825-5705-45d6-86b6-3aacfa5a9bbb => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:48:10 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] VM Stopped (Lifecycle Event)
Aug 15 05:48:10 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-6b07200e-29e9-44d7-b955-847745c23636 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:48:10 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-6b07200e-29e9-44d7-b955-847745c23636 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:48:10 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-6b07200e-29e9-44d7-b955-847745c23636 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] No VIF found with MAC fa:16:3e:56:33:74, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:48:10 user nova-compute[73391]: DEBUG nova.compute.manager [None req-eaaa90fd-25d7-4b21-adc2-1980c11c077c None None] [instance: 6358e825-5705-45d6-86b6-3aacfa5a9bbb] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:48:10 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:48:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6b07200e-29e9-44d7-b955-847745c23636 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "c043ca2f-6468-4b32-ae53-40da261fd1fa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.977s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:48:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:48:15 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0306d82c-03b2-4199-bdab-4e5c22b39baa tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Acquiring lock "c043ca2f-6468-4b32-ae53-40da261fd1fa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:48:15 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0306d82c-03b2-4199-bdab-4e5c22b39baa tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "c043ca2f-6468-4b32-ae53-40da261fd1fa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:48:15 user nova-compute[73391]: DEBUG nova.objects.instance [None req-0306d82c-03b2-4199-bdab-4e5c22b39baa tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lazy-loading 'flavor' on Instance uuid c043ca2f-6468-4b32-ae53-40da261fd1fa {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:48:15 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0306d82c-03b2-4199-bdab-4e5c22b39baa tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "c043ca2f-6468-4b32-ae53-40da261fd1fa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:48:15 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0306d82c-03b2-4199-bdab-4e5c22b39baa tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Acquiring lock "c043ca2f-6468-4b32-ae53-40da261fd1fa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:48:15 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0306d82c-03b2-4199-bdab-4e5c22b39baa tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "c043ca2f-6468-4b32-ae53-40da261fd1fa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:48:15 user nova-compute[73391]: INFO nova.compute.manager [None req-0306d82c-03b2-4199-bdab-4e5c22b39baa tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Attaching volume 7354f3aa-003f-4e3b-9b71-272de6f13c81 to /dev/vdc
Aug 15 05:48:15 user nova-compute[73391]: DEBUG os_brick.utils [None req-0306d82c-03b2-4199-bdab-4e5c22b39baa tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:48:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:15 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6b5da6-67d4-4b2b-a315-acd4f3d54361]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:15 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[540c4f34-f6a4-4343-b3e1-4dff53641e91]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:15 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[19af1a40-5b4c-45b5-9283-d5b9e064e569]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:15 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2cfead6-40ec-4e2f-a46f-8e66d1b8f792]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-0306d82c-03b2-4199-bdab-4e5c22b39baa tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-0306d82c-03b2-4199-bdab-4e5c22b39baa tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:48:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0306d82c-03b2-4199-bdab-4e5c22b39baa tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 05:48:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:48:15 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 05:48:15 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[019bfc0c-a702-476a-8331-3613b4792b93]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-0306d82c-03b2-4199-bdab-4e5c22b39baa tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 05:48:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-0306d82c-03b2-4199-bdab-4e5c22b39baa tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 05:48:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-0306d82c-03b2-4199-bdab-4e5c22b39baa tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 05:48:15 user nova-compute[73391]: DEBUG os_brick.utils [None req-0306d82c-03b2-4199-bdab-4e5c22b39baa tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:48:15 user nova-compute[73391]: DEBUG nova.virt.block_device [None req-0306d82c-03b2-4199-bdab-4e5c22b39baa tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Updating existing volume attachment record: f18f6fae-b942-4978-9a66-38267e1e81e7 {{(pid=73391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 05:48:15 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:48:17 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:48:20 user nova-compute[73391]: DEBUG nova.compute.manager [req-f195ba43-e60f-418b-8b7d-591017bdc74b req-b73223bc-1d77-4945-9f87-7e636d2b882f service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Received event network-changed-d9ae0be2-05e7-4009-b909-713c8c52e5e5 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:48:20 user nova-compute[73391]: DEBUG nova.compute.manager [req-f195ba43-e60f-418b-8b7d-591017bdc74b req-b73223bc-1d77-4945-9f87-7e636d2b882f service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Refreshing instance network info cache due to event network-changed-d9ae0be2-05e7-4009-b909-713c8c52e5e5. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:48:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f195ba43-e60f-418b-8b7d-591017bdc74b req-b73223bc-1d77-4945-9f87-7e636d2b882f service nova] Acquiring lock "refresh_cache-d85a919d-7f44-4093-b89a-51397ad5cedb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:48:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f195ba43-e60f-418b-8b7d-591017bdc74b req-b73223bc-1d77-4945-9f87-7e636d2b882f service nova] Acquired lock "refresh_cache-d85a919d-7f44-4093-b89a-51397ad5cedb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:48:20 user nova-compute[73391]: DEBUG nova.network.neutron [req-f195ba43-e60f-418b-8b7d-591017bdc74b req-b73223bc-1d77-4945-9f87-7e636d2b882f service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Refreshing network info cache for port d9ae0be2-05e7-4009-b909-713c8c52e5e5 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:48:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-283e92a2-9149-4d25-a62e-1d411f3ef1ba tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Acquiring lock "d85a919d-7f44-4093-b89a-51397ad5cedb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:48:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-283e92a2-9149-4d25-a62e-1d411f3ef1ba tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "d85a919d-7f44-4093-b89a-51397ad5cedb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:48:20 user nova-compute[73391]: DEBUG nova.objects.instance [None req-283e92a2-9149-4d25-a62e-1d411f3ef1ba tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lazy-loading 'flavor' on Instance uuid d85a919d-7f44-4093-b89a-51397ad5cedb {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:48:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-283e92a2-9149-4d25-a62e-1d411f3ef1ba tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "d85a919d-7f44-4093-b89a-51397ad5cedb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:48:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-283e92a2-9149-4d25-a62e-1d411f3ef1ba tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Acquiring lock "d85a919d-7f44-4093-b89a-51397ad5cedb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:48:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-283e92a2-9149-4d25-a62e-1d411f3ef1ba tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "d85a919d-7f44-4093-b89a-51397ad5cedb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:48:20 user nova-compute[73391]: INFO nova.compute.manager [None req-283e92a2-9149-4d25-a62e-1d411f3ef1ba tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Attaching volume 3dc55180-bd5d-49cc-b3a5-81b73c5c9f52 to /dev/vdb
Aug 15 05:48:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:48:20 user nova-compute[73391]: DEBUG os_brick.utils [None req-283e92a2-9149-4d25-a62e-1d411f3ef1ba tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:48:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:20 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[564628fe-c71d-4bf4-bd7a-41a80aa36a5d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:20 user nova-compute[73391]: DEBUG nova.network.neutron [req-f195ba43-e60f-418b-8b7d-591017bdc74b req-b73223bc-1d77-4945-9f87-7e636d2b882f service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Updated VIF entry in instance network info cache for port d9ae0be2-05e7-4009-b909-713c8c52e5e5. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:48:20 user nova-compute[73391]: DEBUG nova.network.neutron [req-f195ba43-e60f-418b-8b7d-591017bdc74b req-b73223bc-1d77-4945-9f87-7e636d2b882f service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Updating instance_info_cache with network_info: [{"id": "d9ae0be2-05e7-4009-b909-713c8c52e5e5", "address": "fa:16:3e:8a:49:2b", "network": {"id": "bec69c6a-b2cb-4b0a-ba6e-ae6dae099818", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7da9448cc34b609120da564a01dba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ae0be2-05", "ovs_interfaceid": "d9ae0be2-05e7-4009-b909-713c8c52e5e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:48:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:20 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5847d2d2-4a85-4c8d-a2aa-65f21ef2f819]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f195ba43-e60f-418b-8b7d-591017bdc74b req-b73223bc-1d77-4945-9f87-7e636d2b882f service nova] Releasing lock "refresh_cache-d85a919d-7f44-4093-b89a-51397ad5cedb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:48:20 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0768e1-d09d-44b1-8cb0-b5ff8742b749]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:20 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e98dc46-825f-4338-9677-de5515cff254]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-283e92a2-9149-4d25-a62e-1d411f3ef1ba tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-283e92a2-9149-4d25-a62e-1d411f3ef1ba tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:48:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-283e92a2-9149-4d25-a62e-1d411f3ef1ba tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 05:48:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:48:20 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 05:48:20 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7edfab-fc20-4b29-a4b2-4173b3a57d89]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-283e92a2-9149-4d25-a62e-1d411f3ef1ba tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 05:48:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-283e92a2-9149-4d25-a62e-1d411f3ef1ba tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 05:48:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-283e92a2-9149-4d25-a62e-1d411f3ef1ba tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 05:48:20 user nova-compute[73391]: DEBUG os_brick.utils [None req-283e92a2-9149-4d25-a62e-1d411f3ef1ba tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:48:20 user nova-compute[73391]: DEBUG nova.virt.block_device [None req-283e92a2-9149-4d25-a62e-1d411f3ef1ba tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Updating existing volume attachment record: 0a505e46-9124-446a-aedc-d65ba1cf2847 {{(pid=73391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 05:48:22 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:48:23 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:48:23 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:48:23 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:48:23 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:48:23 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Auditing locally available compute resources for user (node: user) {{(pid=73391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 05:48:23 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:48:23 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fecde5f1-88fb-48b0-b039-93fdb285c93c/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fecde5f1-88fb-48b0-b039-93fdb285c93c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fecde5f1-88fb-48b0-b039-93fdb285c93c/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fecde5f1-88fb-48b0-b039-93fdb285c93c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8775490-2a9e-44ac-aad7-9450afa4c295/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8775490-2a9e-44ac-aad7-9450afa4c295/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8775490-2a9e-44ac-aad7-9450afa4c295/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8775490-2a9e-44ac-aad7-9450afa4c295/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:48:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0306d82c-03b2-4199-bdab-4e5c22b39baa tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0306d82c-03b2-4199-bdab-4e5c22b39baa tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7354f3aa-003f-4e3b-9b71-272de6f13c81'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zBITCNhn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:48:25 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-0306d82c-03b2-4199-bdab-4e5c22b39baa tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:48:25 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-0306d82c-03b2-4199-bdab-4e5c22b39baa tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-0306d82c-03b2-4199-bdab-4e5c22b39baa tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:48:25 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-0306d82c-03b2-4199-bdab-4e5c22b39baa tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:48:25 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-0306d82c-03b2-4199-bdab-4e5c22b39baa tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7354f3aa-003f-4e3b-9b71-272de6f13c81" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-0306d82c-03b2-4199-bdab-4e5c22b39baa tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7354f3aa-003f-4e3b-9b71-272de6f13c81" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:48:25 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-0306d82c-03b2-4199-bdab-4e5c22b39baa tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 05:48:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7354f3aa-003f-4e3b-9b71-272de6f13c81 -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7354f3aa-003f-4e3b-9b71-272de6f13c81 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad7d45f-7a4d-489a-bf0d-9c42ace01fd5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0306d82c-03b2-4199-bdab-4e5c22b39baa tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 05:48:25 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7354f3aa-003f-4e3b-9b71-272de6f13c81 -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7354f3aa-003f-4e3b-9b71-272de6f13c81 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5bff55-1e18-492a-801d-471ff16ee496]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7354f3aa-003f-4e3b-9b71-272de6f13c81] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0306d82c-03b2-4199-bdab-4e5c22b39baa tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7354f3aa-003f-4e3b-9b71-272de6f13c81] added
Aug 15 05:48:25 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7354f3aa-003f-4e3b-9b71-272de6f13c81 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7354f3aa-003f-4e3b-9b71-272de6f13c81 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a408e0eb-84fe-41a6-85d3-8712cd14c4c8]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0306d82c-03b2-4199-bdab-4e5c22b39baa tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7354f3aa-003f-4e3b-9b71-272de6f13c81 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7354f3aa-003f-4e3b-9b71-272de6f13c81 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[399e4233-b626-4127-9ebc-fa6f6e5e9f1e]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0306d82c-03b2-4199-bdab-4e5c22b39baa tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7354f3aa-003f-4e3b-9b71-272de6f13c81 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zBITCNhn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7354f3aa-003f-4e3b-9b71-272de6f13c81 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zBITCNhn" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e7b76f2-1ebb-41db-9deb-14cc8509b1e1]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0306d82c-03b2-4199-bdab-4e5c22b39baa tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zBITCNhn'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7354f3aa-003f-4e3b-9b71-272de6f13c81 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85a919d-7f44-4093-b89a-51397ad5cedb/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7354f3aa-003f-4e3b-9b71-272de6f13c81 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0b61fb-e1ba-46b5-929c-1ae8c173bc9a]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0306d82c-03b2-4199-bdab-4e5c22b39baa tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d94a5a8-53e6-4a57-b4f3-7f917e37e222]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbb80ff-9421-4e66-ab2c-91d3c28e364b (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0306d82c-03b2-4199-bdab-4e5c22b39baa tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)
Aug 15 05:48:25 user nova-compute[73391]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbb80ff-9421-4e66-ab2c-91d3c28e364b (non-flash)
Aug 15 05:48:25 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0306d82c-03b2-4199-bdab-4e5c22b39baa tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)
Aug 15 05:48:25 user nova-compute[73391]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbb80ff-9421-4e66-ab2c-91d3c28e364b (non-flash)
Aug 15 05:48:25 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7354f3aa-003f-4e3b-9b71-272de6f13c81 -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7354f3aa-003f-4e3b-9b71-272de6f13c81 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1617ec3-e696-470a-ab0c-b1eb8588deaa]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7354f3aa-003f-4e3b-9b71-272de6f13c81, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7354f3aa-003f-4e3b-9b71-272de6f13c81, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0306d82c-03b2-4199-bdab-4e5c22b39baa tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7354f3aa-003f-4e3b-9b71-272de6f13c81, portal: 172.16.0.220,3260]
Aug 15 05:48:25 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:7354f3aa-003f-4e3b-9b71-272de6f13c81, portal: 172.16.0.220,3260] successful.
Aug 15 05:48:25 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7354f3aa-003f-4e3b-9b71-272de6f13c81 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7354f3aa-003f-4e3b-9b71-272de6f13c81 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70a17cd-3f29-4660-9d5d-45c7b5f6d313]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0306d82c-03b2-4199-bdab-4e5c22b39baa tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1992758b-295e-4971-9ed5-84b91289d5f2]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbb80ff-9421-4e66-ab2c-91d3c28e364b (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7354f3aa-003f-4e3b-9b71-272de6f13c81 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0306d82c-03b2-4199-bdab-4e5c22b39baa tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)
Aug 15 05:48:25 user nova-compute[73391]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbb80ff-9421-4e66-ab2c-91d3c28e364b (non-flash)
Aug 15 05:48:25 user nova-compute[73391]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7354f3aa-003f-4e3b-9b71-272de6f13c81 (non-flash)
Aug 15 05:48:25 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0306d82c-03b2-4199-bdab-4e5c22b39baa tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)
Aug 15 05:48:25 user nova-compute[73391]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbb80ff-9421-4e66-ab2c-91d3c28e364b (non-flash)
Aug 15 05:48:25 user nova-compute[73391]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7354f3aa-003f-4e3b-9b71-272de6f13c81 (non-flash)
Aug 15 05:48:25 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-0306d82c-03b2-4199-bdab-4e5c22b39baa tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7354f3aa-003f-4e3b-9b71-272de6f13c81" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0306d82c-03b2-4199-bdab-4e5c22b39baa tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-0306d82c-03b2-4199-bdab-4e5c22b39baa tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] HCTL ('34', '-', '-', 0) found on session 49 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-0306d82c-03b2-4199-bdab-4e5c22b39baa tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85a919d-7f44-4093-b89a-51397ad5cedb/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85a919d-7f44-4093-b89a-51397ad5cedb/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42673ac-8678-4c45-b186-e7213fbdb95d]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-0306d82c-03b2-4199-bdab-4e5c22b39baa tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Searching for a device in session 49 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0306d82c-03b2-4199-bdab-4e5c22b39baa tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zBITCNhn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85a919d-7f44-4093-b89a-51397ad5cedb/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:26 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-0306d82c-03b2-4199-bdab-4e5c22b39baa tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.381s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:48:26 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0306d82c-03b2-4199-bdab-4e5c22b39baa tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '23063363630643961', 'path': '/dev/sdc'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:48:26 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0306d82c-03b2-4199-bdab-4e5c22b39baa tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063363630643961', 'path': '/dev/sdc'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 05:48:26 user nova-compute[73391]: DEBUG nova.objects.instance [None req-0306d82c-03b2-4199-bdab-4e5c22b39baa tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lazy-loading 'flavor' on Instance uuid c043ca2f-6468-4b32-ae53-40da261fd1fa {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:48:26 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-0306d82c-03b2-4199-bdab-4e5c22b39baa tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 05:48:26 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:48:26 user nova-compute[73391]:   <source dev="/dev/sdc"/>
Aug 15 05:48:26 user nova-compute[73391]:   <target dev="vdc" bus="virtio"/>
Aug 15 05:48:26 user nova-compute[73391]:   <serial>7354f3aa-003f-4e3b-9b71-272de6f13c81</serial>
Aug 15 05:48:26 user nova-compute[73391]: </disk>
Aug 15 05:48:26 user nova-compute[73391]:  {{(pid=73391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 05:48:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c043ca2f-6468-4b32-ae53-40da261fd1fa/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:27 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0306d82c-03b2-4199-bdab-4e5c22b39baa tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:48:27 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0306d82c-03b2-4199-bdab-4e5c22b39baa tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:48:27 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0306d82c-03b2-4199-bdab-4e5c22b39baa tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:48:27 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0306d82c-03b2-4199-bdab-4e5c22b39baa tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] No VIF found with MAC fa:16:3e:56:33:74, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:48:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c043ca2f-6468-4b32-ae53-40da261fd1fa/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c043ca2f-6468-4b32-ae53-40da261fd1fa/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0306d82c-03b2-4199-bdab-4e5c22b39baa tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "c043ca2f-6468-4b32-ae53-40da261fd1fa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.925s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:48:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c043ca2f-6468-4b32-ae53-40da261fd1fa/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:27 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:48:28 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:48:28 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:48:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Hypervisor/Node resource view: name=user free_ram=7628MB free_disk=24.942386627197266GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-23a2c8ff-46ff-48e8-a991-ddfc9acdda19 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Acquiring lock "c043ca2f-6468-4b32-ae53-40da261fd1fa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-23a2c8ff-46ff-48e8-a991-ddfc9acdda19 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "c043ca2f-6468-4b32-ae53-40da261fd1fa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:48:28 user nova-compute[73391]: INFO nova.compute.manager [None req-23a2c8ff-46ff-48e8-a991-ddfc9acdda19 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Detaching volume ffbb80ff-9421-4e66-ab2c-91d3c28e364b
Aug 15 05:48:28 user nova-compute[73391]: INFO nova.virt.block_device [None req-23a2c8ff-46ff-48e8-a991-ddfc9acdda19 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Attempting to driver detach volume ffbb80ff-9421-4e66-ab2c-91d3c28e364b from mountpoint /dev/vdb
Aug 15 05:48:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-23a2c8ff-46ff-48e8-a991-ddfc9acdda19 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Attempting to detach device vdb from instance c043ca2f-6468-4b32-ae53-40da261fd1fa from the persistent domain config. {{(pid=73391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-23a2c8ff-46ff-48e8-a991-ddfc9acdda19 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 05:48:28 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:48:28 user nova-compute[73391]:   <source dev="/dev/sdb"/>
Aug 15 05:48:28 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:48:28 user nova-compute[73391]:   <serial>ffbb80ff-9421-4e66-ab2c-91d3c28e364b</serial>
Aug 15 05:48:28 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 05:48:28 user nova-compute[73391]: </disk>
Aug 15 05:48:28 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 05:48:28 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-23a2c8ff-46ff-48e8-a991-ddfc9acdda19 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Successfully detached device vdb from instance c043ca2f-6468-4b32-ae53-40da261fd1fa from the persistent domain config.
Aug 15 05:48:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-23a2c8ff-46ff-48e8-a991-ddfc9acdda19 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c043ca2f-6468-4b32-ae53-40da261fd1fa from the live domain config. {{(pid=73391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-23a2c8ff-46ff-48e8-a991-ddfc9acdda19 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 05:48:28 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:48:28 user nova-compute[73391]:   <source dev="/dev/sdb"/>
Aug 15 05:48:28 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:48:28 user nova-compute[73391]:   <serial>ffbb80ff-9421-4e66-ab2c-91d3c28e364b</serial>
Aug 15 05:48:28 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 05:48:28 user nova-compute[73391]: </disk>
Aug 15 05:48:28 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 8f08782b-f793-415e-b0d6-5caad1c3d426 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 6ac9d5dc-56be-402f-b9d4-3327bdfd9220 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 730890c6-6999-4a0f-b80c-e4745bff99ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 8ff2da51-5bfd-4cdc-8cef-330cdef93d97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance e8775490-2a9e-44ac-aad7-9450afa4c295 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance c5d5343f-b8f4-46b7-92fc-66452212192b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance c043ca2f-6468-4b32-ae53-40da261fd1fa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance d85a919d-7f44-4093-b89a-51397ad5cedb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance fecde5f1-88fb-48b0-b039-93fdb285c93c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Compute_service record updated for user:user {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.545s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Received event <DeviceRemovedEvent: 1692078508.6053727, c043ca2f-6468-4b32-ae53-40da261fd1fa => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73391) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-23a2c8ff-46ff-48e8-a991-ddfc9acdda19 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c043ca2f-6468-4b32-ae53-40da261fd1fa {{(pid=73391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 05:48:28 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-23a2c8ff-46ff-48e8-a991-ddfc9acdda19 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Successfully detached device vdb from instance c043ca2f-6468-4b32-ae53-40da261fd1fa from the live domain config.
Aug 15 05:48:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23a2c8ff-46ff-48e8-a991-ddfc9acdda19 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a2c8ff-46ff-48e8-a991-ddfc9acdda19 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:ffbb80ff-9421-4e66-ab2c-91d3c28e364b'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZvAbJtMn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:48:28 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-23a2c8ff-46ff-48e8-a991-ddfc9acdda19 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:48:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-23a2c8ff-46ff-48e8-a991-ddfc9acdda19 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-23a2c8ff-46ff-48e8-a991-ddfc9acdda19 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a2c8ff-46ff-48e8-a991-ddfc9acdda19 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ffbb80ff-9421-4e66-ab2c-91d3c28e364b', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f932c56-44ae-457c-815b-e2a4b7211001]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7354f3aa-003f-4e3b-9b71-272de6f13c81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffbb80ff-9421-4e66-ab2c-91d3c28e364b\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d50f5f-5e4c-4148-a4b8-11dd1b1a8b58]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbb80ff-9421-4e66-ab2c-91d3c28e364b (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7354f3aa-003f-4e3b-9b71-272de6f13c81 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a2c8ff-46ff-48e8-a991-ddfc9acdda19 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)
Aug 15 05:48:28 user nova-compute[73391]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbb80ff-9421-4e66-ab2c-91d3c28e364b (non-flash)
Aug 15 05:48:28 user nova-compute[73391]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7354f3aa-003f-4e3b-9b71-272de6f13c81 (non-flash)
Aug 15 05:48:28 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a2c8ff-46ff-48e8-a991-ddfc9acdda19 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)
Aug 15 05:48:28 user nova-compute[73391]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffbb80ff-9421-4e66-ab2c-91d3c28e364b (non-flash)
Aug 15 05:48:28 user nova-compute[73391]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7354f3aa-003f-4e3b-9b71-272de6f13c81 (non-flash)
Aug 15 05:48:28 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a2c8ff-46ff-48e8-a991-ddfc9acdda19 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7748221b40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ffbb80ff-9421-4e66-ab2c-91d3c28e364b'): ({'sdb'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-23a2c8ff-46ff-48e8-a991-ddfc9acdda19 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Removing single pathed devices sdb {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa3b944-ea79-4c0b-b8a2-6e997905be3c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb49055-2198-43a5-8396-d8a6f57970d6]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-23a2c8ff-46ff-48e8-a991-ddfc9acdda19 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Flushing IO for device /dev/sdb {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2810d5f8-5f05-4d75-a46b-f754f8df5759]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-23a2c8ff-46ff-48e8-a991-ddfc9acdda19 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.052s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a211a460-d495-4009-a225-471aa9294328]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-23a2c8ff-46ff-48e8-a991-ddfc9acdda19 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-23a2c8ff-46ff-48e8-a991-ddfc9acdda19 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] SCSI volumes sdb have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a2c8ff-46ff-48e8-a991-ddfc9acdda19 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ffbb80ff-9421-4e66-ab2c-91d3c28e364b')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffbb80ff-9421-4e66-ab2c-91d3c28e364b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffbb80ff-9421-4e66-ab2c-91d3c28e364b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0db81c-d588-4349-b05c-c03a78d1ada9]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a2c8ff-46ff-48e8-a991-ddfc9acdda19 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffbb80ff-9421-4e66-ab2c-91d3c28e364b -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffbb80ff-9421-4e66-ab2c-91d3c28e364b -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e367f6e-6fcb-48ac-a293-d299e1689884]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:ffbb80ff-9421-4e66-ab2c-91d3c28e364b, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:ffbb80ff-9421-4e66-ab2c-91d3c28e364b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a2c8ff-46ff-48e8-a991-ddfc9acdda19 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:ffbb80ff-9421-4e66-ab2c-91d3c28e364b, portal: 172.16.0.220,3260]
Aug 15 05:48:28 user nova-compute[73391]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:ffbb80ff-9421-4e66-ab2c-91d3c28e364b, portal: 172.16.0.220,3260] successful.
Aug 15 05:48:28 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffbb80ff-9421-4e66-ab2c-91d3c28e364b -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffbb80ff-9421-4e66-ab2c-91d3c28e364b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c4408b-ae8f-4fc2-9385-c2de5bfb0545]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a2c8ff-46ff-48e8-a991-ddfc9acdda19 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-23a2c8ff-46ff-48e8-a991-ddfc9acdda19 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-23a2c8ff-46ff-48e8-a991-ddfc9acdda19 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] <== disconnect_volume: return (291ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:48:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23a2c8ff-46ff-48e8-a991-ddfc9acdda19 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 05:48:29 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:48:29 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:48:29 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Starting heal instance info cache {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 05:48:29 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Rebuilding the list of instances to heal {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 05:48:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "refresh_cache-8f08782b-f793-415e-b0d6-5caad1c3d426" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:48:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquired lock "refresh_cache-8f08782b-f793-415e-b0d6-5caad1c3d426" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:48:29 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Forcefully refreshing network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 05:48:29 user nova-compute[73391]: DEBUG nova.objects.instance [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lazy-loading 'info_cache' on Instance uuid 8f08782b-f793-415e-b0d6-5caad1c3d426 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:48:29 user nova-compute[73391]: DEBUG nova.objects.instance [None req-23a2c8ff-46ff-48e8-a991-ddfc9acdda19 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lazy-loading 'flavor' on Instance uuid c043ca2f-6468-4b32-ae53-40da261fd1fa {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:48:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-23a2c8ff-46ff-48e8-a991-ddfc9acdda19 tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "c043ca2f-6468-4b32-ae53-40da261fd1fa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.688s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:48:29 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:48:30 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Updating instance_info_cache with network_info: [{"id": "13c5a27d-b6c3-424b-a876-068d047fad28", "address": "fa:16:3e:61:0b:53", "network": {"id": "70d88082-aea7-48bb-abb4-d77d264aaf01", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b9acbe11654053bb905e7c92558a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c5a27d-b6", "ovs_interfaceid": "13c5a27d-b6c3-424b-a876-068d047fad28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:48:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Releasing lock "refresh_cache-8f08782b-f793-415e-b0d6-5caad1c3d426" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:48:30 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Updated the network info_cache for instance {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 05:48:30 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:48:30 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:48:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-65fda2ab-9b9c-4b0a-8068-140629fc5faf tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Acquiring lock "c043ca2f-6468-4b32-ae53-40da261fd1fa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:48:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-65fda2ab-9b9c-4b0a-8068-140629fc5faf tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "c043ca2f-6468-4b32-ae53-40da261fd1fa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:48:30 user nova-compute[73391]: INFO nova.compute.manager [None req-65fda2ab-9b9c-4b0a-8068-140629fc5faf tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Detaching volume 7354f3aa-003f-4e3b-9b71-272de6f13c81
Aug 15 05:48:30 user nova-compute[73391]: INFO nova.virt.block_device [None req-65fda2ab-9b9c-4b0a-8068-140629fc5faf tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Attempting to driver detach volume 7354f3aa-003f-4e3b-9b71-272de6f13c81 from mountpoint /dev/vdc
Aug 15 05:48:30 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-65fda2ab-9b9c-4b0a-8068-140629fc5faf tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Attempting to detach device vdc from instance c043ca2f-6468-4b32-ae53-40da261fd1fa from the persistent domain config. {{(pid=73391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 05:48:30 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-65fda2ab-9b9c-4b0a-8068-140629fc5faf tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 05:48:30 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:48:30 user nova-compute[73391]:   <source dev="/dev/sdc"/>
Aug 15 05:48:30 user nova-compute[73391]:   <target dev="vdc" bus="virtio"/>
Aug 15 05:48:30 user nova-compute[73391]:   <serial>7354f3aa-003f-4e3b-9b71-272de6f13c81</serial>
Aug 15 05:48:30 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 15 05:48:30 user nova-compute[73391]: </disk>
Aug 15 05:48:30 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 05:48:30 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-65fda2ab-9b9c-4b0a-8068-140629fc5faf tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Successfully detached device vdc from instance c043ca2f-6468-4b32-ae53-40da261fd1fa from the persistent domain config.
Aug 15 05:48:30 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-65fda2ab-9b9c-4b0a-8068-140629fc5faf tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance c043ca2f-6468-4b32-ae53-40da261fd1fa from the live domain config. {{(pid=73391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 05:48:30 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-65fda2ab-9b9c-4b0a-8068-140629fc5faf tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 05:48:30 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:48:30 user nova-compute[73391]:   <source dev="/dev/sdc"/>
Aug 15 05:48:30 user nova-compute[73391]:   <target dev="vdc" bus="virtio"/>
Aug 15 05:48:30 user nova-compute[73391]:   <serial>7354f3aa-003f-4e3b-9b71-272de6f13c81</serial>
Aug 15 05:48:30 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Aug 15 05:48:30 user nova-compute[73391]: </disk>
Aug 15 05:48:30 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 05:48:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:48:30 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Received event <DeviceRemovedEvent: 1692078510.9296236, c043ca2f-6468-4b32-ae53-40da261fd1fa => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=73391) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 05:48:30 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-65fda2ab-9b9c-4b0a-8068-140629fc5faf tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance c043ca2f-6468-4b32-ae53-40da261fd1fa {{(pid=73391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 05:48:30 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-65fda2ab-9b9c-4b0a-8068-140629fc5faf tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Successfully detached device vdc from instance c043ca2f-6468-4b32-ae53-40da261fd1fa from the live domain config.
Aug 15 05:48:30 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65fda2ab-9b9c-4b0a-8068-140629fc5faf tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 05:48:30 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-65fda2ab-9b9c-4b0a-8068-140629fc5faf tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:7354f3aa-003f-4e3b-9b71-272de6f13c81'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zBITCNhn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:48:30 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-65fda2ab-9b9c-4b0a-8068-140629fc5faf tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:48:30 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-65fda2ab-9b9c-4b0a-8068-140629fc5faf tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:48:30 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-65fda2ab-9b9c-4b0a-8068-140629fc5faf tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:48:30 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-65fda2ab-9b9c-4b0a-8068-140629fc5faf tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7354f3aa-003f-4e3b-9b71-272de6f13c81', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 05:48:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:30 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3851fa90-5692-4f0d-8c3e-7b12790a87f7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7354f3aa-003f-4e3b-9b71-272de6f13c81\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:30 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6c8681-1877-4207-9a89-86624840cdfc]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7354f3aa-003f-4e3b-9b71-272de6f13c81 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:30 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-65fda2ab-9b9c-4b0a-8068-140629fc5faf tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)
Aug 15 05:48:30 user nova-compute[73391]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7354f3aa-003f-4e3b-9b71-272de6f13c81 (non-flash)
Aug 15 05:48:30 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:48:30 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-65fda2ab-9b9c-4b0a-8068-140629fc5faf tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)
Aug 15 05:48:30 user nova-compute[73391]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7354f3aa-003f-4e3b-9b71-272de6f13c81 (non-flash)
Aug 15 05:48:30 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:48:30 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-65fda2ab-9b9c-4b0a-8068-140629fc5faf tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7728184670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7354f3aa-003f-4e3b-9b71-272de6f13c81'): ({'sdc'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 05:48:30 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-65fda2ab-9b9c-4b0a-8068-140629fc5faf tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Removing single pathed devices sdc {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 05:48:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b46f3eda-7f5b-4a4e-b5a6-94422ca28d0f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9632d010-6486-44c6-aaed-3f14d4b2a1ac]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:31 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-65fda2ab-9b9c-4b0a-8068-140629fc5faf tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Flushing IO for device /dev/sdc {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 05:48:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[78708c48-d52c-4a99-9c04-9c7c79cb827f]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:31 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-65fda2ab-9b9c-4b0a-8068-140629fc5faf tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 05:48:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1188380-c75d-4a96-8482-315a76eac5f7]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:31 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-65fda2ab-9b9c-4b0a-8068-140629fc5faf tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 05:48:31 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-65fda2ab-9b9c-4b0a-8068-140629fc5faf tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] SCSI volumes sdc have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 05:48:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-65fda2ab-9b9c-4b0a-8068-140629fc5faf tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7354f3aa-003f-4e3b-9b71-272de6f13c81')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 05:48:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7354f3aa-003f-4e3b-9b71-272de6f13c81 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7354f3aa-003f-4e3b-9b71-272de6f13c81 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[401c50dc-88e0-4152-8d81-5202df1b51a1]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-65fda2ab-9b9c-4b0a-8068-140629fc5faf tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:48:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7354f3aa-003f-4e3b-9b71-272de6f13c81 -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7354f3aa-003f-4e3b-9b71-272de6f13c81 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe24aca5-8feb-4fe4-9ef9-d954249093c5]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:7354f3aa-003f-4e3b-9b71-272de6f13c81, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:7354f3aa-003f-4e3b-9b71-272de6f13c81, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-65fda2ab-9b9c-4b0a-8068-140629fc5faf tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:7354f3aa-003f-4e3b-9b71-272de6f13c81, portal: 172.16.0.220,3260]
Aug 15 05:48:31 user nova-compute[73391]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:7354f3aa-003f-4e3b-9b71-272de6f13c81, portal: 172.16.0.220,3260] successful.
Aug 15 05:48:31 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:48:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7354f3aa-003f-4e3b-9b71-272de6f13c81 -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7354f3aa-003f-4e3b-9b71-272de6f13c81 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5325853c-5d4d-4795-be58-cdcf99c621c0]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-65fda2ab-9b9c-4b0a-8068-140629fc5faf tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:48:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-65fda2ab-9b9c-4b0a-8068-140629fc5faf tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.263s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:48:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-65fda2ab-9b9c-4b0a-8068-140629fc5faf tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] <== disconnect_volume: return (264ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:48:31 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65fda2ab-9b9c-4b0a-8068-140629fc5faf tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 05:48:31 user nova-compute[73391]: DEBUG nova.objects.instance [None req-65fda2ab-9b9c-4b0a-8068-140629fc5faf tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lazy-loading 'flavor' on Instance uuid c043ca2f-6468-4b32-ae53-40da261fd1fa {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:48:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-65fda2ab-9b9c-4b0a-8068-140629fc5faf tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "c043ca2f-6468-4b32-ae53-40da261fd1fa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.572s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:48:32 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:48:32 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:48:32 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 05:48:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-b57fb2a3-b615-4757-8136-67682302ab0a tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Acquiring lock "c043ca2f-6468-4b32-ae53-40da261fd1fa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:48:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-b57fb2a3-b615-4757-8136-67682302ab0a tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "c043ca2f-6468-4b32-ae53-40da261fd1fa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:48:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-b57fb2a3-b615-4757-8136-67682302ab0a tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Acquiring lock "c043ca2f-6468-4b32-ae53-40da261fd1fa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:48:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-b57fb2a3-b615-4757-8136-67682302ab0a tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "c043ca2f-6468-4b32-ae53-40da261fd1fa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:48:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-b57fb2a3-b615-4757-8136-67682302ab0a tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "c043ca2f-6468-4b32-ae53-40da261fd1fa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:48:33 user nova-compute[73391]: INFO nova.compute.manager [None req-b57fb2a3-b615-4757-8136-67682302ab0a tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Terminating instance
Aug 15 05:48:33 user nova-compute[73391]: DEBUG nova.compute.manager [None req-b57fb2a3-b615-4757-8136-67682302ab0a tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Start destroying the instance on the hypervisor. {{(pid=73391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 05:48:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:48:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:48:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:48:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:48:33 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Instance destroyed successfully.
Aug 15 05:48:33 user nova-compute[73391]: DEBUG nova.objects.instance [None req-b57fb2a3-b615-4757-8136-67682302ab0a tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lazy-loading 'resources' on Instance uuid c043ca2f-6468-4b32-ae53-40da261fd1fa {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:48:33 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-b57fb2a3-b615-4757-8136-67682302ab0a tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:46:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-496164599',display_name='tempest-AttachVolumeTestJSON-server-496164599',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-496164599',id=36,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBElvPkTX4381T4Wb55ypwBw8/CJ1olD+kxdnn30P0DQ3o/nxtf0e9aCDlGQ9X6LUsMvM0abg1mcHFH2ya++sTl/qlW8tjZ0A1o/PTJ9H6ifvsi7j4RpokC3s4TVPAq9mWA==',key_name='tempest-keypair-608359081',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:46:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f88922b3c294aea9efa3d80909a171a',ramdisk_id='',reservation_id='r-fheq6edc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-629721707',owner_user_name='tempest-AttachVolumeTestJSON-629721707-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:46:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='02352e5b84f04d0e9975b8b8e5594b92',uuid=c043ca2f-6468-4b32-ae53-40da261fd1fa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8919b46b-766f-4499-8179-1d8538dba72e", "address": "fa:16:3e:56:33:74", "network": {"id": "c94dfbf4-6803-458e-b2c6-231298da7bc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090354282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f88922b3c294aea9efa3d80909a171a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8919b46b-76", "ovs_interfaceid": "8919b46b-766f-4499-8179-1d8538dba72e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:48:33 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-b57fb2a3-b615-4757-8136-67682302ab0a tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Converting VIF {"id": "8919b46b-766f-4499-8179-1d8538dba72e", "address": "fa:16:3e:56:33:74", "network": {"id": "c94dfbf4-6803-458e-b2c6-231298da7bc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2090354282-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.76", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f88922b3c294aea9efa3d80909a171a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8919b46b-76", "ovs_interfaceid": "8919b46b-766f-4499-8179-1d8538dba72e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:48:33 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-b57fb2a3-b615-4757-8136-67682302ab0a tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:33:74,bridge_name='br-int',has_traffic_filtering=True,id=8919b46b-766f-4499-8179-1d8538dba72e,network=Network(c94dfbf4-6803-458e-b2c6-231298da7bc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8919b46b-76') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:48:33 user nova-compute[73391]: DEBUG os_vif [None req-b57fb2a3-b615-4757-8136-67682302ab0a tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:33:74,bridge_name='br-int',has_traffic_filtering=True,id=8919b46b-766f-4499-8179-1d8538dba72e,network=Network(c94dfbf4-6803-458e-b2c6-231298da7bc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8919b46b-76') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:48:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:48:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8919b46b-76, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:48:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:48:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:48:33 user nova-compute[73391]: INFO os_vif [None req-b57fb2a3-b615-4757-8136-67682302ab0a tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:33:74,bridge_name='br-int',has_traffic_filtering=True,id=8919b46b-766f-4499-8179-1d8538dba72e,network=Network(c94dfbf4-6803-458e-b2c6-231298da7bc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8919b46b-76')
Aug 15 05:48:33 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-b57fb2a3-b615-4757-8136-67682302ab0a tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Deleting instance files /opt/stack/data/nova/instances/c043ca2f-6468-4b32-ae53-40da261fd1fa_del
Aug 15 05:48:33 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-b57fb2a3-b615-4757-8136-67682302ab0a tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Deletion of /opt/stack/data/nova/instances/c043ca2f-6468-4b32-ae53-40da261fd1fa_del complete
Aug 15 05:48:33 user nova-compute[73391]: INFO nova.compute.manager [None req-b57fb2a3-b615-4757-8136-67682302ab0a tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 15 05:48:33 user nova-compute[73391]: DEBUG oslo.service.loopingcall [None req-b57fb2a3-b615-4757-8136-67682302ab0a tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 05:48:33 user nova-compute[73391]: DEBUG nova.compute.manager [-] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Deallocating network for instance {{(pid=73391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 05:48:33 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] deallocate_for_instance() {{(pid=73391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 05:48:34 user nova-compute[73391]: DEBUG nova.compute.manager [req-9ee669cb-e821-4b91-ad5d-30b5ad85218b req-1f6c67f5-6433-4fea-b98e-fbce28d0ffa7 service nova] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Received event network-vif-unplugged-8919b46b-766f-4499-8179-1d8538dba72e {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:48:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-9ee669cb-e821-4b91-ad5d-30b5ad85218b req-1f6c67f5-6433-4fea-b98e-fbce28d0ffa7 service nova] Acquiring lock "c043ca2f-6468-4b32-ae53-40da261fd1fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:48:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-9ee669cb-e821-4b91-ad5d-30b5ad85218b req-1f6c67f5-6433-4fea-b98e-fbce28d0ffa7 service nova] Lock "c043ca2f-6468-4b32-ae53-40da261fd1fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:48:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-9ee669cb-e821-4b91-ad5d-30b5ad85218b req-1f6c67f5-6433-4fea-b98e-fbce28d0ffa7 service nova] Lock "c043ca2f-6468-4b32-ae53-40da261fd1fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:48:34 user nova-compute[73391]: DEBUG nova.compute.manager [req-9ee669cb-e821-4b91-ad5d-30b5ad85218b req-1f6c67f5-6433-4fea-b98e-fbce28d0ffa7 service nova] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] No waiting events found dispatching network-vif-unplugged-8919b46b-766f-4499-8179-1d8538dba72e {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:48:34 user nova-compute[73391]: DEBUG nova.compute.manager [req-9ee669cb-e821-4b91-ad5d-30b5ad85218b req-1f6c67f5-6433-4fea-b98e-fbce28d0ffa7 service nova] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Received event network-vif-unplugged-8919b46b-766f-4499-8179-1d8538dba72e for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 05:48:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:48:35 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:48:35 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Took 1.26 seconds to deallocate network for instance.
Aug 15 05:48:35 user nova-compute[73391]: DEBUG nova.compute.manager [req-4409be1a-e72b-4ef4-99a1-f073ecbddd64 req-bcd5989d-9eb4-4065-9928-7d893450f252 service nova] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Received event network-vif-deleted-8919b46b-766f-4499-8179-1d8538dba72e {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:48:35 user nova-compute[73391]: INFO nova.compute.manager [req-4409be1a-e72b-4ef4-99a1-f073ecbddd64 req-bcd5989d-9eb4-4065-9928-7d893450f252 service nova] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Neutron deleted interface 8919b46b-766f-4499-8179-1d8538dba72e; detaching it from the instance and deleting it from the info cache
Aug 15 05:48:35 user nova-compute[73391]: DEBUG nova.network.neutron [req-4409be1a-e72b-4ef4-99a1-f073ecbddd64 req-bcd5989d-9eb4-4065-9928-7d893450f252 service nova] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:48:35 user nova-compute[73391]: DEBUG nova.compute.manager [req-4409be1a-e72b-4ef4-99a1-f073ecbddd64 req-bcd5989d-9eb4-4065-9928-7d893450f252 service nova] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Detach interface failed, port_id=8919b46b-766f-4499-8179-1d8538dba72e, reason: Instance c043ca2f-6468-4b32-ae53-40da261fd1fa could not be found. {{(pid=73391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 05:48:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-b57fb2a3-b615-4757-8136-67682302ab0a tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:48:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-b57fb2a3-b615-4757-8136-67682302ab0a tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:48:35 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-b57fb2a3-b615-4757-8136-67682302ab0a tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:48:35 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-b57fb2a3-b615-4757-8136-67682302ab0a tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:48:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-b57fb2a3-b615-4757-8136-67682302ab0a tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.324s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:48:35 user nova-compute[73391]: INFO nova.scheduler.client.report [None req-b57fb2a3-b615-4757-8136-67682302ab0a tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Deleted allocations for instance c043ca2f-6468-4b32-ae53-40da261fd1fa
Aug 15 05:48:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-b57fb2a3-b615-4757-8136-67682302ab0a tempest-AttachVolumeTestJSON-629721707 tempest-AttachVolumeTestJSON-629721707-project-member] Lock "c043ca2f-6468-4b32-ae53-40da261fd1fa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.632s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:48:36 user nova-compute[73391]: DEBUG nova.compute.manager [req-ddb2c89b-1021-443c-935f-f5e3fc4961a7 req-b6807e60-db36-464c-80ea-95d8fe51ce74 service nova] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Received event network-vif-plugged-8919b46b-766f-4499-8179-1d8538dba72e {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:48:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ddb2c89b-1021-443c-935f-f5e3fc4961a7 req-b6807e60-db36-464c-80ea-95d8fe51ce74 service nova] Acquiring lock "c043ca2f-6468-4b32-ae53-40da261fd1fa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:48:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ddb2c89b-1021-443c-935f-f5e3fc4961a7 req-b6807e60-db36-464c-80ea-95d8fe51ce74 service nova] Lock "c043ca2f-6468-4b32-ae53-40da261fd1fa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:48:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ddb2c89b-1021-443c-935f-f5e3fc4961a7 req-b6807e60-db36-464c-80ea-95d8fe51ce74 service nova] Lock "c043ca2f-6468-4b32-ae53-40da261fd1fa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:48:36 user nova-compute[73391]: DEBUG nova.compute.manager [req-ddb2c89b-1021-443c-935f-f5e3fc4961a7 req-b6807e60-db36-464c-80ea-95d8fe51ce74 service nova] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] No waiting events found dispatching network-vif-plugged-8919b46b-766f-4499-8179-1d8538dba72e {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:48:36 user nova-compute[73391]: WARNING nova.compute.manager [req-ddb2c89b-1021-443c-935f-f5e3fc4961a7 req-b6807e60-db36-464c-80ea-95d8fe51ce74 service nova] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Received unexpected event network-vif-plugged-8919b46b-766f-4499-8179-1d8538dba72e for instance with vm_state deleted and task_state None.
Aug 15 05:48:37 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-283e92a2-9149-4d25-a62e-1d411f3ef1ba tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 05:48:37 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-283e92a2-9149-4d25-a62e-1d411f3ef1ba tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'THLbReou', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:48:37 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-283e92a2-9149-4d25-a62e-1d411f3ef1ba tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:48:37 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-283e92a2-9149-4d25-a62e-1d411f3ef1ba tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:48:37 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-283e92a2-9149-4d25-a62e-1d411f3ef1ba tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:48:37 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-283e92a2-9149-4d25-a62e-1d411f3ef1ba tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:48:37 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-283e92a2-9149-4d25-a62e-1d411f3ef1ba tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:48:37 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-283e92a2-9149-4d25-a62e-1d411f3ef1ba tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:48:37 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-283e92a2-9149-4d25-a62e-1d411f3ef1ba tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 05:48:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52 -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:37 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[166d8cdd-ba45-452d-a570-e80b395f384e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:37 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-283e92a2-9149-4d25-a62e-1d411f3ef1ba tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 05:48:37 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:48:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52 -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:37 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[327233f2-db10-48c4-86b7-7d25f184b803]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:37 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-283e92a2-9149-4d25-a62e-1d411f3ef1ba tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52] added
Aug 15 05:48:37 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:48:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:37 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[36fbc843-5e08-4a44-9ec2-becf8b4214ab]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:37 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-283e92a2-9149-4d25-a62e-1d411f3ef1ba tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:48:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:37 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e05c876-f5ff-4a7d-9f04-d6e80f771eb7]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:37 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-283e92a2-9149-4d25-a62e-1d411f3ef1ba tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:48:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v THLbReou {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v THLbReou" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:37 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d91eb3a3-bfd8-474c-b83b-c1b854c2d78a]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:37 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-283e92a2-9149-4d25-a62e-1d411f3ef1ba tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'THLbReou'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:48:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:37 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5bee0c8-1022-4031-8e32-923a65a8e314]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:37 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-283e92a2-9149-4d25-a62e-1d411f3ef1ba tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:48:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:37 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e350ed4f-1951-4c29-882c-71732f2c9546 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "c5d5343f-b8f4-46b7-92fc-66452212192b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:48:37 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e350ed4f-1951-4c29-882c-71732f2c9546 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "c5d5343f-b8f4-46b7-92fc-66452212192b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:48:37 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e350ed4f-1951-4c29-882c-71732f2c9546 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "c5d5343f-b8f4-46b7-92fc-66452212192b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:48:37 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e350ed4f-1951-4c29-882c-71732f2c9546 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "c5d5343f-b8f4-46b7-92fc-66452212192b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:48:37 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e350ed4f-1951-4c29-882c-71732f2c9546 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "c5d5343f-b8f4-46b7-92fc-66452212192b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:48:37 user nova-compute[73391]: INFO nova.compute.manager [None req-e350ed4f-1951-4c29-882c-71732f2c9546 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Terminating instance
Aug 15 05:48:37 user nova-compute[73391]: DEBUG nova.compute.manager [None req-e350ed4f-1951-4c29-882c-71732f2c9546 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Start destroying the instance on the hypervisor. {{(pid=73391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 05:48:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:37 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[63cd1328-51b2-4277-bb79-6aace786a20c]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:37 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-283e92a2-9149-4d25-a62e-1d411f3ef1ba tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)
Aug 15 05:48:37 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:48:37 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-283e92a2-9149-4d25-a62e-1d411f3ef1ba tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)
Aug 15 05:48:37 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:48:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52 -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:38 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:48:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:38 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ad02e9-805f-46ac-9ef4-ec80fa1a5d50]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:38 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-283e92a2-9149-4d25-a62e-1d411f3ef1ba tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52, portal: 172.16.0.220,3260]
Aug 15 05:48:38 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52, portal: 172.16.0.220,3260] successful.
Aug 15 05:48:38 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:48:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:38 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:48:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:38 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b8f1d8-ffa6-43f7-8519-b0e61cbca033]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:38 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-283e92a2-9149-4d25-a62e-1d411f3ef1ba tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:48:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:38 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:48:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:38 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7294551d-ff70-4ed9-aeca-6c3b8620e9e8]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:38 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-283e92a2-9149-4d25-a62e-1d411f3ef1ba tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)
Aug 15 05:48:38 user nova-compute[73391]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52 (non-flash)
Aug 15 05:48:38 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:48:38 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-283e92a2-9149-4d25-a62e-1d411f3ef1ba tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)
Aug 15 05:48:38 user nova-compute[73391]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52 (non-flash)
Aug 15 05:48:38 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:48:38 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-283e92a2-9149-4d25-a62e-1d411f3ef1ba tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.330s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:48:38 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-283e92a2-9149-4d25-a62e-1d411f3ef1ba tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 05:48:38 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-283e92a2-9149-4d25-a62e-1d411f3ef1ba tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 05:48:38 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-283e92a2-9149-4d25-a62e-1d411f3ef1ba tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 05:48:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:38 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:48:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:38 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70a6be2-ce4a-4967-9bb5-3e4c58376124]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:38 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-283e92a2-9149-4d25-a62e-1d411f3ef1ba tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:48:38 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-283e92a2-9149-4d25-a62e-1d411f3ef1ba tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'THLbReou', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 05:48:38 user nova-compute[73391]: DEBUG nova.compute.manager [req-dc457d5d-43a0-4fc8-8403-79c2dac289eb req-8b1d8c13-b680-4c05-bebc-9fb5a1a1d248 service nova] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Received event network-vif-unplugged-38e26266-d25b-4bbd-a6f1-00e0e81a1546 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:48:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-dc457d5d-43a0-4fc8-8403-79c2dac289eb req-8b1d8c13-b680-4c05-bebc-9fb5a1a1d248 service nova] Acquiring lock "c5d5343f-b8f4-46b7-92fc-66452212192b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:48:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-dc457d5d-43a0-4fc8-8403-79c2dac289eb req-8b1d8c13-b680-4c05-bebc-9fb5a1a1d248 service nova] Lock "c5d5343f-b8f4-46b7-92fc-66452212192b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:48:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-dc457d5d-43a0-4fc8-8403-79c2dac289eb req-8b1d8c13-b680-4c05-bebc-9fb5a1a1d248 service nova] Lock "c5d5343f-b8f4-46b7-92fc-66452212192b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:48:38 user nova-compute[73391]: DEBUG nova.compute.manager [req-dc457d5d-43a0-4fc8-8403-79c2dac289eb req-8b1d8c13-b680-4c05-bebc-9fb5a1a1d248 service nova] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] No waiting events found dispatching network-vif-unplugged-38e26266-d25b-4bbd-a6f1-00e0e81a1546 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:48:38 user nova-compute[73391]: DEBUG nova.compute.manager [req-dc457d5d-43a0-4fc8-8403-79c2dac289eb req-8b1d8c13-b680-4c05-bebc-9fb5a1a1d248 service nova] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Received event network-vif-unplugged-38e26266-d25b-4bbd-a6f1-00e0e81a1546 for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 05:48:38 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Instance destroyed successfully.
Aug 15 05:48:38 user nova-compute[73391]: DEBUG nova.objects.instance [None req-e350ed4f-1951-4c29-882c-71732f2c9546 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lazy-loading 'resources' on Instance uuid c5d5343f-b8f4-46b7-92fc-66452212192b {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:48:38 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-e350ed4f-1951-4c29-882c-71732f2c9546 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:43:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-338118993',display_name='tempest-TestVolumeBootPattern-volume-backed-server-338118993',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-338118993',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFW1+sIZoEFLnPpTAYg0EDhHAtQ7cAXqnax3NryaVFAhDZJvJk4/PvibupTMkUUe1lYjwH4MmmprxSarNF7d+jmyBd+M6obrkGwLFhUGDhHU97jtKvlwFhY2xUb8bLX+Qw==',key_name='tempest-keypair-1848848517',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:43:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8188c2e8ca34ef1982faa49f1058bb7',ramdisk_id='',reservation_id='r-ks0a21qu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1834029963',owner_user_name='tempest-TestVolumeBootPattern-1834029963-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:43:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='aefb6ccab586465dbe56e71a40bcf1f0',uuid=c5d5343f-b8f4-46b7-92fc-66452212192b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "38e26266-d25b-4bbd-a6f1-00e0e81a1546", "address": "fa:16:3e:ce:22:5a", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38e26266-d2", "ovs_interfaceid": "38e26266-d25b-4bbd-a6f1-00e0e81a1546", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:48:38 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-e350ed4f-1951-4c29-882c-71732f2c9546 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Converting VIF {"id": "38e26266-d25b-4bbd-a6f1-00e0e81a1546", "address": "fa:16:3e:ce:22:5a", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.152", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap38e26266-d2", "ovs_interfaceid": "38e26266-d25b-4bbd-a6f1-00e0e81a1546", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:48:38 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-e350ed4f-1951-4c29-882c-71732f2c9546 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:22:5a,bridge_name='br-int',has_traffic_filtering=True,id=38e26266-d25b-4bbd-a6f1-00e0e81a1546,network=Network(fae0e46a-88e4-499d-bcff-5b7df55eab4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38e26266-d2') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:48:38 user nova-compute[73391]: DEBUG os_vif [None req-e350ed4f-1951-4c29-882c-71732f2c9546 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:22:5a,bridge_name='br-int',has_traffic_filtering=True,id=38e26266-d25b-4bbd-a6f1-00e0e81a1546,network=Network(fae0e46a-88e4-499d-bcff-5b7df55eab4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38e26266-d2') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:48:38 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:48:38 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap38e26266-d2, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:48:38 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:48:38 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:48:38 user nova-compute[73391]: INFO os_vif [None req-e350ed4f-1951-4c29-882c-71732f2c9546 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:22:5a,bridge_name='br-int',has_traffic_filtering=True,id=38e26266-d25b-4bbd-a6f1-00e0e81a1546,network=Network(fae0e46a-88e4-499d-bcff-5b7df55eab4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38e26266-d2')
Aug 15 05:48:38 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e350ed4f-1951-4c29-882c-71732f2c9546 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 05:48:38 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e350ed4f-1951-4c29-882c-71732f2c9546 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WHJRNZTs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:48:38 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-e350ed4f-1951-4c29-882c-71732f2c9546 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:48:38 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-e350ed4f-1951-4c29-882c-71732f2c9546 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:48:39 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-283e92a2-9149-4d25-a62e-1d411f3ef1ba tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:48:39 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-283e92a2-9149-4d25-a62e-1d411f3ef1ba tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] <== connect_volume: return (1370ms) {'type': 'block', 'scsi_wwn': '23637363332356161', 'path': '/dev/sdb'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:48:39 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-283e92a2-9149-4d25-a62e-1d411f3ef1ba tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23637363332356161', 'path': '/dev/sdb'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 05:48:39 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-e350ed4f-1951-4c29-882c-71732f2c9546 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.378s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:48:39 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e350ed4f-1951-4c29-882c-71732f2c9546 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 05:48:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:39 user nova-compute[73391]: DEBUG nova.objects.instance [None req-283e92a2-9149-4d25-a62e-1d411f3ef1ba tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lazy-loading 'flavor' on Instance uuid d85a919d-7f44-4093-b89a-51397ad5cedb {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:48:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:39 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb2a0e9-6769-4556-8bdc-1a38b8b8867e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:39 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-283e92a2-9149-4d25-a62e-1d411f3ef1ba tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 05:48:39 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:48:39 user nova-compute[73391]:   <source dev="/dev/sdb"/>
Aug 15 05:48:39 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:48:39 user nova-compute[73391]:   <serial>3dc55180-bd5d-49cc-b3a5-81b73c5c9f52</serial>
Aug 15 05:48:39 user nova-compute[73391]: </disk>
Aug 15 05:48:39 user nova-compute[73391]:  {{(pid=73391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 05:48:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:39 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b3ecea-33a3-4764-a37e-a21648d3d933]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:39 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e350ed4f-1951-4c29-882c-71732f2c9546 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)
Aug 15 05:48:39 user nova-compute[73391]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52 (non-flash)
Aug 15 05:48:39 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:48:39 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e350ed4f-1951-4c29-882c-71732f2c9546 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 (non-flash)
Aug 15 05:48:39 user nova-compute[73391]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52 (non-flash)
Aug 15 05:48:39 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:48:39 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e350ed4f-1951-4c29-882c-71732f2c9546 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77284b55a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9'): ({'sdd'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 05:48:39 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-e350ed4f-1951-4c29-882c-71732f2c9546 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Removing single pathed devices sdd {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 05:48:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:39 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2712ce8-dab5-4b72-9d37-8032cb70ba15]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:39 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[946414d7-d0e0-4155-979a-50fc768f8c1d]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:39 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-e350ed4f-1951-4c29-882c-71732f2c9546 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Flushing IO for device /dev/sdd {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 05:48:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:39 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[721f2b92-755a-4c81-b65b-a7e4e6864202]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:39 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-e350ed4f-1951-4c29-882c-71732f2c9546 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 05:48:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.054s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:39 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97d5e79-c9c6-4371-b6f0-9c98cdb5eebf]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:39 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-e350ed4f-1951-4c29-882c-71732f2c9546 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 05:48:39 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-e350ed4f-1951-4c29-882c-71732f2c9546 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] SCSI volumes sdd have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 05:48:39 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e350ed4f-1951-4c29-882c-71732f2c9546 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 05:48:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:39 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d314b1c9-583b-443c-9d0f-9c6d1487686c]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:39 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e350ed4f-1951-4c29-882c-71732f2c9546 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:48:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:39 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c87012-4efc-4044-9bc2-99ba1fc55730]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:39 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e350ed4f-1951-4c29-882c-71732f2c9546 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9, portal: 172.16.0.220,3260]
Aug 15 05:48:39 user nova-compute[73391]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9, portal: 172.16.0.220,3260] successful.
Aug 15 05:48:39 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:48:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf1f66ba-446a-4c74-98ec-505477d901c9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:39 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1891d05-eac5-406d-a1cf-7ada54e6122c]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:39 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e350ed4f-1951-4c29-882c-71732f2c9546 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:48:39 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-e350ed4f-1951-4c29-882c-71732f2c9546 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.301s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:48:39 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e350ed4f-1951-4c29-882c-71732f2c9546 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] <== disconnect_volume: return (679ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:48:39 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e350ed4f-1951-4c29-882c-71732f2c9546 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 05:48:39 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-e350ed4f-1951-4c29-882c-71732f2c9546 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Deleting instance files /opt/stack/data/nova/instances/c5d5343f-b8f4-46b7-92fc-66452212192b_del
Aug 15 05:48:39 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-e350ed4f-1951-4c29-882c-71732f2c9546 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Deletion of /opt/stack/data/nova/instances/c5d5343f-b8f4-46b7-92fc-66452212192b_del complete
Aug 15 05:48:39 user nova-compute[73391]: INFO nova.compute.manager [None req-e350ed4f-1951-4c29-882c-71732f2c9546 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Took 1.57 seconds to destroy the instance on the hypervisor.
Aug 15 05:48:39 user nova-compute[73391]: DEBUG oslo.service.loopingcall [None req-e350ed4f-1951-4c29-882c-71732f2c9546 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 05:48:39 user nova-compute[73391]: DEBUG nova.compute.manager [-] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Deallocating network for instance {{(pid=73391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 05:48:39 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] deallocate_for_instance() {{(pid=73391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 05:48:39 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-283e92a2-9149-4d25-a62e-1d411f3ef1ba tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:48:39 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-283e92a2-9149-4d25-a62e-1d411f3ef1ba tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:48:39 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-283e92a2-9149-4d25-a62e-1d411f3ef1ba tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] No VIF found with MAC fa:16:3e:8a:49:2b, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:48:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-283e92a2-9149-4d25-a62e-1d411f3ef1ba tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "d85a919d-7f44-4093-b89a-51397ad5cedb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.215s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:48:40 user nova-compute[73391]: DEBUG nova.compute.manager [req-8b918c55-92fa-4e01-8cce-773c1d2e41c9 req-ee4d465e-a6fc-43dd-8f88-99c826809cac service nova] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Received event network-vif-plugged-38e26266-d25b-4bbd-a6f1-00e0e81a1546 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:48:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-8b918c55-92fa-4e01-8cce-773c1d2e41c9 req-ee4d465e-a6fc-43dd-8f88-99c826809cac service nova] Acquiring lock "c5d5343f-b8f4-46b7-92fc-66452212192b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:48:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-8b918c55-92fa-4e01-8cce-773c1d2e41c9 req-ee4d465e-a6fc-43dd-8f88-99c826809cac service nova] Lock "c5d5343f-b8f4-46b7-92fc-66452212192b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:48:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-8b918c55-92fa-4e01-8cce-773c1d2e41c9 req-ee4d465e-a6fc-43dd-8f88-99c826809cac service nova] Lock "c5d5343f-b8f4-46b7-92fc-66452212192b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:48:40 user nova-compute[73391]: DEBUG nova.compute.manager [req-8b918c55-92fa-4e01-8cce-773c1d2e41c9 req-ee4d465e-a6fc-43dd-8f88-99c826809cac service nova] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] No waiting events found dispatching network-vif-plugged-38e26266-d25b-4bbd-a6f1-00e0e81a1546 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:48:40 user nova-compute[73391]: WARNING nova.compute.manager [req-8b918c55-92fa-4e01-8cce-773c1d2e41c9 req-ee4d465e-a6fc-43dd-8f88-99c826809cac service nova] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Received unexpected event network-vif-plugged-38e26266-d25b-4bbd-a6f1-00e0e81a1546 for instance with vm_state active and task_state deleting.
Aug 15 05:48:40 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:48:40 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Took 0.97 seconds to deallocate network for instance.
Aug 15 05:48:40 user nova-compute[73391]: DEBUG nova.compute.manager [req-43059268-8e8b-4b52-b684-fc475b144117 req-ce58379c-520c-4744-a2e7-406960074410 service nova] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Received event network-vif-deleted-38e26266-d25b-4bbd-a6f1-00e0e81a1546 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:48:40 user nova-compute[73391]: INFO nova.compute.manager [req-43059268-8e8b-4b52-b684-fc475b144117 req-ce58379c-520c-4744-a2e7-406960074410 service nova] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Neutron deleted interface 38e26266-d25b-4bbd-a6f1-00e0e81a1546; detaching it from the instance and deleting it from the info cache
Aug 15 05:48:40 user nova-compute[73391]: DEBUG nova.network.neutron [req-43059268-8e8b-4b52-b684-fc475b144117 req-ce58379c-520c-4744-a2e7-406960074410 service nova] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:48:40 user nova-compute[73391]: DEBUG nova.compute.manager [req-43059268-8e8b-4b52-b684-fc475b144117 req-ce58379c-520c-4744-a2e7-406960074410 service nova] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Detach interface failed, port_id=38e26266-d25b-4bbd-a6f1-00e0e81a1546, reason: Instance c5d5343f-b8f4-46b7-92fc-66452212192b could not be found. {{(pid=73391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 05:48:40 user nova-compute[73391]: INFO nova.compute.manager [None req-943ccadd-eba8-4e60-bd75-cc1026b96b3e tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Rescuing
Aug 15 05:48:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-943ccadd-eba8-4e60-bd75-cc1026b96b3e tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Acquiring lock "refresh_cache-d85a919d-7f44-4093-b89a-51397ad5cedb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:48:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-943ccadd-eba8-4e60-bd75-cc1026b96b3e tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Acquired lock "refresh_cache-d85a919d-7f44-4093-b89a-51397ad5cedb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:48:40 user nova-compute[73391]: DEBUG nova.network.neutron [None req-943ccadd-eba8-4e60-bd75-cc1026b96b3e tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:48:41 user nova-compute[73391]: DEBUG nova.network.neutron [None req-943ccadd-eba8-4e60-bd75-cc1026b96b3e tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Updating instance_info_cache with network_info: [{"id": "d9ae0be2-05e7-4009-b909-713c8c52e5e5", "address": "fa:16:3e:8a:49:2b", "network": {"id": "bec69c6a-b2cb-4b0a-ba6e-ae6dae099818", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7da9448cc34b609120da564a01dba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ae0be2-05", "ovs_interfaceid": "d9ae0be2-05e7-4009-b909-713c8c52e5e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:48:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-943ccadd-eba8-4e60-bd75-cc1026b96b3e tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Releasing lock "refresh_cache-d85a919d-7f44-4093-b89a-51397ad5cedb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:48:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:48:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:48:41 user nova-compute[73391]: INFO nova.compute.manager [None req-e350ed4f-1951-4c29-882c-71732f2c9546 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Took 0.93 seconds to detach 1 volumes for instance.
Aug 15 05:48:41 user nova-compute[73391]: DEBUG nova.compute.manager [None req-e350ed4f-1951-4c29-882c-71732f2c9546 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Deleting volume: bf1f66ba-446a-4c74-98ec-505477d901c9 {{(pid=73391) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Aug 15 05:48:41 user nova-compute[73391]: DEBUG nova.compute.manager [req-361ebdd9-4f24-42eb-9f44-725c3c7db70c req-bc1ec62f-5929-4eb4-a8c1-f6ef8276d299 service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Received event network-vif-unplugged-d9ae0be2-05e7-4009-b909-713c8c52e5e5 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:48:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-361ebdd9-4f24-42eb-9f44-725c3c7db70c req-bc1ec62f-5929-4eb4-a8c1-f6ef8276d299 service nova] Acquiring lock "d85a919d-7f44-4093-b89a-51397ad5cedb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:48:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-361ebdd9-4f24-42eb-9f44-725c3c7db70c req-bc1ec62f-5929-4eb4-a8c1-f6ef8276d299 service nova] Lock "d85a919d-7f44-4093-b89a-51397ad5cedb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:48:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-361ebdd9-4f24-42eb-9f44-725c3c7db70c req-bc1ec62f-5929-4eb4-a8c1-f6ef8276d299 service nova] Lock "d85a919d-7f44-4093-b89a-51397ad5cedb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:48:41 user nova-compute[73391]: DEBUG nova.compute.manager [req-361ebdd9-4f24-42eb-9f44-725c3c7db70c req-bc1ec62f-5929-4eb4-a8c1-f6ef8276d299 service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] No waiting events found dispatching network-vif-unplugged-d9ae0be2-05e7-4009-b909-713c8c52e5e5 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:48:41 user nova-compute[73391]: WARNING nova.compute.manager [req-361ebdd9-4f24-42eb-9f44-725c3c7db70c req-bc1ec62f-5929-4eb4-a8c1-f6ef8276d299 service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Received unexpected event network-vif-unplugged-d9ae0be2-05e7-4009-b909-713c8c52e5e5 for instance with vm_state active and task_state rescuing.
Aug 15 05:48:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:48:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:48:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e350ed4f-1951-4c29-882c-71732f2c9546 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:48:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e350ed4f-1951-4c29-882c-71732f2c9546 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:48:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0a179dec-3cf7-48e0-bacd-a2e29520a082 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquiring lock "6ac9d5dc-56be-402f-b9d4-3327bdfd9220" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:48:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0a179dec-3cf7-48e0-bacd-a2e29520a082 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "6ac9d5dc-56be-402f-b9d4-3327bdfd9220" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:48:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0a179dec-3cf7-48e0-bacd-a2e29520a082 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquiring lock "6ac9d5dc-56be-402f-b9d4-3327bdfd9220-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:48:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0a179dec-3cf7-48e0-bacd-a2e29520a082 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "6ac9d5dc-56be-402f-b9d4-3327bdfd9220-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:48:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0a179dec-3cf7-48e0-bacd-a2e29520a082 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "6ac9d5dc-56be-402f-b9d4-3327bdfd9220-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:48:41 user nova-compute[73391]: INFO nova.compute.manager [None req-0a179dec-3cf7-48e0-bacd-a2e29520a082 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Terminating instance
Aug 15 05:48:41 user nova-compute[73391]: DEBUG nova.compute.manager [None req-0a179dec-3cf7-48e0-bacd-a2e29520a082 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Start destroying the instance on the hypervisor. {{(pid=73391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 05:48:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:48:41 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-e350ed4f-1951-4c29-882c-71732f2c9546 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-e350ed4f-1951-4c29-882c-71732f2c9546 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:48:42 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Instance destroyed successfully.
Aug 15 05:48:42 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-943ccadd-eba8-4e60-bd75-cc1026b96b3e tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Attempting rescue
Aug 15 05:48:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-943ccadd-eba8-4e60-bd75-cc1026b96b3e tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=73391) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e350ed4f-1951-4c29-882c-71732f2c9546 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.494s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-943ccadd-eba8-4e60-bd75-cc1026b96b3e tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Instance directory exists: not creating {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 05:48:42 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-943ccadd-eba8-4e60-bd75-cc1026b96b3e tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Creating image(s)
Aug 15 05:48:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-943ccadd-eba8-4e60-bd75-cc1026b96b3e tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Acquiring lock "/opt/stack/data/nova/instances/d85a919d-7f44-4093-b89a-51397ad5cedb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-943ccadd-eba8-4e60-bd75-cc1026b96b3e tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "/opt/stack/data/nova/instances/d85a919d-7f44-4093-b89a-51397ad5cedb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-943ccadd-eba8-4e60-bd75-cc1026b96b3e tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "/opt/stack/data/nova/instances/d85a919d-7f44-4093-b89a-51397ad5cedb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG nova.objects.instance [None req-943ccadd-eba8-4e60-bd75-cc1026b96b3e tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lazy-loading 'trusted_certs' on Instance uuid d85a919d-7f44-4093-b89a-51397ad5cedb {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:48:42 user nova-compute[73391]: INFO nova.scheduler.client.report [None req-e350ed4f-1951-4c29-882c-71732f2c9546 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Deleted allocations for instance c5d5343f-b8f4-46b7-92fc-66452212192b
Aug 15 05:48:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-943ccadd-eba8-4e60-bd75-cc1026b96b3e tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Acquiring lock "999b315ba87151d8252d543312ae7790e7e1583b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-943ccadd-eba8-4e60-bd75-cc1026b96b3e tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-943ccadd-eba8-4e60-bd75-cc1026b96b3e tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e350ed4f-1951-4c29-882c-71732f2c9546 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "c5d5343f-b8f4-46b7-92fc-66452212192b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.306s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-943ccadd-eba8-4e60-bd75-cc1026b96b3e tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.191s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-943ccadd-eba8-4e60-bd75-cc1026b96b3e tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/d85a919d-7f44-4093-b89a-51397ad5cedb/disk.rescue {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-943ccadd-eba8-4e60-bd75-cc1026b96b3e tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/d85a919d-7f44-4093-b89a-51397ad5cedb/disk.rescue" returned: 0 in 0.057s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-943ccadd-eba8-4e60-bd75-cc1026b96b3e tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG nova.objects.instance [None req-943ccadd-eba8-4e60-bd75-cc1026b96b3e tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lazy-loading 'migration_context' on Instance uuid d85a919d-7f44-4093-b89a-51397ad5cedb {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-943ccadd-eba8-4e60-bd75-cc1026b96b3e tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Created local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-943ccadd-eba8-4e60-bd75-cc1026b96b3e tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Start _get_guest_xml network_info=[{"id": "d9ae0be2-05e7-4009-b909-713c8c52e5e5", "address": "fa:16:3e:8a:49:2b", "network": {"id": "bec69c6a-b2cb-4b0a-ba6e-ae6dae099818", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "vif_mac": "fa:16:3e:8a:49:2b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7da9448cc34b609120da564a01dba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ae0be2-05", "ovs_interfaceid": "d9ae0be2-05e7-4009-b909-713c8c52e5e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '191b1dad-305e-4d1c-9b15-515ec59a3278', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG nova.objects.instance [None req-943ccadd-eba8-4e60-bd75-cc1026b96b3e tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lazy-loading 'resources' on Instance uuid d85a919d-7f44-4093-b89a-51397ad5cedb {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG nova.objects.instance [None req-943ccadd-eba8-4e60-bd75-cc1026b96b3e tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lazy-loading 'numa_topology' on Instance uuid d85a919d-7f44-4093-b89a-51397ad5cedb {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:48:42 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-943ccadd-eba8-4e60-bd75-cc1026b96b3e tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:48:42 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-943ccadd-eba8-4e60-bd75-cc1026b96b3e tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:48:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-943ccadd-eba8-4e60-bd75-cc1026b96b3e tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-943ccadd-eba8-4e60-bd75-cc1026b96b3e tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-943ccadd-eba8-4e60-bd75-cc1026b96b3e tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-943ccadd-eba8-4e60-bd75-cc1026b96b3e tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-943ccadd-eba8-4e60-bd75-cc1026b96b3e tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-943ccadd-eba8-4e60-bd75-cc1026b96b3e tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-943ccadd-eba8-4e60-bd75-cc1026b96b3e tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-943ccadd-eba8-4e60-bd75-cc1026b96b3e tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-943ccadd-eba8-4e60-bd75-cc1026b96b3e tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-943ccadd-eba8-4e60-bd75-cc1026b96b3e tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-943ccadd-eba8-4e60-bd75-cc1026b96b3e tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-943ccadd-eba8-4e60-bd75-cc1026b96b3e tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-943ccadd-eba8-4e60-bd75-cc1026b96b3e tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-943ccadd-eba8-4e60-bd75-cc1026b96b3e tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-943ccadd-eba8-4e60-bd75-cc1026b96b3e tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-943ccadd-eba8-4e60-bd75-cc1026b96b3e tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG nova.objects.instance [None req-943ccadd-eba8-4e60-bd75-cc1026b96b3e tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lazy-loading 'vcpu_model' on Instance uuid d85a919d-7f44-4093-b89a-51397ad5cedb {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-943ccadd-eba8-4e60-bd75-cc1026b96b3e tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:46:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1368685045',display_name='tempest-ServerRescueNegativeTestJSON-server-1368685045',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1368685045',id=37,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/6kD3X/Xv8slYXv0KKsJUu8EUECfySzGbYnbQQRqQcPLeD+XN0ODX8guUaAA8SajiP5mAzTEd6NFbpNb6KjPhN8DRWtXs7H08aTDfPvvGUYtwQtRlR6eUlj+qqgyrQ+g==',key_name='tempest-keypair-624447654',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:46:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5a7da9448cc34b609120da564a01dba4',ramdisk_id='',reservation_id='r-hd23d0uc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1933442633',owner_user_name='tempest-ServerRescueNegativeTestJSON-1933442633-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:46:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f0f5888b8c44188a17202fad2725256',uuid=d85a919d-7f44-4093-b89a-51397ad5cedb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d9ae0be2-05e7-4009-b909-713c8c52e5e5", "address": "fa:16:3e:8a:49:2b", "network": {"id": "bec69c6a-b2cb-4b0a-ba6e-ae6dae099818", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "vif_mac": "fa:16:3e:8a:49:2b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7da9448cc34b609120da564a01dba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ae0be2-05", "ovs_interfaceid": "d9ae0be2-05e7-4009-b909-713c8c52e5e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-943ccadd-eba8-4e60-bd75-cc1026b96b3e tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Converting VIF {"id": "d9ae0be2-05e7-4009-b909-713c8c52e5e5", "address": "fa:16:3e:8a:49:2b", "network": {"id": "bec69c6a-b2cb-4b0a-ba6e-ae6dae099818", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "vif_mac": "fa:16:3e:8a:49:2b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7da9448cc34b609120da564a01dba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ae0be2-05", "ovs_interfaceid": "d9ae0be2-05e7-4009-b909-713c8c52e5e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-943ccadd-eba8-4e60-bd75-cc1026b96b3e tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8a:49:2b,bridge_name='br-int',has_traffic_filtering=True,id=d9ae0be2-05e7-4009-b909-713c8c52e5e5,network=Network(bec69c6a-b2cb-4b0a-ba6e-ae6dae099818),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9ae0be2-05') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG nova.objects.instance [None req-943ccadd-eba8-4e60-bd75-cc1026b96b3e tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lazy-loading 'pci_devices' on Instance uuid d85a919d-7f44-4093-b89a-51397ad5cedb {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-943ccadd-eba8-4e60-bd75-cc1026b96b3e tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:48:42 user nova-compute[73391]:   <uuid>d85a919d-7f44-4093-b89a-51397ad5cedb</uuid>
Aug 15 05:48:42 user nova-compute[73391]:   <name>instance-00000025</name>
Aug 15 05:48:42 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:48:42 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:48:42 user nova-compute[73391]:   <metadata>
Aug 15 05:48:42 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:48:42 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:48:42 user nova-compute[73391]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1368685045</nova:name>
Aug 15 05:48:42 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:48:42</nova:creationTime>
Aug 15 05:48:42 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:48:42 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:48:42 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:48:42 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:48:42 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:48:42 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:48:42 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:48:42 user nova-compute[73391]:       <nova:owner>
Aug 15 05:48:42 user nova-compute[73391]:         <nova:user uuid="1f0f5888b8c44188a17202fad2725256">tempest-ServerRescueNegativeTestJSON-1933442633-project-member</nova:user>
Aug 15 05:48:42 user nova-compute[73391]:         <nova:project uuid="5a7da9448cc34b609120da564a01dba4">tempest-ServerRescueNegativeTestJSON-1933442633</nova:project>
Aug 15 05:48:42 user nova-compute[73391]:       </nova:owner>
Aug 15 05:48:42 user nova-compute[73391]:       <nova:root type="image" uuid="191b1dad-305e-4d1c-9b15-515ec59a3278"/>
Aug 15 05:48:42 user nova-compute[73391]:       <nova:ports>
Aug 15 05:48:42 user nova-compute[73391]:         <nova:port uuid="d9ae0be2-05e7-4009-b909-713c8c52e5e5">
Aug 15 05:48:42 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 05:48:42 user nova-compute[73391]:         </nova:port>
Aug 15 05:48:42 user nova-compute[73391]:       </nova:ports>
Aug 15 05:48:42 user nova-compute[73391]:     </nova:instance>
Aug 15 05:48:42 user nova-compute[73391]:   </metadata>
Aug 15 05:48:42 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:48:42 user nova-compute[73391]:     <system>
Aug 15 05:48:42 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:48:42 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:48:42 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:48:42 user nova-compute[73391]:       <entry name="serial">d85a919d-7f44-4093-b89a-51397ad5cedb</entry>
Aug 15 05:48:42 user nova-compute[73391]:       <entry name="uuid">d85a919d-7f44-4093-b89a-51397ad5cedb</entry>
Aug 15 05:48:42 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:48:42 user nova-compute[73391]:     </system>
Aug 15 05:48:42 user nova-compute[73391]:   </sysinfo>
Aug 15 05:48:42 user nova-compute[73391]:   <os>
Aug 15 05:48:42 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:48:42 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:48:42 user nova-compute[73391]:   </os>
Aug 15 05:48:42 user nova-compute[73391]:   <features>
Aug 15 05:48:42 user nova-compute[73391]:     <acpi/>
Aug 15 05:48:42 user nova-compute[73391]:     <apic/>
Aug 15 05:48:42 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:48:42 user nova-compute[73391]:   </features>
Aug 15 05:48:42 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:48:42 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:48:42 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:48:42 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:48:42 user nova-compute[73391]:   </clock>
Aug 15 05:48:42 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:48:42 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:48:42 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:48:42 user nova-compute[73391]:   </cpu>
Aug 15 05:48:42 user nova-compute[73391]:   <devices>
Aug 15 05:48:42 user nova-compute[73391]:     <disk type="file" device="disk">
Aug 15 05:48:42 user nova-compute[73391]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 05:48:42 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/d85a919d-7f44-4093-b89a-51397ad5cedb/disk.rescue"/>
Aug 15 05:48:42 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:48:42 user nova-compute[73391]:     </disk>
Aug 15 05:48:42 user nova-compute[73391]:     <disk type="file" device="disk">
Aug 15 05:48:42 user nova-compute[73391]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 05:48:42 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/d85a919d-7f44-4093-b89a-51397ad5cedb/disk"/>
Aug 15 05:48:42 user nova-compute[73391]:       <target dev="vdb" bus="virtio"/>
Aug 15 05:48:42 user nova-compute[73391]:     </disk>
Aug 15 05:48:42 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:48:42 user nova-compute[73391]:       <mac address="fa:16:3e:8a:49:2b"/>
Aug 15 05:48:42 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:48:42 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:48:42 user nova-compute[73391]:       <target dev="tapd9ae0be2-05"/>
Aug 15 05:48:42 user nova-compute[73391]:     </interface>
Aug 15 05:48:42 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:48:42 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/d85a919d-7f44-4093-b89a-51397ad5cedb/console.log" append="off"/>
Aug 15 05:48:42 user nova-compute[73391]:     </serial>
Aug 15 05:48:42 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:48:42 user nova-compute[73391]:     <video>
Aug 15 05:48:42 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:48:42 user nova-compute[73391]:     </video>
Aug 15 05:48:42 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:48:42 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:48:42 user nova-compute[73391]:     </rng>
Aug 15 05:48:42 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:48:42 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:48:42 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:48:42 user nova-compute[73391]:     </memballoon>
Aug 15 05:48:42 user nova-compute[73391]:   </devices>
Aug 15 05:48:42 user nova-compute[73391]: </domain>
Aug 15 05:48:42 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:48:42 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Instance destroyed successfully.
Aug 15 05:48:42 user nova-compute[73391]: DEBUG nova.compute.manager [req-dda1fa47-ce0a-4941-b9ce-3bf631e76dd7 req-5c05a9cb-c434-4c92-aa70-34c5b7eea997 service nova] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Received event network-vif-unplugged-9cde10e9-3186-4680-8e4d-a3bb0d8600d0 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-dda1fa47-ce0a-4941-b9ce-3bf631e76dd7 req-5c05a9cb-c434-4c92-aa70-34c5b7eea997 service nova] Acquiring lock "6ac9d5dc-56be-402f-b9d4-3327bdfd9220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-dda1fa47-ce0a-4941-b9ce-3bf631e76dd7 req-5c05a9cb-c434-4c92-aa70-34c5b7eea997 service nova] Lock "6ac9d5dc-56be-402f-b9d4-3327bdfd9220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-dda1fa47-ce0a-4941-b9ce-3bf631e76dd7 req-5c05a9cb-c434-4c92-aa70-34c5b7eea997 service nova] Lock "6ac9d5dc-56be-402f-b9d4-3327bdfd9220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG nova.compute.manager [req-dda1fa47-ce0a-4941-b9ce-3bf631e76dd7 req-5c05a9cb-c434-4c92-aa70-34c5b7eea997 service nova] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] No waiting events found dispatching network-vif-unplugged-9cde10e9-3186-4680-8e4d-a3bb0d8600d0 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG nova.compute.manager [req-dda1fa47-ce0a-4941-b9ce-3bf631e76dd7 req-5c05a9cb-c434-4c92-aa70-34c5b7eea997 service nova] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Received event network-vif-unplugged-9cde10e9-3186-4680-8e4d-a3bb0d8600d0 for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG nova.compute.manager [req-dda1fa47-ce0a-4941-b9ce-3bf631e76dd7 req-5c05a9cb-c434-4c92-aa70-34c5b7eea997 service nova] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Received event network-vif-plugged-9cde10e9-3186-4680-8e4d-a3bb0d8600d0 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-dda1fa47-ce0a-4941-b9ce-3bf631e76dd7 req-5c05a9cb-c434-4c92-aa70-34c5b7eea997 service nova] Acquiring lock "6ac9d5dc-56be-402f-b9d4-3327bdfd9220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-dda1fa47-ce0a-4941-b9ce-3bf631e76dd7 req-5c05a9cb-c434-4c92-aa70-34c5b7eea997 service nova] Lock "6ac9d5dc-56be-402f-b9d4-3327bdfd9220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-dda1fa47-ce0a-4941-b9ce-3bf631e76dd7 req-5c05a9cb-c434-4c92-aa70-34c5b7eea997 service nova] Lock "6ac9d5dc-56be-402f-b9d4-3327bdfd9220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG nova.compute.manager [req-dda1fa47-ce0a-4941-b9ce-3bf631e76dd7 req-5c05a9cb-c434-4c92-aa70-34c5b7eea997 service nova] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] No waiting events found dispatching network-vif-plugged-9cde10e9-3186-4680-8e4d-a3bb0d8600d0 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:48:42 user nova-compute[73391]: WARNING nova.compute.manager [req-dda1fa47-ce0a-4941-b9ce-3bf631e76dd7 req-5c05a9cb-c434-4c92-aa70-34c5b7eea997 service nova] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Received unexpected event network-vif-plugged-9cde10e9-3186-4680-8e4d-a3bb0d8600d0 for instance with vm_state active and task_state deleting.
Aug 15 05:48:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-943ccadd-eba8-4e60-bd75-cc1026b96b3e tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-943ccadd-eba8-4e60-bd75-cc1026b96b3e tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-943ccadd-eba8-4e60-bd75-cc1026b96b3e tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] No VIF found with MAC fa:16:3e:8a:49:2b, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:48:42 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Instance destroyed successfully.
Aug 15 05:48:42 user nova-compute[73391]: DEBUG nova.objects.instance [None req-0a179dec-3cf7-48e0-bacd-a2e29520a082 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lazy-loading 'resources' on Instance uuid 6ac9d5dc-56be-402f-b9d4-3327bdfd9220 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-0a179dec-3cf7-48e0-bacd-a2e29520a082 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:29:23Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-435247843',display_name='tempest-ServerActionsTestOtherA-server-435247843',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-435247843',id=3,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNF3pif1QWXVpHrEIxShzB1xE/c22B7LSOZtRDzcmt7Dk63BIrH6/RWzxjN8WpKbyeDl3Aa13tDu+mUrmV6NfezccRAEecdR4P4btA7xRgsBIkQydnisHIujmlpX6Glrow==',key_name='tempest-keypair-512432776',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:29:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='60b01853a82243369bd71dc0dbedb5d6',ramdisk_id='',reservation_id='r-v8i1e7fi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1927429987',owner_user_name='tempest-ServerActionsTestOtherA-1927429987-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:29:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='124dcfde552147e2978970386274c70a',uuid=6ac9d5dc-56be-402f-b9d4-3327bdfd9220,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9cde10e9-3186-4680-8e4d-a3bb0d8600d0", "address": "fa:16:3e:50:39:e0", "network": {"id": "610f78de-5741-4743-815d-d12ba05f8000", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1518164868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b01853a82243369bd71dc0dbedb5d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cde10e9-31", "ovs_interfaceid": "9cde10e9-3186-4680-8e4d-a3bb0d8600d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-0a179dec-3cf7-48e0-bacd-a2e29520a082 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Converting VIF {"id": "9cde10e9-3186-4680-8e4d-a3bb0d8600d0", "address": "fa:16:3e:50:39:e0", "network": {"id": "610f78de-5741-4743-815d-d12ba05f8000", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1518164868-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "60b01853a82243369bd71dc0dbedb5d6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cde10e9-31", "ovs_interfaceid": "9cde10e9-3186-4680-8e4d-a3bb0d8600d0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-0a179dec-3cf7-48e0-bacd-a2e29520a082 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:50:39:e0,bridge_name='br-int',has_traffic_filtering=True,id=9cde10e9-3186-4680-8e4d-a3bb0d8600d0,network=Network(610f78de-5741-4743-815d-d12ba05f8000),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cde10e9-31') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG os_vif [None req-0a179dec-3cf7-48e0-bacd-a2e29520a082 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:39:e0,bridge_name='br-int',has_traffic_filtering=True,id=9cde10e9-3186-4680-8e4d-a3bb0d8600d0,network=Network(610f78de-5741-4743-815d-d12ba05f8000),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cde10e9-31') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9cde10e9-31, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:48:42 user nova-compute[73391]: INFO os_vif [None req-0a179dec-3cf7-48e0-bacd-a2e29520a082 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:50:39:e0,bridge_name='br-int',has_traffic_filtering=True,id=9cde10e9-3186-4680-8e4d-a3bb0d8600d0,network=Network(610f78de-5741-4743-815d-d12ba05f8000),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cde10e9-31')
Aug 15 05:48:42 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-0a179dec-3cf7-48e0-bacd-a2e29520a082 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Deleting instance files /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220_del
Aug 15 05:48:42 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-0a179dec-3cf7-48e0-bacd-a2e29520a082 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Deletion of /opt/stack/data/nova/instances/6ac9d5dc-56be-402f-b9d4-3327bdfd9220_del complete
Aug 15 05:48:42 user nova-compute[73391]: INFO nova.compute.manager [None req-0a179dec-3cf7-48e0-bacd-a2e29520a082 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Took 0.95 seconds to destroy the instance on the hypervisor.
Aug 15 05:48:42 user nova-compute[73391]: DEBUG oslo.service.loopingcall [None req-0a179dec-3cf7-48e0-bacd-a2e29520a082 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG nova.compute.manager [-] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Deallocating network for instance {{(pid=73391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 05:48:42 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] deallocate_for_instance() {{(pid=73391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 05:48:43 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:48:43 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Took 0.54 seconds to deallocate network for instance.
Aug 15 05:48:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0a179dec-3cf7-48e0-bacd-a2e29520a082 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:48:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0a179dec-3cf7-48e0-bacd-a2e29520a082 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:48:43 user nova-compute[73391]: DEBUG nova.compute.manager [req-1e52ef18-a6ce-4a9f-b7c7-50f3f5723bd4 req-7481138c-fc5b-468f-aff6-ea717e626084 service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Received event network-vif-plugged-d9ae0be2-05e7-4009-b909-713c8c52e5e5 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:48:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-1e52ef18-a6ce-4a9f-b7c7-50f3f5723bd4 req-7481138c-fc5b-468f-aff6-ea717e626084 service nova] Acquiring lock "d85a919d-7f44-4093-b89a-51397ad5cedb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:48:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-1e52ef18-a6ce-4a9f-b7c7-50f3f5723bd4 req-7481138c-fc5b-468f-aff6-ea717e626084 service nova] Lock "d85a919d-7f44-4093-b89a-51397ad5cedb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:48:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-1e52ef18-a6ce-4a9f-b7c7-50f3f5723bd4 req-7481138c-fc5b-468f-aff6-ea717e626084 service nova] Lock "d85a919d-7f44-4093-b89a-51397ad5cedb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:48:43 user nova-compute[73391]: DEBUG nova.compute.manager [req-1e52ef18-a6ce-4a9f-b7c7-50f3f5723bd4 req-7481138c-fc5b-468f-aff6-ea717e626084 service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] No waiting events found dispatching network-vif-plugged-d9ae0be2-05e7-4009-b909-713c8c52e5e5 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:48:43 user nova-compute[73391]: WARNING nova.compute.manager [req-1e52ef18-a6ce-4a9f-b7c7-50f3f5723bd4 req-7481138c-fc5b-468f-aff6-ea717e626084 service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Received unexpected event network-vif-plugged-d9ae0be2-05e7-4009-b909-713c8c52e5e5 for instance with vm_state active and task_state rescuing.
Aug 15 05:48:43 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-0a179dec-3cf7-48e0-bacd-a2e29520a082 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:48:43 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-0a179dec-3cf7-48e0-bacd-a2e29520a082 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:48:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0a179dec-3cf7-48e0-bacd-a2e29520a082 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.370s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:48:43 user nova-compute[73391]: INFO nova.scheduler.client.report [None req-0a179dec-3cf7-48e0-bacd-a2e29520a082 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Deleted allocations for instance 6ac9d5dc-56be-402f-b9d4-3327bdfd9220
Aug 15 05:48:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0a179dec-3cf7-48e0-bacd-a2e29520a082 tempest-ServerActionsTestOtherA-1927429987 tempest-ServerActionsTestOtherA-1927429987-project-member] Lock "6ac9d5dc-56be-402f-b9d4-3327bdfd9220" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.090s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:48:44 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:48:44 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:48:44 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:48:44 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:48:44 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:48:44 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:48:44 user nova-compute[73391]: DEBUG nova.compute.manager [req-deb5b981-7068-49bf-b688-10191c25a56e req-5568b454-a458-4fd9-8872-e527239dd15e service nova] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Received event network-vif-deleted-9cde10e9-3186-4680-8e4d-a3bb0d8600d0 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:48:45 user nova-compute[73391]: DEBUG nova.compute.manager [req-db5fd1f8-9dea-4a5a-b4f8-97632388ec8c req-fca70130-3c20-4373-abd7-606858406acc service nova] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Received event network-changed-b884b795-4023-4343-b6dd-9cf6e5dd880a {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:48:45 user nova-compute[73391]: DEBUG nova.compute.manager [req-db5fd1f8-9dea-4a5a-b4f8-97632388ec8c req-fca70130-3c20-4373-abd7-606858406acc service nova] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Refreshing instance network info cache due to event network-changed-b884b795-4023-4343-b6dd-9cf6e5dd880a. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:48:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-db5fd1f8-9dea-4a5a-b4f8-97632388ec8c req-fca70130-3c20-4373-abd7-606858406acc service nova] Acquiring lock "refresh_cache-fecde5f1-88fb-48b0-b039-93fdb285c93c" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:48:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-db5fd1f8-9dea-4a5a-b4f8-97632388ec8c req-fca70130-3c20-4373-abd7-606858406acc service nova] Acquired lock "refresh_cache-fecde5f1-88fb-48b0-b039-93fdb285c93c" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:48:45 user nova-compute[73391]: DEBUG nova.network.neutron [req-db5fd1f8-9dea-4a5a-b4f8-97632388ec8c req-fca70130-3c20-4373-abd7-606858406acc service nova] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Refreshing network info cache for port b884b795-4023-4343-b6dd-9cf6e5dd880a {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:48:45 user nova-compute[73391]: DEBUG nova.compute.manager [req-53a5092b-32fb-4986-884e-ed08edf48519 req-91367da0-84af-4c5b-92d0-8522bf73f7a5 service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Received event network-vif-plugged-d9ae0be2-05e7-4009-b909-713c8c52e5e5 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:48:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-53a5092b-32fb-4986-884e-ed08edf48519 req-91367da0-84af-4c5b-92d0-8522bf73f7a5 service nova] Acquiring lock "d85a919d-7f44-4093-b89a-51397ad5cedb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:48:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-53a5092b-32fb-4986-884e-ed08edf48519 req-91367da0-84af-4c5b-92d0-8522bf73f7a5 service nova] Lock "d85a919d-7f44-4093-b89a-51397ad5cedb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:48:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-53a5092b-32fb-4986-884e-ed08edf48519 req-91367da0-84af-4c5b-92d0-8522bf73f7a5 service nova] Lock "d85a919d-7f44-4093-b89a-51397ad5cedb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:48:45 user nova-compute[73391]: DEBUG nova.compute.manager [req-53a5092b-32fb-4986-884e-ed08edf48519 req-91367da0-84af-4c5b-92d0-8522bf73f7a5 service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] No waiting events found dispatching network-vif-plugged-d9ae0be2-05e7-4009-b909-713c8c52e5e5 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:48:45 user nova-compute[73391]: WARNING nova.compute.manager [req-53a5092b-32fb-4986-884e-ed08edf48519 req-91367da0-84af-4c5b-92d0-8522bf73f7a5 service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Received unexpected event network-vif-plugged-d9ae0be2-05e7-4009-b909-713c8c52e5e5 for instance with vm_state active and task_state rescuing.
Aug 15 05:48:45 user nova-compute[73391]: DEBUG nova.compute.manager [req-53a5092b-32fb-4986-884e-ed08edf48519 req-91367da0-84af-4c5b-92d0-8522bf73f7a5 service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Received event network-vif-plugged-d9ae0be2-05e7-4009-b909-713c8c52e5e5 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:48:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-53a5092b-32fb-4986-884e-ed08edf48519 req-91367da0-84af-4c5b-92d0-8522bf73f7a5 service nova] Acquiring lock "d85a919d-7f44-4093-b89a-51397ad5cedb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:48:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-53a5092b-32fb-4986-884e-ed08edf48519 req-91367da0-84af-4c5b-92d0-8522bf73f7a5 service nova] Lock "d85a919d-7f44-4093-b89a-51397ad5cedb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:48:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-53a5092b-32fb-4986-884e-ed08edf48519 req-91367da0-84af-4c5b-92d0-8522bf73f7a5 service nova] Lock "d85a919d-7f44-4093-b89a-51397ad5cedb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:48:45 user nova-compute[73391]: DEBUG nova.compute.manager [req-53a5092b-32fb-4986-884e-ed08edf48519 req-91367da0-84af-4c5b-92d0-8522bf73f7a5 service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] No waiting events found dispatching network-vif-plugged-d9ae0be2-05e7-4009-b909-713c8c52e5e5 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:48:45 user nova-compute[73391]: WARNING nova.compute.manager [req-53a5092b-32fb-4986-884e-ed08edf48519 req-91367da0-84af-4c5b-92d0-8522bf73f7a5 service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Received unexpected event network-vif-plugged-d9ae0be2-05e7-4009-b909-713c8c52e5e5 for instance with vm_state active and task_state rescuing.
Aug 15 05:48:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-26ee6291-68bf-4557-856d-00e61bfdaa24 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Acquiring lock "fecde5f1-88fb-48b0-b039-93fdb285c93c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:48:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-26ee6291-68bf-4557-856d-00e61bfdaa24 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lock "fecde5f1-88fb-48b0-b039-93fdb285c93c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:48:45 user nova-compute[73391]: DEBUG nova.objects.instance [None req-26ee6291-68bf-4557-856d-00e61bfdaa24 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lazy-loading 'flavor' on Instance uuid fecde5f1-88fb-48b0-b039-93fdb285c93c {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:48:45 user nova-compute[73391]: DEBUG nova.network.neutron [req-db5fd1f8-9dea-4a5a-b4f8-97632388ec8c req-fca70130-3c20-4373-abd7-606858406acc service nova] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Updated VIF entry in instance network info cache for port b884b795-4023-4343-b6dd-9cf6e5dd880a. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:48:45 user nova-compute[73391]: DEBUG nova.network.neutron [req-db5fd1f8-9dea-4a5a-b4f8-97632388ec8c req-fca70130-3c20-4373-abd7-606858406acc service nova] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Updating instance_info_cache with network_info: [{"id": "b884b795-4023-4343-b6dd-9cf6e5dd880a", "address": "fa:16:3e:66:e9:85", "network": {"id": "c7ff2e30-7396-4af7-bd21-e9157804987e", "bridge": "br-int", "label": "tempest-TestStampPattern-2022602784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "623d93149e574954839e469432f24fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb884b795-40", "ovs_interfaceid": "b884b795-4023-4343-b6dd-9cf6e5dd880a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:48:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-db5fd1f8-9dea-4a5a-b4f8-97632388ec8c req-fca70130-3c20-4373-abd7-606858406acc service nova] Releasing lock "refresh_cache-fecde5f1-88fb-48b0-b039-93fdb285c93c" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:48:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-26ee6291-68bf-4557-856d-00e61bfdaa24 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lock "fecde5f1-88fb-48b0-b039-93fdb285c93c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:48:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2ebee662-a6e8-4ab2-9c3b-0f171b4f52cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquiring lock "8f08782b-f793-415e-b0d6-5caad1c3d426" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:48:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2ebee662-a6e8-4ab2-9c3b-0f171b4f52cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "8f08782b-f793-415e-b0d6-5caad1c3d426" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:48:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2ebee662-a6e8-4ab2-9c3b-0f171b4f52cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquiring lock "8f08782b-f793-415e-b0d6-5caad1c3d426-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:48:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2ebee662-a6e8-4ab2-9c3b-0f171b4f52cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "8f08782b-f793-415e-b0d6-5caad1c3d426-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:48:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2ebee662-a6e8-4ab2-9c3b-0f171b4f52cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "8f08782b-f793-415e-b0d6-5caad1c3d426-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:48:45 user nova-compute[73391]: INFO nova.compute.manager [None req-2ebee662-a6e8-4ab2-9c3b-0f171b4f52cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Terminating instance
Aug 15 05:48:45 user nova-compute[73391]: DEBUG nova.compute.manager [None req-2ebee662-a6e8-4ab2-9c3b-0f171b4f52cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Start destroying the instance on the hypervisor. {{(pid=73391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 05:48:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:48:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:48:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:48:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-26ee6291-68bf-4557-856d-00e61bfdaa24 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Acquiring lock "fecde5f1-88fb-48b0-b039-93fdb285c93c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:48:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-26ee6291-68bf-4557-856d-00e61bfdaa24 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lock "fecde5f1-88fb-48b0-b039-93fdb285c93c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:48:45 user nova-compute[73391]: INFO nova.compute.manager [None req-26ee6291-68bf-4557-856d-00e61bfdaa24 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Attaching volume f55f8f6a-9762-499c-b6eb-b261bd7709a4 to /dev/vdb
Aug 15 05:48:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:48:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:48:46 user nova-compute[73391]: DEBUG os_brick.utils [None req-26ee6291-68bf-4557-856d-00e61bfdaa24 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:48:46 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:46 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:46 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c4f7dc-ef20-4646-a720-9b6625e15469]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:46 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:46 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:46 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[154b5363-8850-466e-b37a-03ec760555a6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:46 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:46 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:46 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[332b3122-0fff-47ca-916f-f484ac844232]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:46 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1050e215-b7ee-4395-9d8d-7b710560a0da]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:46 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-26ee6291-68bf-4557-856d-00e61bfdaa24 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:46 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-26ee6291-68bf-4557-856d-00e61bfdaa24 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:48:46 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-26ee6291-68bf-4557-856d-00e61bfdaa24 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 05:48:46 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:46 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:48:46 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 05:48:46 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[352ad93f-d9ce-4582-ab96-a2347085d74a]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:46 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-26ee6291-68bf-4557-856d-00e61bfdaa24 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 05:48:46 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-26ee6291-68bf-4557-856d-00e61bfdaa24 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 05:48:46 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-26ee6291-68bf-4557-856d-00e61bfdaa24 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 05:48:46 user nova-compute[73391]: DEBUG os_brick.utils [None req-26ee6291-68bf-4557-856d-00e61bfdaa24 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:48:46 user nova-compute[73391]: DEBUG nova.virt.block_device [None req-26ee6291-68bf-4557-856d-00e61bfdaa24 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Updating existing volume attachment record: 228fb9b8-8b0f-41d7-b334-f4f4577104ce {{(pid=73391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 05:48:46 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Removed pending event for d85a919d-7f44-4093-b89a-51397ad5cedb due to event {{(pid=73391) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 05:48:46 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078526.714444, d85a919d-7f44-4093-b89a-51397ad5cedb => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:48:46 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] VM Resumed (Lifecycle Event)
Aug 15 05:48:46 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Instance destroyed successfully.
Aug 15 05:48:46 user nova-compute[73391]: DEBUG nova.compute.manager [None req-943ccadd-eba8-4e60-bd75-cc1026b96b3e tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:48:46 user nova-compute[73391]: DEBUG nova.objects.instance [None req-2ebee662-a6e8-4ab2-9c3b-0f171b4f52cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lazy-loading 'resources' on Instance uuid 8f08782b-f793-415e-b0d6-5caad1c3d426 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:48:46 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:48:46 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-2ebee662-a6e8-4ab2-9c3b-0f171b4f52cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:29:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-547612131',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-547612131',id=1,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:29:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='83b9acbe11654053bb905e7c92558a35',ramdisk_id='',reservation_id='r-l60ytipu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1045163116',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:31:04Z,user_data=None,user_id='887f0846cf554e12acf92a663f5ab266',uuid=8f08782b-f793-415e-b0d6-5caad1c3d426,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13c5a27d-b6c3-424b-a876-068d047fad28", "address": "fa:16:3e:61:0b:53", "network": {"id": "70d88082-aea7-48bb-abb4-d77d264aaf01", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b9acbe11654053bb905e7c92558a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c5a27d-b6", "ovs_interfaceid": "13c5a27d-b6c3-424b-a876-068d047fad28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:48:46 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-2ebee662-a6e8-4ab2-9c3b-0f171b4f52cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Converting VIF {"id": "13c5a27d-b6c3-424b-a876-068d047fad28", "address": "fa:16:3e:61:0b:53", "network": {"id": "70d88082-aea7-48bb-abb4-d77d264aaf01", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1734155448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "83b9acbe11654053bb905e7c92558a35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13c5a27d-b6", "ovs_interfaceid": "13c5a27d-b6c3-424b-a876-068d047fad28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:48:46 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-2ebee662-a6e8-4ab2-9c3b-0f171b4f52cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:61:0b:53,bridge_name='br-int',has_traffic_filtering=True,id=13c5a27d-b6c3-424b-a876-068d047fad28,network=Network(70d88082-aea7-48bb-abb4-d77d264aaf01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13c5a27d-b6') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:48:46 user nova-compute[73391]: DEBUG os_vif [None req-2ebee662-a6e8-4ab2-9c3b-0f171b4f52cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:0b:53,bridge_name='br-int',has_traffic_filtering=True,id=13c5a27d-b6c3-424b-a876-068d047fad28,network=Network(70d88082-aea7-48bb-abb4-d77d264aaf01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13c5a27d-b6') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:48:46 user nova-compute[73391]: DEBUG nova.compute.manager [req-88811eca-c8d9-484b-9aa7-56a6b9081eac req-23414bcf-f3bd-429b-ba23-e21b9985a4d1 service nova] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Received event network-vif-unplugged-13c5a27d-b6c3-424b-a876-068d047fad28 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:48:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-88811eca-c8d9-484b-9aa7-56a6b9081eac req-23414bcf-f3bd-429b-ba23-e21b9985a4d1 service nova] Acquiring lock "8f08782b-f793-415e-b0d6-5caad1c3d426-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:48:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-88811eca-c8d9-484b-9aa7-56a6b9081eac req-23414bcf-f3bd-429b-ba23-e21b9985a4d1 service nova] Lock "8f08782b-f793-415e-b0d6-5caad1c3d426-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:48:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-88811eca-c8d9-484b-9aa7-56a6b9081eac req-23414bcf-f3bd-429b-ba23-e21b9985a4d1 service nova] Lock "8f08782b-f793-415e-b0d6-5caad1c3d426-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:48:46 user nova-compute[73391]: DEBUG nova.compute.manager [req-88811eca-c8d9-484b-9aa7-56a6b9081eac req-23414bcf-f3bd-429b-ba23-e21b9985a4d1 service nova] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] No waiting events found dispatching network-vif-unplugged-13c5a27d-b6c3-424b-a876-068d047fad28 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:48:46 user nova-compute[73391]: DEBUG nova.compute.manager [req-88811eca-c8d9-484b-9aa7-56a6b9081eac req-23414bcf-f3bd-429b-ba23-e21b9985a4d1 service nova] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Received event network-vif-unplugged-13c5a27d-b6c3-424b-a876-068d047fad28 for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 05:48:46 user nova-compute[73391]: DEBUG nova.compute.manager [req-88811eca-c8d9-484b-9aa7-56a6b9081eac req-23414bcf-f3bd-429b-ba23-e21b9985a4d1 service nova] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Received event network-vif-plugged-13c5a27d-b6c3-424b-a876-068d047fad28 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:48:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-88811eca-c8d9-484b-9aa7-56a6b9081eac req-23414bcf-f3bd-429b-ba23-e21b9985a4d1 service nova] Acquiring lock "8f08782b-f793-415e-b0d6-5caad1c3d426-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:48:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-88811eca-c8d9-484b-9aa7-56a6b9081eac req-23414bcf-f3bd-429b-ba23-e21b9985a4d1 service nova] Lock "8f08782b-f793-415e-b0d6-5caad1c3d426-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:48:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-88811eca-c8d9-484b-9aa7-56a6b9081eac req-23414bcf-f3bd-429b-ba23-e21b9985a4d1 service nova] Lock "8f08782b-f793-415e-b0d6-5caad1c3d426-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:48:46 user nova-compute[73391]: DEBUG nova.compute.manager [req-88811eca-c8d9-484b-9aa7-56a6b9081eac req-23414bcf-f3bd-429b-ba23-e21b9985a4d1 service nova] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] No waiting events found dispatching network-vif-plugged-13c5a27d-b6c3-424b-a876-068d047fad28 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:48:46 user nova-compute[73391]: WARNING nova.compute.manager [req-88811eca-c8d9-484b-9aa7-56a6b9081eac req-23414bcf-f3bd-429b-ba23-e21b9985a4d1 service nova] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Received unexpected event network-vif-plugged-13c5a27d-b6c3-424b-a876-068d047fad28 for instance with vm_state active and task_state deleting.
Aug 15 05:48:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:48:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap13c5a27d-b6, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:48:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:48:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:48:46 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:48:46 user nova-compute[73391]: INFO os_vif [None req-2ebee662-a6e8-4ab2-9c3b-0f171b4f52cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:61:0b:53,bridge_name='br-int',has_traffic_filtering=True,id=13c5a27d-b6c3-424b-a876-068d047fad28,network=Network(70d88082-aea7-48bb-abb4-d77d264aaf01),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13c5a27d-b6')
Aug 15 05:48:46 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-2ebee662-a6e8-4ab2-9c3b-0f171b4f52cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Deleting instance files /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426_del
Aug 15 05:48:46 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-2ebee662-a6e8-4ab2-9c3b-0f171b4f52cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Deletion of /opt/stack/data/nova/instances/8f08782b-f793-415e-b0d6-5caad1c3d426_del complete
Aug 15 05:48:46 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078526.7163448, d85a919d-7f44-4093-b89a-51397ad5cedb => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:48:46 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] VM Started (Lifecycle Event)
Aug 15 05:48:46 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:48:46 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:48:46 user nova-compute[73391]: INFO nova.compute.manager [None req-2ebee662-a6e8-4ab2-9c3b-0f171b4f52cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Took 1.08 seconds to destroy the instance on the hypervisor.
Aug 15 05:48:46 user nova-compute[73391]: DEBUG oslo.service.loopingcall [None req-2ebee662-a6e8-4ab2-9c3b-0f171b4f52cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 05:48:46 user nova-compute[73391]: DEBUG nova.compute.manager [-] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Deallocating network for instance {{(pid=73391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 05:48:46 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] deallocate_for_instance() {{(pid=73391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 05:48:47 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:48:47 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Took 0.60 seconds to deallocate network for instance.
Aug 15 05:48:47 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2ebee662-a6e8-4ab2-9c3b-0f171b4f52cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:48:47 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2ebee662-a6e8-4ab2-9c3b-0f171b4f52cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:48:47 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-2ebee662-a6e8-4ab2-9c3b-0f171b4f52cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:48:47 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-2ebee662-a6e8-4ab2-9c3b-0f171b4f52cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:48:47 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2ebee662-a6e8-4ab2-9c3b-0f171b4f52cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.253s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:48:47 user nova-compute[73391]: INFO nova.scheduler.client.report [None req-2ebee662-a6e8-4ab2-9c3b-0f171b4f52cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Deleted allocations for instance 8f08782b-f793-415e-b0d6-5caad1c3d426
Aug 15 05:48:48 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2ebee662-a6e8-4ab2-9c3b-0f171b4f52cf tempest-ServerBootFromVolumeStableRescueTest-1045163116 tempest-ServerBootFromVolumeStableRescueTest-1045163116-project-member] Lock "8f08782b-f793-415e-b0d6-5caad1c3d426" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.188s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:48:48 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692078513.7979724, c043ca2f-6468-4b32-ae53-40da261fd1fa => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:48:48 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] VM Stopped (Lifecycle Event)
Aug 15 05:48:48 user nova-compute[73391]: DEBUG nova.compute.manager [req-09c5ec8c-5f3a-48e0-8009-7ffa1418a43d req-8c89c96b-3587-4a10-84cf-ad148c031502 service nova] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Received event network-vif-deleted-13c5a27d-b6c3-424b-a876-068d047fad28 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:48:48 user nova-compute[73391]: DEBUG nova.compute.manager [None req-1ad8656b-ca09-4b00-bcbd-3a4b6cbeb11b None None] [instance: c043ca2f-6468-4b32-ae53-40da261fd1fa] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:48:49 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:48:51 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:48:53 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692078518.7469609, c5d5343f-b8f4-46b7-92fc-66452212192b => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:48:53 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] VM Stopped (Lifecycle Event)
Aug 15 05:48:53 user nova-compute[73391]: DEBUG nova.compute.manager [None req-caaca138-b38c-4534-b66b-6841db309de4 None None] [instance: c5d5343f-b8f4-46b7-92fc-66452212192b] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:48:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:48:55 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26ee6291-68bf-4557-856d-00e61bfdaa24 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 05:48:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ee6291-68bf-4557-856d-00e61bfdaa24 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:f55f8f6a-9762-499c-b6eb-b261bd7709a4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gcyxFbpA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:48:55 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-26ee6291-68bf-4557-856d-00e61bfdaa24 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:48:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-26ee6291-68bf-4557-856d-00e61bfdaa24 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:48:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-26ee6291-68bf-4557-856d-00e61bfdaa24 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:48:55 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-26ee6291-68bf-4557-856d-00e61bfdaa24 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:48:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-26ee6291-68bf-4557-856d-00e61bfdaa24 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f55f8f6a-9762-499c-b6eb-b261bd7709a4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:48:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-26ee6291-68bf-4557-856d-00e61bfdaa24 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f55f8f6a-9762-499c-b6eb-b261bd7709a4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:48:55 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-26ee6291-68bf-4557-856d-00e61bfdaa24 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 05:48:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f55f8f6a-9762-499c-b6eb-b261bd7709a4 -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f55f8f6a-9762-499c-b6eb-b261bd7709a4 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:55 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9711702c-41e3-4605-9c9c-db2b08b855c1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ee6291-68bf-4557-856d-00e61bfdaa24 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 05:48:55 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:48:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f55f8f6a-9762-499c-b6eb-b261bd7709a4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f55f8f6a-9762-499c-b6eb-b261bd7709a4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:55 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6a4479-0cff-4fd1-99a4-a9d7b50d7c7f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f55f8f6a-9762-499c-b6eb-b261bd7709a4] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ee6291-68bf-4557-856d-00e61bfdaa24 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f55f8f6a-9762-499c-b6eb-b261bd7709a4] added
Aug 15 05:48:55 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:48:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f55f8f6a-9762-499c-b6eb-b261bd7709a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f55f8f6a-9762-499c-b6eb-b261bd7709a4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:55 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7a4c806-8301-40e5-955c-ae6aa1a4d2c6]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ee6291-68bf-4557-856d-00e61bfdaa24 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:48:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f55f8f6a-9762-499c-b6eb-b261bd7709a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f55f8f6a-9762-499c-b6eb-b261bd7709a4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:55 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[409b4181-d5b1-466f-9f1f-18754350a1e5]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ee6291-68bf-4557-856d-00e61bfdaa24 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:48:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f55f8f6a-9762-499c-b6eb-b261bd7709a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gcyxFbpA {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f55f8f6a-9762-499c-b6eb-b261bd7709a4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gcyxFbpA" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:55 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10880c6-2939-4112-ab3f-4564b9d7068f]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ee6291-68bf-4557-856d-00e61bfdaa24 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gcyxFbpA'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:48:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f55f8f6a-9762-499c-b6eb-b261bd7709a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f55f8f6a-9762-499c-b6eb-b261bd7709a4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:55 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c935e67d-6ef7-4625-b5a8-b29d22c951f2]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ee6291-68bf-4557-856d-00e61bfdaa24 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:48:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:55 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1567d35c-46fe-4cb4-aa89-4d3950ddb9aa]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ee6291-68bf-4557-856d-00e61bfdaa24 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52 (non-flash)
Aug 15 05:48:55 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:48:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ee6291-68bf-4557-856d-00e61bfdaa24 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52 (non-flash)
Aug 15 05:48:55 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:48:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f55f8f6a-9762-499c-b6eb-b261bd7709a4 -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f55f8f6a-9762-499c-b6eb-b261bd7709a4 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:55 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef3069d3-bb29-48d7-9441-a220e8b1fe9d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f55f8f6a-9762-499c-b6eb-b261bd7709a4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f55f8f6a-9762-499c-b6eb-b261bd7709a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ee6291-68bf-4557-856d-00e61bfdaa24 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f55f8f6a-9762-499c-b6eb-b261bd7709a4, portal: 172.16.0.220,3260]
Aug 15 05:48:55 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:f55f8f6a-9762-499c-b6eb-b261bd7709a4, portal: 172.16.0.220,3260] successful.
Aug 15 05:48:55 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:48:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f55f8f6a-9762-499c-b6eb-b261bd7709a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f55f8f6a-9762-499c-b6eb-b261bd7709a4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:55 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ce0241-c6f9-4056-9309-5ebd3b68c1ae]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ee6291-68bf-4557-856d-00e61bfdaa24 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:48:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:55 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[19dd008c-fb2a-4a32-b870-a4544aa22d7e]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f55f8f6a-9762-499c-b6eb-b261bd7709a4 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ee6291-68bf-4557-856d-00e61bfdaa24 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52 (non-flash)
Aug 15 05:48:55 user nova-compute[73391]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f55f8f6a-9762-499c-b6eb-b261bd7709a4 (non-flash)
Aug 15 05:48:55 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:48:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ee6291-68bf-4557-856d-00e61bfdaa24 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52 (non-flash)
Aug 15 05:48:55 user nova-compute[73391]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f55f8f6a-9762-499c-b6eb-b261bd7709a4 (non-flash)
Aug 15 05:48:55 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:48:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-26ee6291-68bf-4557-856d-00e61bfdaa24 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f55f8f6a-9762-499c-b6eb-b261bd7709a4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:48:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ee6291-68bf-4557-856d-00e61bfdaa24 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 05:48:55 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-26ee6291-68bf-4557-856d-00e61bfdaa24 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] HCTL ('34', '-', '-', 0) found on session 51 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 05:48:55 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-26ee6291-68bf-4557-856d-00e61bfdaa24 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 05:48:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:55 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36d6c68-511d-4f80-9edc-6a01f05647ff]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:55 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-26ee6291-68bf-4557-856d-00e61bfdaa24 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: None {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:48:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:48:56 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-26ee6291-68bf-4557-856d-00e61bfdaa24 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Searching for a device in session 51 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:48:56 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ee6291-68bf-4557-856d-00e61bfdaa24 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gcyxFbpA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 05:48:56 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-26ee6291-68bf-4557-856d-00e61bfdaa24 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:48:56 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-26ee6291-68bf-4557-856d-00e61bfdaa24 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '26532656163656536', 'path': '/dev/sdc'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:48:56 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26ee6291-68bf-4557-856d-00e61bfdaa24 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26532656163656536', 'path': '/dev/sdc'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 05:48:56 user nova-compute[73391]: DEBUG nova.objects.instance [None req-26ee6291-68bf-4557-856d-00e61bfdaa24 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lazy-loading 'flavor' on Instance uuid fecde5f1-88fb-48b0-b039-93fdb285c93c {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:48:56 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-26ee6291-68bf-4557-856d-00e61bfdaa24 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 05:48:56 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:48:56 user nova-compute[73391]:   <source dev="/dev/sdc"/>
Aug 15 05:48:56 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:48:56 user nova-compute[73391]:   <serial>f55f8f6a-9762-499c-b6eb-b261bd7709a4</serial>
Aug 15 05:48:56 user nova-compute[73391]: </disk>
Aug 15 05:48:56 user nova-compute[73391]:  {{(pid=73391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 05:48:57 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-26ee6291-68bf-4557-856d-00e61bfdaa24 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:48:57 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-26ee6291-68bf-4557-856d-00e61bfdaa24 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:48:57 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-26ee6291-68bf-4557-856d-00e61bfdaa24 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] No VIF found with MAC fa:16:3e:66:e9:85, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:48:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-26ee6291-68bf-4557-856d-00e61bfdaa24 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lock "fecde5f1-88fb-48b0-b039-93fdb285c93c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.431s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:48:57 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:48:57 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692078522.6791737, 6ac9d5dc-56be-402f-b9d4-3327bdfd9220 => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:48:57 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] VM Stopped (Lifecycle Event)
Aug 15 05:48:57 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3fcac30f-994c-4363-b8b3-eaf7de558bf2 None None] [instance: 6ac9d5dc-56be-402f-b9d4-3327bdfd9220] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:48:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7990e351-6feb-49bc-8e0d-053d9657c3ea tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Acquiring lock "fecde5f1-88fb-48b0-b039-93fdb285c93c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:48:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7990e351-6feb-49bc-8e0d-053d9657c3ea tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lock "fecde5f1-88fb-48b0-b039-93fdb285c93c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:48:59 user nova-compute[73391]: INFO nova.compute.manager [None req-7990e351-6feb-49bc-8e0d-053d9657c3ea tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Detaching volume f55f8f6a-9762-499c-b6eb-b261bd7709a4
Aug 15 05:48:59 user nova-compute[73391]: INFO nova.virt.block_device [None req-7990e351-6feb-49bc-8e0d-053d9657c3ea tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Attempting to driver detach volume f55f8f6a-9762-499c-b6eb-b261bd7709a4 from mountpoint /dev/vdb
Aug 15 05:48:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-7990e351-6feb-49bc-8e0d-053d9657c3ea tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Attempting to detach device vdb from instance fecde5f1-88fb-48b0-b039-93fdb285c93c from the persistent domain config. {{(pid=73391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 05:48:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-7990e351-6feb-49bc-8e0d-053d9657c3ea tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 05:48:59 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:48:59 user nova-compute[73391]:   <source dev="/dev/sdc"/>
Aug 15 05:48:59 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:48:59 user nova-compute[73391]:   <serial>f55f8f6a-9762-499c-b6eb-b261bd7709a4</serial>
Aug 15 05:48:59 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 05:48:59 user nova-compute[73391]: </disk>
Aug 15 05:48:59 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 05:48:59 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-7990e351-6feb-49bc-8e0d-053d9657c3ea tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Successfully detached device vdb from instance fecde5f1-88fb-48b0-b039-93fdb285c93c from the persistent domain config.
Aug 15 05:48:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-7990e351-6feb-49bc-8e0d-053d9657c3ea tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fecde5f1-88fb-48b0-b039-93fdb285c93c from the live domain config. {{(pid=73391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 05:48:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-7990e351-6feb-49bc-8e0d-053d9657c3ea tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 05:48:59 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:48:59 user nova-compute[73391]:   <source dev="/dev/sdc"/>
Aug 15 05:48:59 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:48:59 user nova-compute[73391]:   <serial>f55f8f6a-9762-499c-b6eb-b261bd7709a4</serial>
Aug 15 05:48:59 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 05:48:59 user nova-compute[73391]: </disk>
Aug 15 05:48:59 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 05:48:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Received event <DeviceRemovedEvent: 1692078539.5909672, fecde5f1-88fb-48b0-b039-93fdb285c93c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73391) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 05:48:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-7990e351-6feb-49bc-8e0d-053d9657c3ea tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fecde5f1-88fb-48b0-b039-93fdb285c93c {{(pid=73391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 05:48:59 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-7990e351-6feb-49bc-8e0d-053d9657c3ea tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Successfully detached device vdb from instance fecde5f1-88fb-48b0-b039-93fdb285c93c from the live domain config.
Aug 15 05:48:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7990e351-6feb-49bc-8e0d-053d9657c3ea tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 05:48:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7990e351-6feb-49bc-8e0d-053d9657c3ea tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:f55f8f6a-9762-499c-b6eb-b261bd7709a4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gcyxFbpA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:48:59 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-7990e351-6feb-49bc-8e0d-053d9657c3ea tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:48:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-7990e351-6feb-49bc-8e0d-053d9657c3ea tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:48:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-7990e351-6feb-49bc-8e0d-053d9657c3ea tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:48:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7990e351-6feb-49bc-8e0d-053d9657c3ea tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f55f8f6a-9762-499c-b6eb-b261bd7709a4', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 05:48:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:59 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aeeed86-5122-4c38-8d20-86d121694b74]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f55f8f6a-9762-499c-b6eb-b261bd7709a4\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:59 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee39053-3030-46ca-a7ac-b94b010d10a9]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52 (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f55f8f6a-9762-499c-b6eb-b261bd7709a4 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7990e351-6feb-49bc-8e0d-053d9657c3ea tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52 (non-flash)
Aug 15 05:48:59 user nova-compute[73391]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f55f8f6a-9762-499c-b6eb-b261bd7709a4 (non-flash)
Aug 15 05:48:59 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:48:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7990e351-6feb-49bc-8e0d-053d9657c3ea tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52 (non-flash)
Aug 15 05:48:59 user nova-compute[73391]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f55f8f6a-9762-499c-b6eb-b261bd7709a4 (non-flash)
Aug 15 05:48:59 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:48:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7990e351-6feb-49bc-8e0d-053d9657c3ea tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77484c5cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f55f8f6a-9762-499c-b6eb-b261bd7709a4'): ({'sdc'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 05:48:59 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-7990e351-6feb-49bc-8e0d-053d9657c3ea tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Removing single pathed devices sdc {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 05:48:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:59 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93994d6-5fa2-4f9f-a9a2-5bda0478cf94]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:59 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[29793449-7894-4726-a32f-57e2f5f47783]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:59 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-7990e351-6feb-49bc-8e0d-053d9657c3ea tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Flushing IO for device /dev/sdc {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 05:48:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:59 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b535412e-1243-4d30-a1ee-d3d89b51613d]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:59 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-7990e351-6feb-49bc-8e0d-053d9657c3ea tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 05:48:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:48:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.126s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:59 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[da718074-0955-4dfe-bad2-d040823cd247]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:59 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-7990e351-6feb-49bc-8e0d-053d9657c3ea tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 05:48:59 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-7990e351-6feb-49bc-8e0d-053d9657c3ea tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] SCSI volumes sdc have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 05:48:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7990e351-6feb-49bc-8e0d-053d9657c3ea tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f55f8f6a-9762-499c-b6eb-b261bd7709a4')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 05:48:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f55f8f6a-9762-499c-b6eb-b261bd7709a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f55f8f6a-9762-499c-b6eb-b261bd7709a4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:59 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0de14699-7acd-42d0-84ce-0572f425de65]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7990e351-6feb-49bc-8e0d-053d9657c3ea tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:48:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f55f8f6a-9762-499c-b6eb-b261bd7709a4 -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:48:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f55f8f6a-9762-499c-b6eb-b261bd7709a4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:48:59 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd19e328-c5c2-4d6b-9cd7-53267edfba8d]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:f55f8f6a-9762-499c-b6eb-b261bd7709a4, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:f55f8f6a-9762-499c-b6eb-b261bd7709a4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:48:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7990e351-6feb-49bc-8e0d-053d9657c3ea tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:f55f8f6a-9762-499c-b6eb-b261bd7709a4, portal: 172.16.0.220,3260]
Aug 15 05:48:59 user nova-compute[73391]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:f55f8f6a-9762-499c-b6eb-b261bd7709a4, portal: 172.16.0.220,3260] successful.
Aug 15 05:48:59 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:48:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f55f8f6a-9762-499c-b6eb-b261bd7709a4 -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:49:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f55f8f6a-9762-499c-b6eb-b261bd7709a4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:49:00 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe52dd7-ead5-4647-8d9b-8850a4319fe4]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:49:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7990e351-6feb-49bc-8e0d-053d9657c3ea tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:49:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-7990e351-6feb-49bc-8e0d-053d9657c3ea tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.397s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:49:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7990e351-6feb-49bc-8e0d-053d9657c3ea tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] <== disconnect_volume: return (398ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:49:00 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7990e351-6feb-49bc-8e0d-053d9657c3ea tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 05:49:00 user nova-compute[73391]: DEBUG nova.objects.instance [None req-7990e351-6feb-49bc-8e0d-053d9657c3ea tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lazy-loading 'flavor' on Instance uuid fecde5f1-88fb-48b0-b039-93fdb285c93c {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:49:00 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7990e351-6feb-49bc-8e0d-053d9657c3ea tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lock "fecde5f1-88fb-48b0-b039-93fdb285c93c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.914s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:49:01 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692078526.7067533, 8f08782b-f793-415e-b0d6-5caad1c3d426 => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:49:01 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] VM Stopped (Lifecycle Event)
Aug 15 05:49:01 user nova-compute[73391]: DEBUG nova.compute.manager [None req-94b416ef-3537-4889-bd9e-af7121332e38 None None] [instance: 8f08782b-f793-415e-b0d6-5caad1c3d426] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:49:01 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:49:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:49:06 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:49:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:49:11 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:49:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:49:16 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:49:19 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:49:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:49:21 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:49:24 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:49:25 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:49:25 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:49:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:49:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:49:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:49:25 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Auditing locally available compute resources for user (node: user) {{(pid=73391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 05:49:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:49:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:49:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:49:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:49:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fecde5f1-88fb-48b0-b039-93fdb285c93c/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:49:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fecde5f1-88fb-48b0-b039-93fdb285c93c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:49:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fecde5f1-88fb-48b0-b039-93fdb285c93c/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:49:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fecde5f1-88fb-48b0-b039-93fdb285c93c/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:49:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85a919d-7f44-4093-b89a-51397ad5cedb/disk.rescue --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:49:26 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:49:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85a919d-7f44-4093-b89a-51397ad5cedb/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:49:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85a919d-7f44-4093-b89a-51397ad5cedb/disk.rescue --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:49:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85a919d-7f44-4093-b89a-51397ad5cedb/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:49:27 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /opt/stack/data/nova/instances/d85a919d-7f44-4093-b89a-51397ad5cedb/disk (vdb) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:49:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8775490-2a9e-44ac-aad7-9450afa4c295/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:49:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8775490-2a9e-44ac-aad7-9450afa4c295/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:49:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8775490-2a9e-44ac-aad7-9450afa4c295/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:49:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8775490-2a9e-44ac-aad7-9450afa4c295/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:49:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:49:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:49:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:49:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:49:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:49:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:49:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:49:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:49:28 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:49:28 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:49:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Hypervisor/Node resource view: name=user free_ram=8050MB free_disk=25.109752655029297GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 05:49:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:49:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:49:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 730890c6-6999-4a0f-b80c-e4745bff99ab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:49:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 8ff2da51-5bfd-4cdc-8cef-330cdef93d97 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:49:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance e8775490-2a9e-44ac-aad7-9450afa4c295 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:49:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance d85a919d-7f44-4093-b89a-51397ad5cedb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:49:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance fecde5f1-88fb-48b0-b039-93fdb285c93c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:49:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 05:49:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 05:49:29 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:49:29 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:49:29 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Compute_service record updated for user:user {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 05:49:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.378s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:49:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:49:33 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:49:33 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:49:33 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Starting heal instance info cache {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 05:49:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "refresh_cache-730890c6-6999-4a0f-b80c-e4745bff99ab" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:49:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquired lock "refresh_cache-730890c6-6999-4a0f-b80c-e4745bff99ab" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:49:33 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Forcefully refreshing network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 05:49:34 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Updating instance_info_cache with network_info: [{"id": "f598ee19-8c81-4cf2-a88d-8221516eb1cf", "address": "fa:16:3e:2e:da:40", "network": {"id": "bec69c6a-b2cb-4b0a-ba6e-ae6dae099818", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7da9448cc34b609120da564a01dba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf598ee19-8c", "ovs_interfaceid": "f598ee19-8c81-4cf2-a88d-8221516eb1cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:49:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Releasing lock "refresh_cache-730890c6-6999-4a0f-b80c-e4745bff99ab" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:49:34 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Updated the network info_cache for instance {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 05:49:34 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:49:34 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:49:34 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:49:34 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 05:49:36 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:49:36 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:49:36 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:49:36 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:49:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:49:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:49:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "fc4686ad-47da-40ad-83ce-941ee8810059" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:49:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "fc4686ad-47da-40ad-83ce-941ee8810059" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:49:43 user nova-compute[73391]: DEBUG nova.compute.manager [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Starting instance... {{(pid=73391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 05:49:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:49:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:49:43 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 05:49:43 user nova-compute[73391]: INFO nova.compute.claims [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Claim successful on node user
Aug 15 05:49:43 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:49:43 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:49:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.337s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:49:43 user nova-compute[73391]: DEBUG nova.compute.manager [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Start building networks asynchronously for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 05:49:43 user nova-compute[73391]: DEBUG nova.compute.manager [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Allocating IP information in the background. {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 05:49:43 user nova-compute[73391]: DEBUG nova.network.neutron [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] allocate_for_instance() {{(pid=73391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 05:49:43 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 05:49:43 user nova-compute[73391]: DEBUG nova.compute.manager [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Start building block device mappings for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 05:49:44 user nova-compute[73391]: INFO nova.virt.block_device [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Booting with volume 7f4a52d4-743f-45db-91c3-b7e42de736c1 at /dev/vda
Aug 15 05:49:44 user nova-compute[73391]: DEBUG nova.policy [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aefb6ccab586465dbe56e71a40bcf1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8188c2e8ca34ef1982faa49f1058bb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73391) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 05:49:44 user nova-compute[73391]: DEBUG os_brick.utils [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:49:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:49:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:49:44 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b3f6518-be58-4633-94d4-1c65729e5d34]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:49:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:49:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:49:44 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[86922705-7b68-451b-b39a-e855b8f329b1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:49:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:49:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:49:44 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b31a25b-9ccf-49b0-847b-d0232127a20d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:49:44 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6849259f-9570-46d2-93ce-3ab84e577117]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:49:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:49:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:49:44 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 05:49:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:49:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:49:44 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 05:49:44 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b70039e-4f28-4fa4-a8ba-e64b344a82bb]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:49:44 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 05:49:44 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 05:49:44 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 05:49:44 user nova-compute[73391]: DEBUG os_brick.utils [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:49:44 user nova-compute[73391]: DEBUG nova.virt.block_device [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Updating existing volume attachment record: 41c7fb04-2d25-41bf-9057-0ba7e39abb05 {{(pid=73391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 05:49:44 user nova-compute[73391]: DEBUG nova.network.neutron [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Successfully created port: 23bb4aff-c85d-49e5-9fef-83fae45710d3 {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 05:49:45 user nova-compute[73391]: DEBUG nova.network.neutron [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Successfully updated port: 23bb4aff-c85d-49e5-9fef-83fae45710d3 {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:49:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "refresh_cache-fc4686ad-47da-40ad-83ce-941ee8810059" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:49:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquired lock "refresh_cache-fc4686ad-47da-40ad-83ce-941ee8810059" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:49:46 user nova-compute[73391]: DEBUG nova.network.neutron [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:49:46 user nova-compute[73391]: DEBUG nova.compute.manager [req-a9155a43-aadc-4529-9e18-645e0d916bef req-d1d69a68-1f60-4168-86b4-8e9d3f15ce33 service nova] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Received event network-changed-23bb4aff-c85d-49e5-9fef-83fae45710d3 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:49:46 user nova-compute[73391]: DEBUG nova.compute.manager [req-a9155a43-aadc-4529-9e18-645e0d916bef req-d1d69a68-1f60-4168-86b4-8e9d3f15ce33 service nova] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Refreshing instance network info cache due to event network-changed-23bb4aff-c85d-49e5-9fef-83fae45710d3. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:49:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-a9155a43-aadc-4529-9e18-645e0d916bef req-d1d69a68-1f60-4168-86b4-8e9d3f15ce33 service nova] Acquiring lock "refresh_cache-fc4686ad-47da-40ad-83ce-941ee8810059" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:49:46 user nova-compute[73391]: DEBUG nova.network.neutron [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:49:46 user nova-compute[73391]: DEBUG nova.network.neutron [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Updating instance_info_cache with network_info: [{"id": "23bb4aff-c85d-49e5-9fef-83fae45710d3", "address": "fa:16:3e:62:f5:97", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23bb4aff-c8", "ovs_interfaceid": "23bb4aff-c85d-49e5-9fef-83fae45710d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:49:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Releasing lock "refresh_cache-fc4686ad-47da-40ad-83ce-941ee8810059" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:49:46 user nova-compute[73391]: DEBUG nova.compute.manager [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Instance network_info: |[{"id": "23bb4aff-c85d-49e5-9fef-83fae45710d3", "address": "fa:16:3e:62:f5:97", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23bb4aff-c8", "ovs_interfaceid": "23bb4aff-c85d-49e5-9fef-83fae45710d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 05:49:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-a9155a43-aadc-4529-9e18-645e0d916bef req-d1d69a68-1f60-4168-86b4-8e9d3f15ce33 service nova] Acquired lock "refresh_cache-fc4686ad-47da-40ad-83ce-941ee8810059" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:49:46 user nova-compute[73391]: DEBUG nova.network.neutron [req-a9155a43-aadc-4529-9e18-645e0d916bef req-d1d69a68-1f60-4168-86b4-8e9d3f15ce33 service nova] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Refreshing network info cache for port 23bb4aff-c85d-49e5-9fef-83fae45710d3 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:49:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:49:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:49:47 user nova-compute[73391]: DEBUG nova.network.neutron [req-a9155a43-aadc-4529-9e18-645e0d916bef req-d1d69a68-1f60-4168-86b4-8e9d3f15ce33 service nova] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Updated VIF entry in instance network info cache for port 23bb4aff-c85d-49e5-9fef-83fae45710d3. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:49:47 user nova-compute[73391]: DEBUG nova.network.neutron [req-a9155a43-aadc-4529-9e18-645e0d916bef req-d1d69a68-1f60-4168-86b4-8e9d3f15ce33 service nova] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Updating instance_info_cache with network_info: [{"id": "23bb4aff-c85d-49e5-9fef-83fae45710d3", "address": "fa:16:3e:62:f5:97", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23bb4aff-c8", "ovs_interfaceid": "23bb4aff-c85d-49e5-9fef-83fae45710d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:49:47 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-a9155a43-aadc-4529-9e18-645e0d916bef req-d1d69a68-1f60-4168-86b4-8e9d3f15ce33 service nova] Releasing lock "refresh_cache-fc4686ad-47da-40ad-83ce-941ee8810059" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:49:49 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:49:50 user nova-compute[73391]: DEBUG nova.compute.manager [req-6ba4e90e-f210-4f64-9b22-d3d9fb4c7bc8 req-cb667e77-90e9-474a-bf0b-f497411159a0 service nova] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Received event network-changed-b884b795-4023-4343-b6dd-9cf6e5dd880a {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:49:50 user nova-compute[73391]: DEBUG nova.compute.manager [req-6ba4e90e-f210-4f64-9b22-d3d9fb4c7bc8 req-cb667e77-90e9-474a-bf0b-f497411159a0 service nova] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Refreshing instance network info cache due to event network-changed-b884b795-4023-4343-b6dd-9cf6e5dd880a. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:49:50 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-6ba4e90e-f210-4f64-9b22-d3d9fb4c7bc8 req-cb667e77-90e9-474a-bf0b-f497411159a0 service nova] Acquiring lock "refresh_cache-fecde5f1-88fb-48b0-b039-93fdb285c93c" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:49:50 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-6ba4e90e-f210-4f64-9b22-d3d9fb4c7bc8 req-cb667e77-90e9-474a-bf0b-f497411159a0 service nova] Acquired lock "refresh_cache-fecde5f1-88fb-48b0-b039-93fdb285c93c" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:49:50 user nova-compute[73391]: DEBUG nova.network.neutron [req-6ba4e90e-f210-4f64-9b22-d3d9fb4c7bc8 req-cb667e77-90e9-474a-bf0b-f497411159a0 service nova] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Refreshing network info cache for port b884b795-4023-4343-b6dd-9cf6e5dd880a {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:49:50 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-623fb1f0-a815-4403-9686-f9e7af50d2d3 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Acquiring lock "fecde5f1-88fb-48b0-b039-93fdb285c93c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:49:50 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-623fb1f0-a815-4403-9686-f9e7af50d2d3 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lock "fecde5f1-88fb-48b0-b039-93fdb285c93c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:49:50 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-623fb1f0-a815-4403-9686-f9e7af50d2d3 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Acquiring lock "fecde5f1-88fb-48b0-b039-93fdb285c93c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:49:50 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-623fb1f0-a815-4403-9686-f9e7af50d2d3 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lock "fecde5f1-88fb-48b0-b039-93fdb285c93c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:49:50 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-623fb1f0-a815-4403-9686-f9e7af50d2d3 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lock "fecde5f1-88fb-48b0-b039-93fdb285c93c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:49:50 user nova-compute[73391]: INFO nova.compute.manager [None req-623fb1f0-a815-4403-9686-f9e7af50d2d3 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Terminating instance
Aug 15 05:49:50 user nova-compute[73391]: DEBUG nova.compute.manager [None req-623fb1f0-a815-4403-9686-f9e7af50d2d3 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Start destroying the instance on the hypervisor. {{(pid=73391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 05:49:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:49:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:49:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:49:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:49:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:49:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:49:50 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Instance destroyed successfully.
Aug 15 05:49:50 user nova-compute[73391]: DEBUG nova.objects.instance [None req-623fb1f0-a815-4403-9686-f9e7af50d2d3 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lazy-loading 'resources' on Instance uuid fecde5f1-88fb-48b0-b039-93fdb285c93c {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:49:51 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-623fb1f0-a815-4403-9686-f9e7af50d2d3 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:46:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-758061833',display_name='tempest-TestStampPattern-server-758061833',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-758061833',id=38,image_ref='bfa322eb-e7e2-4d69-a0db-ebbf2aec1b33',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQQVWOeuc6yJ6EmMw2rWLVsGpBPeA9gFNl5HRrfI/TUHS+ncoxmVN1359pxZR2y8M4qFx49b4zMDH1GSzjx/6CrvC6kH/thvZ4QYbb7yiE9dJlfo8ha6chN1RxR3KNG5w==',key_name='tempest-TestStampPattern-1501428928',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:47:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='623d93149e574954839e469432f24fc8',ramdisk_id='',reservation_id='r-1hk4sx36',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='e8775490-2a9e-44ac-aad7-9450afa4c295',image_min_disk='1',image_min_ram='0',image_owner_id='623d93149e574954839e469432f24fc8',image_owner_project_name='tempest-TestStampPattern-1421231515',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1421231515-project-member',image_user_id='5f88c49b60b5427bb5c07323e4312b14',owner_project_name='tempest-TestStampPattern-1421231515',owner_user_name='tempest-TestStampPattern-1421231515-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:47:00Z,user_data=None,user_id='5f88c49b60b5427bb5c07323e4312b14',uuid=fecde5f1-88fb-48b0-b039-93fdb285c93c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b884b795-4023-4343-b6dd-9cf6e5dd880a", "address": "fa:16:3e:66:e9:85", "network": {"id": "c7ff2e30-7396-4af7-bd21-e9157804987e", "bridge": "br-int", "label": "tempest-TestStampPattern-2022602784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "623d93149e574954839e469432f24fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb884b795-40", "ovs_interfaceid": "b884b795-4023-4343-b6dd-9cf6e5dd880a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:49:51 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-623fb1f0-a815-4403-9686-f9e7af50d2d3 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Converting VIF {"id": "b884b795-4023-4343-b6dd-9cf6e5dd880a", "address": "fa:16:3e:66:e9:85", "network": {"id": "c7ff2e30-7396-4af7-bd21-e9157804987e", "bridge": "br-int", "label": "tempest-TestStampPattern-2022602784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.238", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "623d93149e574954839e469432f24fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb884b795-40", "ovs_interfaceid": "b884b795-4023-4343-b6dd-9cf6e5dd880a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:49:51 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-623fb1f0-a815-4403-9686-f9e7af50d2d3 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:e9:85,bridge_name='br-int',has_traffic_filtering=True,id=b884b795-4023-4343-b6dd-9cf6e5dd880a,network=Network(c7ff2e30-7396-4af7-bd21-e9157804987e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb884b795-40') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:49:51 user nova-compute[73391]: DEBUG os_vif [None req-623fb1f0-a815-4403-9686-f9e7af50d2d3 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:e9:85,bridge_name='br-int',has_traffic_filtering=True,id=b884b795-4023-4343-b6dd-9cf6e5dd880a,network=Network(c7ff2e30-7396-4af7-bd21-e9157804987e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb884b795-40') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:49:51 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:49:51 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb884b795-40, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:49:51 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:49:51 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:49:51 user nova-compute[73391]: INFO os_vif [None req-623fb1f0-a815-4403-9686-f9e7af50d2d3 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:e9:85,bridge_name='br-int',has_traffic_filtering=True,id=b884b795-4023-4343-b6dd-9cf6e5dd880a,network=Network(c7ff2e30-7396-4af7-bd21-e9157804987e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb884b795-40')
Aug 15 05:49:51 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-623fb1f0-a815-4403-9686-f9e7af50d2d3 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Deleting instance files /opt/stack/data/nova/instances/fecde5f1-88fb-48b0-b039-93fdb285c93c_del
Aug 15 05:49:51 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-623fb1f0-a815-4403-9686-f9e7af50d2d3 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Deletion of /opt/stack/data/nova/instances/fecde5f1-88fb-48b0-b039-93fdb285c93c_del complete
Aug 15 05:49:51 user nova-compute[73391]: INFO nova.compute.manager [None req-623fb1f0-a815-4403-9686-f9e7af50d2d3 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Took 0.99 seconds to destroy the instance on the hypervisor.
Aug 15 05:49:51 user nova-compute[73391]: DEBUG oslo.service.loopingcall [None req-623fb1f0-a815-4403-9686-f9e7af50d2d3 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 05:49:51 user nova-compute[73391]: DEBUG nova.compute.manager [-] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Deallocating network for instance {{(pid=73391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 05:49:51 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] deallocate_for_instance() {{(pid=73391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 05:49:51 user nova-compute[73391]: DEBUG nova.network.neutron [req-6ba4e90e-f210-4f64-9b22-d3d9fb4c7bc8 req-cb667e77-90e9-474a-bf0b-f497411159a0 service nova] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Updated VIF entry in instance network info cache for port b884b795-4023-4343-b6dd-9cf6e5dd880a. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:49:51 user nova-compute[73391]: DEBUG nova.network.neutron [req-6ba4e90e-f210-4f64-9b22-d3d9fb4c7bc8 req-cb667e77-90e9-474a-bf0b-f497411159a0 service nova] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Updating instance_info_cache with network_info: [{"id": "b884b795-4023-4343-b6dd-9cf6e5dd880a", "address": "fa:16:3e:66:e9:85", "network": {"id": "c7ff2e30-7396-4af7-bd21-e9157804987e", "bridge": "br-int", "label": "tempest-TestStampPattern-2022602784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "623d93149e574954839e469432f24fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb884b795-40", "ovs_interfaceid": "b884b795-4023-4343-b6dd-9cf6e5dd880a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:49:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-6ba4e90e-f210-4f64-9b22-d3d9fb4c7bc8 req-cb667e77-90e9-474a-bf0b-f497411159a0 service nova] Releasing lock "refresh_cache-fecde5f1-88fb-48b0-b039-93fdb285c93c" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:49:52 user nova-compute[73391]: DEBUG nova.compute.manager [req-2cbf8195-be38-4735-9d1f-684093a29d62 req-46adca1d-0699-449c-8c16-c1841c3f35a8 service nova] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Received event network-vif-unplugged-b884b795-4023-4343-b6dd-9cf6e5dd880a {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:49:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2cbf8195-be38-4735-9d1f-684093a29d62 req-46adca1d-0699-449c-8c16-c1841c3f35a8 service nova] Acquiring lock "fecde5f1-88fb-48b0-b039-93fdb285c93c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:49:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2cbf8195-be38-4735-9d1f-684093a29d62 req-46adca1d-0699-449c-8c16-c1841c3f35a8 service nova] Lock "fecde5f1-88fb-48b0-b039-93fdb285c93c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:49:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2cbf8195-be38-4735-9d1f-684093a29d62 req-46adca1d-0699-449c-8c16-c1841c3f35a8 service nova] Lock "fecde5f1-88fb-48b0-b039-93fdb285c93c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:49:52 user nova-compute[73391]: DEBUG nova.compute.manager [req-2cbf8195-be38-4735-9d1f-684093a29d62 req-46adca1d-0699-449c-8c16-c1841c3f35a8 service nova] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] No waiting events found dispatching network-vif-unplugged-b884b795-4023-4343-b6dd-9cf6e5dd880a {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:49:52 user nova-compute[73391]: DEBUG nova.compute.manager [req-2cbf8195-be38-4735-9d1f-684093a29d62 req-46adca1d-0699-449c-8c16-c1841c3f35a8 service nova] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Received event network-vif-unplugged-b884b795-4023-4343-b6dd-9cf6e5dd880a for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 05:49:52 user nova-compute[73391]: DEBUG nova.compute.manager [req-2cbf8195-be38-4735-9d1f-684093a29d62 req-46adca1d-0699-449c-8c16-c1841c3f35a8 service nova] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Received event network-vif-plugged-b884b795-4023-4343-b6dd-9cf6e5dd880a {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:49:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2cbf8195-be38-4735-9d1f-684093a29d62 req-46adca1d-0699-449c-8c16-c1841c3f35a8 service nova] Acquiring lock "fecde5f1-88fb-48b0-b039-93fdb285c93c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:49:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2cbf8195-be38-4735-9d1f-684093a29d62 req-46adca1d-0699-449c-8c16-c1841c3f35a8 service nova] Lock "fecde5f1-88fb-48b0-b039-93fdb285c93c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:49:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2cbf8195-be38-4735-9d1f-684093a29d62 req-46adca1d-0699-449c-8c16-c1841c3f35a8 service nova] Lock "fecde5f1-88fb-48b0-b039-93fdb285c93c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:49:52 user nova-compute[73391]: DEBUG nova.compute.manager [req-2cbf8195-be38-4735-9d1f-684093a29d62 req-46adca1d-0699-449c-8c16-c1841c3f35a8 service nova] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] No waiting events found dispatching network-vif-plugged-b884b795-4023-4343-b6dd-9cf6e5dd880a {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:49:52 user nova-compute[73391]: WARNING nova.compute.manager [req-2cbf8195-be38-4735-9d1f-684093a29d62 req-46adca1d-0699-449c-8c16-c1841c3f35a8 service nova] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Received unexpected event network-vif-plugged-b884b795-4023-4343-b6dd-9cf6e5dd880a for instance with vm_state active and task_state deleting.
Aug 15 05:49:52 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:49:52 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Took 1.29 seconds to deallocate network for instance.
Aug 15 05:49:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-623fb1f0-a815-4403-9686-f9e7af50d2d3 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:49:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-623fb1f0-a815-4403-9686-f9e7af50d2d3 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:49:52 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-623fb1f0-a815-4403-9686-f9e7af50d2d3 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:49:52 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-623fb1f0-a815-4403-9686-f9e7af50d2d3 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:49:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-623fb1f0-a815-4403-9686-f9e7af50d2d3 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.287s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:49:52 user nova-compute[73391]: INFO nova.scheduler.client.report [None req-623fb1f0-a815-4403-9686-f9e7af50d2d3 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Deleted allocations for instance fecde5f1-88fb-48b0-b039-93fdb285c93c
Aug 15 05:49:53 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-623fb1f0-a815-4403-9686-f9e7af50d2d3 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lock "fecde5f1-88fb-48b0-b039-93fdb285c93c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.870s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:49:54 user nova-compute[73391]: DEBUG nova.compute.manager [req-10757901-114a-4dab-83f6-e9ed3bfa6f8b req-463f022f-e100-4259-9e45-90a6093eb569 service nova] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Received event network-vif-deleted-b884b795-4023-4343-b6dd-9cf6e5dd880a {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:49:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG nova.compute.manager [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Start spawning the instance on the hypervisor. {{(pid=73391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Creating instance directory {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 05:49:55 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Creating image(s)
Aug 15 05:49:55 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Did not create local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Ensure instance console log exists: /opt/stack/data/nova/instances/fc4686ad-47da-40ad-83ce-941ee8810059/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Start _get_guest_xml network_info=[{"id": "23bb4aff-c85d-49e5-9fef-83fae45710d3", "address": "fa:16:3e:62:f5:97", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23bb4aff-c8", "ovs_interfaceid": "23bb4aff-c85d-49e5-9fef-83fae45710d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sQZfExwK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'fc4686ad-47da-40ad-83ce-941ee8810059', 'attached_at': '', 'detached_at': '', 'volume_id': '7f4a52d4-743f-45db-91c3-b7e42de736c1', 'serial': '7f4a52d4-743f-45db-91c3-b7e42de736c1'}, 'attachment_id': '41c7fb04-2d25-41bf-9057-0ba7e39abb05', 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:49:55 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:49:55 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:49:55 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sQZfExwK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:49:55 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:49:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:49:55 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:49:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:49:55 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 05:49:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Acquiring lock "3adc0c85-0f31-4a73-8b98-eb1a4b32434d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Lock "3adc0c85-0f31-4a73-8b98-eb1a4b32434d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b773682-4d56-4b28-87fa-6f7f8811e5de]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 05:49:55 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG nova.compute.manager [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Starting instance... {{(pid=73391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[06f2d3b1-79fa-4ac0-9051-620f025ed728]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1] added
Aug 15 05:49:55 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0d31c4-535f-4a52-b597-10c4db92ddfa]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f4061d7-e270-4bec-977e-d8f3457e3361]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sQZfExwK {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sQZfExwK" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[665d97aa-75ef-43c2-9934-a3694c27c0e6]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sQZfExwK'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 05:49:55 user nova-compute[73391]: INFO nova.compute.claims [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Claim successful on node user
Aug 15 05:49:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[31a0070a-66e1-4ac4-b99f-28c77eb0db9d]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e51650-ba82-4c00-9dec-c82a275945d0]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52 (non-flash)
Aug 15 05:49:55 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52 (non-flash)
Aug 15 05:49:55 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df54cd6-d791-4c17-84d0-1b6d9f9de699]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1, portal: 172.16.0.220,3260]
Aug 15 05:49:55 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1, portal: 172.16.0.220,3260] successful.
Aug 15 05:49:55 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.036s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a083629-3eb6-4379-bceb-3ba63705bfb9]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[db15849c-cbba-469c-963e-4256802a35c8]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52 (non-flash)
Aug 15 05:49:55 user nova-compute[73391]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 (non-flash)
Aug 15 05:49:55 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52 (non-flash)
Aug 15 05:49:55 user nova-compute[73391]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 (non-flash)
Aug 15 05:49:55 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.024s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fac5944-248a-4902-86f9-84ac7f10ec1d]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sQZfExwK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.416s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG nova.compute.manager [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Start building networks asynchronously for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG nova.compute.manager [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Allocating IP information in the background. {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 05:49:55 user nova-compute[73391]: DEBUG nova.network.neutron [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] allocate_for_instance() {{(pid=73391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 05:49:55 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 05:49:55 user nova-compute[73391]: DEBUG nova.compute.manager [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Start building block device mappings for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 05:49:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:49:56 user nova-compute[73391]: DEBUG nova.policy [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '43a914b6a21746b99ec36fb395d2f87f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d6c4fcd171841d6b59b8b400efd0619', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73391) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 05:49:56 user nova-compute[73391]: DEBUG nova.compute.manager [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Start spawning the instance on the hypervisor. {{(pid=73391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 05:49:56 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Creating instance directory {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 05:49:56 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Creating image(s)
Aug 15 05:49:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Acquiring lock "/opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:49:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Lock "/opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:49:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Lock "/opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:49:56 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:49:56 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.178s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:49:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Acquiring lock "999b315ba87151d8252d543312ae7790e7e1583b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:49:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:49:56 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:49:56 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.176s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:49:56 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/disk 1073741824 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:49:56 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/disk 1073741824" returned: 0 in 0.055s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:49:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:49:56 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:49:56 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.412s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:49:56 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] <== connect_volume: return (1416ms) {'type': 'block', 'scsi_wwn': '23931386230356335', 'path': '/dev/sdc'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:49:56 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931386230356335', 'path': '/dev/sdc'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 05:49:56 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:49:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1648940891',display_name='tempest-TestVolumeBootPattern-server-1648940891',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1648940891',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9jBoYjOy+aqM5q6fYRpW336xJnp1RjcA+ryp4UUPjXWPw7VtxeYktb68BzzUpanNxgDS13R1RxH4S+D0vqFMFtOkREwueXmREiQ22XqN9Aby3PDiDj1ii3iTWuJ+dFag==',key_name='tempest-TestVolumeBootPattern-1057822238',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8188c2e8ca34ef1982faa49f1058bb7',ramdisk_id='',reservation_id='r-eie8f2tq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1834029963',owner_user_name='tempest-TestVolumeBootPattern-1834029963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:49:44Z,user_data=None,user_id='aefb6ccab586465dbe56e71a40bcf1f0',uuid=fc4686ad-47da-40ad-83ce-941ee8810059,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23bb4aff-c85d-49e5-9fef-83fae45710d3", "address": "fa:16:3e:62:f5:97", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23bb4aff-c8", "ovs_interfaceid": "23bb4aff-c85d-49e5-9fef-83fae45710d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:49:56 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Converting VIF {"id": "23bb4aff-c85d-49e5-9fef-83fae45710d3", "address": "fa:16:3e:62:f5:97", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23bb4aff-c8", "ovs_interfaceid": "23bb4aff-c85d-49e5-9fef-83fae45710d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:49:56 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:f5:97,bridge_name='br-int',has_traffic_filtering=True,id=23bb4aff-c85d-49e5-9fef-83fae45710d3,network=Network(fae0e46a-88e4-499d-bcff-5b7df55eab4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23bb4aff-c8') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:49:56 user nova-compute[73391]: DEBUG nova.objects.instance [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lazy-loading 'pci_devices' on Instance uuid fc4686ad-47da-40ad-83ce-941ee8810059 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:49:56 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:49:56 user nova-compute[73391]:   <uuid>fc4686ad-47da-40ad-83ce-941ee8810059</uuid>
Aug 15 05:49:56 user nova-compute[73391]:   <name>instance-00000027</name>
Aug 15 05:49:56 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:49:56 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:49:56 user nova-compute[73391]:   <metadata>
Aug 15 05:49:56 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:49:56 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:49:56 user nova-compute[73391]:       <nova:name>tempest-TestVolumeBootPattern-server-1648940891</nova:name>
Aug 15 05:49:56 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:49:55</nova:creationTime>
Aug 15 05:49:56 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:49:56 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:49:56 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:49:56 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:49:56 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:49:56 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:49:56 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:49:56 user nova-compute[73391]:       <nova:owner>
Aug 15 05:49:56 user nova-compute[73391]:         <nova:user uuid="aefb6ccab586465dbe56e71a40bcf1f0">tempest-TestVolumeBootPattern-1834029963-project-member</nova:user>
Aug 15 05:49:56 user nova-compute[73391]:         <nova:project uuid="a8188c2e8ca34ef1982faa49f1058bb7">tempest-TestVolumeBootPattern-1834029963</nova:project>
Aug 15 05:49:56 user nova-compute[73391]:       </nova:owner>
Aug 15 05:49:56 user nova-compute[73391]:       <nova:ports>
Aug 15 05:49:56 user nova-compute[73391]:         <nova:port uuid="23bb4aff-c85d-49e5-9fef-83fae45710d3">
Aug 15 05:49:56 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Aug 15 05:49:56 user nova-compute[73391]:         </nova:port>
Aug 15 05:49:56 user nova-compute[73391]:       </nova:ports>
Aug 15 05:49:56 user nova-compute[73391]:     </nova:instance>
Aug 15 05:49:56 user nova-compute[73391]:   </metadata>
Aug 15 05:49:56 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:49:56 user nova-compute[73391]:     <system>
Aug 15 05:49:56 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:49:56 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:49:56 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:49:56 user nova-compute[73391]:       <entry name="serial">fc4686ad-47da-40ad-83ce-941ee8810059</entry>
Aug 15 05:49:56 user nova-compute[73391]:       <entry name="uuid">fc4686ad-47da-40ad-83ce-941ee8810059</entry>
Aug 15 05:49:56 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:49:56 user nova-compute[73391]:     </system>
Aug 15 05:49:56 user nova-compute[73391]:   </sysinfo>
Aug 15 05:49:56 user nova-compute[73391]:   <os>
Aug 15 05:49:56 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:49:56 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:49:56 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:49:56 user nova-compute[73391]:   </os>
Aug 15 05:49:56 user nova-compute[73391]:   <features>
Aug 15 05:49:56 user nova-compute[73391]:     <acpi/>
Aug 15 05:49:56 user nova-compute[73391]:     <apic/>
Aug 15 05:49:56 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:49:56 user nova-compute[73391]:   </features>
Aug 15 05:49:56 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:49:56 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:49:56 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:49:56 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:49:56 user nova-compute[73391]:   </clock>
Aug 15 05:49:56 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:49:56 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:49:56 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:49:56 user nova-compute[73391]:   </cpu>
Aug 15 05:49:56 user nova-compute[73391]:   <devices>
Aug 15 05:49:56 user nova-compute[73391]:     <disk type="block" device="disk">
Aug 15 05:49:56 user nova-compute[73391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:49:56 user nova-compute[73391]:       <source dev="/dev/sdc"/>
Aug 15 05:49:56 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:49:56 user nova-compute[73391]:       <serial>7f4a52d4-743f-45db-91c3-b7e42de736c1</serial>
Aug 15 05:49:56 user nova-compute[73391]:     </disk>
Aug 15 05:49:56 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:49:56 user nova-compute[73391]:       <mac address="fa:16:3e:62:f5:97"/>
Aug 15 05:49:56 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:49:56 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:49:56 user nova-compute[73391]:       <target dev="tap23bb4aff-c8"/>
Aug 15 05:49:56 user nova-compute[73391]:     </interface>
Aug 15 05:49:56 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:49:56 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/fc4686ad-47da-40ad-83ce-941ee8810059/console.log" append="off"/>
Aug 15 05:49:56 user nova-compute[73391]:     </serial>
Aug 15 05:49:56 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:49:56 user nova-compute[73391]:     <video>
Aug 15 05:49:56 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:49:56 user nova-compute[73391]:     </video>
Aug 15 05:49:56 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:49:56 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:49:56 user nova-compute[73391]:     </rng>
Aug 15 05:49:56 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:49:56 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:49:56 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:49:56 user nova-compute[73391]:     </memballoon>
Aug 15 05:49:56 user nova-compute[73391]:   </devices>
Aug 15 05:49:56 user nova-compute[73391]: </domain>
Aug 15 05:49:56 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:49:56 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:49:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1648940891',display_name='tempest-TestVolumeBootPattern-server-1648940891',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1648940891',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9jBoYjOy+aqM5q6fYRpW336xJnp1RjcA+ryp4UUPjXWPw7VtxeYktb68BzzUpanNxgDS13R1RxH4S+D0vqFMFtOkREwueXmREiQ22XqN9Aby3PDiDj1ii3iTWuJ+dFag==',key_name='tempest-TestVolumeBootPattern-1057822238',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8188c2e8ca34ef1982faa49f1058bb7',ramdisk_id='',reservation_id='r-eie8f2tq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1834029963',owner_user_name='tempest-TestVolumeBootPattern-1834029963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:49:44Z,user_data=None,user_id='aefb6ccab586465dbe56e71a40bcf1f0',uuid=fc4686ad-47da-40ad-83ce-941ee8810059,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "23bb4aff-c85d-49e5-9fef-83fae45710d3", "address": "fa:16:3e:62:f5:97", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23bb4aff-c8", "ovs_interfaceid": "23bb4aff-c85d-49e5-9fef-83fae45710d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:49:56 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Converting VIF {"id": "23bb4aff-c85d-49e5-9fef-83fae45710d3", "address": "fa:16:3e:62:f5:97", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23bb4aff-c8", "ovs_interfaceid": "23bb4aff-c85d-49e5-9fef-83fae45710d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:49:56 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:f5:97,bridge_name='br-int',has_traffic_filtering=True,id=23bb4aff-c85d-49e5-9fef-83fae45710d3,network=Network(fae0e46a-88e4-499d-bcff-5b7df55eab4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23bb4aff-c8') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:49:56 user nova-compute[73391]: DEBUG os_vif [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:f5:97,bridge_name='br-int',has_traffic_filtering=True,id=23bb4aff-c85d-49e5-9fef-83fae45710d3,network=Network(fae0e46a-88e4-499d-bcff-5b7df55eab4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23bb4aff-c8') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:49:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:49:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:49:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:49:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:49:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap23bb4aff-c8, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:49:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap23bb4aff-c8, col_values=(('external_ids', {'iface-id': '23bb4aff-c85d-49e5-9fef-83fae45710d3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:f5:97', 'vm-uuid': 'fc4686ad-47da-40ad-83ce-941ee8810059'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:49:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:49:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:49:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:49:56 user nova-compute[73391]: INFO os_vif [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:f5:97,bridge_name='br-int',has_traffic_filtering=True,id=23bb4aff-c85d-49e5-9fef-83fae45710d3,network=Network(fae0e46a-88e4-499d-bcff-5b7df55eab4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23bb4aff-c8')
Aug 15 05:49:56 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.209s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:49:56 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/disk. size=1073741824 {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 05:49:56 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:49:56 user nova-compute[73391]: DEBUG nova.network.neutron [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Successfully created port: 95260c2c-bfa7-42c2-934b-af9874c68201 {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 05:49:56 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:49:56 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] No VIF found with MAC fa:16:3e:62:f5:97, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:49:56 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:49:56 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Cannot resize image /opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/disk to a smaller size. {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 05:49:56 user nova-compute[73391]: DEBUG nova.objects.instance [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Lazy-loading 'migration_context' on Instance uuid 3adc0c85-0f31-4a73-8b98-eb1a4b32434d {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:49:56 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Created local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 05:49:56 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Ensure instance console log exists: /opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 05:49:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:49:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:49:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:49:57 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:49:57 user nova-compute[73391]: DEBUG nova.network.neutron [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Successfully updated port: 95260c2c-bfa7-42c2-934b-af9874c68201 {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:49:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Acquiring lock "refresh_cache-3adc0c85-0f31-4a73-8b98-eb1a4b32434d" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:49:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Acquired lock "refresh_cache-3adc0c85-0f31-4a73-8b98-eb1a4b32434d" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:49:57 user nova-compute[73391]: DEBUG nova.network.neutron [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:49:57 user nova-compute[73391]: DEBUG nova.compute.manager [req-522ed07f-c131-462d-86c3-6da44792f6b4 req-92ac6d3d-f5aa-4016-b5ea-fcfd1d40c459 service nova] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Received event network-changed-95260c2c-bfa7-42c2-934b-af9874c68201 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:49:57 user nova-compute[73391]: DEBUG nova.compute.manager [req-522ed07f-c131-462d-86c3-6da44792f6b4 req-92ac6d3d-f5aa-4016-b5ea-fcfd1d40c459 service nova] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Refreshing instance network info cache due to event network-changed-95260c2c-bfa7-42c2-934b-af9874c68201. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:49:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-522ed07f-c131-462d-86c3-6da44792f6b4 req-92ac6d3d-f5aa-4016-b5ea-fcfd1d40c459 service nova] Acquiring lock "refresh_cache-3adc0c85-0f31-4a73-8b98-eb1a4b32434d" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:49:57 user nova-compute[73391]: DEBUG nova.network.neutron [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:49:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:49:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:49:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:49:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:49:58 user nova-compute[73391]: DEBUG nova.network.neutron [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Updating instance_info_cache with network_info: [{"id": "95260c2c-bfa7-42c2-934b-af9874c68201", "address": "fa:16:3e:9e:93:8d", "network": {"id": "6444073e-0d7a-4ecd-a945-4cbbb6bf2c92", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1589197255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d6c4fcd171841d6b59b8b400efd0619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95260c2c-bf", "ovs_interfaceid": "95260c2c-bfa7-42c2-934b-af9874c68201", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:49:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Releasing lock "refresh_cache-3adc0c85-0f31-4a73-8b98-eb1a4b32434d" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:49:58 user nova-compute[73391]: DEBUG nova.compute.manager [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Instance network_info: |[{"id": "95260c2c-bfa7-42c2-934b-af9874c68201", "address": "fa:16:3e:9e:93:8d", "network": {"id": "6444073e-0d7a-4ecd-a945-4cbbb6bf2c92", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1589197255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d6c4fcd171841d6b59b8b400efd0619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95260c2c-bf", "ovs_interfaceid": "95260c2c-bfa7-42c2-934b-af9874c68201", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 05:49:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-522ed07f-c131-462d-86c3-6da44792f6b4 req-92ac6d3d-f5aa-4016-b5ea-fcfd1d40c459 service nova] Acquired lock "refresh_cache-3adc0c85-0f31-4a73-8b98-eb1a4b32434d" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:49:58 user nova-compute[73391]: DEBUG nova.network.neutron [req-522ed07f-c131-462d-86c3-6da44792f6b4 req-92ac6d3d-f5aa-4016-b5ea-fcfd1d40c459 service nova] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Refreshing network info cache for port 95260c2c-bfa7-42c2-934b-af9874c68201 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:49:58 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Start _get_guest_xml network_info=[{"id": "95260c2c-bfa7-42c2-934b-af9874c68201", "address": "fa:16:3e:9e:93:8d", "network": {"id": "6444073e-0d7a-4ecd-a945-4cbbb6bf2c92", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1589197255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d6c4fcd171841d6b59b8b400efd0619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95260c2c-bf", "ovs_interfaceid": "95260c2c-bfa7-42c2-934b-af9874c68201", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '191b1dad-305e-4d1c-9b15-515ec59a3278'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:49:58 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:49:58 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:49:58 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:49:58 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:49:58 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:49:58 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:49:58 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:49:58 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:49:58 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:49:58 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:49:58 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:49:58 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:49:58 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:49:58 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:49:58 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:49:58 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:49:58 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:49:58 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:49:58 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:49:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1266227369',display_name='tempest-ServerStableDeviceRescueTest-server-1266227369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1266227369',id=40,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClbn+ZluhSwHYHUlfY7kR3eatJoIxOJzOUNz+RPGiKGWCzkk0oGlPS2RkCrWZEexGlaxiCjPu9TAHalxvsHmjvpVHNYRCtECwXpmtDg6eyUHQPHz+qqJmib5EvKgKkJ5A==',key_name='tempest-keypair-1197168403',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d6c4fcd171841d6b59b8b400efd0619',ramdisk_id='',reservation_id='r-4hbuvl6a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1604927137',owner_user_name='tempest-ServerStableDeviceRescueTest-1604927137-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:49:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43a914b6a21746b99ec36fb395d2f87f',uuid=3adc0c85-0f31-4a73-8b98-eb1a4b32434d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95260c2c-bfa7-42c2-934b-af9874c68201", "address": "fa:16:3e:9e:93:8d", "network": {"id": "6444073e-0d7a-4ecd-a945-4cbbb6bf2c92", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1589197255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d6c4fcd171841d6b59b8b400efd0619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95260c2c-bf", "ovs_interfaceid": "95260c2c-bfa7-42c2-934b-af9874c68201", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:49:58 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Converting VIF {"id": "95260c2c-bfa7-42c2-934b-af9874c68201", "address": "fa:16:3e:9e:93:8d", "network": {"id": "6444073e-0d7a-4ecd-a945-4cbbb6bf2c92", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1589197255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d6c4fcd171841d6b59b8b400efd0619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95260c2c-bf", "ovs_interfaceid": "95260c2c-bfa7-42c2-934b-af9874c68201", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:49:58 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:93:8d,bridge_name='br-int',has_traffic_filtering=True,id=95260c2c-bfa7-42c2-934b-af9874c68201,network=Network(6444073e-0d7a-4ecd-a945-4cbbb6bf2c92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95260c2c-bf') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:49:58 user nova-compute[73391]: DEBUG nova.objects.instance [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Lazy-loading 'pci_devices' on Instance uuid 3adc0c85-0f31-4a73-8b98-eb1a4b32434d {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:49:58 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:49:58 user nova-compute[73391]:   <uuid>3adc0c85-0f31-4a73-8b98-eb1a4b32434d</uuid>
Aug 15 05:49:58 user nova-compute[73391]:   <name>instance-00000028</name>
Aug 15 05:49:58 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:49:58 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:49:58 user nova-compute[73391]:   <metadata>
Aug 15 05:49:58 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:49:58 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:49:58 user nova-compute[73391]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1266227369</nova:name>
Aug 15 05:49:58 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:49:58</nova:creationTime>
Aug 15 05:49:58 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:49:58 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:49:58 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:49:58 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:49:58 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:49:58 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:49:58 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:49:58 user nova-compute[73391]:       <nova:owner>
Aug 15 05:49:58 user nova-compute[73391]:         <nova:user uuid="43a914b6a21746b99ec36fb395d2f87f">tempest-ServerStableDeviceRescueTest-1604927137-project-member</nova:user>
Aug 15 05:49:58 user nova-compute[73391]:         <nova:project uuid="0d6c4fcd171841d6b59b8b400efd0619">tempest-ServerStableDeviceRescueTest-1604927137</nova:project>
Aug 15 05:49:58 user nova-compute[73391]:       </nova:owner>
Aug 15 05:49:58 user nova-compute[73391]:       <nova:root type="image" uuid="191b1dad-305e-4d1c-9b15-515ec59a3278"/>
Aug 15 05:49:58 user nova-compute[73391]:       <nova:ports>
Aug 15 05:49:58 user nova-compute[73391]:         <nova:port uuid="95260c2c-bfa7-42c2-934b-af9874c68201">
Aug 15 05:49:58 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 05:49:58 user nova-compute[73391]:         </nova:port>
Aug 15 05:49:58 user nova-compute[73391]:       </nova:ports>
Aug 15 05:49:58 user nova-compute[73391]:     </nova:instance>
Aug 15 05:49:58 user nova-compute[73391]:   </metadata>
Aug 15 05:49:58 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:49:58 user nova-compute[73391]:     <system>
Aug 15 05:49:58 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:49:58 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:49:58 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:49:58 user nova-compute[73391]:       <entry name="serial">3adc0c85-0f31-4a73-8b98-eb1a4b32434d</entry>
Aug 15 05:49:58 user nova-compute[73391]:       <entry name="uuid">3adc0c85-0f31-4a73-8b98-eb1a4b32434d</entry>
Aug 15 05:49:58 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:49:58 user nova-compute[73391]:     </system>
Aug 15 05:49:58 user nova-compute[73391]:   </sysinfo>
Aug 15 05:49:58 user nova-compute[73391]:   <os>
Aug 15 05:49:58 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:49:58 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:49:58 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:49:58 user nova-compute[73391]:   </os>
Aug 15 05:49:58 user nova-compute[73391]:   <features>
Aug 15 05:49:58 user nova-compute[73391]:     <acpi/>
Aug 15 05:49:58 user nova-compute[73391]:     <apic/>
Aug 15 05:49:58 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:49:58 user nova-compute[73391]:   </features>
Aug 15 05:49:58 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:49:58 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:49:58 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:49:58 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:49:58 user nova-compute[73391]:   </clock>
Aug 15 05:49:58 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:49:58 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:49:58 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:49:58 user nova-compute[73391]:   </cpu>
Aug 15 05:49:58 user nova-compute[73391]:   <devices>
Aug 15 05:49:58 user nova-compute[73391]:     <disk type="file" device="disk">
Aug 15 05:49:58 user nova-compute[73391]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 05:49:58 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/disk"/>
Aug 15 05:49:58 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:49:58 user nova-compute[73391]:     </disk>
Aug 15 05:49:58 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:49:58 user nova-compute[73391]:       <mac address="fa:16:3e:9e:93:8d"/>
Aug 15 05:49:58 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:49:58 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:49:58 user nova-compute[73391]:       <target dev="tap95260c2c-bf"/>
Aug 15 05:49:58 user nova-compute[73391]:     </interface>
Aug 15 05:49:58 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:49:58 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/console.log" append="off"/>
Aug 15 05:49:58 user nova-compute[73391]:     </serial>
Aug 15 05:49:58 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:49:58 user nova-compute[73391]:     <video>
Aug 15 05:49:58 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:49:58 user nova-compute[73391]:     </video>
Aug 15 05:49:58 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:49:58 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:49:58 user nova-compute[73391]:     </rng>
Aug 15 05:49:58 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:49:58 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:49:58 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:49:58 user nova-compute[73391]:     </memballoon>
Aug 15 05:49:58 user nova-compute[73391]:   </devices>
Aug 15 05:49:58 user nova-compute[73391]: </domain>
Aug 15 05:49:58 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:49:58 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:49:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1266227369',display_name='tempest-ServerStableDeviceRescueTest-server-1266227369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1266227369',id=40,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClbn+ZluhSwHYHUlfY7kR3eatJoIxOJzOUNz+RPGiKGWCzkk0oGlPS2RkCrWZEexGlaxiCjPu9TAHalxvsHmjvpVHNYRCtECwXpmtDg6eyUHQPHz+qqJmib5EvKgKkJ5A==',key_name='tempest-keypair-1197168403',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d6c4fcd171841d6b59b8b400efd0619',ramdisk_id='',reservation_id='r-4hbuvl6a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1604927137',owner_user_name='tempest-ServerStableDeviceRescueTest-1604927137-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:49:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43a914b6a21746b99ec36fb395d2f87f',uuid=3adc0c85-0f31-4a73-8b98-eb1a4b32434d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95260c2c-bfa7-42c2-934b-af9874c68201", "address": "fa:16:3e:9e:93:8d", "network": {"id": "6444073e-0d7a-4ecd-a945-4cbbb6bf2c92", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1589197255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d6c4fcd171841d6b59b8b400efd0619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95260c2c-bf", "ovs_interfaceid": "95260c2c-bfa7-42c2-934b-af9874c68201", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:49:58 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Converting VIF {"id": "95260c2c-bfa7-42c2-934b-af9874c68201", "address": "fa:16:3e:9e:93:8d", "network": {"id": "6444073e-0d7a-4ecd-a945-4cbbb6bf2c92", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1589197255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d6c4fcd171841d6b59b8b400efd0619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95260c2c-bf", "ovs_interfaceid": "95260c2c-bfa7-42c2-934b-af9874c68201", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:49:58 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:93:8d,bridge_name='br-int',has_traffic_filtering=True,id=95260c2c-bfa7-42c2-934b-af9874c68201,network=Network(6444073e-0d7a-4ecd-a945-4cbbb6bf2c92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95260c2c-bf') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:49:58 user nova-compute[73391]: DEBUG os_vif [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:93:8d,bridge_name='br-int',has_traffic_filtering=True,id=95260c2c-bfa7-42c2-934b-af9874c68201,network=Network(6444073e-0d7a-4ecd-a945-4cbbb6bf2c92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95260c2c-bf') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:49:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:49:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:49:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:49:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:49:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap95260c2c-bf, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:49:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap95260c2c-bf, col_values=(('external_ids', {'iface-id': '95260c2c-bfa7-42c2-934b-af9874c68201', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:93:8d', 'vm-uuid': '3adc0c85-0f31-4a73-8b98-eb1a4b32434d'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:49:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:49:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:49:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:49:58 user nova-compute[73391]: INFO os_vif [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:93:8d,bridge_name='br-int',has_traffic_filtering=True,id=95260c2c-bfa7-42c2-934b-af9874c68201,network=Network(6444073e-0d7a-4ecd-a945-4cbbb6bf2c92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95260c2c-bf')
Aug 15 05:49:58 user nova-compute[73391]: DEBUG nova.compute.manager [req-163ce04b-61d4-43f0-9fc6-3fee2dba2e9a req-2fab0173-8215-4ca5-80ba-767b5629a0e6 service nova] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Received event network-vif-plugged-23bb4aff-c85d-49e5-9fef-83fae45710d3 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:49:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-163ce04b-61d4-43f0-9fc6-3fee2dba2e9a req-2fab0173-8215-4ca5-80ba-767b5629a0e6 service nova] Acquiring lock "fc4686ad-47da-40ad-83ce-941ee8810059-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:49:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-163ce04b-61d4-43f0-9fc6-3fee2dba2e9a req-2fab0173-8215-4ca5-80ba-767b5629a0e6 service nova] Lock "fc4686ad-47da-40ad-83ce-941ee8810059-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:49:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-163ce04b-61d4-43f0-9fc6-3fee2dba2e9a req-2fab0173-8215-4ca5-80ba-767b5629a0e6 service nova] Lock "fc4686ad-47da-40ad-83ce-941ee8810059-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:49:58 user nova-compute[73391]: DEBUG nova.compute.manager [req-163ce04b-61d4-43f0-9fc6-3fee2dba2e9a req-2fab0173-8215-4ca5-80ba-767b5629a0e6 service nova] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] No waiting events found dispatching network-vif-plugged-23bb4aff-c85d-49e5-9fef-83fae45710d3 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:49:58 user nova-compute[73391]: WARNING nova.compute.manager [req-163ce04b-61d4-43f0-9fc6-3fee2dba2e9a req-2fab0173-8215-4ca5-80ba-767b5629a0e6 service nova] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Received unexpected event network-vif-plugged-23bb4aff-c85d-49e5-9fef-83fae45710d3 for instance with vm_state building and task_state spawning.
Aug 15 05:49:58 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:49:58 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] No VIF found with MAC fa:16:3e:9e:93:8d, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:49:58 user nova-compute[73391]: DEBUG nova.network.neutron [req-522ed07f-c131-462d-86c3-6da44792f6b4 req-92ac6d3d-f5aa-4016-b5ea-fcfd1d40c459 service nova] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Updated VIF entry in instance network info cache for port 95260c2c-bfa7-42c2-934b-af9874c68201. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:49:58 user nova-compute[73391]: DEBUG nova.network.neutron [req-522ed07f-c131-462d-86c3-6da44792f6b4 req-92ac6d3d-f5aa-4016-b5ea-fcfd1d40c459 service nova] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Updating instance_info_cache with network_info: [{"id": "95260c2c-bfa7-42c2-934b-af9874c68201", "address": "fa:16:3e:9e:93:8d", "network": {"id": "6444073e-0d7a-4ecd-a945-4cbbb6bf2c92", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1589197255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d6c4fcd171841d6b59b8b400efd0619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95260c2c-bf", "ovs_interfaceid": "95260c2c-bfa7-42c2-934b-af9874c68201", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:49:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-522ed07f-c131-462d-86c3-6da44792f6b4 req-92ac6d3d-f5aa-4016-b5ea-fcfd1d40c459 service nova] Releasing lock "refresh_cache-3adc0c85-0f31-4a73-8b98-eb1a4b32434d" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:49:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:49:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:49:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:49:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:49:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:49:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:49:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:49:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:50:00 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:50:00 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:50:00 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:50:00 user nova-compute[73391]: DEBUG nova.compute.manager [req-70bedf58-7d9f-4043-a7eb-90cdeb9543c1 req-ac13297b-6000-40ad-9916-a8144874d04b service nova] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Received event network-vif-plugged-23bb4aff-c85d-49e5-9fef-83fae45710d3 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:50:00 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-70bedf58-7d9f-4043-a7eb-90cdeb9543c1 req-ac13297b-6000-40ad-9916-a8144874d04b service nova] Acquiring lock "fc4686ad-47da-40ad-83ce-941ee8810059-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:50:00 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-70bedf58-7d9f-4043-a7eb-90cdeb9543c1 req-ac13297b-6000-40ad-9916-a8144874d04b service nova] Lock "fc4686ad-47da-40ad-83ce-941ee8810059-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:50:00 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-70bedf58-7d9f-4043-a7eb-90cdeb9543c1 req-ac13297b-6000-40ad-9916-a8144874d04b service nova] Lock "fc4686ad-47da-40ad-83ce-941ee8810059-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:50:00 user nova-compute[73391]: DEBUG nova.compute.manager [req-70bedf58-7d9f-4043-a7eb-90cdeb9543c1 req-ac13297b-6000-40ad-9916-a8144874d04b service nova] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] No waiting events found dispatching network-vif-plugged-23bb4aff-c85d-49e5-9fef-83fae45710d3 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:50:00 user nova-compute[73391]: WARNING nova.compute.manager [req-70bedf58-7d9f-4043-a7eb-90cdeb9543c1 req-ac13297b-6000-40ad-9916-a8144874d04b service nova] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Received unexpected event network-vif-plugged-23bb4aff-c85d-49e5-9fef-83fae45710d3 for instance with vm_state building and task_state spawning.
Aug 15 05:50:00 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:50:00 user nova-compute[73391]: DEBUG nova.compute.manager [req-98b1a57f-883b-4e05-8c9d-a5476727bbcd req-2fa923d9-2f9e-456c-ab20-691c8b66a9d2 service nova] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Received event network-vif-plugged-95260c2c-bfa7-42c2-934b-af9874c68201 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:50:00 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-98b1a57f-883b-4e05-8c9d-a5476727bbcd req-2fa923d9-2f9e-456c-ab20-691c8b66a9d2 service nova] Acquiring lock "3adc0c85-0f31-4a73-8b98-eb1a4b32434d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:50:00 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-98b1a57f-883b-4e05-8c9d-a5476727bbcd req-2fa923d9-2f9e-456c-ab20-691c8b66a9d2 service nova] Lock "3adc0c85-0f31-4a73-8b98-eb1a4b32434d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:50:00 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-98b1a57f-883b-4e05-8c9d-a5476727bbcd req-2fa923d9-2f9e-456c-ab20-691c8b66a9d2 service nova] Lock "3adc0c85-0f31-4a73-8b98-eb1a4b32434d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:50:00 user nova-compute[73391]: DEBUG nova.compute.manager [req-98b1a57f-883b-4e05-8c9d-a5476727bbcd req-2fa923d9-2f9e-456c-ab20-691c8b66a9d2 service nova] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] No waiting events found dispatching network-vif-plugged-95260c2c-bfa7-42c2-934b-af9874c68201 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:50:00 user nova-compute[73391]: WARNING nova.compute.manager [req-98b1a57f-883b-4e05-8c9d-a5476727bbcd req-2fa923d9-2f9e-456c-ab20-691c8b66a9d2 service nova] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Received unexpected event network-vif-plugged-95260c2c-bfa7-42c2-934b-af9874c68201 for instance with vm_state building and task_state spawning.
Aug 15 05:50:00 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078600.861746, fc4686ad-47da-40ad-83ce-941ee8810059 => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:50:00 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] VM Resumed (Lifecycle Event)
Aug 15 05:50:00 user nova-compute[73391]: DEBUG nova.compute.manager [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:50:00 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Guest created on hypervisor {{(pid=73391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 05:50:00 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Instance spawned successfully.
Aug 15 05:50:00 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 05:50:00 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:50:00 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:50:00 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:50:00 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:50:00 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078600.8618965, fc4686ad-47da-40ad-83ce-941ee8810059 => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:50:00 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] VM Started (Lifecycle Event)
Aug 15 05:50:00 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:50:00 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Found default for hw_cdrom_bus of ide {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:50:00 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Found default for hw_disk_bus of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:50:00 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Found default for hw_input_bus of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:50:00 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Found default for hw_pointer_model of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:50:00 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Found default for hw_video_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:50:00 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Found default for hw_vif_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:50:00 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:50:00 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:50:01 user nova-compute[73391]: INFO nova.compute.manager [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Took 6.00 seconds to spawn the instance on the hypervisor.
Aug 15 05:50:01 user nova-compute[73391]: DEBUG nova.compute.manager [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:50:01 user nova-compute[73391]: INFO nova.compute.manager [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Took 17.75 seconds to build instance.
Aug 15 05:50:01 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-4f8a7365-8114-443e-b976-e2ad72d8c478 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "fc4686ad-47da-40ad-83ce-941ee8810059" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.859s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:50:02 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078602.0152013, 3adc0c85-0f31-4a73-8b98-eb1a4b32434d => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:50:02 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] VM Resumed (Lifecycle Event)
Aug 15 05:50:02 user nova-compute[73391]: DEBUG nova.compute.manager [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:50:02 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Guest created on hypervisor {{(pid=73391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 05:50:02 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Instance spawned successfully.
Aug 15 05:50:02 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 05:50:02 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:50:02 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:50:02 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Found default for hw_cdrom_bus of ide {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:50:02 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Found default for hw_disk_bus of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:50:02 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Found default for hw_input_bus of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:50:02 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Found default for hw_pointer_model of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:50:02 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Found default for hw_video_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:50:02 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Found default for hw_vif_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:50:02 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:50:02 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078602.0171256, 3adc0c85-0f31-4a73-8b98-eb1a4b32434d => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:50:02 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] VM Started (Lifecycle Event)
Aug 15 05:50:02 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:50:02 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:50:02 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:50:02 user nova-compute[73391]: INFO nova.compute.manager [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Took 6.05 seconds to spawn the instance on the hypervisor.
Aug 15 05:50:02 user nova-compute[73391]: DEBUG nova.compute.manager [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:50:02 user nova-compute[73391]: INFO nova.compute.manager [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Took 6.99 seconds to build instance.
Aug 15 05:50:02 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-f35af816-ba85-4a58-9ae1-99f5b1471561 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Lock "3adc0c85-0f31-4a73-8b98-eb1a4b32434d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.092s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:50:02 user nova-compute[73391]: DEBUG nova.compute.manager [req-38cffc6c-7e57-4589-bf3e-4f0efdd573cd req-ae0358ba-e82c-4b3b-bb97-9b892aafca6c service nova] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Received event network-vif-plugged-95260c2c-bfa7-42c2-934b-af9874c68201 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:50:02 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-38cffc6c-7e57-4589-bf3e-4f0efdd573cd req-ae0358ba-e82c-4b3b-bb97-9b892aafca6c service nova] Acquiring lock "3adc0c85-0f31-4a73-8b98-eb1a4b32434d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:50:02 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-38cffc6c-7e57-4589-bf3e-4f0efdd573cd req-ae0358ba-e82c-4b3b-bb97-9b892aafca6c service nova] Lock "3adc0c85-0f31-4a73-8b98-eb1a4b32434d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:50:02 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-38cffc6c-7e57-4589-bf3e-4f0efdd573cd req-ae0358ba-e82c-4b3b-bb97-9b892aafca6c service nova] Lock "3adc0c85-0f31-4a73-8b98-eb1a4b32434d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:50:02 user nova-compute[73391]: DEBUG nova.compute.manager [req-38cffc6c-7e57-4589-bf3e-4f0efdd573cd req-ae0358ba-e82c-4b3b-bb97-9b892aafca6c service nova] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] No waiting events found dispatching network-vif-plugged-95260c2c-bfa7-42c2-934b-af9874c68201 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:50:02 user nova-compute[73391]: WARNING nova.compute.manager [req-38cffc6c-7e57-4589-bf3e-4f0efdd573cd req-ae0358ba-e82c-4b3b-bb97-9b892aafca6c service nova] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Received unexpected event network-vif-plugged-95260c2c-bfa7-42c2-934b-af9874c68201 for instance with vm_state active and task_state None.
Aug 15 05:50:03 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:50:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Acquiring lock "134610fb-ed36-4ecb-a884-a26febb7943d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:50:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "134610fb-ed36-4ecb-a884-a26febb7943d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:50:04 user nova-compute[73391]: DEBUG nova.compute.manager [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Starting instance... {{(pid=73391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 05:50:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:50:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:50:04 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 05:50:04 user nova-compute[73391]: INFO nova.compute.claims [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Claim successful on node user
Aug 15 05:50:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:50:05 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:50:05 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:50:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.501s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:50:05 user nova-compute[73391]: DEBUG nova.compute.manager [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Start building networks asynchronously for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 05:50:05 user nova-compute[73391]: DEBUG nova.compute.manager [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Allocating IP information in the background. {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 05:50:05 user nova-compute[73391]: DEBUG nova.network.neutron [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] allocate_for_instance() {{(pid=73391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 05:50:05 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 05:50:05 user nova-compute[73391]: DEBUG nova.compute.manager [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Start building block device mappings for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 05:50:05 user nova-compute[73391]: DEBUG nova.policy [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9552a83a6a214c149ddceac64ccbdef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8086add121594fe8a0bdde99dd9cae90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73391) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 05:50:05 user nova-compute[73391]: DEBUG nova.compute.manager [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Start spawning the instance on the hypervisor. {{(pid=73391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 05:50:05 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Creating instance directory {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 05:50:05 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Creating image(s)
Aug 15 05:50:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Acquiring lock "/opt/stack/data/nova/instances/134610fb-ed36-4ecb-a884-a26febb7943d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:50:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "/opt/stack/data/nova/instances/134610fb-ed36-4ecb-a884-a26febb7943d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:50:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "/opt/stack/data/nova/instances/134610fb-ed36-4ecb-a884-a26febb7943d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:50:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:50:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.245s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:50:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Acquiring lock "999b315ba87151d8252d543312ae7790e7e1583b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:50:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:50:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:50:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.209s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:50:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/134610fb-ed36-4ecb-a884-a26febb7943d/disk 1073741824 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:50:05 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692078590.9813554, fecde5f1-88fb-48b0-b039-93fdb285c93c => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:50:05 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] VM Stopped (Lifecycle Event)
Aug 15 05:50:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/134610fb-ed36-4ecb-a884-a26febb7943d/disk 1073741824" returned: 0 in 0.061s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:50:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:50:06 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:50:06 user nova-compute[73391]: DEBUG nova.compute.manager [None req-b5636209-1a5f-4a70-8fb9-94f55b53681e None None] [instance: fecde5f1-88fb-48b0-b039-93fdb285c93c] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:50:06 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.187s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:50:06 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Checking if we can resize image /opt/stack/data/nova/instances/134610fb-ed36-4ecb-a884-a26febb7943d/disk. size=1073741824 {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 05:50:06 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/134610fb-ed36-4ecb-a884-a26febb7943d/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:50:06 user nova-compute[73391]: DEBUG nova.network.neutron [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Successfully created port: 26dd9755-2d2e-4165-88ca-e00170b943f1 {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 05:50:06 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/134610fb-ed36-4ecb-a884-a26febb7943d/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:50:06 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Cannot resize image /opt/stack/data/nova/instances/134610fb-ed36-4ecb-a884-a26febb7943d/disk to a smaller size. {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 05:50:06 user nova-compute[73391]: DEBUG nova.objects.instance [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lazy-loading 'migration_context' on Instance uuid 134610fb-ed36-4ecb-a884-a26febb7943d {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:50:06 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Created local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 05:50:06 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Ensure instance console log exists: /opt/stack/data/nova/instances/134610fb-ed36-4ecb-a884-a26febb7943d/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 05:50:06 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:50:06 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:50:06 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:50:07 user nova-compute[73391]: DEBUG nova.network.neutron [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Successfully updated port: 26dd9755-2d2e-4165-88ca-e00170b943f1 {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:50:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Acquiring lock "refresh_cache-134610fb-ed36-4ecb-a884-a26febb7943d" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:50:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Acquired lock "refresh_cache-134610fb-ed36-4ecb-a884-a26febb7943d" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:50:07 user nova-compute[73391]: DEBUG nova.network.neutron [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:50:07 user nova-compute[73391]: DEBUG nova.compute.manager [req-8b81877c-3097-4103-9ab4-204d77f8ed9e req-6744eefb-a3ca-4ee8-ba24-94f2edd5f0e5 service nova] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Received event network-changed-26dd9755-2d2e-4165-88ca-e00170b943f1 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:50:07 user nova-compute[73391]: DEBUG nova.compute.manager [req-8b81877c-3097-4103-9ab4-204d77f8ed9e req-6744eefb-a3ca-4ee8-ba24-94f2edd5f0e5 service nova] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Refreshing instance network info cache due to event network-changed-26dd9755-2d2e-4165-88ca-e00170b943f1. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:50:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-8b81877c-3097-4103-9ab4-204d77f8ed9e req-6744eefb-a3ca-4ee8-ba24-94f2edd5f0e5 service nova] Acquiring lock "refresh_cache-134610fb-ed36-4ecb-a884-a26febb7943d" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:50:07 user nova-compute[73391]: DEBUG nova.network.neutron [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:50:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:50:08 user nova-compute[73391]: DEBUG nova.network.neutron [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Updating instance_info_cache with network_info: [{"id": "26dd9755-2d2e-4165-88ca-e00170b943f1", "address": "fa:16:3e:eb:3c:1d", "network": {"id": "bc2718a2-a5ab-44e0-966d-9b180a30ac75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1022668030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8086add121594fe8a0bdde99dd9cae90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dd9755-2d", "ovs_interfaceid": "26dd9755-2d2e-4165-88ca-e00170b943f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:50:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Releasing lock "refresh_cache-134610fb-ed36-4ecb-a884-a26febb7943d" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:50:08 user nova-compute[73391]: DEBUG nova.compute.manager [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Instance network_info: |[{"id": "26dd9755-2d2e-4165-88ca-e00170b943f1", "address": "fa:16:3e:eb:3c:1d", "network": {"id": "bc2718a2-a5ab-44e0-966d-9b180a30ac75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1022668030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8086add121594fe8a0bdde99dd9cae90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dd9755-2d", "ovs_interfaceid": "26dd9755-2d2e-4165-88ca-e00170b943f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 05:50:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-8b81877c-3097-4103-9ab4-204d77f8ed9e req-6744eefb-a3ca-4ee8-ba24-94f2edd5f0e5 service nova] Acquired lock "refresh_cache-134610fb-ed36-4ecb-a884-a26febb7943d" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:50:08 user nova-compute[73391]: DEBUG nova.network.neutron [req-8b81877c-3097-4103-9ab4-204d77f8ed9e req-6744eefb-a3ca-4ee8-ba24-94f2edd5f0e5 service nova] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Refreshing network info cache for port 26dd9755-2d2e-4165-88ca-e00170b943f1 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:50:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Start _get_guest_xml network_info=[{"id": "26dd9755-2d2e-4165-88ca-e00170b943f1", "address": "fa:16:3e:eb:3c:1d", "network": {"id": "bc2718a2-a5ab-44e0-966d-9b180a30ac75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1022668030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8086add121594fe8a0bdde99dd9cae90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dd9755-2d", "ovs_interfaceid": "26dd9755-2d2e-4165-88ca-e00170b943f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '191b1dad-305e-4d1c-9b15-515ec59a3278'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:50:08 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:50:08 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:50:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:50:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:50:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:50:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:50:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:50:08 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:50:08 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:50:08 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:50:08 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:50:08 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:50:08 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:50:08 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:50:08 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:50:08 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:50:08 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:50:08 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:50:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:50:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-818670014',display_name='tempest-AttachVolumeNegativeTest-server-818670014',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-818670014',id=41,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImkim6ov9DeYYcyYsOdyj+YvgjCNyYKjKBCOayYji2g5VMN371MxRtS1UBm92iz+0MIF/ApPQzE/qe2gGoDPUZgFmhqem58PMw7/WiRsreIDbkNor0HR7pdNa9wlhUADg==',key_name='tempest-keypair-384761910',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8086add121594fe8a0bdde99dd9cae90',ramdisk_id='',reservation_id='r-lka2eu2u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1479702824',owner_user_name='tempest-AttachVolumeNegativeTest-1479702824-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:50:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9552a83a6a214c149ddceac64ccbdef6',uuid=134610fb-ed36-4ecb-a884-a26febb7943d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26dd9755-2d2e-4165-88ca-e00170b943f1", "address": "fa:16:3e:eb:3c:1d", "network": {"id": "bc2718a2-a5ab-44e0-966d-9b180a30ac75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1022668030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8086add121594fe8a0bdde99dd9cae90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dd9755-2d", "ovs_interfaceid": "26dd9755-2d2e-4165-88ca-e00170b943f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:50:08 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Converting VIF {"id": "26dd9755-2d2e-4165-88ca-e00170b943f1", "address": "fa:16:3e:eb:3c:1d", "network": {"id": "bc2718a2-a5ab-44e0-966d-9b180a30ac75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1022668030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8086add121594fe8a0bdde99dd9cae90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dd9755-2d", "ovs_interfaceid": "26dd9755-2d2e-4165-88ca-e00170b943f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:50:08 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:3c:1d,bridge_name='br-int',has_traffic_filtering=True,id=26dd9755-2d2e-4165-88ca-e00170b943f1,network=Network(bc2718a2-a5ab-44e0-966d-9b180a30ac75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26dd9755-2d') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:50:08 user nova-compute[73391]: DEBUG nova.objects.instance [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lazy-loading 'pci_devices' on Instance uuid 134610fb-ed36-4ecb-a884-a26febb7943d {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:50:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:50:08 user nova-compute[73391]:   <uuid>134610fb-ed36-4ecb-a884-a26febb7943d</uuid>
Aug 15 05:50:08 user nova-compute[73391]:   <name>instance-00000029</name>
Aug 15 05:50:08 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:50:08 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:50:08 user nova-compute[73391]:   <metadata>
Aug 15 05:50:08 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:50:08 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:50:08 user nova-compute[73391]:       <nova:name>tempest-AttachVolumeNegativeTest-server-818670014</nova:name>
Aug 15 05:50:08 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:50:08</nova:creationTime>
Aug 15 05:50:08 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:50:08 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:50:08 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:50:08 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:50:08 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:50:08 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:50:08 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:50:08 user nova-compute[73391]:       <nova:owner>
Aug 15 05:50:08 user nova-compute[73391]:         <nova:user uuid="9552a83a6a214c149ddceac64ccbdef6">tempest-AttachVolumeNegativeTest-1479702824-project-member</nova:user>
Aug 15 05:50:08 user nova-compute[73391]:         <nova:project uuid="8086add121594fe8a0bdde99dd9cae90">tempest-AttachVolumeNegativeTest-1479702824</nova:project>
Aug 15 05:50:08 user nova-compute[73391]:       </nova:owner>
Aug 15 05:50:08 user nova-compute[73391]:       <nova:root type="image" uuid="191b1dad-305e-4d1c-9b15-515ec59a3278"/>
Aug 15 05:50:08 user nova-compute[73391]:       <nova:ports>
Aug 15 05:50:08 user nova-compute[73391]:         <nova:port uuid="26dd9755-2d2e-4165-88ca-e00170b943f1">
Aug 15 05:50:08 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 05:50:08 user nova-compute[73391]:         </nova:port>
Aug 15 05:50:08 user nova-compute[73391]:       </nova:ports>
Aug 15 05:50:08 user nova-compute[73391]:     </nova:instance>
Aug 15 05:50:08 user nova-compute[73391]:   </metadata>
Aug 15 05:50:08 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:50:08 user nova-compute[73391]:     <system>
Aug 15 05:50:08 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:50:08 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:50:08 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:50:08 user nova-compute[73391]:       <entry name="serial">134610fb-ed36-4ecb-a884-a26febb7943d</entry>
Aug 15 05:50:08 user nova-compute[73391]:       <entry name="uuid">134610fb-ed36-4ecb-a884-a26febb7943d</entry>
Aug 15 05:50:08 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:50:08 user nova-compute[73391]:     </system>
Aug 15 05:50:08 user nova-compute[73391]:   </sysinfo>
Aug 15 05:50:08 user nova-compute[73391]:   <os>
Aug 15 05:50:08 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:50:08 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:50:08 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:50:08 user nova-compute[73391]:   </os>
Aug 15 05:50:08 user nova-compute[73391]:   <features>
Aug 15 05:50:08 user nova-compute[73391]:     <acpi/>
Aug 15 05:50:08 user nova-compute[73391]:     <apic/>
Aug 15 05:50:08 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:50:08 user nova-compute[73391]:   </features>
Aug 15 05:50:08 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:50:08 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:50:08 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:50:08 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:50:08 user nova-compute[73391]:   </clock>
Aug 15 05:50:08 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:50:08 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:50:08 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:50:08 user nova-compute[73391]:   </cpu>
Aug 15 05:50:08 user nova-compute[73391]:   <devices>
Aug 15 05:50:08 user nova-compute[73391]:     <disk type="file" device="disk">
Aug 15 05:50:08 user nova-compute[73391]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 05:50:08 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/134610fb-ed36-4ecb-a884-a26febb7943d/disk"/>
Aug 15 05:50:08 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:50:08 user nova-compute[73391]:     </disk>
Aug 15 05:50:08 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:50:08 user nova-compute[73391]:       <mac address="fa:16:3e:eb:3c:1d"/>
Aug 15 05:50:08 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:50:08 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:50:08 user nova-compute[73391]:       <target dev="tap26dd9755-2d"/>
Aug 15 05:50:08 user nova-compute[73391]:     </interface>
Aug 15 05:50:08 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:50:08 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/134610fb-ed36-4ecb-a884-a26febb7943d/console.log" append="off"/>
Aug 15 05:50:08 user nova-compute[73391]:     </serial>
Aug 15 05:50:08 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:50:08 user nova-compute[73391]:     <video>
Aug 15 05:50:08 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:50:08 user nova-compute[73391]:     </video>
Aug 15 05:50:08 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:50:08 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:50:08 user nova-compute[73391]:     </rng>
Aug 15 05:50:08 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:50:08 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:50:08 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:50:08 user nova-compute[73391]:     </memballoon>
Aug 15 05:50:08 user nova-compute[73391]:   </devices>
Aug 15 05:50:08 user nova-compute[73391]: </domain>
Aug 15 05:50:08 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:50:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:50:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-818670014',display_name='tempest-AttachVolumeNegativeTest-server-818670014',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-818670014',id=41,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImkim6ov9DeYYcyYsOdyj+YvgjCNyYKjKBCOayYji2g5VMN371MxRtS1UBm92iz+0MIF/ApPQzE/qe2gGoDPUZgFmhqem58PMw7/WiRsreIDbkNor0HR7pdNa9wlhUADg==',key_name='tempest-keypair-384761910',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8086add121594fe8a0bdde99dd9cae90',ramdisk_id='',reservation_id='r-lka2eu2u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1479702824',owner_user_name='tempest-AttachVolumeNegativeTest-1479702824-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:50:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9552a83a6a214c149ddceac64ccbdef6',uuid=134610fb-ed36-4ecb-a884-a26febb7943d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26dd9755-2d2e-4165-88ca-e00170b943f1", "address": "fa:16:3e:eb:3c:1d", "network": {"id": "bc2718a2-a5ab-44e0-966d-9b180a30ac75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1022668030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8086add121594fe8a0bdde99dd9cae90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dd9755-2d", "ovs_interfaceid": "26dd9755-2d2e-4165-88ca-e00170b943f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:50:08 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Converting VIF {"id": "26dd9755-2d2e-4165-88ca-e00170b943f1", "address": "fa:16:3e:eb:3c:1d", "network": {"id": "bc2718a2-a5ab-44e0-966d-9b180a30ac75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1022668030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8086add121594fe8a0bdde99dd9cae90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dd9755-2d", "ovs_interfaceid": "26dd9755-2d2e-4165-88ca-e00170b943f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:50:08 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:3c:1d,bridge_name='br-int',has_traffic_filtering=True,id=26dd9755-2d2e-4165-88ca-e00170b943f1,network=Network(bc2718a2-a5ab-44e0-966d-9b180a30ac75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26dd9755-2d') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:50:08 user nova-compute[73391]: DEBUG os_vif [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:3c:1d,bridge_name='br-int',has_traffic_filtering=True,id=26dd9755-2d2e-4165-88ca-e00170b943f1,network=Network(bc2718a2-a5ab-44e0-966d-9b180a30ac75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26dd9755-2d') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:50:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:50:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:50:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:50:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:50:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26dd9755-2d, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:50:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap26dd9755-2d, col_values=(('external_ids', {'iface-id': '26dd9755-2d2e-4165-88ca-e00170b943f1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:3c:1d', 'vm-uuid': '134610fb-ed36-4ecb-a884-a26febb7943d'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:50:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:50:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:50:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:50:08 user nova-compute[73391]: INFO os_vif [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:3c:1d,bridge_name='br-int',has_traffic_filtering=True,id=26dd9755-2d2e-4165-88ca-e00170b943f1,network=Network(bc2718a2-a5ab-44e0-966d-9b180a30ac75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26dd9755-2d')
Aug 15 05:50:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:50:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] No VIF found with MAC fa:16:3e:eb:3c:1d, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:50:09 user nova-compute[73391]: DEBUG nova.network.neutron [req-8b81877c-3097-4103-9ab4-204d77f8ed9e req-6744eefb-a3ca-4ee8-ba24-94f2edd5f0e5 service nova] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Updated VIF entry in instance network info cache for port 26dd9755-2d2e-4165-88ca-e00170b943f1. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:50:09 user nova-compute[73391]: DEBUG nova.network.neutron [req-8b81877c-3097-4103-9ab4-204d77f8ed9e req-6744eefb-a3ca-4ee8-ba24-94f2edd5f0e5 service nova] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Updating instance_info_cache with network_info: [{"id": "26dd9755-2d2e-4165-88ca-e00170b943f1", "address": "fa:16:3e:eb:3c:1d", "network": {"id": "bc2718a2-a5ab-44e0-966d-9b180a30ac75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1022668030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8086add121594fe8a0bdde99dd9cae90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dd9755-2d", "ovs_interfaceid": "26dd9755-2d2e-4165-88ca-e00170b943f1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:50:09 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-8b81877c-3097-4103-9ab4-204d77f8ed9e req-6744eefb-a3ca-4ee8-ba24-94f2edd5f0e5 service nova] Releasing lock "refresh_cache-134610fb-ed36-4ecb-a884-a26febb7943d" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:50:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:50:10 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:50:10 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:50:10 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:50:10 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:50:10 user nova-compute[73391]: DEBUG nova.compute.manager [req-0e8d42d0-1d2c-4384-968a-eace613537bb req-ca8daa97-90c3-4a79-ab73-72eecf724b13 service nova] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Received event network-vif-plugged-26dd9755-2d2e-4165-88ca-e00170b943f1 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:50:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-0e8d42d0-1d2c-4384-968a-eace613537bb req-ca8daa97-90c3-4a79-ab73-72eecf724b13 service nova] Acquiring lock "134610fb-ed36-4ecb-a884-a26febb7943d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:50:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-0e8d42d0-1d2c-4384-968a-eace613537bb req-ca8daa97-90c3-4a79-ab73-72eecf724b13 service nova] Lock "134610fb-ed36-4ecb-a884-a26febb7943d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:50:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-0e8d42d0-1d2c-4384-968a-eace613537bb req-ca8daa97-90c3-4a79-ab73-72eecf724b13 service nova] Lock "134610fb-ed36-4ecb-a884-a26febb7943d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:50:10 user nova-compute[73391]: DEBUG nova.compute.manager [req-0e8d42d0-1d2c-4384-968a-eace613537bb req-ca8daa97-90c3-4a79-ab73-72eecf724b13 service nova] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] No waiting events found dispatching network-vif-plugged-26dd9755-2d2e-4165-88ca-e00170b943f1 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:50:10 user nova-compute[73391]: WARNING nova.compute.manager [req-0e8d42d0-1d2c-4384-968a-eace613537bb req-ca8daa97-90c3-4a79-ab73-72eecf724b13 service nova] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Received unexpected event network-vif-plugged-26dd9755-2d2e-4165-88ca-e00170b943f1 for instance with vm_state building and task_state spawning.
Aug 15 05:50:10 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:50:10 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:50:10 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:50:12 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078612.403805, 134610fb-ed36-4ecb-a884-a26febb7943d => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:50:12 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] VM Resumed (Lifecycle Event)
Aug 15 05:50:12 user nova-compute[73391]: DEBUG nova.compute.manager [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:50:12 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Guest created on hypervisor {{(pid=73391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 05:50:12 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Instance spawned successfully.
Aug 15 05:50:12 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 05:50:12 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:50:12 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:50:12 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Found default for hw_cdrom_bus of ide {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:50:12 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Found default for hw_disk_bus of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:50:12 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Found default for hw_input_bus of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:50:12 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Found default for hw_pointer_model of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:50:12 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Found default for hw_video_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:50:12 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Found default for hw_vif_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:50:12 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:50:12 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078612.4053686, 134610fb-ed36-4ecb-a884-a26febb7943d => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:50:12 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] VM Started (Lifecycle Event)
Aug 15 05:50:12 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:50:12 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:50:12 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:50:12 user nova-compute[73391]: INFO nova.compute.manager [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Took 7.09 seconds to spawn the instance on the hypervisor.
Aug 15 05:50:12 user nova-compute[73391]: DEBUG nova.compute.manager [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:50:12 user nova-compute[73391]: DEBUG nova.compute.manager [req-e19e3635-5ca3-4d07-9d5b-297161a9b580 req-64d23463-f653-4e71-bf54-e8d629eb4728 service nova] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Received event network-vif-plugged-26dd9755-2d2e-4165-88ca-e00170b943f1 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:50:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e19e3635-5ca3-4d07-9d5b-297161a9b580 req-64d23463-f653-4e71-bf54-e8d629eb4728 service nova] Acquiring lock "134610fb-ed36-4ecb-a884-a26febb7943d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:50:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e19e3635-5ca3-4d07-9d5b-297161a9b580 req-64d23463-f653-4e71-bf54-e8d629eb4728 service nova] Lock "134610fb-ed36-4ecb-a884-a26febb7943d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:50:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e19e3635-5ca3-4d07-9d5b-297161a9b580 req-64d23463-f653-4e71-bf54-e8d629eb4728 service nova] Lock "134610fb-ed36-4ecb-a884-a26febb7943d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:50:12 user nova-compute[73391]: DEBUG nova.compute.manager [req-e19e3635-5ca3-4d07-9d5b-297161a9b580 req-64d23463-f653-4e71-bf54-e8d629eb4728 service nova] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] No waiting events found dispatching network-vif-plugged-26dd9755-2d2e-4165-88ca-e00170b943f1 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:50:12 user nova-compute[73391]: WARNING nova.compute.manager [req-e19e3635-5ca3-4d07-9d5b-297161a9b580 req-64d23463-f653-4e71-bf54-e8d629eb4728 service nova] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Received unexpected event network-vif-plugged-26dd9755-2d2e-4165-88ca-e00170b943f1 for instance with vm_state building and task_state spawning.
Aug 15 05:50:12 user nova-compute[73391]: INFO nova.compute.manager [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Took 7.98 seconds to build instance.
Aug 15 05:50:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6c5e8192-270a-4263-a1fa-b7ae11b63f33 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "134610fb-ed36-4ecb-a884-a26febb7943d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.087s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:50:13 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:50:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:50:17 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:50:17 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Cleaning up deleted instances {{(pid=73391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 05:50:17 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] There are 0 instances to clean {{(pid=73391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 05:50:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:50:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:50:21 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:50:23 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:50:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:50:26 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:50:26 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:50:26 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:50:26 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:50:26 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:50:26 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:50:26 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Auditing locally available compute resources for user (node: user) {{(pid=73391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 05:50:26 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:50:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:50:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:50:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:50:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:50:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:50:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:50:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:50:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:50:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/134610fb-ed36-4ecb-a884-a26febb7943d/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:50:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/134610fb-ed36-4ecb-a884-a26febb7943d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:50:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/134610fb-ed36-4ecb-a884-a26febb7943d/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:50:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/134610fb-ed36-4ecb-a884-a26febb7943d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:50:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85a919d-7f44-4093-b89a-51397ad5cedb/disk.rescue --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:50:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85a919d-7f44-4093-b89a-51397ad5cedb/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:50:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85a919d-7f44-4093-b89a-51397ad5cedb/disk.rescue --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:50:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85a919d-7f44-4093-b89a-51397ad5cedb/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:50:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /opt/stack/data/nova/instances/d85a919d-7f44-4093-b89a-51397ad5cedb/disk (vdb) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:50:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8775490-2a9e-44ac-aad7-9450afa4c295/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:50:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8775490-2a9e-44ac-aad7-9450afa4c295/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:50:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8775490-2a9e-44ac-aad7-9450afa4c295/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:50:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:50:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e8775490-2a9e-44ac-aad7-9450afa4c295/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:50:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:50:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:50:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:50:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:50:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:50:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:50:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:50:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:50:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:50:30 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:50:30 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:50:30 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Hypervisor/Node resource view: name=user free_ram=7684MB free_disk=25.04059600830078GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 05:50:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:50:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:50:30 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 730890c6-6999-4a0f-b80c-e4745bff99ab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:50:30 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 8ff2da51-5bfd-4cdc-8cef-330cdef93d97 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:50:30 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance e8775490-2a9e-44ac-aad7-9450afa4c295 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:50:30 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance d85a919d-7f44-4093-b89a-51397ad5cedb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:50:30 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance fc4686ad-47da-40ad-83ce-941ee8810059 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:50:30 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 3adc0c85-0f31-4a73-8b98-eb1a4b32434d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:50:30 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 134610fb-ed36-4ecb-a884-a26febb7943d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:50:30 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 05:50:30 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 05:50:30 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:50:30 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:50:30 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Compute_service record updated for user:user {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 05:50:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.443s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:50:30 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:50:31 user nova-compute[73391]: INFO nova.compute.manager [None req-78a4c6da-3d70-4c20-9fdc-ddf8972087c6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Unrescuing
Aug 15 05:50:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-78a4c6da-3d70-4c20-9fdc-ddf8972087c6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Acquiring lock "refresh_cache-d85a919d-7f44-4093-b89a-51397ad5cedb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:50:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-78a4c6da-3d70-4c20-9fdc-ddf8972087c6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Acquired lock "refresh_cache-d85a919d-7f44-4093-b89a-51397ad5cedb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:50:31 user nova-compute[73391]: DEBUG nova.network.neutron [None req-78a4c6da-3d70-4c20-9fdc-ddf8972087c6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:50:32 user nova-compute[73391]: DEBUG nova.network.neutron [None req-78a4c6da-3d70-4c20-9fdc-ddf8972087c6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Updating instance_info_cache with network_info: [{"id": "d9ae0be2-05e7-4009-b909-713c8c52e5e5", "address": "fa:16:3e:8a:49:2b", "network": {"id": "bec69c6a-b2cb-4b0a-ba6e-ae6dae099818", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7da9448cc34b609120da564a01dba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ae0be2-05", "ovs_interfaceid": "d9ae0be2-05e7-4009-b909-713c8c52e5e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:50:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-78a4c6da-3d70-4c20-9fdc-ddf8972087c6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Releasing lock "refresh_cache-d85a919d-7f44-4093-b89a-51397ad5cedb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:50:32 user nova-compute[73391]: DEBUG nova.objects.instance [None req-78a4c6da-3d70-4c20-9fdc-ddf8972087c6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lazy-loading 'flavor' on Instance uuid d85a919d-7f44-4093-b89a-51397ad5cedb {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:50:32 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:50:32 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:50:32 user nova-compute[73391]: DEBUG nova.compute.manager [req-a12a7767-2799-4e1b-9cea-8b2252dc6b70 req-321a2857-40c6-435e-8ff2-d2aa11bbe484 service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Received event network-vif-unplugged-d9ae0be2-05e7-4009-b909-713c8c52e5e5 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:50:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-a12a7767-2799-4e1b-9cea-8b2252dc6b70 req-321a2857-40c6-435e-8ff2-d2aa11bbe484 service nova] Acquiring lock "d85a919d-7f44-4093-b89a-51397ad5cedb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:50:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-a12a7767-2799-4e1b-9cea-8b2252dc6b70 req-321a2857-40c6-435e-8ff2-d2aa11bbe484 service nova] Lock "d85a919d-7f44-4093-b89a-51397ad5cedb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:50:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-a12a7767-2799-4e1b-9cea-8b2252dc6b70 req-321a2857-40c6-435e-8ff2-d2aa11bbe484 service nova] Lock "d85a919d-7f44-4093-b89a-51397ad5cedb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:50:32 user nova-compute[73391]: DEBUG nova.compute.manager [req-a12a7767-2799-4e1b-9cea-8b2252dc6b70 req-321a2857-40c6-435e-8ff2-d2aa11bbe484 service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] No waiting events found dispatching network-vif-unplugged-d9ae0be2-05e7-4009-b909-713c8c52e5e5 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:50:32 user nova-compute[73391]: WARNING nova.compute.manager [req-a12a7767-2799-4e1b-9cea-8b2252dc6b70 req-321a2857-40c6-435e-8ff2-d2aa11bbe484 service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Received unexpected event network-vif-unplugged-d9ae0be2-05e7-4009-b909-713c8c52e5e5 for instance with vm_state rescued and task_state unrescuing.
Aug 15 05:50:32 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:50:32 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:50:32 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Instance destroyed successfully.
Aug 15 05:50:33 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:50:33 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:50:33 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Starting heal instance info cache {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 05:50:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "refresh_cache-8ff2da51-5bfd-4cdc-8cef-330cdef93d97" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:50:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquired lock "refresh_cache-8ff2da51-5bfd-4cdc-8cef-330cdef93d97" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:50:33 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Forcefully refreshing network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 05:50:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:50:34 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Updating instance_info_cache with network_info: [{"id": "075b72cf-5f6f-443c-a0e1-dd3744944e5b", "address": "fa:16:3e:88:63:d4", "network": {"id": "bec69c6a-b2cb-4b0a-ba6e-ae6dae099818", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7da9448cc34b609120da564a01dba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap075b72cf-5f", "ovs_interfaceid": "075b72cf-5f6f-443c-a0e1-dd3744944e5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:50:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Releasing lock "refresh_cache-8ff2da51-5bfd-4cdc-8cef-330cdef93d97" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:50:34 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Updated the network info_cache for instance {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 05:50:34 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:50:34 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:50:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:50:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:50:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:50:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:50:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:50:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:50:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:50:34 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:50:34 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 05:50:34 user nova-compute[73391]: DEBUG nova.compute.manager [req-27469cfe-af68-48d8-9cc2-6f8f01bc80fd req-718b4b3e-4a3b-4d85-95dc-8cbae366051e service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Received event network-vif-plugged-d9ae0be2-05e7-4009-b909-713c8c52e5e5 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:50:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-27469cfe-af68-48d8-9cc2-6f8f01bc80fd req-718b4b3e-4a3b-4d85-95dc-8cbae366051e service nova] Acquiring lock "d85a919d-7f44-4093-b89a-51397ad5cedb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:50:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-27469cfe-af68-48d8-9cc2-6f8f01bc80fd req-718b4b3e-4a3b-4d85-95dc-8cbae366051e service nova] Lock "d85a919d-7f44-4093-b89a-51397ad5cedb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:50:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-27469cfe-af68-48d8-9cc2-6f8f01bc80fd req-718b4b3e-4a3b-4d85-95dc-8cbae366051e service nova] Lock "d85a919d-7f44-4093-b89a-51397ad5cedb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:50:34 user nova-compute[73391]: DEBUG nova.compute.manager [req-27469cfe-af68-48d8-9cc2-6f8f01bc80fd req-718b4b3e-4a3b-4d85-95dc-8cbae366051e service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] No waiting events found dispatching network-vif-plugged-d9ae0be2-05e7-4009-b909-713c8c52e5e5 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:50:34 user nova-compute[73391]: WARNING nova.compute.manager [req-27469cfe-af68-48d8-9cc2-6f8f01bc80fd req-718b4b3e-4a3b-4d85-95dc-8cbae366051e service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Received unexpected event network-vif-plugged-d9ae0be2-05e7-4009-b909-713c8c52e5e5 for instance with vm_state rescued and task_state unrescuing.
Aug 15 05:50:34 user nova-compute[73391]: DEBUG nova.compute.manager [req-27469cfe-af68-48d8-9cc2-6f8f01bc80fd req-718b4b3e-4a3b-4d85-95dc-8cbae366051e service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Received event network-vif-plugged-d9ae0be2-05e7-4009-b909-713c8c52e5e5 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:50:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-27469cfe-af68-48d8-9cc2-6f8f01bc80fd req-718b4b3e-4a3b-4d85-95dc-8cbae366051e service nova] Acquiring lock "d85a919d-7f44-4093-b89a-51397ad5cedb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:50:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-27469cfe-af68-48d8-9cc2-6f8f01bc80fd req-718b4b3e-4a3b-4d85-95dc-8cbae366051e service nova] Lock "d85a919d-7f44-4093-b89a-51397ad5cedb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:50:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-27469cfe-af68-48d8-9cc2-6f8f01bc80fd req-718b4b3e-4a3b-4d85-95dc-8cbae366051e service nova] Lock "d85a919d-7f44-4093-b89a-51397ad5cedb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:50:34 user nova-compute[73391]: DEBUG nova.compute.manager [req-27469cfe-af68-48d8-9cc2-6f8f01bc80fd req-718b4b3e-4a3b-4d85-95dc-8cbae366051e service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] No waiting events found dispatching network-vif-plugged-d9ae0be2-05e7-4009-b909-713c8c52e5e5 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:50:34 user nova-compute[73391]: WARNING nova.compute.manager [req-27469cfe-af68-48d8-9cc2-6f8f01bc80fd req-718b4b3e-4a3b-4d85-95dc-8cbae366051e service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Received unexpected event network-vif-plugged-d9ae0be2-05e7-4009-b909-713c8c52e5e5 for instance with vm_state rescued and task_state unrescuing.
Aug 15 05:50:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:50:36 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Removed pending event for d85a919d-7f44-4093-b89a-51397ad5cedb due to event {{(pid=73391) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 05:50:36 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078636.5634825, d85a919d-7f44-4093-b89a-51397ad5cedb => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:50:36 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] VM Resumed (Lifecycle Event)
Aug 15 05:50:36 user nova-compute[73391]: DEBUG nova.compute.manager [None req-78a4c6da-3d70-4c20-9fdc-ddf8972087c6 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:50:36 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:50:36 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:50:36 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 15 05:50:36 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078636.565646, d85a919d-7f44-4093-b89a-51397ad5cedb => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:50:36 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] VM Started (Lifecycle Event)
Aug 15 05:50:36 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:50:36 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:50:36 user nova-compute[73391]: DEBUG nova.compute.manager [req-7545a88a-3b43-49e5-a341-a58baf777319 req-6df0695c-6023-48e6-89c2-11ee960e297f service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Received event network-vif-plugged-d9ae0be2-05e7-4009-b909-713c8c52e5e5 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:50:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-7545a88a-3b43-49e5-a341-a58baf777319 req-6df0695c-6023-48e6-89c2-11ee960e297f service nova] Acquiring lock "d85a919d-7f44-4093-b89a-51397ad5cedb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:50:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-7545a88a-3b43-49e5-a341-a58baf777319 req-6df0695c-6023-48e6-89c2-11ee960e297f service nova] Lock "d85a919d-7f44-4093-b89a-51397ad5cedb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:50:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-7545a88a-3b43-49e5-a341-a58baf777319 req-6df0695c-6023-48e6-89c2-11ee960e297f service nova] Lock "d85a919d-7f44-4093-b89a-51397ad5cedb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:50:36 user nova-compute[73391]: DEBUG nova.compute.manager [req-7545a88a-3b43-49e5-a341-a58baf777319 req-6df0695c-6023-48e6-89c2-11ee960e297f service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] No waiting events found dispatching network-vif-plugged-d9ae0be2-05e7-4009-b909-713c8c52e5e5 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:50:36 user nova-compute[73391]: WARNING nova.compute.manager [req-7545a88a-3b43-49e5-a341-a58baf777319 req-6df0695c-6023-48e6-89c2-11ee960e297f service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Received unexpected event network-vif-plugged-d9ae0be2-05e7-4009-b909-713c8c52e5e5 for instance with vm_state active and task_state None.
Aug 15 05:50:38 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:50:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:50:43 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:50:44 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:50:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:50:49 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:50:49 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73391) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 05:50:53 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:50:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:50:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:50:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:50:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:51:03 user nova-compute[73391]: DEBUG nova.compute.manager [req-17464ddc-1eab-438e-899b-306023d123dc req-8ba08b15-ca49-454d-9f3a-3249a48bd207 service nova] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Received event network-changed-3dc39268-abd9-42ad-8f0d-75b567aa7ec9 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:51:03 user nova-compute[73391]: DEBUG nova.compute.manager [req-17464ddc-1eab-438e-899b-306023d123dc req-8ba08b15-ca49-454d-9f3a-3249a48bd207 service nova] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Refreshing instance network info cache due to event network-changed-3dc39268-abd9-42ad-8f0d-75b567aa7ec9. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:51:03 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-17464ddc-1eab-438e-899b-306023d123dc req-8ba08b15-ca49-454d-9f3a-3249a48bd207 service nova] Acquiring lock "refresh_cache-e8775490-2a9e-44ac-aad7-9450afa4c295" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:51:03 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-17464ddc-1eab-438e-899b-306023d123dc req-8ba08b15-ca49-454d-9f3a-3249a48bd207 service nova] Acquired lock "refresh_cache-e8775490-2a9e-44ac-aad7-9450afa4c295" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:51:03 user nova-compute[73391]: DEBUG nova.network.neutron [req-17464ddc-1eab-438e-899b-306023d123dc req-8ba08b15-ca49-454d-9f3a-3249a48bd207 service nova] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Refreshing network info cache for port 3dc39268-abd9-42ad-8f0d-75b567aa7ec9 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:51:03 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c3b31d3b-97b9-4b92-9a44-b16e783067f9 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Acquiring lock "e8775490-2a9e-44ac-aad7-9450afa4c295" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:51:03 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c3b31d3b-97b9-4b92-9a44-b16e783067f9 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lock "e8775490-2a9e-44ac-aad7-9450afa4c295" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:51:03 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c3b31d3b-97b9-4b92-9a44-b16e783067f9 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Acquiring lock "e8775490-2a9e-44ac-aad7-9450afa4c295-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:51:03 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c3b31d3b-97b9-4b92-9a44-b16e783067f9 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lock "e8775490-2a9e-44ac-aad7-9450afa4c295-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:51:03 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c3b31d3b-97b9-4b92-9a44-b16e783067f9 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lock "e8775490-2a9e-44ac-aad7-9450afa4c295-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:51:03 user nova-compute[73391]: INFO nova.compute.manager [None req-c3b31d3b-97b9-4b92-9a44-b16e783067f9 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Terminating instance
Aug 15 05:51:03 user nova-compute[73391]: DEBUG nova.compute.manager [None req-c3b31d3b-97b9-4b92-9a44-b16e783067f9 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Start destroying the instance on the hypervisor. {{(pid=73391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 05:51:03 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:51:03 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:51:03 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:51:03 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:51:03 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:51:03 user nova-compute[73391]: DEBUG nova.network.neutron [req-17464ddc-1eab-438e-899b-306023d123dc req-8ba08b15-ca49-454d-9f3a-3249a48bd207 service nova] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Updated VIF entry in instance network info cache for port 3dc39268-abd9-42ad-8f0d-75b567aa7ec9. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:51:03 user nova-compute[73391]: DEBUG nova.network.neutron [req-17464ddc-1eab-438e-899b-306023d123dc req-8ba08b15-ca49-454d-9f3a-3249a48bd207 service nova] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Updating instance_info_cache with network_info: [{"id": "3dc39268-abd9-42ad-8f0d-75b567aa7ec9", "address": "fa:16:3e:74:c3:08", "network": {"id": "c7ff2e30-7396-4af7-bd21-e9157804987e", "bridge": "br-int", "label": "tempest-TestStampPattern-2022602784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "623d93149e574954839e469432f24fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dc39268-ab", "ovs_interfaceid": "3dc39268-abd9-42ad-8f0d-75b567aa7ec9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:51:03 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-17464ddc-1eab-438e-899b-306023d123dc req-8ba08b15-ca49-454d-9f3a-3249a48bd207 service nova] Releasing lock "refresh_cache-e8775490-2a9e-44ac-aad7-9450afa4c295" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:51:03 user nova-compute[73391]: DEBUG nova.compute.manager [req-0cbae379-e19d-468a-8e8b-5f967b4d39c5 req-b7f3cf55-1ca2-49b9-9513-909068e89733 service nova] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Received event network-vif-unplugged-3dc39268-abd9-42ad-8f0d-75b567aa7ec9 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:51:03 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-0cbae379-e19d-468a-8e8b-5f967b4d39c5 req-b7f3cf55-1ca2-49b9-9513-909068e89733 service nova] Acquiring lock "e8775490-2a9e-44ac-aad7-9450afa4c295-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:51:03 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-0cbae379-e19d-468a-8e8b-5f967b4d39c5 req-b7f3cf55-1ca2-49b9-9513-909068e89733 service nova] Lock "e8775490-2a9e-44ac-aad7-9450afa4c295-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:51:03 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-0cbae379-e19d-468a-8e8b-5f967b4d39c5 req-b7f3cf55-1ca2-49b9-9513-909068e89733 service nova] Lock "e8775490-2a9e-44ac-aad7-9450afa4c295-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:51:03 user nova-compute[73391]: DEBUG nova.compute.manager [req-0cbae379-e19d-468a-8e8b-5f967b4d39c5 req-b7f3cf55-1ca2-49b9-9513-909068e89733 service nova] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] No waiting events found dispatching network-vif-unplugged-3dc39268-abd9-42ad-8f0d-75b567aa7ec9 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:51:03 user nova-compute[73391]: DEBUG nova.compute.manager [req-0cbae379-e19d-468a-8e8b-5f967b4d39c5 req-b7f3cf55-1ca2-49b9-9513-909068e89733 service nova] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Received event network-vif-unplugged-3dc39268-abd9-42ad-8f0d-75b567aa7ec9 for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 05:51:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:51:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:51:04 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Instance destroyed successfully.
Aug 15 05:51:04 user nova-compute[73391]: DEBUG nova.objects.instance [None req-c3b31d3b-97b9-4b92-9a44-b16e783067f9 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lazy-loading 'resources' on Instance uuid e8775490-2a9e-44ac-aad7-9450afa4c295 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:51:04 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-c3b31d3b-97b9-4b92-9a44-b16e783067f9 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:43:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1823706797',display_name='tempest-TestStampPattern-server-1823706797',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1823706797',id=32,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBQQVWOeuc6yJ6EmMw2rWLVsGpBPeA9gFNl5HRrfI/TUHS+ncoxmVN1359pxZR2y8M4qFx49b4zMDH1GSzjx/6CrvC6kH/thvZ4QYbb7yiE9dJlfo8ha6chN1RxR3KNG5w==',key_name='tempest-TestStampPattern-1501428928',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:43:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='623d93149e574954839e469432f24fc8',ramdisk_id='',reservation_id='r-8klg39st',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1421231515',owner_user_name='tempest-TestStampPattern-1421231515-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:46:50Z,user_data=None,user_id='5f88c49b60b5427bb5c07323e4312b14',uuid=e8775490-2a9e-44ac-aad7-9450afa4c295,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3dc39268-abd9-42ad-8f0d-75b567aa7ec9", "address": "fa:16:3e:74:c3:08", "network": {"id": "c7ff2e30-7396-4af7-bd21-e9157804987e", "bridge": "br-int", "label": "tempest-TestStampPattern-2022602784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "623d93149e574954839e469432f24fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dc39268-ab", "ovs_interfaceid": "3dc39268-abd9-42ad-8f0d-75b567aa7ec9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:51:04 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-c3b31d3b-97b9-4b92-9a44-b16e783067f9 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Converting VIF {"id": "3dc39268-abd9-42ad-8f0d-75b567aa7ec9", "address": "fa:16:3e:74:c3:08", "network": {"id": "c7ff2e30-7396-4af7-bd21-e9157804987e", "bridge": "br-int", "label": "tempest-TestStampPattern-2022602784-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "623d93149e574954839e469432f24fc8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3dc39268-ab", "ovs_interfaceid": "3dc39268-abd9-42ad-8f0d-75b567aa7ec9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:51:04 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-c3b31d3b-97b9-4b92-9a44-b16e783067f9 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:74:c3:08,bridge_name='br-int',has_traffic_filtering=True,id=3dc39268-abd9-42ad-8f0d-75b567aa7ec9,network=Network(c7ff2e30-7396-4af7-bd21-e9157804987e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dc39268-ab') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:51:04 user nova-compute[73391]: DEBUG os_vif [None req-c3b31d3b-97b9-4b92-9a44-b16e783067f9 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:c3:08,bridge_name='br-int',has_traffic_filtering=True,id=3dc39268-abd9-42ad-8f0d-75b567aa7ec9,network=Network(c7ff2e30-7396-4af7-bd21-e9157804987e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dc39268-ab') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:51:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:51:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3dc39268-ab, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:51:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:51:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:51:04 user nova-compute[73391]: INFO os_vif [None req-c3b31d3b-97b9-4b92-9a44-b16e783067f9 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:74:c3:08,bridge_name='br-int',has_traffic_filtering=True,id=3dc39268-abd9-42ad-8f0d-75b567aa7ec9,network=Network(c7ff2e30-7396-4af7-bd21-e9157804987e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3dc39268-ab')
Aug 15 05:51:04 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-c3b31d3b-97b9-4b92-9a44-b16e783067f9 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Deleting instance files /opt/stack/data/nova/instances/e8775490-2a9e-44ac-aad7-9450afa4c295_del
Aug 15 05:51:04 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-c3b31d3b-97b9-4b92-9a44-b16e783067f9 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Deletion of /opt/stack/data/nova/instances/e8775490-2a9e-44ac-aad7-9450afa4c295_del complete
Aug 15 05:51:04 user nova-compute[73391]: INFO nova.compute.manager [None req-c3b31d3b-97b9-4b92-9a44-b16e783067f9 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 15 05:51:04 user nova-compute[73391]: DEBUG oslo.service.loopingcall [None req-c3b31d3b-97b9-4b92-9a44-b16e783067f9 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 05:51:04 user nova-compute[73391]: DEBUG nova.compute.manager [-] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Deallocating network for instance {{(pid=73391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 05:51:04 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] deallocate_for_instance() {{(pid=73391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 05:51:04 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:51:04 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Took 0.66 seconds to deallocate network for instance.
Aug 15 05:51:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:51:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c3b31d3b-97b9-4b92-9a44-b16e783067f9 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:51:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c3b31d3b-97b9-4b92-9a44-b16e783067f9 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:51:04 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-c3b31d3b-97b9-4b92-9a44-b16e783067f9 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Refreshing inventories for resource provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 05:51:04 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-c3b31d3b-97b9-4b92-9a44-b16e783067f9 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Updating ProviderTree inventory for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 05:51:04 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-c3b31d3b-97b9-4b92-9a44-b16e783067f9 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Updating inventory in ProviderTree for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 05:51:05 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-c3b31d3b-97b9-4b92-9a44-b16e783067f9 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Refreshing aggregate associations for resource provider 771708bd-6a2a-4e0c-9869-46d45e6b1896, aggregates: None {{(pid=73391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 05:51:05 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-c3b31d3b-97b9-4b92-9a44-b16e783067f9 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Refreshing trait associations for resource provider 771708bd-6a2a-4e0c-9869-46d45e6b1896, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=73391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 05:51:05 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-c3b31d3b-97b9-4b92-9a44-b16e783067f9 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:51:05 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-c3b31d3b-97b9-4b92-9a44-b16e783067f9 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:51:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c3b31d3b-97b9-4b92-9a44-b16e783067f9 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.453s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:51:05 user nova-compute[73391]: INFO nova.scheduler.client.report [None req-c3b31d3b-97b9-4b92-9a44-b16e783067f9 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Deleted allocations for instance e8775490-2a9e-44ac-aad7-9450afa4c295
Aug 15 05:51:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c3b31d3b-97b9-4b92-9a44-b16e783067f9 tempest-TestStampPattern-1421231515 tempest-TestStampPattern-1421231515-project-member] Lock "e8775490-2a9e-44ac-aad7-9450afa4c295" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.162s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:51:05 user nova-compute[73391]: DEBUG nova.compute.manager [req-3744dd25-e765-4fa0-aa56-5e5e16ea7576 req-1ff4c90e-50dc-47d3-b649-fc13fd7fb6e4 service nova] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Received event network-vif-plugged-3dc39268-abd9-42ad-8f0d-75b567aa7ec9 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:51:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-3744dd25-e765-4fa0-aa56-5e5e16ea7576 req-1ff4c90e-50dc-47d3-b649-fc13fd7fb6e4 service nova] Acquiring lock "e8775490-2a9e-44ac-aad7-9450afa4c295-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:51:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-3744dd25-e765-4fa0-aa56-5e5e16ea7576 req-1ff4c90e-50dc-47d3-b649-fc13fd7fb6e4 service nova] Lock "e8775490-2a9e-44ac-aad7-9450afa4c295-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:51:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-3744dd25-e765-4fa0-aa56-5e5e16ea7576 req-1ff4c90e-50dc-47d3-b649-fc13fd7fb6e4 service nova] Lock "e8775490-2a9e-44ac-aad7-9450afa4c295-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:51:05 user nova-compute[73391]: DEBUG nova.compute.manager [req-3744dd25-e765-4fa0-aa56-5e5e16ea7576 req-1ff4c90e-50dc-47d3-b649-fc13fd7fb6e4 service nova] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] No waiting events found dispatching network-vif-plugged-3dc39268-abd9-42ad-8f0d-75b567aa7ec9 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:51:05 user nova-compute[73391]: WARNING nova.compute.manager [req-3744dd25-e765-4fa0-aa56-5e5e16ea7576 req-1ff4c90e-50dc-47d3-b649-fc13fd7fb6e4 service nova] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Received unexpected event network-vif-plugged-3dc39268-abd9-42ad-8f0d-75b567aa7ec9 for instance with vm_state deleted and task_state None.
Aug 15 05:51:05 user nova-compute[73391]: DEBUG nova.compute.manager [req-3744dd25-e765-4fa0-aa56-5e5e16ea7576 req-1ff4c90e-50dc-47d3-b649-fc13fd7fb6e4 service nova] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Received event network-vif-deleted-3dc39268-abd9-42ad-8f0d-75b567aa7ec9 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:51:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:51:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:51:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:51:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 05:51:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 05:51:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 05:51:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:51:19 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692078664.05937, e8775490-2a9e-44ac-aad7-9450afa4c295 => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:51:19 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] VM Stopped (Lifecycle Event)
Aug 15 05:51:19 user nova-compute[73391]: DEBUG nova.compute.manager [None req-921d27a8-9da3-4d29-926a-e1ab2485f661 None None] [instance: e8775490-2a9e-44ac-aad7-9450afa4c295] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:51:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:51:23 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:51:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:51:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:51:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 05:51:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 05:51:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 05:51:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:51:26 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:51:26 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:51:26 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:51:26 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:51:26 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:51:26 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:51:26 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Auditing locally available compute resources for user (node: user) {{(pid=73391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 05:51:26 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:51:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:51:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:51:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:51:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:51:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:51:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:51:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:51:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:51:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/134610fb-ed36-4ecb-a884-a26febb7943d/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:51:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/134610fb-ed36-4ecb-a884-a26febb7943d/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:51:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/134610fb-ed36-4ecb-a884-a26febb7943d/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:51:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/134610fb-ed36-4ecb-a884-a26febb7943d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:51:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85a919d-7f44-4093-b89a-51397ad5cedb/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:51:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85a919d-7f44-4093-b89a-51397ad5cedb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:51:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85a919d-7f44-4093-b89a-51397ad5cedb/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:51:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85a919d-7f44-4093-b89a-51397ad5cedb/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:51:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:51:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:51:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:51:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:51:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:51:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:51:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:51:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:51:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:51:29 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:51:29 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:51:29 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:51:29 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Hypervisor/Node resource view: name=user free_ram=8008MB free_disk=25.160999298095703GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 05:51:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:51:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:51:29 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 730890c6-6999-4a0f-b80c-e4745bff99ab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:51:29 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 8ff2da51-5bfd-4cdc-8cef-330cdef93d97 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:51:29 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance d85a919d-7f44-4093-b89a-51397ad5cedb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:51:29 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance fc4686ad-47da-40ad-83ce-941ee8810059 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:51:29 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 3adc0c85-0f31-4a73-8b98-eb1a4b32434d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:51:29 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 134610fb-ed36-4ecb-a884-a26febb7943d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:51:29 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 05:51:29 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 05:51:29 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:51:29 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:51:29 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Compute_service record updated for user:user {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 05:51:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.336s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:51:32 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:51:33 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:51:33 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Starting heal instance info cache {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 05:51:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "refresh_cache-d85a919d-7f44-4093-b89a-51397ad5cedb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:51:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquired lock "refresh_cache-d85a919d-7f44-4093-b89a-51397ad5cedb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:51:33 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Forcefully refreshing network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 05:51:34 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Updating instance_info_cache with network_info: [{"id": "d9ae0be2-05e7-4009-b909-713c8c52e5e5", "address": "fa:16:3e:8a:49:2b", "network": {"id": "bec69c6a-b2cb-4b0a-ba6e-ae6dae099818", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7da9448cc34b609120da564a01dba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ae0be2-05", "ovs_interfaceid": "d9ae0be2-05e7-4009-b909-713c8c52e5e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:51:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Releasing lock "refresh_cache-d85a919d-7f44-4093-b89a-51397ad5cedb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:51:34 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Updated the network info_cache for instance {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 05:51:34 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:51:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:51:34 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:51:34 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:51:34 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 05:51:35 user nova-compute[73391]: DEBUG nova.compute.manager [req-60b74ae5-869e-4401-9548-a66feb3ba255 req-07a57de4-a8a9-43cd-9dc9-99cc12f7a59d service nova] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Received event network-changed-23bb4aff-c85d-49e5-9fef-83fae45710d3 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:51:35 user nova-compute[73391]: DEBUG nova.compute.manager [req-60b74ae5-869e-4401-9548-a66feb3ba255 req-07a57de4-a8a9-43cd-9dc9-99cc12f7a59d service nova] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Refreshing instance network info cache due to event network-changed-23bb4aff-c85d-49e5-9fef-83fae45710d3. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:51:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-60b74ae5-869e-4401-9548-a66feb3ba255 req-07a57de4-a8a9-43cd-9dc9-99cc12f7a59d service nova] Acquiring lock "refresh_cache-fc4686ad-47da-40ad-83ce-941ee8810059" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:51:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-60b74ae5-869e-4401-9548-a66feb3ba255 req-07a57de4-a8a9-43cd-9dc9-99cc12f7a59d service nova] Acquired lock "refresh_cache-fc4686ad-47da-40ad-83ce-941ee8810059" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:51:35 user nova-compute[73391]: DEBUG nova.network.neutron [req-60b74ae5-869e-4401-9548-a66feb3ba255 req-07a57de4-a8a9-43cd-9dc9-99cc12f7a59d service nova] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Refreshing network info cache for port 23bb4aff-c85d-49e5-9fef-83fae45710d3 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:51:35 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:51:35 user nova-compute[73391]: DEBUG nova.network.neutron [req-60b74ae5-869e-4401-9548-a66feb3ba255 req-07a57de4-a8a9-43cd-9dc9-99cc12f7a59d service nova] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Updated VIF entry in instance network info cache for port 23bb4aff-c85d-49e5-9fef-83fae45710d3. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:51:35 user nova-compute[73391]: DEBUG nova.network.neutron [req-60b74ae5-869e-4401-9548-a66feb3ba255 req-07a57de4-a8a9-43cd-9dc9-99cc12f7a59d service nova] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Updating instance_info_cache with network_info: [{"id": "23bb4aff-c85d-49e5-9fef-83fae45710d3", "address": "fa:16:3e:62:f5:97", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.45", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23bb4aff-c8", "ovs_interfaceid": "23bb4aff-c85d-49e5-9fef-83fae45710d3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:51:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-60b74ae5-869e-4401-9548-a66feb3ba255 req-07a57de4-a8a9-43cd-9dc9-99cc12f7a59d service nova] Releasing lock "refresh_cache-fc4686ad-47da-40ad-83ce-941ee8810059" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:51:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-454577ca-53ca-482b-8652-f8463f940e7f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "fc4686ad-47da-40ad-83ce-941ee8810059" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:51:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-454577ca-53ca-482b-8652-f8463f940e7f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "fc4686ad-47da-40ad-83ce-941ee8810059" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:51:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-454577ca-53ca-482b-8652-f8463f940e7f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "fc4686ad-47da-40ad-83ce-941ee8810059-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:51:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-454577ca-53ca-482b-8652-f8463f940e7f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "fc4686ad-47da-40ad-83ce-941ee8810059-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:51:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-454577ca-53ca-482b-8652-f8463f940e7f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "fc4686ad-47da-40ad-83ce-941ee8810059-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:51:35 user nova-compute[73391]: INFO nova.compute.manager [None req-454577ca-53ca-482b-8652-f8463f940e7f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Terminating instance
Aug 15 05:51:35 user nova-compute[73391]: DEBUG nova.compute.manager [None req-454577ca-53ca-482b-8652-f8463f940e7f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Start destroying the instance on the hypervisor. {{(pid=73391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 05:51:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:51:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:51:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:51:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:51:36 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Instance destroyed successfully.
Aug 15 05:51:36 user nova-compute[73391]: DEBUG nova.objects.instance [None req-454577ca-53ca-482b-8652-f8463f940e7f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lazy-loading 'resources' on Instance uuid fc4686ad-47da-40ad-83ce-941ee8810059 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:51:36 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-454577ca-53ca-482b-8652-f8463f940e7f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:49:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1648940891',display_name='tempest-TestVolumeBootPattern-server-1648940891',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1648940891',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9jBoYjOy+aqM5q6fYRpW336xJnp1RjcA+ryp4UUPjXWPw7VtxeYktb68BzzUpanNxgDS13R1RxH4S+D0vqFMFtOkREwueXmREiQ22XqN9Aby3PDiDj1ii3iTWuJ+dFag==',key_name='tempest-TestVolumeBootPattern-1057822238',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:50:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8188c2e8ca34ef1982faa49f1058bb7',ramdisk_id='',reservation_id='r-eie8f2tq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1834029963',owner_user_name='tempest-TestVolumeBootPattern-1834029963-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:50:01Z,user_data=None,user_id='aefb6ccab586465dbe56e71a40bcf1f0',uuid=fc4686ad-47da-40ad-83ce-941ee8810059,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "23bb4aff-c85d-49e5-9fef-83fae45710d3", "address": "fa:16:3e:62:f5:97", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23bb4aff-c8", "ovs_interfaceid": "23bb4aff-c85d-49e5-9fef-83fae45710d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:51:36 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-454577ca-53ca-482b-8652-f8463f940e7f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Converting VIF {"id": "23bb4aff-c85d-49e5-9fef-83fae45710d3", "address": "fa:16:3e:62:f5:97", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap23bb4aff-c8", "ovs_interfaceid": "23bb4aff-c85d-49e5-9fef-83fae45710d3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:51:36 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-454577ca-53ca-482b-8652-f8463f940e7f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:f5:97,bridge_name='br-int',has_traffic_filtering=True,id=23bb4aff-c85d-49e5-9fef-83fae45710d3,network=Network(fae0e46a-88e4-499d-bcff-5b7df55eab4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23bb4aff-c8') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:51:36 user nova-compute[73391]: DEBUG os_vif [None req-454577ca-53ca-482b-8652-f8463f940e7f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:f5:97,bridge_name='br-int',has_traffic_filtering=True,id=23bb4aff-c85d-49e5-9fef-83fae45710d3,network=Network(fae0e46a-88e4-499d-bcff-5b7df55eab4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23bb4aff-c8') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:51:36 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:51:36 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap23bb4aff-c8, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:51:36 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:51:36 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:51:36 user nova-compute[73391]: INFO os_vif [None req-454577ca-53ca-482b-8652-f8463f940e7f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:f5:97,bridge_name='br-int',has_traffic_filtering=True,id=23bb4aff-c85d-49e5-9fef-83fae45710d3,network=Network(fae0e46a-88e4-499d-bcff-5b7df55eab4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap23bb4aff-c8')
Aug 15 05:51:36 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-454577ca-53ca-482b-8652-f8463f940e7f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 05:51:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-454577ca-53ca-482b-8652-f8463f940e7f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sQZfExwK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:51:36 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-454577ca-53ca-482b-8652-f8463f940e7f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:51:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-454577ca-53ca-482b-8652-f8463f940e7f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:51:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-454577ca-53ca-482b-8652-f8463f940e7f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:51:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-454577ca-53ca-482b-8652-f8463f940e7f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 05:51:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:51:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:51:36 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1becddbd-36ef-4993-83aa-cdd3ce3fe442]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:51:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:51:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:51:36 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2fd8408-f8e9-470d-a4aa-7e2fe971a08a]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:51:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-454577ca-53ca-482b-8652-f8463f940e7f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52 (non-flash)
Aug 15 05:51:36 user nova-compute[73391]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 (non-flash)
Aug 15 05:51:36 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:51:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-454577ca-53ca-482b-8652-f8463f940e7f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52 (non-flash)
Aug 15 05:51:36 user nova-compute[73391]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 (non-flash)
Aug 15 05:51:36 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:51:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-454577ca-53ca-482b-8652-f8463f940e7f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f772848ec20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1'): ({'sdc'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 05:51:36 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-454577ca-53ca-482b-8652-f8463f940e7f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Removing single pathed devices sdc {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 05:51:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:51:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:51:36 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b121706-ef6f-4009-83f8-bb790b211675]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:51:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:51:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:51:36 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d034ad4a-d56f-4866-8ac7-d4a386c85284]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:51:36 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-454577ca-53ca-482b-8652-f8463f940e7f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Flushing IO for device /dev/sdc {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 05:51:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:51:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:51:36 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c01f252-40d3-4ed9-a933-70a04b314e9e]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:51:36 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-454577ca-53ca-482b-8652-f8463f940e7f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 05:51:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:51:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.075s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:51:36 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf4762a8-1a16-4fc6-9c60-27501f49d891]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:51:36 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-454577ca-53ca-482b-8652-f8463f940e7f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 05:51:36 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-454577ca-53ca-482b-8652-f8463f940e7f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] SCSI volumes sdc have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 05:51:36 user nova-compute[73391]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOba65baa6-918b05c506e77a3f', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_ba65baa6', '/dev/disk/by-id/scsi-23931386230356335') {{(pid=84527) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 15 05:51:36 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb38d84d-0ca2-4631-a742-f5e29b3851ea]: (4, None) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:51:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-454577ca-53ca-482b-8652-f8463f940e7f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 05:51:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:51:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:51:36 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0df0d94-7f22-4e47-832b-579af7102a7a]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:51:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-454577ca-53ca-482b-8652-f8463f940e7f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:51:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:51:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:51:36 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[32a39601-f114-435a-85a3-379a30f8fccd]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:51:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-454577ca-53ca-482b-8652-f8463f940e7f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1, portal: 172.16.0.220,3260]
Aug 15 05:51:36 user nova-compute[73391]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1, portal: 172.16.0.220,3260] successful.
Aug 15 05:51:36 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:51:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:51:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:51:36 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[326ffd07-58de-49fe-8644-1945f2665964]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:51:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-454577ca-53ca-482b-8652-f8463f940e7f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:51:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-454577ca-53ca-482b-8652-f8463f940e7f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:51:36 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-454577ca-53ca-482b-8652-f8463f940e7f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] <== disconnect_volume: return (334ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:51:36 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-454577ca-53ca-482b-8652-f8463f940e7f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 05:51:36 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-454577ca-53ca-482b-8652-f8463f940e7f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Deleting instance files /opt/stack/data/nova/instances/fc4686ad-47da-40ad-83ce-941ee8810059_del
Aug 15 05:51:36 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-454577ca-53ca-482b-8652-f8463f940e7f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Deletion of /opt/stack/data/nova/instances/fc4686ad-47da-40ad-83ce-941ee8810059_del complete
Aug 15 05:51:36 user nova-compute[73391]: INFO nova.compute.manager [None req-454577ca-53ca-482b-8652-f8463f940e7f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Took 1.23 seconds to destroy the instance on the hypervisor.
Aug 15 05:51:36 user nova-compute[73391]: DEBUG oslo.service.loopingcall [None req-454577ca-53ca-482b-8652-f8463f940e7f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 05:51:36 user nova-compute[73391]: DEBUG nova.compute.manager [-] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Deallocating network for instance {{(pid=73391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 05:51:36 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] deallocate_for_instance() {{(pid=73391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 05:51:37 user nova-compute[73391]: DEBUG nova.compute.manager [req-4203bec9-e7fa-4d83-9d0c-0fcf6bf9b8f2 req-98faa974-9bdc-4530-8429-825bf17c62da service nova] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Received event network-vif-unplugged-23bb4aff-c85d-49e5-9fef-83fae45710d3 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:51:37 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-4203bec9-e7fa-4d83-9d0c-0fcf6bf9b8f2 req-98faa974-9bdc-4530-8429-825bf17c62da service nova] Acquiring lock "fc4686ad-47da-40ad-83ce-941ee8810059-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:51:37 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-4203bec9-e7fa-4d83-9d0c-0fcf6bf9b8f2 req-98faa974-9bdc-4530-8429-825bf17c62da service nova] Lock "fc4686ad-47da-40ad-83ce-941ee8810059-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:51:37 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-4203bec9-e7fa-4d83-9d0c-0fcf6bf9b8f2 req-98faa974-9bdc-4530-8429-825bf17c62da service nova] Lock "fc4686ad-47da-40ad-83ce-941ee8810059-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:51:37 user nova-compute[73391]: DEBUG nova.compute.manager [req-4203bec9-e7fa-4d83-9d0c-0fcf6bf9b8f2 req-98faa974-9bdc-4530-8429-825bf17c62da service nova] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] No waiting events found dispatching network-vif-unplugged-23bb4aff-c85d-49e5-9fef-83fae45710d3 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:51:37 user nova-compute[73391]: DEBUG nova.compute.manager [req-4203bec9-e7fa-4d83-9d0c-0fcf6bf9b8f2 req-98faa974-9bdc-4530-8429-825bf17c62da service nova] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Received event network-vif-unplugged-23bb4aff-c85d-49e5-9fef-83fae45710d3 for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 05:51:37 user nova-compute[73391]: DEBUG nova.compute.manager [req-4203bec9-e7fa-4d83-9d0c-0fcf6bf9b8f2 req-98faa974-9bdc-4530-8429-825bf17c62da service nova] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Received event network-vif-plugged-23bb4aff-c85d-49e5-9fef-83fae45710d3 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:51:37 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-4203bec9-e7fa-4d83-9d0c-0fcf6bf9b8f2 req-98faa974-9bdc-4530-8429-825bf17c62da service nova] Acquiring lock "fc4686ad-47da-40ad-83ce-941ee8810059-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:51:37 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-4203bec9-e7fa-4d83-9d0c-0fcf6bf9b8f2 req-98faa974-9bdc-4530-8429-825bf17c62da service nova] Lock "fc4686ad-47da-40ad-83ce-941ee8810059-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:51:37 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-4203bec9-e7fa-4d83-9d0c-0fcf6bf9b8f2 req-98faa974-9bdc-4530-8429-825bf17c62da service nova] Lock "fc4686ad-47da-40ad-83ce-941ee8810059-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:51:37 user nova-compute[73391]: DEBUG nova.compute.manager [req-4203bec9-e7fa-4d83-9d0c-0fcf6bf9b8f2 req-98faa974-9bdc-4530-8429-825bf17c62da service nova] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] No waiting events found dispatching network-vif-plugged-23bb4aff-c85d-49e5-9fef-83fae45710d3 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:51:37 user nova-compute[73391]: WARNING nova.compute.manager [req-4203bec9-e7fa-4d83-9d0c-0fcf6bf9b8f2 req-98faa974-9bdc-4530-8429-825bf17c62da service nova] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Received unexpected event network-vif-plugged-23bb4aff-c85d-49e5-9fef-83fae45710d3 for instance with vm_state active and task_state deleting.
Aug 15 05:51:37 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:51:37 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Took 0.93 seconds to deallocate network for instance.
Aug 15 05:51:37 user nova-compute[73391]: DEBUG nova.compute.manager [req-bd14baae-b6c8-470d-be18-9de6a454afb1 req-06b8a9aa-cfa6-45c2-af56-a3811540c6dc service nova] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Received event network-vif-deleted-23bb4aff-c85d-49e5-9fef-83fae45710d3 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:51:38 user nova-compute[73391]: INFO nova.compute.manager [None req-454577ca-53ca-482b-8652-f8463f940e7f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Took 0.77 seconds to detach 1 volumes for instance.
Aug 15 05:51:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-454577ca-53ca-482b-8652-f8463f940e7f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:51:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-454577ca-53ca-482b-8652-f8463f940e7f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:51:38 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-454577ca-53ca-482b-8652-f8463f940e7f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:51:38 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-454577ca-53ca-482b-8652-f8463f940e7f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:51:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-454577ca-53ca-482b-8652-f8463f940e7f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.245s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:51:39 user nova-compute[73391]: INFO nova.scheduler.client.report [None req-454577ca-53ca-482b-8652-f8463f940e7f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Deleted allocations for instance fc4686ad-47da-40ad-83ce-941ee8810059
Aug 15 05:51:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-454577ca-53ca-482b-8652-f8463f940e7f tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "fc4686ad-47da-40ad-83ce-941ee8810059" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.368s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:51:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:51:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:51:46 user nova-compute[73391]: DEBUG nova.compute.manager [req-48ad911c-3f7f-4b24-98c4-8ac4023b5985 req-4cd9cf11-e6fc-4667-a57d-0942204bbb63 service nova] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Received event network-changed-95260c2c-bfa7-42c2-934b-af9874c68201 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:51:46 user nova-compute[73391]: DEBUG nova.compute.manager [req-48ad911c-3f7f-4b24-98c4-8ac4023b5985 req-4cd9cf11-e6fc-4667-a57d-0942204bbb63 service nova] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Refreshing instance network info cache due to event network-changed-95260c2c-bfa7-42c2-934b-af9874c68201. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:51:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-48ad911c-3f7f-4b24-98c4-8ac4023b5985 req-4cd9cf11-e6fc-4667-a57d-0942204bbb63 service nova] Acquiring lock "refresh_cache-3adc0c85-0f31-4a73-8b98-eb1a4b32434d" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:51:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-48ad911c-3f7f-4b24-98c4-8ac4023b5985 req-4cd9cf11-e6fc-4667-a57d-0942204bbb63 service nova] Acquired lock "refresh_cache-3adc0c85-0f31-4a73-8b98-eb1a4b32434d" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:51:46 user nova-compute[73391]: DEBUG nova.network.neutron [req-48ad911c-3f7f-4b24-98c4-8ac4023b5985 req-4cd9cf11-e6fc-4667-a57d-0942204bbb63 service nova] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Refreshing network info cache for port 95260c2c-bfa7-42c2-934b-af9874c68201 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:51:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:51:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:51:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 05:51:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 05:51:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 05:51:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:51:46 user nova-compute[73391]: DEBUG nova.network.neutron [req-48ad911c-3f7f-4b24-98c4-8ac4023b5985 req-4cd9cf11-e6fc-4667-a57d-0942204bbb63 service nova] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Updated VIF entry in instance network info cache for port 95260c2c-bfa7-42c2-934b-af9874c68201. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:51:46 user nova-compute[73391]: DEBUG nova.network.neutron [req-48ad911c-3f7f-4b24-98c4-8ac4023b5985 req-4cd9cf11-e6fc-4667-a57d-0942204bbb63 service nova] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Updating instance_info_cache with network_info: [{"id": "95260c2c-bfa7-42c2-934b-af9874c68201", "address": "fa:16:3e:9e:93:8d", "network": {"id": "6444073e-0d7a-4ecd-a945-4cbbb6bf2c92", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1589197255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d6c4fcd171841d6b59b8b400efd0619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95260c2c-bf", "ovs_interfaceid": "95260c2c-bfa7-42c2-934b-af9874c68201", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:51:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-48ad911c-3f7f-4b24-98c4-8ac4023b5985 req-4cd9cf11-e6fc-4667-a57d-0942204bbb63 service nova] Releasing lock "refresh_cache-3adc0c85-0f31-4a73-8b98-eb1a4b32434d" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:51:47 user nova-compute[73391]: DEBUG nova.compute.manager [None req-ce91bf8e-8de7-452a-8773-ed28511cf9a1 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:51:47 user nova-compute[73391]: INFO nova.compute.manager [None req-ce91bf8e-8de7-452a-8773-ed28511cf9a1 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] instance snapshotting
Aug 15 05:51:47 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-ce91bf8e-8de7-452a-8773-ed28511cf9a1 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Beginning live snapshot process
Aug 15 05:51:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-ce91bf8e-8de7-452a-8773-ed28511cf9a1 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/disk --force-share --output=json -f qcow2 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:51:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-ce91bf8e-8de7-452a-8773-ed28511cf9a1 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/disk --force-share --output=json -f qcow2" returned: 0 in 0.170s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:51:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-ce91bf8e-8de7-452a-8773-ed28511cf9a1 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/disk --force-share --output=json -f qcow2 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:51:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-ce91bf8e-8de7-452a-8773-ed28511cf9a1 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/disk --force-share --output=json -f qcow2" returned: 0 in 0.180s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:51:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-ce91bf8e-8de7-452a-8773-ed28511cf9a1 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:51:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-ce91bf8e-8de7-452a-8773-ed28511cf9a1 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.176s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:51:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-ce91bf8e-8de7-452a-8773-ed28511cf9a1 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpobu53ugs/ee1969c4f4c04d3684671d71bea7bfad.delta 1073741824 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:51:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-ce91bf8e-8de7-452a-8773-ed28511cf9a1 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpobu53ugs/ee1969c4f4c04d3684671d71bea7bfad.delta 1073741824" returned: 0 in 0.051s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:51:47 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-ce91bf8e-8de7-452a-8773-ed28511cf9a1 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Quiescing instance not available: QEMU guest agent is not enabled.
Aug 15 05:51:48 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-ce91bf8e-8de7-452a-8773-ed28511cf9a1 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=73391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 05:51:49 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-ce91bf8e-8de7-452a-8773-ed28511cf9a1 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=73391) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Aug 15 05:51:49 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-ce91bf8e-8de7-452a-8773-ed28511cf9a1 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Skipping quiescing instance: QEMU guest agent is not enabled.
Aug 15 05:51:49 user nova-compute[73391]: DEBUG nova.privsep.utils [None req-ce91bf8e-8de7-452a-8773-ed28511cf9a1 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73391) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 05:51:49 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-ce91bf8e-8de7-452a-8773-ed28511cf9a1 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpobu53ugs/ee1969c4f4c04d3684671d71bea7bfad.delta /opt/stack/data/nova/instances/snapshots/tmpobu53ugs/ee1969c4f4c04d3684671d71bea7bfad {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:51:49 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-ce91bf8e-8de7-452a-8773-ed28511cf9a1 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpobu53ugs/ee1969c4f4c04d3684671d71bea7bfad.delta /opt/stack/data/nova/instances/snapshots/tmpobu53ugs/ee1969c4f4c04d3684671d71bea7bfad" returned: 0 in 0.533s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:51:49 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-ce91bf8e-8de7-452a-8773-ed28511cf9a1 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Snapshot extracted, beginning image upload
Aug 15 05:51:49 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:51:51 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:51:51 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692078696.4910262, fc4686ad-47da-40ad-83ce-941ee8810059 => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:51:51 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] VM Stopped (Lifecycle Event)
Aug 15 05:51:51 user nova-compute[73391]: DEBUG nova.compute.manager [None req-0ce59e78-dc8c-4b58-aa64-fcefa2e08371 None None] [instance: fc4686ad-47da-40ad-83ce-941ee8810059] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:51:51 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:51:52 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-ce91bf8e-8de7-452a-8773-ed28511cf9a1 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Snapshot image upload complete
Aug 15 05:51:52 user nova-compute[73391]: INFO nova.compute.manager [None req-ce91bf8e-8de7-452a-8773-ed28511cf9a1 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Took 5.24 seconds to snapshot the instance on the hypervisor.
Aug 15 05:51:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:51:56 user nova-compute[73391]: DEBUG nova.compute.manager [req-f705ea8e-a980-46d3-8ca3-bde198d20586 req-d89cac62-d653-4eb2-a9bb-0eec2eaccb20 service nova] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Received event network-changed-26dd9755-2d2e-4165-88ca-e00170b943f1 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:51:56 user nova-compute[73391]: DEBUG nova.compute.manager [req-f705ea8e-a980-46d3-8ca3-bde198d20586 req-d89cac62-d653-4eb2-a9bb-0eec2eaccb20 service nova] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Refreshing instance network info cache due to event network-changed-26dd9755-2d2e-4165-88ca-e00170b943f1. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:51:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f705ea8e-a980-46d3-8ca3-bde198d20586 req-d89cac62-d653-4eb2-a9bb-0eec2eaccb20 service nova] Acquiring lock "refresh_cache-134610fb-ed36-4ecb-a884-a26febb7943d" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:51:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f705ea8e-a980-46d3-8ca3-bde198d20586 req-d89cac62-d653-4eb2-a9bb-0eec2eaccb20 service nova] Acquired lock "refresh_cache-134610fb-ed36-4ecb-a884-a26febb7943d" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:51:56 user nova-compute[73391]: DEBUG nova.network.neutron [req-f705ea8e-a980-46d3-8ca3-bde198d20586 req-d89cac62-d653-4eb2-a9bb-0eec2eaccb20 service nova] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Refreshing network info cache for port 26dd9755-2d2e-4165-88ca-e00170b943f1 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:51:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:51:57 user nova-compute[73391]: DEBUG nova.network.neutron [req-f705ea8e-a980-46d3-8ca3-bde198d20586 req-d89cac62-d653-4eb2-a9bb-0eec2eaccb20 service nova] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Updated VIF entry in instance network info cache for port 26dd9755-2d2e-4165-88ca-e00170b943f1. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:51:57 user nova-compute[73391]: DEBUG nova.network.neutron [req-f705ea8e-a980-46d3-8ca3-bde198d20586 req-d89cac62-d653-4eb2-a9bb-0eec2eaccb20 service nova] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Updating instance_info_cache with network_info: [{"id": "26dd9755-2d2e-4165-88ca-e00170b943f1", "address": "fa:16:3e:eb:3c:1d", "network": {"id": "bc2718a2-a5ab-44e0-966d-9b180a30ac75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1022668030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8086add121594fe8a0bdde99dd9cae90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dd9755-2d", "ovs_interfaceid": "26dd9755-2d2e-4165-88ca-e00170b943f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:51:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f705ea8e-a980-46d3-8ca3-bde198d20586 req-d89cac62-d653-4eb2-a9bb-0eec2eaccb20 service nova] Releasing lock "refresh_cache-134610fb-ed36-4ecb-a884-a26febb7943d" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:51:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-259d4ad2-397b-49fd-b871-cead03b00ed0 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Acquiring lock "134610fb-ed36-4ecb-a884-a26febb7943d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:51:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-259d4ad2-397b-49fd-b871-cead03b00ed0 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "134610fb-ed36-4ecb-a884-a26febb7943d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:51:59 user nova-compute[73391]: DEBUG nova.objects.instance [None req-259d4ad2-397b-49fd-b871-cead03b00ed0 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lazy-loading 'flavor' on Instance uuid 134610fb-ed36-4ecb-a884-a26febb7943d {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:51:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-259d4ad2-397b-49fd-b871-cead03b00ed0 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "134610fb-ed36-4ecb-a884-a26febb7943d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:51:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-259d4ad2-397b-49fd-b871-cead03b00ed0 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Acquiring lock "134610fb-ed36-4ecb-a884-a26febb7943d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:51:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-259d4ad2-397b-49fd-b871-cead03b00ed0 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "134610fb-ed36-4ecb-a884-a26febb7943d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:51:59 user nova-compute[73391]: INFO nova.compute.manager [None req-259d4ad2-397b-49fd-b871-cead03b00ed0 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Attaching volume 81318dd2-ff3a-4b2e-b510-3bc8759e88de to /dev/vdb
Aug 15 05:51:59 user nova-compute[73391]: DEBUG os_brick.utils [None req-259d4ad2-397b-49fd-b871-cead03b00ed0 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:51:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:51:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:51:59 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b03420-3b14-4131-87a0-097bbf820b25]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:51:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:51:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:51:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:51:59 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbdaa99-b7c7-4772-bc65-2a1e5c61f44c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:51:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:51:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:51:59 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[468770c1-578c-4ff4-9f02-b8ebed87284c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:51:59 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3b26a7-bcf2-47a6-928f-34dfe3d31200]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:51:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-259d4ad2-397b-49fd-b871-cead03b00ed0 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:51:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-259d4ad2-397b-49fd-b871-cead03b00ed0 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:51:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-259d4ad2-397b-49fd-b871-cead03b00ed0 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 05:51:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:51:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:51:59 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 05:51:59 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e1c68c-0ef9-451e-be3d-0f577c3b67e1]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:51:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-259d4ad2-397b-49fd-b871-cead03b00ed0 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 05:51:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-259d4ad2-397b-49fd-b871-cead03b00ed0 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 05:51:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-259d4ad2-397b-49fd-b871-cead03b00ed0 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 05:51:59 user nova-compute[73391]: DEBUG os_brick.utils [None req-259d4ad2-397b-49fd-b871-cead03b00ed0 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:51:59 user nova-compute[73391]: DEBUG nova.virt.block_device [None req-259d4ad2-397b-49fd-b871-cead03b00ed0 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Updating existing volume attachment record: f35cd4c6-eef6-4ee2-a383-d37e84fc171c {{(pid=73391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 05:52:01 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:52:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:52:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:52:06 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:52:07 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:52:09 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-259d4ad2-397b-49fd-b871-cead03b00ed0 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 05:52:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-259d4ad2-397b-49fd-b871-cead03b00ed0 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dnzqHYfX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:52:09 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-259d4ad2-397b-49fd-b871-cead03b00ed0 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:52:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-259d4ad2-397b-49fd-b871-cead03b00ed0 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:52:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-259d4ad2-397b-49fd-b871-cead03b00ed0 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:52:09 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-259d4ad2-397b-49fd-b871-cead03b00ed0 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:52:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-259d4ad2-397b-49fd-b871-cead03b00ed0 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:52:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-259d4ad2-397b-49fd-b871-cead03b00ed0 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:52:09 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-259d4ad2-397b-49fd-b871-cead03b00ed0 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 05:52:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:09 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b04f4980-765a-405f-b254-7b3945a1ba38]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:52:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-259d4ad2-397b-49fd-b871-cead03b00ed0 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 05:52:09 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:52:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:09 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c454a037-8e96-4325-8714-173d78e0a947]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:52:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-259d4ad2-397b-49fd-b871-cead03b00ed0 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de] added
Aug 15 05:52:09 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:52:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:09 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[213f095f-b5b8-4c7e-8636-fbf3310c20b4]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:52:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-259d4ad2-397b-49fd-b871-cead03b00ed0 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:52:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:09 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[03332c6e-6a25-4782-bced-75c36c822768]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:52:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-259d4ad2-397b-49fd-b871-cead03b00ed0 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:52:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dnzqHYfX {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dnzqHYfX" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:09 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a34e6f-ef70-413a-a1be-ddde6035caf4]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:52:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-259d4ad2-397b-49fd-b871-cead03b00ed0 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dnzqHYfX'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:52:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:09 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[db47f639-1efc-4c3f-ab85-dfeb0d3a3149]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:52:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-259d4ad2-397b-49fd-b871-cead03b00ed0 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:52:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:09 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[763c974f-34d8-4d9c-a121-477fb43c6357]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:52:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-259d4ad2-397b-49fd-b871-cead03b00ed0 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52 (non-flash)
Aug 15 05:52:09 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:52:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-259d4ad2-397b-49fd-b871-cead03b00ed0 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52 (non-flash)
Aug 15 05:52:09 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:52:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:09 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8684db14-2fa3-4ead-8ef0-74852f3c3626]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:52:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-259d4ad2-397b-49fd-b871-cead03b00ed0 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de, portal: 172.16.0.220,3260]
Aug 15 05:52:09 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de, portal: 172.16.0.220,3260] successful.
Aug 15 05:52:09 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:52:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:09 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[592730e7-fe5e-401b-b158-96229e1ff2bd]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:52:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-259d4ad2-397b-49fd-b871-cead03b00ed0 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:52:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:09 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb5650a-95bc-48c0-be03-e3a312bf3324]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:52:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-259d4ad2-397b-49fd-b871-cead03b00ed0 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52 (non-flash)
Aug 15 05:52:09 user nova-compute[73391]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de (non-flash)
Aug 15 05:52:09 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:52:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-259d4ad2-397b-49fd-b871-cead03b00ed0 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52 (non-flash)
Aug 15 05:52:09 user nova-compute[73391]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de (non-flash)
Aug 15 05:52:09 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:52:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-259d4ad2-397b-49fd-b871-cead03b00ed0 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:52:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-259d4ad2-397b-49fd-b871-cead03b00ed0 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 05:52:09 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-259d4ad2-397b-49fd-b871-cead03b00ed0 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 05:52:09 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-259d4ad2-397b-49fd-b871-cead03b00ed0 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 05:52:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:09 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[74dcc998-5015-42e7-90e9-4490962a9f97]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:52:09 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-259d4ad2-397b-49fd-b871-cead03b00ed0 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:52:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-259d4ad2-397b-49fd-b871-cead03b00ed0 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dnzqHYfX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 05:52:10 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-259d4ad2-397b-49fd-b871-cead03b00ed0 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:52:10 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-259d4ad2-397b-49fd-b871-cead03b00ed0 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '26533393131613739', 'path': '/dev/sdc'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:52:10 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-259d4ad2-397b-49fd-b871-cead03b00ed0 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26533393131613739', 'path': '/dev/sdc'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 05:52:10 user nova-compute[73391]: DEBUG nova.objects.instance [None req-259d4ad2-397b-49fd-b871-cead03b00ed0 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lazy-loading 'flavor' on Instance uuid 134610fb-ed36-4ecb-a884-a26febb7943d {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:52:10 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-259d4ad2-397b-49fd-b871-cead03b00ed0 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 05:52:10 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:52:10 user nova-compute[73391]:   <source dev="/dev/sdc"/>
Aug 15 05:52:10 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:52:10 user nova-compute[73391]:   <serial>81318dd2-ff3a-4b2e-b510-3bc8759e88de</serial>
Aug 15 05:52:10 user nova-compute[73391]: </disk>
Aug 15 05:52:10 user nova-compute[73391]:  {{(pid=73391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 05:52:10 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-259d4ad2-397b-49fd-b871-cead03b00ed0 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:52:10 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-259d4ad2-397b-49fd-b871-cead03b00ed0 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:52:10 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-259d4ad2-397b-49fd-b871-cead03b00ed0 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] No VIF found with MAC fa:16:3e:eb:3c:1d, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:52:11 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-259d4ad2-397b-49fd-b871-cead03b00ed0 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "134610fb-ed36-4ecb-a884-a26febb7943d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.318s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:52:11 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:52:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Acquiring lock "0b14ae94-2a1e-4202-9676-e1ae1c996729" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:52:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "0b14ae94-2a1e-4202-9676-e1ae1c996729" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:52:14 user nova-compute[73391]: DEBUG nova.compute.manager [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Starting instance... {{(pid=73391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 05:52:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:52:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:52:14 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 05:52:14 user nova-compute[73391]: INFO nova.compute.claims [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Claim successful on node user
Aug 15 05:52:14 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:52:14 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:52:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.310s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:52:14 user nova-compute[73391]: DEBUG nova.compute.manager [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Start building networks asynchronously for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 05:52:14 user nova-compute[73391]: DEBUG nova.compute.manager [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Allocating IP information in the background. {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 05:52:14 user nova-compute[73391]: DEBUG nova.network.neutron [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] allocate_for_instance() {{(pid=73391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 05:52:14 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 05:52:14 user nova-compute[73391]: DEBUG nova.compute.manager [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Start building block device mappings for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 05:52:14 user nova-compute[73391]: DEBUG nova.policy [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9552a83a6a214c149ddceac64ccbdef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8086add121594fe8a0bdde99dd9cae90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73391) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 05:52:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Acquiring lock "a7f591b9-7028-431d-aacc-9725767d8e1d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:52:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Lock "a7f591b9-7028-431d-aacc-9725767d8e1d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:52:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:52:14 user nova-compute[73391]: DEBUG nova.compute.manager [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Start spawning the instance on the hypervisor. {{(pid=73391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 05:52:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Creating instance directory {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 05:52:14 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Creating image(s)
Aug 15 05:52:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Acquiring lock "/opt/stack/data/nova/instances/0b14ae94-2a1e-4202-9676-e1ae1c996729/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:52:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "/opt/stack/data/nova/instances/0b14ae94-2a1e-4202-9676-e1ae1c996729/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:52:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "/opt/stack/data/nova/instances/0b14ae94-2a1e-4202-9676-e1ae1c996729/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:52:14 user nova-compute[73391]: DEBUG nova.compute.manager [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Starting instance... {{(pid=73391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 05:52:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:15 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:52:15 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:52:15 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 05:52:15 user nova-compute[73391]: INFO nova.compute.claims [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Claim successful on node user
Aug 15 05:52:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.209s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:15 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Acquiring lock "999b315ba87151d8252d543312ae7790e7e1583b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:52:15 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:52:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.181s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/0b14ae94-2a1e-4202-9676-e1ae1c996729/disk 1073741824 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/0b14ae94-2a1e-4202-9676-e1ae1c996729/disk 1073741824" returned: 0 in 0.049s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:15 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:52:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.174s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:15 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0b14ae94-2a1e-4202-9676-e1ae1c996729/disk. size=1073741824 {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 05:52:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b14ae94-2a1e-4202-9676-e1ae1c996729/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:15 user nova-compute[73391]: DEBUG nova.network.neutron [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Successfully created port: 99504223-260d-420c-b804-62b5a7de9592 {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 05:52:15 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:52:15 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:52:15 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.623s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:52:15 user nova-compute[73391]: DEBUG nova.compute.manager [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Start building networks asynchronously for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 05:52:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b14ae94-2a1e-4202-9676-e1ae1c996729/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:15 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Cannot resize image /opt/stack/data/nova/instances/0b14ae94-2a1e-4202-9676-e1ae1c996729/disk to a smaller size. {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 05:52:15 user nova-compute[73391]: DEBUG nova.objects.instance [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lazy-loading 'migration_context' on Instance uuid 0b14ae94-2a1e-4202-9676-e1ae1c996729 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:52:15 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Created local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 05:52:15 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Ensure instance console log exists: /opt/stack/data/nova/instances/0b14ae94-2a1e-4202-9676-e1ae1c996729/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 05:52:15 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:52:15 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:52:15 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:52:15 user nova-compute[73391]: DEBUG nova.compute.manager [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Allocating IP information in the background. {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 05:52:15 user nova-compute[73391]: DEBUG nova.network.neutron [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] allocate_for_instance() {{(pid=73391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 05:52:15 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 05:52:15 user nova-compute[73391]: DEBUG nova.compute.manager [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Start building block device mappings for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 05:52:15 user nova-compute[73391]: DEBUG nova.compute.manager [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Start spawning the instance on the hypervisor. {{(pid=73391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 05:52:15 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Creating instance directory {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 05:52:15 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Creating image(s)
Aug 15 05:52:15 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Acquiring lock "/opt/stack/data/nova/instances/a7f591b9-7028-431d-aacc-9725767d8e1d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:52:15 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Lock "/opt/stack/data/nova/instances/a7f591b9-7028-431d-aacc-9725767d8e1d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:52:15 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Lock "/opt/stack/data/nova/instances/a7f591b9-7028-431d-aacc-9725767d8e1d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:52:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:16 user nova-compute[73391]: DEBUG nova.policy [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '4b83572d8f5447c282fb182320d4035f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b63a1678a0274c1084ddccd206711afe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73391) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 05:52:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.180s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:16 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Acquiring lock "999b315ba87151d8252d543312ae7790e7e1583b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:52:16 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:52:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.175s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/a7f591b9-7028-431d-aacc-9725767d8e1d/disk 1073741824 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/a7f591b9-7028-431d-aacc-9725767d8e1d/disk 1073741824" returned: 0 in 0.051s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:16 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:52:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.176s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:16 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a7f591b9-7028-431d-aacc-9725767d8e1d/disk. size=1073741824 {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 05:52:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7f591b9-7028-431d-aacc-9725767d8e1d/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:16 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:52:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7f591b9-7028-431d-aacc-9725767d8e1d/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:16 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Cannot resize image /opt/stack/data/nova/instances/a7f591b9-7028-431d-aacc-9725767d8e1d/disk to a smaller size. {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 05:52:16 user nova-compute[73391]: DEBUG nova.objects.instance [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Lazy-loading 'migration_context' on Instance uuid a7f591b9-7028-431d-aacc-9725767d8e1d {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:52:16 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Created local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 05:52:16 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Ensure instance console log exists: /opt/stack/data/nova/instances/a7f591b9-7028-431d-aacc-9725767d8e1d/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 05:52:16 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:52:16 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:52:16 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:52:17 user nova-compute[73391]: DEBUG nova.network.neutron [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Successfully updated port: 99504223-260d-420c-b804-62b5a7de9592 {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:52:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Acquiring lock "refresh_cache-0b14ae94-2a1e-4202-9676-e1ae1c996729" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:52:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Acquired lock "refresh_cache-0b14ae94-2a1e-4202-9676-e1ae1c996729" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:52:17 user nova-compute[73391]: DEBUG nova.network.neutron [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:52:17 user nova-compute[73391]: DEBUG nova.compute.manager [req-d625312b-57b4-4022-b4ea-75b7ec13b91f req-b0e59a45-c665-4f4b-890e-342be37eb2cb service nova] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Received event network-changed-99504223-260d-420c-b804-62b5a7de9592 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:52:17 user nova-compute[73391]: DEBUG nova.compute.manager [req-d625312b-57b4-4022-b4ea-75b7ec13b91f req-b0e59a45-c665-4f4b-890e-342be37eb2cb service nova] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Refreshing instance network info cache due to event network-changed-99504223-260d-420c-b804-62b5a7de9592. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:52:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d625312b-57b4-4022-b4ea-75b7ec13b91f req-b0e59a45-c665-4f4b-890e-342be37eb2cb service nova] Acquiring lock "refresh_cache-0b14ae94-2a1e-4202-9676-e1ae1c996729" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:52:17 user nova-compute[73391]: DEBUG nova.network.neutron [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:52:17 user nova-compute[73391]: DEBUG nova.network.neutron [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Successfully created port: 32d1f42a-cab6-41ee-ae14-2cf842756259 {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 05:52:17 user nova-compute[73391]: DEBUG nova.network.neutron [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Updating instance_info_cache with network_info: [{"id": "99504223-260d-420c-b804-62b5a7de9592", "address": "fa:16:3e:a3:fd:a4", "network": {"id": "bc2718a2-a5ab-44e0-966d-9b180a30ac75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1022668030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8086add121594fe8a0bdde99dd9cae90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99504223-26", "ovs_interfaceid": "99504223-260d-420c-b804-62b5a7de9592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:52:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Releasing lock "refresh_cache-0b14ae94-2a1e-4202-9676-e1ae1c996729" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:52:17 user nova-compute[73391]: DEBUG nova.compute.manager [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Instance network_info: |[{"id": "99504223-260d-420c-b804-62b5a7de9592", "address": "fa:16:3e:a3:fd:a4", "network": {"id": "bc2718a2-a5ab-44e0-966d-9b180a30ac75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1022668030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8086add121594fe8a0bdde99dd9cae90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99504223-26", "ovs_interfaceid": "99504223-260d-420c-b804-62b5a7de9592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 05:52:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d625312b-57b4-4022-b4ea-75b7ec13b91f req-b0e59a45-c665-4f4b-890e-342be37eb2cb service nova] Acquired lock "refresh_cache-0b14ae94-2a1e-4202-9676-e1ae1c996729" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:52:17 user nova-compute[73391]: DEBUG nova.network.neutron [req-d625312b-57b4-4022-b4ea-75b7ec13b91f req-b0e59a45-c665-4f4b-890e-342be37eb2cb service nova] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Refreshing network info cache for port 99504223-260d-420c-b804-62b5a7de9592 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:52:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Start _get_guest_xml network_info=[{"id": "99504223-260d-420c-b804-62b5a7de9592", "address": "fa:16:3e:a3:fd:a4", "network": {"id": "bc2718a2-a5ab-44e0-966d-9b180a30ac75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1022668030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8086add121594fe8a0bdde99dd9cae90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99504223-26", "ovs_interfaceid": "99504223-260d-420c-b804-62b5a7de9592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '191b1dad-305e-4d1c-9b15-515ec59a3278'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:52:17 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:52:17 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:52:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:52:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:52:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:52:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:52:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:52:17 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:52:17 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:52:17 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:52:17 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:52:17 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:52:17 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:52:17 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:52:17 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:52:17 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:52:17 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:52:17 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:52:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:52:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-580057320',display_name='tempest-AttachVolumeNegativeTest-server-580057320',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-580057320',id=42,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJt0+6930J72EYFBgaP4BWbuf/K4PsIWS9cnonjXjJbH40mXM7+brQsgKb5SEE0gKl60e2aB5RYRm/Lq0AVW7zsLtcv+k7ieJPmvsJjQ9Lhj0vRP+RIUpBInkGtCEaxNiQ==',key_name='tempest-keypair-496769485',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8086add121594fe8a0bdde99dd9cae90',ramdisk_id='',reservation_id='r-4oxvvamf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1479702824',owner_user_name='tempest-AttachVolumeNegativeTest-1479702824-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:52:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9552a83a6a214c149ddceac64ccbdef6',uuid=0b14ae94-2a1e-4202-9676-e1ae1c996729,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99504223-260d-420c-b804-62b5a7de9592", "address": "fa:16:3e:a3:fd:a4", "network": {"id": "bc2718a2-a5ab-44e0-966d-9b180a30ac75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1022668030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8086add121594fe8a0bdde99dd9cae90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99504223-26", "ovs_interfaceid": "99504223-260d-420c-b804-62b5a7de9592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:52:17 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Converting VIF {"id": "99504223-260d-420c-b804-62b5a7de9592", "address": "fa:16:3e:a3:fd:a4", "network": {"id": "bc2718a2-a5ab-44e0-966d-9b180a30ac75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1022668030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8086add121594fe8a0bdde99dd9cae90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99504223-26", "ovs_interfaceid": "99504223-260d-420c-b804-62b5a7de9592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:52:17 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:fd:a4,bridge_name='br-int',has_traffic_filtering=True,id=99504223-260d-420c-b804-62b5a7de9592,network=Network(bc2718a2-a5ab-44e0-966d-9b180a30ac75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99504223-26') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:52:17 user nova-compute[73391]: DEBUG nova.objects.instance [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lazy-loading 'pci_devices' on Instance uuid 0b14ae94-2a1e-4202-9676-e1ae1c996729 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:52:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:52:17 user nova-compute[73391]:   <uuid>0b14ae94-2a1e-4202-9676-e1ae1c996729</uuid>
Aug 15 05:52:17 user nova-compute[73391]:   <name>instance-0000002a</name>
Aug 15 05:52:17 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:52:17 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:52:17 user nova-compute[73391]:   <metadata>
Aug 15 05:52:17 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:52:17 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:52:17 user nova-compute[73391]:       <nova:name>tempest-AttachVolumeNegativeTest-server-580057320</nova:name>
Aug 15 05:52:17 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:52:17</nova:creationTime>
Aug 15 05:52:17 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:52:17 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:52:17 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:52:17 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:52:17 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:52:17 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:52:17 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:52:17 user nova-compute[73391]:       <nova:owner>
Aug 15 05:52:17 user nova-compute[73391]:         <nova:user uuid="9552a83a6a214c149ddceac64ccbdef6">tempest-AttachVolumeNegativeTest-1479702824-project-member</nova:user>
Aug 15 05:52:17 user nova-compute[73391]:         <nova:project uuid="8086add121594fe8a0bdde99dd9cae90">tempest-AttachVolumeNegativeTest-1479702824</nova:project>
Aug 15 05:52:17 user nova-compute[73391]:       </nova:owner>
Aug 15 05:52:17 user nova-compute[73391]:       <nova:root type="image" uuid="191b1dad-305e-4d1c-9b15-515ec59a3278"/>
Aug 15 05:52:17 user nova-compute[73391]:       <nova:ports>
Aug 15 05:52:17 user nova-compute[73391]:         <nova:port uuid="99504223-260d-420c-b804-62b5a7de9592">
Aug 15 05:52:17 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 05:52:17 user nova-compute[73391]:         </nova:port>
Aug 15 05:52:17 user nova-compute[73391]:       </nova:ports>
Aug 15 05:52:17 user nova-compute[73391]:     </nova:instance>
Aug 15 05:52:17 user nova-compute[73391]:   </metadata>
Aug 15 05:52:17 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:52:17 user nova-compute[73391]:     <system>
Aug 15 05:52:17 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:52:17 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:52:17 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:52:17 user nova-compute[73391]:       <entry name="serial">0b14ae94-2a1e-4202-9676-e1ae1c996729</entry>
Aug 15 05:52:17 user nova-compute[73391]:       <entry name="uuid">0b14ae94-2a1e-4202-9676-e1ae1c996729</entry>
Aug 15 05:52:17 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:52:17 user nova-compute[73391]:     </system>
Aug 15 05:52:17 user nova-compute[73391]:   </sysinfo>
Aug 15 05:52:17 user nova-compute[73391]:   <os>
Aug 15 05:52:17 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:52:17 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:52:17 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:52:17 user nova-compute[73391]:   </os>
Aug 15 05:52:17 user nova-compute[73391]:   <features>
Aug 15 05:52:17 user nova-compute[73391]:     <acpi/>
Aug 15 05:52:17 user nova-compute[73391]:     <apic/>
Aug 15 05:52:17 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:52:17 user nova-compute[73391]:   </features>
Aug 15 05:52:17 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:52:17 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:52:17 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:52:17 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:52:17 user nova-compute[73391]:   </clock>
Aug 15 05:52:17 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:52:17 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:52:17 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:52:17 user nova-compute[73391]:   </cpu>
Aug 15 05:52:17 user nova-compute[73391]:   <devices>
Aug 15 05:52:17 user nova-compute[73391]:     <disk type="file" device="disk">
Aug 15 05:52:17 user nova-compute[73391]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 05:52:17 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/0b14ae94-2a1e-4202-9676-e1ae1c996729/disk"/>
Aug 15 05:52:17 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:52:17 user nova-compute[73391]:     </disk>
Aug 15 05:52:17 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:52:17 user nova-compute[73391]:       <mac address="fa:16:3e:a3:fd:a4"/>
Aug 15 05:52:17 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:52:17 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:52:17 user nova-compute[73391]:       <target dev="tap99504223-26"/>
Aug 15 05:52:17 user nova-compute[73391]:     </interface>
Aug 15 05:52:17 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:52:17 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/0b14ae94-2a1e-4202-9676-e1ae1c996729/console.log" append="off"/>
Aug 15 05:52:17 user nova-compute[73391]:     </serial>
Aug 15 05:52:17 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:52:17 user nova-compute[73391]:     <video>
Aug 15 05:52:17 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:52:17 user nova-compute[73391]:     </video>
Aug 15 05:52:17 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:52:17 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:52:17 user nova-compute[73391]:     </rng>
Aug 15 05:52:17 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:52:17 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:52:17 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:52:17 user nova-compute[73391]:     </memballoon>
Aug 15 05:52:17 user nova-compute[73391]:   </devices>
Aug 15 05:52:17 user nova-compute[73391]: </domain>
Aug 15 05:52:17 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:52:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:52:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-580057320',display_name='tempest-AttachVolumeNegativeTest-server-580057320',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-580057320',id=42,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJt0+6930J72EYFBgaP4BWbuf/K4PsIWS9cnonjXjJbH40mXM7+brQsgKb5SEE0gKl60e2aB5RYRm/Lq0AVW7zsLtcv+k7ieJPmvsJjQ9Lhj0vRP+RIUpBInkGtCEaxNiQ==',key_name='tempest-keypair-496769485',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8086add121594fe8a0bdde99dd9cae90',ramdisk_id='',reservation_id='r-4oxvvamf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1479702824',owner_user_name='tempest-AttachVolumeNegativeTest-1479702824-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:52:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9552a83a6a214c149ddceac64ccbdef6',uuid=0b14ae94-2a1e-4202-9676-e1ae1c996729,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99504223-260d-420c-b804-62b5a7de9592", "address": "fa:16:3e:a3:fd:a4", "network": {"id": "bc2718a2-a5ab-44e0-966d-9b180a30ac75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1022668030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8086add121594fe8a0bdde99dd9cae90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99504223-26", "ovs_interfaceid": "99504223-260d-420c-b804-62b5a7de9592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:52:17 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Converting VIF {"id": "99504223-260d-420c-b804-62b5a7de9592", "address": "fa:16:3e:a3:fd:a4", "network": {"id": "bc2718a2-a5ab-44e0-966d-9b180a30ac75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1022668030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8086add121594fe8a0bdde99dd9cae90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99504223-26", "ovs_interfaceid": "99504223-260d-420c-b804-62b5a7de9592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:52:17 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:fd:a4,bridge_name='br-int',has_traffic_filtering=True,id=99504223-260d-420c-b804-62b5a7de9592,network=Network(bc2718a2-a5ab-44e0-966d-9b180a30ac75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99504223-26') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:52:17 user nova-compute[73391]: DEBUG os_vif [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:fd:a4,bridge_name='br-int',has_traffic_filtering=True,id=99504223-260d-420c-b804-62b5a7de9592,network=Network(bc2718a2-a5ab-44e0-966d-9b180a30ac75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99504223-26') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:52:17 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:52:17 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:52:17 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:52:17 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:52:17 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap99504223-26, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:52:17 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap99504223-26, col_values=(('external_ids', {'iface-id': '99504223-260d-420c-b804-62b5a7de9592', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:fd:a4', 'vm-uuid': '0b14ae94-2a1e-4202-9676-e1ae1c996729'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:52:17 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:52:17 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:52:17 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:52:17 user nova-compute[73391]: INFO os_vif [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:fd:a4,bridge_name='br-int',has_traffic_filtering=True,id=99504223-260d-420c-b804-62b5a7de9592,network=Network(bc2718a2-a5ab-44e0-966d-9b180a30ac75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99504223-26')
Aug 15 05:52:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:52:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] No VIF found with MAC fa:16:3e:a3:fd:a4, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:52:18 user nova-compute[73391]: DEBUG nova.network.neutron [req-d625312b-57b4-4022-b4ea-75b7ec13b91f req-b0e59a45-c665-4f4b-890e-342be37eb2cb service nova] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Updated VIF entry in instance network info cache for port 99504223-260d-420c-b804-62b5a7de9592. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:52:18 user nova-compute[73391]: DEBUG nova.network.neutron [req-d625312b-57b4-4022-b4ea-75b7ec13b91f req-b0e59a45-c665-4f4b-890e-342be37eb2cb service nova] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Updating instance_info_cache with network_info: [{"id": "99504223-260d-420c-b804-62b5a7de9592", "address": "fa:16:3e:a3:fd:a4", "network": {"id": "bc2718a2-a5ab-44e0-966d-9b180a30ac75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1022668030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8086add121594fe8a0bdde99dd9cae90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99504223-26", "ovs_interfaceid": "99504223-260d-420c-b804-62b5a7de9592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:52:18 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d625312b-57b4-4022-b4ea-75b7ec13b91f req-b0e59a45-c665-4f4b-890e-342be37eb2cb service nova] Releasing lock "refresh_cache-0b14ae94-2a1e-4202-9676-e1ae1c996729" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:52:18 user nova-compute[73391]: DEBUG nova.network.neutron [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Successfully updated port: 32d1f42a-cab6-41ee-ae14-2cf842756259 {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:52:18 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Acquiring lock "refresh_cache-a7f591b9-7028-431d-aacc-9725767d8e1d" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:52:18 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Acquired lock "refresh_cache-a7f591b9-7028-431d-aacc-9725767d8e1d" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:52:18 user nova-compute[73391]: DEBUG nova.network.neutron [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:52:18 user nova-compute[73391]: DEBUG nova.network.neutron [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:52:18 user nova-compute[73391]: DEBUG nova.network.neutron [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Updating instance_info_cache with network_info: [{"id": "32d1f42a-cab6-41ee-ae14-2cf842756259", "address": "fa:16:3e:d6:29:41", "network": {"id": "16e02c7a-c90b-40d7-a58c-59f7fbfb2c14", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b6806eca80d44b87b1a19efa0667e7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32d1f42a-ca", "ovs_interfaceid": "32d1f42a-cab6-41ee-ae14-2cf842756259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:52:18 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Releasing lock "refresh_cache-a7f591b9-7028-431d-aacc-9725767d8e1d" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:52:18 user nova-compute[73391]: DEBUG nova.compute.manager [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Instance network_info: |[{"id": "32d1f42a-cab6-41ee-ae14-2cf842756259", "address": "fa:16:3e:d6:29:41", "network": {"id": "16e02c7a-c90b-40d7-a58c-59f7fbfb2c14", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b6806eca80d44b87b1a19efa0667e7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32d1f42a-ca", "ovs_interfaceid": "32d1f42a-cab6-41ee-ae14-2cf842756259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 05:52:18 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Start _get_guest_xml network_info=[{"id": "32d1f42a-cab6-41ee-ae14-2cf842756259", "address": "fa:16:3e:d6:29:41", "network": {"id": "16e02c7a-c90b-40d7-a58c-59f7fbfb2c14", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b6806eca80d44b87b1a19efa0667e7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32d1f42a-ca", "ovs_interfaceid": "32d1f42a-cab6-41ee-ae14-2cf842756259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '191b1dad-305e-4d1c-9b15-515ec59a3278'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:52:18 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:52:18 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:52:18 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:52:18 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:52:18 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:52:18 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:52:18 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:52:18 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:52:18 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:52:18 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:52:18 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:52:18 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:52:18 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:52:18 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:52:18 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:52:18 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:52:18 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:52:18 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:52:18 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:52:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-204804039',display_name='tempest-VolumesNegativeTest-instance-204804039',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-204804039',id=43,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b63a1678a0274c1084ddccd206711afe',ramdisk_id='',reservation_id='r-vvd0587p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1848425558',owner_user_name='tempest-VolumesNegativeTest-1848425558-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:52:16Z,user_data=None,user_id='4b83572d8f5447c282fb182320d4035f',uuid=a7f591b9-7028-431d-aacc-9725767d8e1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32d1f42a-cab6-41ee-ae14-2cf842756259", "address": "fa:16:3e:d6:29:41", "network": {"id": "16e02c7a-c90b-40d7-a58c-59f7fbfb2c14", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b6806eca80d44b87b1a19efa0667e7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32d1f42a-ca", "ovs_interfaceid": "32d1f42a-cab6-41ee-ae14-2cf842756259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:52:18 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Converting VIF {"id": "32d1f42a-cab6-41ee-ae14-2cf842756259", "address": "fa:16:3e:d6:29:41", "network": {"id": "16e02c7a-c90b-40d7-a58c-59f7fbfb2c14", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b6806eca80d44b87b1a19efa0667e7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32d1f42a-ca", "ovs_interfaceid": "32d1f42a-cab6-41ee-ae14-2cf842756259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:52:18 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:29:41,bridge_name='br-int',has_traffic_filtering=True,id=32d1f42a-cab6-41ee-ae14-2cf842756259,network=Network(16e02c7a-c90b-40d7-a58c-59f7fbfb2c14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32d1f42a-ca') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:52:18 user nova-compute[73391]: DEBUG nova.objects.instance [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Lazy-loading 'pci_devices' on Instance uuid a7f591b9-7028-431d-aacc-9725767d8e1d {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:52:18 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:52:18 user nova-compute[73391]:   <uuid>a7f591b9-7028-431d-aacc-9725767d8e1d</uuid>
Aug 15 05:52:18 user nova-compute[73391]:   <name>instance-0000002b</name>
Aug 15 05:52:18 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:52:18 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:52:18 user nova-compute[73391]:   <metadata>
Aug 15 05:52:18 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:52:18 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:52:18 user nova-compute[73391]:       <nova:name>tempest-VolumesNegativeTest-instance-204804039</nova:name>
Aug 15 05:52:18 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:52:18</nova:creationTime>
Aug 15 05:52:18 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:52:18 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:52:18 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:52:18 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:52:18 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:52:18 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:52:18 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:52:18 user nova-compute[73391]:       <nova:owner>
Aug 15 05:52:18 user nova-compute[73391]:         <nova:user uuid="4b83572d8f5447c282fb182320d4035f">tempest-VolumesNegativeTest-1848425558-project-member</nova:user>
Aug 15 05:52:18 user nova-compute[73391]:         <nova:project uuid="b63a1678a0274c1084ddccd206711afe">tempest-VolumesNegativeTest-1848425558</nova:project>
Aug 15 05:52:18 user nova-compute[73391]:       </nova:owner>
Aug 15 05:52:18 user nova-compute[73391]:       <nova:root type="image" uuid="191b1dad-305e-4d1c-9b15-515ec59a3278"/>
Aug 15 05:52:18 user nova-compute[73391]:       <nova:ports>
Aug 15 05:52:18 user nova-compute[73391]:         <nova:port uuid="32d1f42a-cab6-41ee-ae14-2cf842756259">
Aug 15 05:52:18 user nova-compute[73391]:           <nova:ip type="fixed" address="192.168.233.16" ipVersion="4"/>
Aug 15 05:52:18 user nova-compute[73391]:         </nova:port>
Aug 15 05:52:18 user nova-compute[73391]:       </nova:ports>
Aug 15 05:52:18 user nova-compute[73391]:     </nova:instance>
Aug 15 05:52:18 user nova-compute[73391]:   </metadata>
Aug 15 05:52:18 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:52:18 user nova-compute[73391]:     <system>
Aug 15 05:52:18 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:52:18 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:52:18 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:52:18 user nova-compute[73391]:       <entry name="serial">a7f591b9-7028-431d-aacc-9725767d8e1d</entry>
Aug 15 05:52:18 user nova-compute[73391]:       <entry name="uuid">a7f591b9-7028-431d-aacc-9725767d8e1d</entry>
Aug 15 05:52:18 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:52:18 user nova-compute[73391]:     </system>
Aug 15 05:52:18 user nova-compute[73391]:   </sysinfo>
Aug 15 05:52:18 user nova-compute[73391]:   <os>
Aug 15 05:52:18 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:52:18 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:52:18 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:52:18 user nova-compute[73391]:   </os>
Aug 15 05:52:18 user nova-compute[73391]:   <features>
Aug 15 05:52:18 user nova-compute[73391]:     <acpi/>
Aug 15 05:52:18 user nova-compute[73391]:     <apic/>
Aug 15 05:52:18 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:52:18 user nova-compute[73391]:   </features>
Aug 15 05:52:18 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:52:18 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:52:18 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:52:18 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:52:18 user nova-compute[73391]:   </clock>
Aug 15 05:52:18 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:52:18 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:52:18 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:52:18 user nova-compute[73391]:   </cpu>
Aug 15 05:52:18 user nova-compute[73391]:   <devices>
Aug 15 05:52:18 user nova-compute[73391]:     <disk type="file" device="disk">
Aug 15 05:52:18 user nova-compute[73391]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 05:52:18 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/a7f591b9-7028-431d-aacc-9725767d8e1d/disk"/>
Aug 15 05:52:18 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:52:18 user nova-compute[73391]:     </disk>
Aug 15 05:52:18 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:52:18 user nova-compute[73391]:       <mac address="fa:16:3e:d6:29:41"/>
Aug 15 05:52:18 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:52:18 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:52:18 user nova-compute[73391]:       <target dev="tap32d1f42a-ca"/>
Aug 15 05:52:18 user nova-compute[73391]:     </interface>
Aug 15 05:52:18 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:52:18 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/a7f591b9-7028-431d-aacc-9725767d8e1d/console.log" append="off"/>
Aug 15 05:52:18 user nova-compute[73391]:     </serial>
Aug 15 05:52:18 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:52:18 user nova-compute[73391]:     <video>
Aug 15 05:52:18 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:52:18 user nova-compute[73391]:     </video>
Aug 15 05:52:18 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:52:18 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:52:18 user nova-compute[73391]:     </rng>
Aug 15 05:52:18 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:52:18 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:52:18 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:52:18 user nova-compute[73391]:     </memballoon>
Aug 15 05:52:18 user nova-compute[73391]:   </devices>
Aug 15 05:52:18 user nova-compute[73391]: </domain>
Aug 15 05:52:18 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:52:18 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:52:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-204804039',display_name='tempest-VolumesNegativeTest-instance-204804039',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-204804039',id=43,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b63a1678a0274c1084ddccd206711afe',ramdisk_id='',reservation_id='r-vvd0587p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1848425558',owner_user_name='tempest-VolumesNegativeTest-1848425558-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:52:16Z,user_data=None,user_id='4b83572d8f5447c282fb182320d4035f',uuid=a7f591b9-7028-431d-aacc-9725767d8e1d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32d1f42a-cab6-41ee-ae14-2cf842756259", "address": "fa:16:3e:d6:29:41", "network": {"id": "16e02c7a-c90b-40d7-a58c-59f7fbfb2c14", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b6806eca80d44b87b1a19efa0667e7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32d1f42a-ca", "ovs_interfaceid": "32d1f42a-cab6-41ee-ae14-2cf842756259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:52:18 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Converting VIF {"id": "32d1f42a-cab6-41ee-ae14-2cf842756259", "address": "fa:16:3e:d6:29:41", "network": {"id": "16e02c7a-c90b-40d7-a58c-59f7fbfb2c14", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b6806eca80d44b87b1a19efa0667e7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32d1f42a-ca", "ovs_interfaceid": "32d1f42a-cab6-41ee-ae14-2cf842756259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:52:18 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:29:41,bridge_name='br-int',has_traffic_filtering=True,id=32d1f42a-cab6-41ee-ae14-2cf842756259,network=Network(16e02c7a-c90b-40d7-a58c-59f7fbfb2c14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32d1f42a-ca') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:52:18 user nova-compute[73391]: DEBUG os_vif [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:29:41,bridge_name='br-int',has_traffic_filtering=True,id=32d1f42a-cab6-41ee-ae14-2cf842756259,network=Network(16e02c7a-c90b-40d7-a58c-59f7fbfb2c14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32d1f42a-ca') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:52:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:52:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:52:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:52:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:52:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap32d1f42a-ca, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:52:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap32d1f42a-ca, col_values=(('external_ids', {'iface-id': '32d1f42a-cab6-41ee-ae14-2cf842756259', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d6:29:41', 'vm-uuid': 'a7f591b9-7028-431d-aacc-9725767d8e1d'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:52:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:52:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:52:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:52:18 user nova-compute[73391]: INFO os_vif [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:29:41,bridge_name='br-int',has_traffic_filtering=True,id=32d1f42a-cab6-41ee-ae14-2cf842756259,network=Network(16e02c7a-c90b-40d7-a58c-59f7fbfb2c14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32d1f42a-ca')
Aug 15 05:52:18 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:52:18 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] No VIF found with MAC fa:16:3e:d6:29:41, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:52:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:52:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:52:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:52:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:52:19 user nova-compute[73391]: DEBUG nova.compute.manager [req-24331e85-1557-4478-a6f7-0041ea40170e req-74740882-5c5a-4017-a227-c2271d73464e service nova] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Received event network-changed-32d1f42a-cab6-41ee-ae14-2cf842756259 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:52:19 user nova-compute[73391]: DEBUG nova.compute.manager [req-24331e85-1557-4478-a6f7-0041ea40170e req-74740882-5c5a-4017-a227-c2271d73464e service nova] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Refreshing instance network info cache due to event network-changed-32d1f42a-cab6-41ee-ae14-2cf842756259. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:52:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-24331e85-1557-4478-a6f7-0041ea40170e req-74740882-5c5a-4017-a227-c2271d73464e service nova] Acquiring lock "refresh_cache-a7f591b9-7028-431d-aacc-9725767d8e1d" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:52:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-24331e85-1557-4478-a6f7-0041ea40170e req-74740882-5c5a-4017-a227-c2271d73464e service nova] Acquired lock "refresh_cache-a7f591b9-7028-431d-aacc-9725767d8e1d" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:52:19 user nova-compute[73391]: DEBUG nova.network.neutron [req-24331e85-1557-4478-a6f7-0041ea40170e req-74740882-5c5a-4017-a227-c2271d73464e service nova] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Refreshing network info cache for port 32d1f42a-cab6-41ee-ae14-2cf842756259 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:52:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:52:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:52:19 user nova-compute[73391]: DEBUG nova.compute.manager [req-03debbc3-cf27-445e-9b71-dfce3461b7b1 req-ba9d7279-0108-448d-8069-14080d215017 service nova] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Received event network-vif-plugged-99504223-260d-420c-b804-62b5a7de9592 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:52:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-03debbc3-cf27-445e-9b71-dfce3461b7b1 req-ba9d7279-0108-448d-8069-14080d215017 service nova] Acquiring lock "0b14ae94-2a1e-4202-9676-e1ae1c996729-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:52:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-03debbc3-cf27-445e-9b71-dfce3461b7b1 req-ba9d7279-0108-448d-8069-14080d215017 service nova] Lock "0b14ae94-2a1e-4202-9676-e1ae1c996729-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:52:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-03debbc3-cf27-445e-9b71-dfce3461b7b1 req-ba9d7279-0108-448d-8069-14080d215017 service nova] Lock "0b14ae94-2a1e-4202-9676-e1ae1c996729-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:52:19 user nova-compute[73391]: DEBUG nova.compute.manager [req-03debbc3-cf27-445e-9b71-dfce3461b7b1 req-ba9d7279-0108-448d-8069-14080d215017 service nova] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] No waiting events found dispatching network-vif-plugged-99504223-260d-420c-b804-62b5a7de9592 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:52:19 user nova-compute[73391]: WARNING nova.compute.manager [req-03debbc3-cf27-445e-9b71-dfce3461b7b1 req-ba9d7279-0108-448d-8069-14080d215017 service nova] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Received unexpected event network-vif-plugged-99504223-260d-420c-b804-62b5a7de9592 for instance with vm_state building and task_state spawning.
Aug 15 05:52:19 user nova-compute[73391]: DEBUG nova.network.neutron [req-24331e85-1557-4478-a6f7-0041ea40170e req-74740882-5c5a-4017-a227-c2271d73464e service nova] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Updated VIF entry in instance network info cache for port 32d1f42a-cab6-41ee-ae14-2cf842756259. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:52:19 user nova-compute[73391]: DEBUG nova.network.neutron [req-24331e85-1557-4478-a6f7-0041ea40170e req-74740882-5c5a-4017-a227-c2271d73464e service nova] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Updating instance_info_cache with network_info: [{"id": "32d1f42a-cab6-41ee-ae14-2cf842756259", "address": "fa:16:3e:d6:29:41", "network": {"id": "16e02c7a-c90b-40d7-a58c-59f7fbfb2c14", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b6806eca80d44b87b1a19efa0667e7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32d1f42a-ca", "ovs_interfaceid": "32d1f42a-cab6-41ee-ae14-2cf842756259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:52:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-24331e85-1557-4478-a6f7-0041ea40170e req-74740882-5c5a-4017-a227-c2271d73464e service nova] Releasing lock "refresh_cache-a7f591b9-7028-431d-aacc-9725767d8e1d" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:52:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:52:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:52:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:52:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:52:20 user nova-compute[73391]: DEBUG nova.compute.manager [req-99461dc1-4bf4-41ae-aba5-d9d4ee2b75be req-89a14998-5289-4b1a-8f52-336501bf99fd service nova] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Received event network-vif-plugged-32d1f42a-cab6-41ee-ae14-2cf842756259 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:52:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-99461dc1-4bf4-41ae-aba5-d9d4ee2b75be req-89a14998-5289-4b1a-8f52-336501bf99fd service nova] Acquiring lock "a7f591b9-7028-431d-aacc-9725767d8e1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:52:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-99461dc1-4bf4-41ae-aba5-d9d4ee2b75be req-89a14998-5289-4b1a-8f52-336501bf99fd service nova] Lock "a7f591b9-7028-431d-aacc-9725767d8e1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:52:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-99461dc1-4bf4-41ae-aba5-d9d4ee2b75be req-89a14998-5289-4b1a-8f52-336501bf99fd service nova] Lock "a7f591b9-7028-431d-aacc-9725767d8e1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:52:20 user nova-compute[73391]: DEBUG nova.compute.manager [req-99461dc1-4bf4-41ae-aba5-d9d4ee2b75be req-89a14998-5289-4b1a-8f52-336501bf99fd service nova] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] No waiting events found dispatching network-vif-plugged-32d1f42a-cab6-41ee-ae14-2cf842756259 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:52:20 user nova-compute[73391]: WARNING nova.compute.manager [req-99461dc1-4bf4-41ae-aba5-d9d4ee2b75be req-89a14998-5289-4b1a-8f52-336501bf99fd service nova] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Received unexpected event network-vif-plugged-32d1f42a-cab6-41ee-ae14-2cf842756259 for instance with vm_state building and task_state spawning.
Aug 15 05:52:21 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:52:21 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:52:21 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:52:21 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:52:21 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:52:21 user nova-compute[73391]: DEBUG nova.compute.manager [req-f6ef330e-054f-47af-b0f6-3eddc8b6c3d8 req-8f55b84b-eef0-48b7-acc3-43e8342624ae service nova] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Received event network-vif-plugged-99504223-260d-420c-b804-62b5a7de9592 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:52:21 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f6ef330e-054f-47af-b0f6-3eddc8b6c3d8 req-8f55b84b-eef0-48b7-acc3-43e8342624ae service nova] Acquiring lock "0b14ae94-2a1e-4202-9676-e1ae1c996729-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:52:21 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f6ef330e-054f-47af-b0f6-3eddc8b6c3d8 req-8f55b84b-eef0-48b7-acc3-43e8342624ae service nova] Lock "0b14ae94-2a1e-4202-9676-e1ae1c996729-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:52:21 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f6ef330e-054f-47af-b0f6-3eddc8b6c3d8 req-8f55b84b-eef0-48b7-acc3-43e8342624ae service nova] Lock "0b14ae94-2a1e-4202-9676-e1ae1c996729-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:52:21 user nova-compute[73391]: DEBUG nova.compute.manager [req-f6ef330e-054f-47af-b0f6-3eddc8b6c3d8 req-8f55b84b-eef0-48b7-acc3-43e8342624ae service nova] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] No waiting events found dispatching network-vif-plugged-99504223-260d-420c-b804-62b5a7de9592 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:52:21 user nova-compute[73391]: WARNING nova.compute.manager [req-f6ef330e-054f-47af-b0f6-3eddc8b6c3d8 req-8f55b84b-eef0-48b7-acc3-43e8342624ae service nova] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Received unexpected event network-vif-plugged-99504223-260d-420c-b804-62b5a7de9592 for instance with vm_state building and task_state spawning.
Aug 15 05:52:22 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078742.307442, 0b14ae94-2a1e-4202-9676-e1ae1c996729 => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:52:22 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] VM Resumed (Lifecycle Event)
Aug 15 05:52:22 user nova-compute[73391]: DEBUG nova.compute.manager [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:52:22 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Guest created on hypervisor {{(pid=73391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 05:52:22 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Instance spawned successfully.
Aug 15 05:52:22 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 05:52:22 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:52:22 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:52:22 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Found default for hw_cdrom_bus of ide {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:52:22 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Found default for hw_disk_bus of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:52:22 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Found default for hw_input_bus of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:52:22 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Found default for hw_pointer_model of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:52:22 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Found default for hw_video_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:52:22 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Found default for hw_vif_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:52:22 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:52:22 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078742.3087413, 0b14ae94-2a1e-4202-9676-e1ae1c996729 => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:52:22 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] VM Started (Lifecycle Event)
Aug 15 05:52:22 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:52:22 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:52:22 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:52:22 user nova-compute[73391]: INFO nova.compute.manager [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Took 7.52 seconds to spawn the instance on the hypervisor.
Aug 15 05:52:22 user nova-compute[73391]: DEBUG nova.compute.manager [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:52:22 user nova-compute[73391]: INFO nova.compute.manager [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Took 8.19 seconds to build instance.
Aug 15 05:52:22 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-389c6531-3d42-4ba8-8d18-74c08f90c68f tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "0b14ae94-2a1e-4202-9676-e1ae1c996729" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.292s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:52:22 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078742.6881166, a7f591b9-7028-431d-aacc-9725767d8e1d => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:52:22 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] VM Resumed (Lifecycle Event)
Aug 15 05:52:22 user nova-compute[73391]: DEBUG nova.compute.manager [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:52:22 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Guest created on hypervisor {{(pid=73391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 05:52:22 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Instance spawned successfully.
Aug 15 05:52:22 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 05:52:22 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:52:22 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:52:22 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:52:22 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078742.6896446, a7f591b9-7028-431d-aacc-9725767d8e1d => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:52:22 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] VM Started (Lifecycle Event)
Aug 15 05:52:22 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Found default for hw_cdrom_bus of ide {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:52:22 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Found default for hw_disk_bus of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:52:22 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Found default for hw_input_bus of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:52:22 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Found default for hw_pointer_model of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:52:22 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Found default for hw_video_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:52:22 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Found default for hw_vif_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:52:22 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:52:22 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:52:22 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:52:22 user nova-compute[73391]: INFO nova.compute.manager [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Took 7.01 seconds to spawn the instance on the hypervisor.
Aug 15 05:52:22 user nova-compute[73391]: DEBUG nova.compute.manager [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:52:22 user nova-compute[73391]: DEBUG nova.compute.manager [req-0ebff8c4-48c6-482d-bb54-3b5946e0ca82 req-aae86b8a-42de-40af-83fa-bb44959ddb56 service nova] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Received event network-vif-plugged-32d1f42a-cab6-41ee-ae14-2cf842756259 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:52:22 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-0ebff8c4-48c6-482d-bb54-3b5946e0ca82 req-aae86b8a-42de-40af-83fa-bb44959ddb56 service nova] Acquiring lock "a7f591b9-7028-431d-aacc-9725767d8e1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:52:22 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-0ebff8c4-48c6-482d-bb54-3b5946e0ca82 req-aae86b8a-42de-40af-83fa-bb44959ddb56 service nova] Lock "a7f591b9-7028-431d-aacc-9725767d8e1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:52:22 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-0ebff8c4-48c6-482d-bb54-3b5946e0ca82 req-aae86b8a-42de-40af-83fa-bb44959ddb56 service nova] Lock "a7f591b9-7028-431d-aacc-9725767d8e1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:52:22 user nova-compute[73391]: DEBUG nova.compute.manager [req-0ebff8c4-48c6-482d-bb54-3b5946e0ca82 req-aae86b8a-42de-40af-83fa-bb44959ddb56 service nova] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] No waiting events found dispatching network-vif-plugged-32d1f42a-cab6-41ee-ae14-2cf842756259 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:52:22 user nova-compute[73391]: WARNING nova.compute.manager [req-0ebff8c4-48c6-482d-bb54-3b5946e0ca82 req-aae86b8a-42de-40af-83fa-bb44959ddb56 service nova] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Received unexpected event network-vif-plugged-32d1f42a-cab6-41ee-ae14-2cf842756259 for instance with vm_state building and task_state spawning.
Aug 15 05:52:22 user nova-compute[73391]: INFO nova.compute.manager [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Took 8.02 seconds to build instance.
Aug 15 05:52:23 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e0da89cd-9ba8-4a01-b266-190890d6b0f2 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Lock "a7f591b9-7028-431d-aacc-9725767d8e1d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.137s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:52:23 user nova-compute[73391]: DEBUG nova.compute.manager [req-9fd0ca2a-6fb6-4171-a172-0b329c4f6a4a req-dcd80291-01d6-4fa0-9e9e-e25b4110373a service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Received event network-changed-d9ae0be2-05e7-4009-b909-713c8c52e5e5 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:52:23 user nova-compute[73391]: DEBUG nova.compute.manager [req-9fd0ca2a-6fb6-4171-a172-0b329c4f6a4a req-dcd80291-01d6-4fa0-9e9e-e25b4110373a service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Refreshing instance network info cache due to event network-changed-d9ae0be2-05e7-4009-b909-713c8c52e5e5. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:52:23 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-9fd0ca2a-6fb6-4171-a172-0b329c4f6a4a req-dcd80291-01d6-4fa0-9e9e-e25b4110373a service nova] Acquiring lock "refresh_cache-d85a919d-7f44-4093-b89a-51397ad5cedb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:52:23 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-9fd0ca2a-6fb6-4171-a172-0b329c4f6a4a req-dcd80291-01d6-4fa0-9e9e-e25b4110373a service nova] Acquired lock "refresh_cache-d85a919d-7f44-4093-b89a-51397ad5cedb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:52:23 user nova-compute[73391]: DEBUG nova.network.neutron [req-9fd0ca2a-6fb6-4171-a172-0b329c4f6a4a req-dcd80291-01d6-4fa0-9e9e-e25b4110373a service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Refreshing network info cache for port d9ae0be2-05e7-4009-b909-713c8c52e5e5 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:52:23 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:52:24 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-92271f98-4ecb-4b2e-9e8a-93b721832040 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Acquiring lock "d85a919d-7f44-4093-b89a-51397ad5cedb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:52:24 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-92271f98-4ecb-4b2e-9e8a-93b721832040 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "d85a919d-7f44-4093-b89a-51397ad5cedb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:52:24 user nova-compute[73391]: DEBUG nova.network.neutron [req-9fd0ca2a-6fb6-4171-a172-0b329c4f6a4a req-dcd80291-01d6-4fa0-9e9e-e25b4110373a service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Updated VIF entry in instance network info cache for port d9ae0be2-05e7-4009-b909-713c8c52e5e5. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:52:24 user nova-compute[73391]: DEBUG nova.network.neutron [req-9fd0ca2a-6fb6-4171-a172-0b329c4f6a4a req-dcd80291-01d6-4fa0-9e9e-e25b4110373a service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Updating instance_info_cache with network_info: [{"id": "d9ae0be2-05e7-4009-b909-713c8c52e5e5", "address": "fa:16:3e:8a:49:2b", "network": {"id": "bec69c6a-b2cb-4b0a-ba6e-ae6dae099818", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7da9448cc34b609120da564a01dba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ae0be2-05", "ovs_interfaceid": "d9ae0be2-05e7-4009-b909-713c8c52e5e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:52:24 user nova-compute[73391]: INFO nova.compute.manager [None req-92271f98-4ecb-4b2e-9e8a-93b721832040 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Detaching volume 3dc55180-bd5d-49cc-b3a5-81b73c5c9f52
Aug 15 05:52:24 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-9fd0ca2a-6fb6-4171-a172-0b329c4f6a4a req-dcd80291-01d6-4fa0-9e9e-e25b4110373a service nova] Releasing lock "refresh_cache-d85a919d-7f44-4093-b89a-51397ad5cedb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:52:24 user nova-compute[73391]: INFO nova.virt.block_device [None req-92271f98-4ecb-4b2e-9e8a-93b721832040 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Attempting to driver detach volume 3dc55180-bd5d-49cc-b3a5-81b73c5c9f52 from mountpoint /dev/vdb
Aug 15 05:52:24 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-92271f98-4ecb-4b2e-9e8a-93b721832040 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Attempting to detach device vdb from instance d85a919d-7f44-4093-b89a-51397ad5cedb from the persistent domain config. {{(pid=73391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 05:52:24 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-92271f98-4ecb-4b2e-9e8a-93b721832040 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 05:52:24 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:52:24 user nova-compute[73391]:   <source dev="/dev/sdb"/>
Aug 15 05:52:24 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:52:24 user nova-compute[73391]:   <serial>3dc55180-bd5d-49cc-b3a5-81b73c5c9f52</serial>
Aug 15 05:52:24 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 05:52:24 user nova-compute[73391]: </disk>
Aug 15 05:52:24 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 05:52:24 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-92271f98-4ecb-4b2e-9e8a-93b721832040 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Successfully detached device vdb from instance d85a919d-7f44-4093-b89a-51397ad5cedb from the persistent domain config.
Aug 15 05:52:24 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-92271f98-4ecb-4b2e-9e8a-93b721832040 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d85a919d-7f44-4093-b89a-51397ad5cedb from the live domain config. {{(pid=73391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 05:52:24 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-92271f98-4ecb-4b2e-9e8a-93b721832040 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 05:52:24 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:52:24 user nova-compute[73391]:   <source dev="/dev/sdb"/>
Aug 15 05:52:24 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:52:24 user nova-compute[73391]:   <serial>3dc55180-bd5d-49cc-b3a5-81b73c5c9f52</serial>
Aug 15 05:52:24 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 05:52:24 user nova-compute[73391]: </disk>
Aug 15 05:52:24 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 05:52:24 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:52:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:52:24 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Received event <DeviceRemovedEvent: 1692078744.9261732, d85a919d-7f44-4093-b89a-51397ad5cedb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73391) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 05:52:24 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-92271f98-4ecb-4b2e-9e8a-93b721832040 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d85a919d-7f44-4093-b89a-51397ad5cedb {{(pid=73391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 05:52:24 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-92271f98-4ecb-4b2e-9e8a-93b721832040 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Successfully detached device vdb from instance d85a919d-7f44-4093-b89a-51397ad5cedb from the live domain config.
Aug 15 05:52:24 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92271f98-4ecb-4b2e-9e8a-93b721832040 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 05:52:24 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-92271f98-4ecb-4b2e-9e8a-93b721832040 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'THLbReou', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:52:24 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-92271f98-4ecb-4b2e-9e8a-93b721832040 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:52:24 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-92271f98-4ecb-4b2e-9e8a-93b721832040 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:52:24 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-92271f98-4ecb-4b2e-9e8a-93b721832040 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:52:24 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-92271f98-4ecb-4b2e-9e8a-93b721832040 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 05:52:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:24 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d649a3-aed8-4ec3-a7ae-2c6cc3b7662f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:52:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:24 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee770a05-9c68-4804-a60a-80fe4e588aae]: (4, ('tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:52:24 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-92271f98-4ecb-4b2e-9e8a-93b721832040 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52 (non-flash)
Aug 15 05:52:24 user nova-compute[73391]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de (non-flash)
Aug 15 05:52:24 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:52:24 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-92271f98-4ecb-4b2e-9e8a-93b721832040 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] iscsi session list stdout=tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52 (non-flash)
Aug 15 05:52:24 user nova-compute[73391]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de (non-flash)
Aug 15 05:52:24 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:52:25 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-92271f98-4ecb-4b2e-9e8a-93b721832040 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77581727a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52'): ({'sdb'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 05:52:25 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-92271f98-4ecb-4b2e-9e8a-93b721832040 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Removing single pathed devices sdb {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 05:52:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:25 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0068a3b8-e699-47af-b799-dbb5282884c9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:52:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.036s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:25 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[108f5ce6-01a9-41e2-bc1e-2b7517d2533c]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:52:25 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-92271f98-4ecb-4b2e-9e8a-93b721832040 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Flushing IO for device /dev/sdb {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 05:52:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:25 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff76150-0c78-435d-89c0-2210c5e6a501]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:52:25 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-92271f98-4ecb-4b2e-9e8a-93b721832040 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 05:52:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:25 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb16a579-c77b-4c03-bce5-f66b43e13cf6]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:52:25 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-92271f98-4ecb-4b2e-9e8a-93b721832040 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 05:52:25 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-92271f98-4ecb-4b2e-9e8a-93b721832040 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] SCSI volumes sdb have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 05:52:25 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-92271f98-4ecb-4b2e-9e8a-93b721832040 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 05:52:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:25 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e6214b-964a-4d44-b3d6-d2e354d78ce9]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:52:25 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-92271f98-4ecb-4b2e-9e8a-93b721832040 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:52:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52 -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:25 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[71692fbd-0c49-4fcb-b798-aa059a6340a4]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:52:25 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-92271f98-4ecb-4b2e-9e8a-93b721832040 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52, portal: 172.16.0.220,3260]
Aug 15 05:52:25 user nova-compute[73391]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52, portal: 172.16.0.220,3260] successful.
Aug 15 05:52:25 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:52:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52 -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:25 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3dc55180-bd5d-49cc-b3a5-81b73c5c9f52 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:25 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2962ca4-b43c-4de0-9457-c347a6ac24c8]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:52:25 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-92271f98-4ecb-4b2e-9e8a-93b721832040 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:52:25 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-92271f98-4ecb-4b2e-9e8a-93b721832040 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.419s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:52:25 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-92271f98-4ecb-4b2e-9e8a-93b721832040 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] <== disconnect_volume: return (420ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:52:25 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92271f98-4ecb-4b2e-9e8a-93b721832040 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 05:52:25 user nova-compute[73391]: DEBUG nova.compute.manager [req-cec74135-f0e1-4cd4-91b0-eedaa40a0315 req-c6dd0a55-de4f-42de-a184-d8a6900a7c75 service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Received event network-changed-d9ae0be2-05e7-4009-b909-713c8c52e5e5 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:52:25 user nova-compute[73391]: DEBUG nova.compute.manager [req-cec74135-f0e1-4cd4-91b0-eedaa40a0315 req-c6dd0a55-de4f-42de-a184-d8a6900a7c75 service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Refreshing instance network info cache due to event network-changed-d9ae0be2-05e7-4009-b909-713c8c52e5e5. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:52:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-cec74135-f0e1-4cd4-91b0-eedaa40a0315 req-c6dd0a55-de4f-42de-a184-d8a6900a7c75 service nova] Acquiring lock "refresh_cache-d85a919d-7f44-4093-b89a-51397ad5cedb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:52:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-cec74135-f0e1-4cd4-91b0-eedaa40a0315 req-c6dd0a55-de4f-42de-a184-d8a6900a7c75 service nova] Acquired lock "refresh_cache-d85a919d-7f44-4093-b89a-51397ad5cedb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:52:25 user nova-compute[73391]: DEBUG nova.network.neutron [req-cec74135-f0e1-4cd4-91b0-eedaa40a0315 req-c6dd0a55-de4f-42de-a184-d8a6900a7c75 service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Refreshing network info cache for port d9ae0be2-05e7-4009-b909-713c8c52e5e5 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:52:26 user nova-compute[73391]: DEBUG nova.objects.instance [None req-92271f98-4ecb-4b2e-9e8a-93b721832040 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lazy-loading 'flavor' on Instance uuid d85a919d-7f44-4093-b89a-51397ad5cedb {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:52:26 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-92271f98-4ecb-4b2e-9e8a-93b721832040 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "d85a919d-7f44-4093-b89a-51397ad5cedb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.897s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:52:26 user nova-compute[73391]: DEBUG nova.network.neutron [req-cec74135-f0e1-4cd4-91b0-eedaa40a0315 req-c6dd0a55-de4f-42de-a184-d8a6900a7c75 service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Updated VIF entry in instance network info cache for port d9ae0be2-05e7-4009-b909-713c8c52e5e5. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:52:26 user nova-compute[73391]: DEBUG nova.network.neutron [req-cec74135-f0e1-4cd4-91b0-eedaa40a0315 req-c6dd0a55-de4f-42de-a184-d8a6900a7c75 service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Updating instance_info_cache with network_info: [{"id": "d9ae0be2-05e7-4009-b909-713c8c52e5e5", "address": "fa:16:3e:8a:49:2b", "network": {"id": "bec69c6a-b2cb-4b0a-ba6e-ae6dae099818", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7da9448cc34b609120da564a01dba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ae0be2-05", "ovs_interfaceid": "d9ae0be2-05e7-4009-b909-713c8c52e5e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:52:26 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-cec74135-f0e1-4cd4-91b0-eedaa40a0315 req-c6dd0a55-de4f-42de-a184-d8a6900a7c75 service nova] Releasing lock "refresh_cache-d85a919d-7f44-4093-b89a-51397ad5cedb" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:52:26 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:52:26 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:52:26 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:52:26 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:52:26 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:52:26 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Auditing locally available compute resources for user (node: user) {{(pid=73391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 05:52:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b14ae94-2a1e-4202-9676-e1ae1c996729/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b14ae94-2a1e-4202-9676-e1ae1c996729/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b14ae94-2a1e-4202-9676-e1ae1c996729/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b14ae94-2a1e-4202-9676-e1ae1c996729/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "f730e539-5371-49d7-8487-d94f400fe0bc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:52:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "f730e539-5371-49d7-8487-d94f400fe0bc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:52:27 user nova-compute[73391]: DEBUG nova.compute.manager [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Starting instance... {{(pid=73391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 05:52:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:52:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:52:27 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 05:52:27 user nova-compute[73391]: INFO nova.compute.claims [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Claim successful on node user
Aug 15 05:52:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/134610fb-ed36-4ecb-a884-a26febb7943d/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:28 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:52:28 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:52:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.466s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:52:28 user nova-compute[73391]: DEBUG nova.compute.manager [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Start building networks asynchronously for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 05:52:28 user nova-compute[73391]: DEBUG nova.compute.manager [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Allocating IP information in the background. {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 05:52:28 user nova-compute[73391]: DEBUG nova.network.neutron [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] allocate_for_instance() {{(pid=73391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 05:52:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/134610fb-ed36-4ecb-a884-a26febb7943d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/134610fb-ed36-4ecb-a884-a26febb7943d/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:28 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 05:52:28 user nova-compute[73391]: DEBUG nova.compute.manager [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Start building block device mappings for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 05:52:28 user nova-compute[73391]: DEBUG nova.policy [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aefb6ccab586465dbe56e71a40bcf1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8188c2e8ca34ef1982faa49f1058bb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73391) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 05:52:28 user nova-compute[73391]: INFO nova.virt.block_device [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Booting with volume 7f4a52d4-743f-45db-91c3-b7e42de736c1 at /dev/vda
Aug 15 05:52:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/134610fb-ed36-4ecb-a884-a26febb7943d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:52:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85a919d-7f44-4093-b89a-51397ad5cedb/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:28 user nova-compute[73391]: DEBUG os_brick.utils [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:52:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:28 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73d718e-2827-4782-a04d-f69325f869e1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:52:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:28 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc8e790f-7181-4865-b807-e49c05ff020b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:52:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:28 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3e983f-9a9d-4ce1-bf81-43e6a24774bf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:52:28 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[87a08f10-325b-4bd0-b2f5-4184b031b6b8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:52:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:52:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 05:52:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:52:28 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 05:52:28 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad3a0b46-0e8f-4803-8467-50f7fdbc7b59]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:52:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 05:52:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 05:52:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 05:52:28 user nova-compute[73391]: DEBUG os_brick.utils [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:52:28 user nova-compute[73391]: DEBUG nova.virt.block_device [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Updating existing volume attachment record: 55b49734-e57c-4391-8c1b-08517c501ed0 {{(pid=73391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 05:52:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85a919d-7f44-4093-b89a-51397ad5cedb/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85a919d-7f44-4093-b89a-51397ad5cedb/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:52:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d85a919d-7f44-4093-b89a-51397ad5cedb/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:29 user nova-compute[73391]: DEBUG nova.network.neutron [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Successfully created port: 164663cf-1c4f-4166-86e2-465351cdaaea {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 05:52:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7f591b9-7028-431d-aacc-9725767d8e1d/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:29 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:52:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7f591b9-7028-431d-aacc-9725767d8e1d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7f591b9-7028-431d-aacc-9725767d8e1d/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:30 user nova-compute[73391]: DEBUG nova.network.neutron [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Successfully updated port: 164663cf-1c4f-4166-86e2-465351cdaaea {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:52:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "refresh_cache-f730e539-5371-49d7-8487-d94f400fe0bc" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:52:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquired lock "refresh_cache-f730e539-5371-49d7-8487-d94f400fe0bc" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:52:30 user nova-compute[73391]: DEBUG nova.network.neutron [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:52:30 user nova-compute[73391]: DEBUG nova.compute.manager [req-443a2034-5d0c-493a-8573-e1a799823ed8 req-c5957ccc-71f8-494b-a7c4-1687a040968f service nova] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Received event network-changed-164663cf-1c4f-4166-86e2-465351cdaaea {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:52:30 user nova-compute[73391]: DEBUG nova.compute.manager [req-443a2034-5d0c-493a-8573-e1a799823ed8 req-c5957ccc-71f8-494b-a7c4-1687a040968f service nova] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Refreshing instance network info cache due to event network-changed-164663cf-1c4f-4166-86e2-465351cdaaea. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:52:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-443a2034-5d0c-493a-8573-e1a799823ed8 req-c5957ccc-71f8-494b-a7c4-1687a040968f service nova] Acquiring lock "refresh_cache-f730e539-5371-49d7-8487-d94f400fe0bc" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:52:30 user nova-compute[73391]: DEBUG nova.network.neutron [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:52:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7f591b9-7028-431d-aacc-9725767d8e1d/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:30 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:52:30 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:52:30 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Hypervisor/Node resource view: name=user free_ram=8149MB free_disk=25.082813262939453GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 05:52:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:52:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:52:30 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 730890c6-6999-4a0f-b80c-e4745bff99ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:52:30 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 8ff2da51-5bfd-4cdc-8cef-330cdef93d97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:52:30 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance d85a919d-7f44-4093-b89a-51397ad5cedb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:52:30 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 3adc0c85-0f31-4a73-8b98-eb1a4b32434d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:52:30 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 134610fb-ed36-4ecb-a884-a26febb7943d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:52:30 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 0b14ae94-2a1e-4202-9676-e1ae1c996729 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:52:30 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance a7f591b9-7028-431d-aacc-9725767d8e1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:52:30 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance f730e539-5371-49d7-8487-d94f400fe0bc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:52:30 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 05:52:30 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 05:52:30 user nova-compute[73391]: DEBUG nova.network.neutron [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Updating instance_info_cache with network_info: [{"id": "164663cf-1c4f-4166-86e2-465351cdaaea", "address": "fa:16:3e:83:de:e8", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap164663cf-1c", "ovs_interfaceid": "164663cf-1c4f-4166-86e2-465351cdaaea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:52:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Releasing lock "refresh_cache-f730e539-5371-49d7-8487-d94f400fe0bc" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:52:30 user nova-compute[73391]: DEBUG nova.compute.manager [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Instance network_info: |[{"id": "164663cf-1c4f-4166-86e2-465351cdaaea", "address": "fa:16:3e:83:de:e8", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap164663cf-1c", "ovs_interfaceid": "164663cf-1c4f-4166-86e2-465351cdaaea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 05:52:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-443a2034-5d0c-493a-8573-e1a799823ed8 req-c5957ccc-71f8-494b-a7c4-1687a040968f service nova] Acquired lock "refresh_cache-f730e539-5371-49d7-8487-d94f400fe0bc" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:52:30 user nova-compute[73391]: DEBUG nova.network.neutron [req-443a2034-5d0c-493a-8573-e1a799823ed8 req-c5957ccc-71f8-494b-a7c4-1687a040968f service nova] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Refreshing network info cache for port 164663cf-1c4f-4166-86e2-465351cdaaea {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:52:30 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:52:31 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:52:31 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Compute_service record updated for user:user {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 05:52:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.451s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:52:31 user nova-compute[73391]: DEBUG nova.network.neutron [req-443a2034-5d0c-493a-8573-e1a799823ed8 req-c5957ccc-71f8-494b-a7c4-1687a040968f service nova] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Updated VIF entry in instance network info cache for port 164663cf-1c4f-4166-86e2-465351cdaaea. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:52:31 user nova-compute[73391]: DEBUG nova.network.neutron [req-443a2034-5d0c-493a-8573-e1a799823ed8 req-c5957ccc-71f8-494b-a7c4-1687a040968f service nova] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Updating instance_info_cache with network_info: [{"id": "164663cf-1c4f-4166-86e2-465351cdaaea", "address": "fa:16:3e:83:de:e8", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap164663cf-1c", "ovs_interfaceid": "164663cf-1c4f-4166-86e2-465351cdaaea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:52:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-443a2034-5d0c-493a-8573-e1a799823ed8 req-c5957ccc-71f8-494b-a7c4-1687a040968f service nova] Releasing lock "refresh_cache-f730e539-5371-49d7-8487-d94f400fe0bc" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:52:32 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:52:32 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:52:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:52:34 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:52:34 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Starting heal instance info cache {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 05:52:34 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Didn't find any instances for network info cache update. {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 05:52:34 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:52:34 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 05:52:35 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:52:35 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG nova.compute.manager [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Start spawning the instance on the hypervisor. {{(pid=73391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Creating instance directory {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 05:52:37 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Creating image(s)
Aug 15 05:52:37 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Did not create local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Ensure instance console log exists: /opt/stack/data/nova/instances/f730e539-5371-49d7-8487-d94f400fe0bc/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Start _get_guest_xml network_info=[{"id": "164663cf-1c4f-4166-86e2-465351cdaaea", "address": "fa:16:3e:83:de:e8", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap164663cf-1c", "ovs_interfaceid": "164663cf-1c4f-4166-86e2-465351cdaaea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sQZfExwK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f730e539-5371-49d7-8487-d94f400fe0bc', 'attached_at': '', 'detached_at': '', 'volume_id': '7f4a52d4-743f-45db-91c3-b7e42de736c1', 'serial': '7f4a52d4-743f-45db-91c3-b7e42de736c1'}, 'attachment_id': '55b49734-e57c-4391-8c1b-08517c501ed0', 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:52:37 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:52:37 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:52:37 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sQZfExwK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:52:37 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:52:37 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:52:37 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:52:37 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:52:37 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 05:52:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[26cffeff-323b-49f9-a167-416aaa811b0c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 05:52:37 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7cb92e-c803-4f3a-98e9-eb56465c01cb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1] added
Aug 15 05:52:37 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9164a0-c642-4bc0-82a0-8799f795d5bc]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[52910098-8647-4bbd-8340-7c470de48fb3]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sQZfExwK {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sQZfExwK" returned: 0 in 0.024s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82ce8e9-d02f-4ba5-a322-e1d49e66e035]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sQZfExwK'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6efd6e6-631c-4888-a5c4-5a2ae21a7631]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09ca1df-dfba-41e5-972d-e685769dafaf]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de (non-flash)
Aug 15 05:52:37 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de (non-flash)
Aug 15 05:52:37 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[25da2915-5c77-4371-8a7f-a95df3246f3e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1, portal: 172.16.0.220,3260]
Aug 15 05:52:37 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1, portal: 172.16.0.220,3260] successful.
Aug 15 05:52:37 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[81898e17-970c-42d0-b0a7-5055141b162e]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a1bb29-2cc4-46fd-a1a2-41d761868e0c]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de (non-flash)
Aug 15 05:52:37 user nova-compute[73391]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 (non-flash)
Aug 15 05:52:37 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de (non-flash)
Aug 15 05:52:37 user nova-compute[73391]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 (non-flash)
Aug 15 05:52:37 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] HCTL ('33', '-', '-', 0) found on session 55 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c83fc2-21aa-4834-ad9d-e56d771d4aab]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Searching for a device in session 55 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:52:37 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sQZfExwK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 05:52:38 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:52:38 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:52:38 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23931386230356335', 'path': '/dev/sdb'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:52:38 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931386230356335', 'path': '/dev/sdb'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 05:52:38 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:52:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1674785904',display_name='tempest-TestVolumeBootPattern-server-1674785904',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1674785904',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9jBoYjOy+aqM5q6fYRpW336xJnp1RjcA+ryp4UUPjXWPw7VtxeYktb68BzzUpanNxgDS13R1RxH4S+D0vqFMFtOkREwueXmREiQ22XqN9Aby3PDiDj1ii3iTWuJ+dFag==',key_name='tempest-TestVolumeBootPattern-1057822238',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8188c2e8ca34ef1982faa49f1058bb7',ramdisk_id='',reservation_id='r-lb7o515p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1834029963',owner_user_name='tempest-TestVolumeBootPattern-1834029963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:52:28Z,user_data=None,user_id='aefb6ccab586465dbe56e71a40bcf1f0',uuid=f730e539-5371-49d7-8487-d94f400fe0bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "164663cf-1c4f-4166-86e2-465351cdaaea", "address": "fa:16:3e:83:de:e8", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap164663cf-1c", "ovs_interfaceid": "164663cf-1c4f-4166-86e2-465351cdaaea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:52:38 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Converting VIF {"id": "164663cf-1c4f-4166-86e2-465351cdaaea", "address": "fa:16:3e:83:de:e8", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap164663cf-1c", "ovs_interfaceid": "164663cf-1c4f-4166-86e2-465351cdaaea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:52:38 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:de:e8,bridge_name='br-int',has_traffic_filtering=True,id=164663cf-1c4f-4166-86e2-465351cdaaea,network=Network(fae0e46a-88e4-499d-bcff-5b7df55eab4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap164663cf-1c') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:52:38 user nova-compute[73391]: DEBUG nova.objects.instance [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lazy-loading 'pci_devices' on Instance uuid f730e539-5371-49d7-8487-d94f400fe0bc {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:52:38 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:52:38 user nova-compute[73391]:   <uuid>f730e539-5371-49d7-8487-d94f400fe0bc</uuid>
Aug 15 05:52:38 user nova-compute[73391]:   <name>instance-0000002c</name>
Aug 15 05:52:38 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:52:38 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:52:38 user nova-compute[73391]:   <metadata>
Aug 15 05:52:38 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:52:38 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:52:38 user nova-compute[73391]:       <nova:name>tempest-TestVolumeBootPattern-server-1674785904</nova:name>
Aug 15 05:52:38 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:52:37</nova:creationTime>
Aug 15 05:52:38 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:52:38 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:52:38 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:52:38 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:52:38 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:52:38 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:52:38 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:52:38 user nova-compute[73391]:       <nova:owner>
Aug 15 05:52:38 user nova-compute[73391]:         <nova:user uuid="aefb6ccab586465dbe56e71a40bcf1f0">tempest-TestVolumeBootPattern-1834029963-project-member</nova:user>
Aug 15 05:52:38 user nova-compute[73391]:         <nova:project uuid="a8188c2e8ca34ef1982faa49f1058bb7">tempest-TestVolumeBootPattern-1834029963</nova:project>
Aug 15 05:52:38 user nova-compute[73391]:       </nova:owner>
Aug 15 05:52:38 user nova-compute[73391]:       <nova:ports>
Aug 15 05:52:38 user nova-compute[73391]:         <nova:port uuid="164663cf-1c4f-4166-86e2-465351cdaaea">
Aug 15 05:52:38 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Aug 15 05:52:38 user nova-compute[73391]:         </nova:port>
Aug 15 05:52:38 user nova-compute[73391]:       </nova:ports>
Aug 15 05:52:38 user nova-compute[73391]:     </nova:instance>
Aug 15 05:52:38 user nova-compute[73391]:   </metadata>
Aug 15 05:52:38 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:52:38 user nova-compute[73391]:     <system>
Aug 15 05:52:38 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:52:38 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:52:38 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:52:38 user nova-compute[73391]:       <entry name="serial">f730e539-5371-49d7-8487-d94f400fe0bc</entry>
Aug 15 05:52:38 user nova-compute[73391]:       <entry name="uuid">f730e539-5371-49d7-8487-d94f400fe0bc</entry>
Aug 15 05:52:38 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:52:38 user nova-compute[73391]:     </system>
Aug 15 05:52:38 user nova-compute[73391]:   </sysinfo>
Aug 15 05:52:38 user nova-compute[73391]:   <os>
Aug 15 05:52:38 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:52:38 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:52:38 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:52:38 user nova-compute[73391]:   </os>
Aug 15 05:52:38 user nova-compute[73391]:   <features>
Aug 15 05:52:38 user nova-compute[73391]:     <acpi/>
Aug 15 05:52:38 user nova-compute[73391]:     <apic/>
Aug 15 05:52:38 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:52:38 user nova-compute[73391]:   </features>
Aug 15 05:52:38 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:52:38 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:52:38 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:52:38 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:52:38 user nova-compute[73391]:   </clock>
Aug 15 05:52:38 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:52:38 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:52:38 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:52:38 user nova-compute[73391]:   </cpu>
Aug 15 05:52:38 user nova-compute[73391]:   <devices>
Aug 15 05:52:38 user nova-compute[73391]:     <disk type="block" device="disk">
Aug 15 05:52:38 user nova-compute[73391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:52:38 user nova-compute[73391]:       <source dev="/dev/sdb"/>
Aug 15 05:52:38 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:52:38 user nova-compute[73391]:       <serial>7f4a52d4-743f-45db-91c3-b7e42de736c1</serial>
Aug 15 05:52:38 user nova-compute[73391]:     </disk>
Aug 15 05:52:38 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:52:38 user nova-compute[73391]:       <mac address="fa:16:3e:83:de:e8"/>
Aug 15 05:52:38 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:52:38 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:52:38 user nova-compute[73391]:       <target dev="tap164663cf-1c"/>
Aug 15 05:52:38 user nova-compute[73391]:     </interface>
Aug 15 05:52:38 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:52:38 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/f730e539-5371-49d7-8487-d94f400fe0bc/console.log" append="off"/>
Aug 15 05:52:38 user nova-compute[73391]:     </serial>
Aug 15 05:52:38 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:52:38 user nova-compute[73391]:     <video>
Aug 15 05:52:38 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:52:38 user nova-compute[73391]:     </video>
Aug 15 05:52:38 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:52:38 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:52:38 user nova-compute[73391]:     </rng>
Aug 15 05:52:38 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:52:38 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:52:38 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:52:38 user nova-compute[73391]:     </memballoon>
Aug 15 05:52:38 user nova-compute[73391]:   </devices>
Aug 15 05:52:38 user nova-compute[73391]: </domain>
Aug 15 05:52:38 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:52:39 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:52:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1674785904',display_name='tempest-TestVolumeBootPattern-server-1674785904',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1674785904',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9jBoYjOy+aqM5q6fYRpW336xJnp1RjcA+ryp4UUPjXWPw7VtxeYktb68BzzUpanNxgDS13R1RxH4S+D0vqFMFtOkREwueXmREiQ22XqN9Aby3PDiDj1ii3iTWuJ+dFag==',key_name='tempest-TestVolumeBootPattern-1057822238',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8188c2e8ca34ef1982faa49f1058bb7',ramdisk_id='',reservation_id='r-lb7o515p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1834029963',owner_user_name='tempest-TestVolumeBootPattern-1834029963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:52:28Z,user_data=None,user_id='aefb6ccab586465dbe56e71a40bcf1f0',uuid=f730e539-5371-49d7-8487-d94f400fe0bc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "164663cf-1c4f-4166-86e2-465351cdaaea", "address": "fa:16:3e:83:de:e8", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap164663cf-1c", "ovs_interfaceid": "164663cf-1c4f-4166-86e2-465351cdaaea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:52:39 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Converting VIF {"id": "164663cf-1c4f-4166-86e2-465351cdaaea", "address": "fa:16:3e:83:de:e8", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap164663cf-1c", "ovs_interfaceid": "164663cf-1c4f-4166-86e2-465351cdaaea", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:52:39 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:de:e8,bridge_name='br-int',has_traffic_filtering=True,id=164663cf-1c4f-4166-86e2-465351cdaaea,network=Network(fae0e46a-88e4-499d-bcff-5b7df55eab4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap164663cf-1c') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:52:39 user nova-compute[73391]: DEBUG os_vif [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:de:e8,bridge_name='br-int',has_traffic_filtering=True,id=164663cf-1c4f-4166-86e2-465351cdaaea,network=Network(fae0e46a-88e4-499d-bcff-5b7df55eab4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap164663cf-1c') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:52:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:52:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:52:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:52:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:52:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap164663cf-1c, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:52:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap164663cf-1c, col_values=(('external_ids', {'iface-id': '164663cf-1c4f-4166-86e2-465351cdaaea', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:de:e8', 'vm-uuid': 'f730e539-5371-49d7-8487-d94f400fe0bc'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:52:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:52:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:52:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:52:39 user nova-compute[73391]: INFO os_vif [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:de:e8,bridge_name='br-int',has_traffic_filtering=True,id=164663cf-1c4f-4166-86e2-465351cdaaea,network=Network(fae0e46a-88e4-499d-bcff-5b7df55eab4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap164663cf-1c')
Aug 15 05:52:39 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:52:39 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] No VIF found with MAC fa:16:3e:83:de:e8, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:52:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:52:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:52:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:52:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:52:40 user nova-compute[73391]: DEBUG nova.compute.manager [req-7915119d-dad2-4243-8ce7-e61983c7a521 req-2a842dcf-3fd1-4e53-8129-4dc777c999f9 service nova] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Received event network-vif-plugged-164663cf-1c4f-4166-86e2-465351cdaaea {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:52:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-7915119d-dad2-4243-8ce7-e61983c7a521 req-2a842dcf-3fd1-4e53-8129-4dc777c999f9 service nova] Acquiring lock "f730e539-5371-49d7-8487-d94f400fe0bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:52:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-7915119d-dad2-4243-8ce7-e61983c7a521 req-2a842dcf-3fd1-4e53-8129-4dc777c999f9 service nova] Lock "f730e539-5371-49d7-8487-d94f400fe0bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:52:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-7915119d-dad2-4243-8ce7-e61983c7a521 req-2a842dcf-3fd1-4e53-8129-4dc777c999f9 service nova] Lock "f730e539-5371-49d7-8487-d94f400fe0bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:52:40 user nova-compute[73391]: DEBUG nova.compute.manager [req-7915119d-dad2-4243-8ce7-e61983c7a521 req-2a842dcf-3fd1-4e53-8129-4dc777c999f9 service nova] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] No waiting events found dispatching network-vif-plugged-164663cf-1c4f-4166-86e2-465351cdaaea {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:52:40 user nova-compute[73391]: WARNING nova.compute.manager [req-7915119d-dad2-4243-8ce7-e61983c7a521 req-2a842dcf-3fd1-4e53-8129-4dc777c999f9 service nova] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Received unexpected event network-vif-plugged-164663cf-1c4f-4166-86e2-465351cdaaea for instance with vm_state building and task_state spawning.
Aug 15 05:52:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:52:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:52:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:52:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:52:42 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078762.4210725, f730e539-5371-49d7-8487-d94f400fe0bc => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:52:42 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] VM Resumed (Lifecycle Event)
Aug 15 05:52:42 user nova-compute[73391]: DEBUG nova.compute.manager [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:52:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Guest created on hypervisor {{(pid=73391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 05:52:42 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Instance spawned successfully.
Aug 15 05:52:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 05:52:42 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:52:42 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:52:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Found default for hw_cdrom_bus of ide {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:52:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Found default for hw_disk_bus of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:52:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Found default for hw_input_bus of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:52:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Found default for hw_pointer_model of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:52:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Found default for hw_video_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:52:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Found default for hw_vif_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:52:42 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:52:42 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078762.4221268, f730e539-5371-49d7-8487-d94f400fe0bc => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:52:42 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] VM Started (Lifecycle Event)
Aug 15 05:52:42 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:52:42 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:52:42 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:52:42 user nova-compute[73391]: DEBUG nova.compute.manager [req-af45e5f3-5307-41ab-b095-307a83b6e8bf req-c75a2a9b-3f3e-4fad-a3d7-69b0762d45e9 service nova] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Received event network-vif-plugged-164663cf-1c4f-4166-86e2-465351cdaaea {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:52:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-af45e5f3-5307-41ab-b095-307a83b6e8bf req-c75a2a9b-3f3e-4fad-a3d7-69b0762d45e9 service nova] Acquiring lock "f730e539-5371-49d7-8487-d94f400fe0bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:52:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-af45e5f3-5307-41ab-b095-307a83b6e8bf req-c75a2a9b-3f3e-4fad-a3d7-69b0762d45e9 service nova] Lock "f730e539-5371-49d7-8487-d94f400fe0bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:52:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-af45e5f3-5307-41ab-b095-307a83b6e8bf req-c75a2a9b-3f3e-4fad-a3d7-69b0762d45e9 service nova] Lock "f730e539-5371-49d7-8487-d94f400fe0bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:52:42 user nova-compute[73391]: DEBUG nova.compute.manager [req-af45e5f3-5307-41ab-b095-307a83b6e8bf req-c75a2a9b-3f3e-4fad-a3d7-69b0762d45e9 service nova] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] No waiting events found dispatching network-vif-plugged-164663cf-1c4f-4166-86e2-465351cdaaea {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:52:42 user nova-compute[73391]: WARNING nova.compute.manager [req-af45e5f3-5307-41ab-b095-307a83b6e8bf req-c75a2a9b-3f3e-4fad-a3d7-69b0762d45e9 service nova] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Received unexpected event network-vif-plugged-164663cf-1c4f-4166-86e2-465351cdaaea for instance with vm_state building and task_state spawning.
Aug 15 05:52:42 user nova-compute[73391]: INFO nova.compute.manager [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Took 5.05 seconds to spawn the instance on the hypervisor.
Aug 15 05:52:42 user nova-compute[73391]: DEBUG nova.compute.manager [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:52:42 user nova-compute[73391]: INFO nova.compute.manager [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Took 15.03 seconds to build instance.
Aug 15 05:52:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-56077c13-dbe0-458b-9c95-889413d02b82 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "f730e539-5371-49d7-8487-d94f400fe0bc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.139s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:52:44 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:52:44 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:52:49 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:52:49 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:52:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:52:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:52:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:52:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:53:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:53:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:53:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:53:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:53:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:53:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d73d9d5b-febb-4bf7-8ea5-4ca6e535b42f tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Acquiring lock "d85a919d-7f44-4093-b89a-51397ad5cedb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:53:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d73d9d5b-febb-4bf7-8ea5-4ca6e535b42f tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "d85a919d-7f44-4093-b89a-51397ad5cedb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:53:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d73d9d5b-febb-4bf7-8ea5-4ca6e535b42f tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Acquiring lock "d85a919d-7f44-4093-b89a-51397ad5cedb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:53:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d73d9d5b-febb-4bf7-8ea5-4ca6e535b42f tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "d85a919d-7f44-4093-b89a-51397ad5cedb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:53:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d73d9d5b-febb-4bf7-8ea5-4ca6e535b42f tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "d85a919d-7f44-4093-b89a-51397ad5cedb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:53:14 user nova-compute[73391]: INFO nova.compute.manager [None req-d73d9d5b-febb-4bf7-8ea5-4ca6e535b42f tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Terminating instance
Aug 15 05:53:14 user nova-compute[73391]: DEBUG nova.compute.manager [None req-d73d9d5b-febb-4bf7-8ea5-4ca6e535b42f tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Start destroying the instance on the hypervisor. {{(pid=73391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 05:53:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:53:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:53:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:53:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:53:15 user nova-compute[73391]: DEBUG nova.compute.manager [req-6450e6fb-0fcf-46dd-8ec2-d98aec68f64b req-4dc18797-fbc2-40e1-a938-44525431af4f service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Received event network-vif-unplugged-d9ae0be2-05e7-4009-b909-713c8c52e5e5 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:53:15 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-6450e6fb-0fcf-46dd-8ec2-d98aec68f64b req-4dc18797-fbc2-40e1-a938-44525431af4f service nova] Acquiring lock "d85a919d-7f44-4093-b89a-51397ad5cedb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:53:15 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-6450e6fb-0fcf-46dd-8ec2-d98aec68f64b req-4dc18797-fbc2-40e1-a938-44525431af4f service nova] Lock "d85a919d-7f44-4093-b89a-51397ad5cedb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:53:15 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-6450e6fb-0fcf-46dd-8ec2-d98aec68f64b req-4dc18797-fbc2-40e1-a938-44525431af4f service nova] Lock "d85a919d-7f44-4093-b89a-51397ad5cedb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:53:15 user nova-compute[73391]: DEBUG nova.compute.manager [req-6450e6fb-0fcf-46dd-8ec2-d98aec68f64b req-4dc18797-fbc2-40e1-a938-44525431af4f service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] No waiting events found dispatching network-vif-unplugged-d9ae0be2-05e7-4009-b909-713c8c52e5e5 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:53:15 user nova-compute[73391]: DEBUG nova.compute.manager [req-6450e6fb-0fcf-46dd-8ec2-d98aec68f64b req-4dc18797-fbc2-40e1-a938-44525431af4f service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Received event network-vif-unplugged-d9ae0be2-05e7-4009-b909-713c8c52e5e5 for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 05:53:15 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:53:15 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Instance destroyed successfully.
Aug 15 05:53:15 user nova-compute[73391]: DEBUG nova.objects.instance [None req-d73d9d5b-febb-4bf7-8ea5-4ca6e535b42f tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lazy-loading 'resources' on Instance uuid d85a919d-7f44-4093-b89a-51397ad5cedb {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:53:15 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-d73d9d5b-febb-4bf7-8ea5-4ca6e535b42f tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:46:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1368685045',display_name='tempest-ServerRescueNegativeTestJSON-server-1368685045',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1368685045',id=37,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG/6kD3X/Xv8slYXv0KKsJUu8EUECfySzGbYnbQQRqQcPLeD+XN0ODX8guUaAA8SajiP5mAzTEd6NFbpNb6KjPhN8DRWtXs7H08aTDfPvvGUYtwQtRlR6eUlj+qqgyrQ+g==',key_name='tempest-keypair-624447654',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:48:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5a7da9448cc34b609120da564a01dba4',ramdisk_id='',reservation_id='r-hd23d0uc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1933442633',owner_user_name='tempest-ServerRescueNegativeTestJSON-1933442633-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:50:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1f0f5888b8c44188a17202fad2725256',uuid=d85a919d-7f44-4093-b89a-51397ad5cedb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d9ae0be2-05e7-4009-b909-713c8c52e5e5", "address": "fa:16:3e:8a:49:2b", "network": {"id": "bec69c6a-b2cb-4b0a-ba6e-ae6dae099818", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7da9448cc34b609120da564a01dba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ae0be2-05", "ovs_interfaceid": "d9ae0be2-05e7-4009-b909-713c8c52e5e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:53:15 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-d73d9d5b-febb-4bf7-8ea5-4ca6e535b42f tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Converting VIF {"id": "d9ae0be2-05e7-4009-b909-713c8c52e5e5", "address": "fa:16:3e:8a:49:2b", "network": {"id": "bec69c6a-b2cb-4b0a-ba6e-ae6dae099818", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7da9448cc34b609120da564a01dba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9ae0be2-05", "ovs_interfaceid": "d9ae0be2-05e7-4009-b909-713c8c52e5e5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:53:15 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-d73d9d5b-febb-4bf7-8ea5-4ca6e535b42f tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8a:49:2b,bridge_name='br-int',has_traffic_filtering=True,id=d9ae0be2-05e7-4009-b909-713c8c52e5e5,network=Network(bec69c6a-b2cb-4b0a-ba6e-ae6dae099818),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9ae0be2-05') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:53:15 user nova-compute[73391]: DEBUG os_vif [None req-d73d9d5b-febb-4bf7-8ea5-4ca6e535b42f tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:49:2b,bridge_name='br-int',has_traffic_filtering=True,id=d9ae0be2-05e7-4009-b909-713c8c52e5e5,network=Network(bec69c6a-b2cb-4b0a-ba6e-ae6dae099818),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9ae0be2-05') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:53:15 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:53:15 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd9ae0be2-05, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:53:15 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:53:15 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:53:15 user nova-compute[73391]: INFO os_vif [None req-d73d9d5b-febb-4bf7-8ea5-4ca6e535b42f tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:49:2b,bridge_name='br-int',has_traffic_filtering=True,id=d9ae0be2-05e7-4009-b909-713c8c52e5e5,network=Network(bec69c6a-b2cb-4b0a-ba6e-ae6dae099818),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9ae0be2-05')
Aug 15 05:53:15 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-d73d9d5b-febb-4bf7-8ea5-4ca6e535b42f tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Deleting instance files /opt/stack/data/nova/instances/d85a919d-7f44-4093-b89a-51397ad5cedb_del
Aug 15 05:53:15 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-d73d9d5b-febb-4bf7-8ea5-4ca6e535b42f tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Deletion of /opt/stack/data/nova/instances/d85a919d-7f44-4093-b89a-51397ad5cedb_del complete
Aug 15 05:53:15 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:53:15 user nova-compute[73391]: INFO nova.compute.manager [None req-d73d9d5b-febb-4bf7-8ea5-4ca6e535b42f tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Took 0.84 seconds to destroy the instance on the hypervisor.
Aug 15 05:53:15 user nova-compute[73391]: DEBUG oslo.service.loopingcall [None req-d73d9d5b-febb-4bf7-8ea5-4ca6e535b42f tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 05:53:15 user nova-compute[73391]: DEBUG nova.compute.manager [-] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Deallocating network for instance {{(pid=73391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 05:53:15 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] deallocate_for_instance() {{(pid=73391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 05:53:16 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:53:16 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Took 0.82 seconds to deallocate network for instance.
Aug 15 05:53:16 user nova-compute[73391]: DEBUG nova.compute.manager [req-bb27e890-6d8a-4080-9371-f67e9af64751 req-ed49fc11-9295-47e1-bbdc-689b86d61631 service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Received event network-vif-deleted-d9ae0be2-05e7-4009-b909-713c8c52e5e5 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:53:16 user nova-compute[73391]: INFO nova.compute.manager [req-bb27e890-6d8a-4080-9371-f67e9af64751 req-ed49fc11-9295-47e1-bbdc-689b86d61631 service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Neutron deleted interface d9ae0be2-05e7-4009-b909-713c8c52e5e5; detaching it from the instance and deleting it from the info cache
Aug 15 05:53:16 user nova-compute[73391]: DEBUG nova.network.neutron [req-bb27e890-6d8a-4080-9371-f67e9af64751 req-ed49fc11-9295-47e1-bbdc-689b86d61631 service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:53:16 user nova-compute[73391]: DEBUG nova.compute.manager [req-bb27e890-6d8a-4080-9371-f67e9af64751 req-ed49fc11-9295-47e1-bbdc-689b86d61631 service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Detach interface failed, port_id=d9ae0be2-05e7-4009-b909-713c8c52e5e5, reason: Instance d85a919d-7f44-4093-b89a-51397ad5cedb could not be found. {{(pid=73391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 05:53:16 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d73d9d5b-febb-4bf7-8ea5-4ca6e535b42f tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:53:16 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d73d9d5b-febb-4bf7-8ea5-4ca6e535b42f tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:53:16 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-d73d9d5b-febb-4bf7-8ea5-4ca6e535b42f tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:53:16 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-d73d9d5b-febb-4bf7-8ea5-4ca6e535b42f tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:53:16 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d73d9d5b-febb-4bf7-8ea5-4ca6e535b42f tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.547s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:53:16 user nova-compute[73391]: INFO nova.scheduler.client.report [None req-d73d9d5b-febb-4bf7-8ea5-4ca6e535b42f tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Deleted allocations for instance d85a919d-7f44-4093-b89a-51397ad5cedb
Aug 15 05:53:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-d73d9d5b-febb-4bf7-8ea5-4ca6e535b42f tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "d85a919d-7f44-4093-b89a-51397ad5cedb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.471s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:53:17 user nova-compute[73391]: DEBUG nova.compute.manager [req-ead5ec86-9de7-44b3-a0af-440b2b89ca4f req-66a7cc59-72bb-44cd-945b-610a3d9a3dfa service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Received event network-vif-plugged-d9ae0be2-05e7-4009-b909-713c8c52e5e5 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:53:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ead5ec86-9de7-44b3-a0af-440b2b89ca4f req-66a7cc59-72bb-44cd-945b-610a3d9a3dfa service nova] Acquiring lock "d85a919d-7f44-4093-b89a-51397ad5cedb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:53:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ead5ec86-9de7-44b3-a0af-440b2b89ca4f req-66a7cc59-72bb-44cd-945b-610a3d9a3dfa service nova] Lock "d85a919d-7f44-4093-b89a-51397ad5cedb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:53:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ead5ec86-9de7-44b3-a0af-440b2b89ca4f req-66a7cc59-72bb-44cd-945b-610a3d9a3dfa service nova] Lock "d85a919d-7f44-4093-b89a-51397ad5cedb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:53:17 user nova-compute[73391]: DEBUG nova.compute.manager [req-ead5ec86-9de7-44b3-a0af-440b2b89ca4f req-66a7cc59-72bb-44cd-945b-610a3d9a3dfa service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] No waiting events found dispatching network-vif-plugged-d9ae0be2-05e7-4009-b909-713c8c52e5e5 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:53:17 user nova-compute[73391]: WARNING nova.compute.manager [req-ead5ec86-9de7-44b3-a0af-440b2b89ca4f req-66a7cc59-72bb-44cd-945b-610a3d9a3dfa service nova] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Received unexpected event network-vif-plugged-d9ae0be2-05e7-4009-b909-713c8c52e5e5 for instance with vm_state deleted and task_state None.
Aug 15 05:53:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:53:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:53:24 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:53:25 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:53:27 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:53:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:53:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:53:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:53:27 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Auditing locally available compute resources for user (node: user) {{(pid=73391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 05:53:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b14ae94-2a1e-4202-9676-e1ae1c996729/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:53:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b14ae94-2a1e-4202-9676-e1ae1c996729/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:53:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b14ae94-2a1e-4202-9676-e1ae1c996729/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:53:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b14ae94-2a1e-4202-9676-e1ae1c996729/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:53:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:53:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:53:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:53:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:53:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:53:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:53:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:53:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:53:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:53:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/134610fb-ed36-4ecb-a884-a26febb7943d/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:53:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/134610fb-ed36-4ecb-a884-a26febb7943d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:53:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/134610fb-ed36-4ecb-a884-a26febb7943d/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:53:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/134610fb-ed36-4ecb-a884-a26febb7943d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:53:29 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:53:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:53:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:53:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:53:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:53:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:53:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:53:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:53:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:53:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7f591b9-7028-431d-aacc-9725767d8e1d/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:53:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7f591b9-7028-431d-aacc-9725767d8e1d/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:53:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7f591b9-7028-431d-aacc-9725767d8e1d/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:53:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7f591b9-7028-431d-aacc-9725767d8e1d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:53:30 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692078795.4319675, d85a919d-7f44-4093-b89a-51397ad5cedb => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:53:30 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] VM Stopped (Lifecycle Event)
Aug 15 05:53:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:53:30 user nova-compute[73391]: DEBUG nova.compute.manager [None req-cc849a8b-f819-40d3-b6e2-8d6d25cccec8 None None] [instance: d85a919d-7f44-4093-b89a-51397ad5cedb] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:53:30 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:53:30 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:53:30 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Hypervisor/Node resource view: name=user free_ram=7933MB free_disk=25.053340911865234GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 05:53:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:53:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:53:31 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 730890c6-6999-4a0f-b80c-e4745bff99ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:53:31 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 8ff2da51-5bfd-4cdc-8cef-330cdef93d97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:53:31 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 3adc0c85-0f31-4a73-8b98-eb1a4b32434d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:53:31 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 134610fb-ed36-4ecb-a884-a26febb7943d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:53:31 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 0b14ae94-2a1e-4202-9676-e1ae1c996729 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:53:31 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance a7f591b9-7028-431d-aacc-9725767d8e1d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:53:31 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance f730e539-5371-49d7-8487-d94f400fe0bc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:53:31 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 05:53:31 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 05:53:31 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:53:31 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:53:31 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Compute_service record updated for user:user {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 05:53:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.346s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:53:32 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:53:32 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:53:32 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:53:35 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:53:35 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Starting heal instance info cache {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 05:53:35 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Rebuilding the list of instances to heal {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 05:53:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "refresh_cache-730890c6-6999-4a0f-b80c-e4745bff99ab" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:53:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquired lock "refresh_cache-730890c6-6999-4a0f-b80c-e4745bff99ab" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:53:35 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Forcefully refreshing network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 05:53:35 user nova-compute[73391]: DEBUG nova.objects.instance [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lazy-loading 'info_cache' on Instance uuid 730890c6-6999-4a0f-b80c-e4745bff99ab {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:53:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:53:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:53:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 05:53:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 05:53:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 05:53:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:53:36 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Updating instance_info_cache with network_info: [{"id": "f598ee19-8c81-4cf2-a88d-8221516eb1cf", "address": "fa:16:3e:2e:da:40", "network": {"id": "bec69c6a-b2cb-4b0a-ba6e-ae6dae099818", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7da9448cc34b609120da564a01dba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf598ee19-8c", "ovs_interfaceid": "f598ee19-8c81-4cf2-a88d-8221516eb1cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:53:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Releasing lock "refresh_cache-730890c6-6999-4a0f-b80c-e4745bff99ab" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:53:36 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Updated the network info_cache for instance {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 05:53:36 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:53:36 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:53:36 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:53:36 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 05:53:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-91c24495-9d6e-4938-9f26-c9906f935159 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Acquiring lock "3adc0c85-0f31-4a73-8b98-eb1a4b32434d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:53:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-91c24495-9d6e-4938-9f26-c9906f935159 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Lock "3adc0c85-0f31-4a73-8b98-eb1a4b32434d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:53:38 user nova-compute[73391]: DEBUG nova.objects.instance [None req-91c24495-9d6e-4938-9f26-c9906f935159 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Lazy-loading 'flavor' on Instance uuid 3adc0c85-0f31-4a73-8b98-eb1a4b32434d {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:53:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-91c24495-9d6e-4938-9f26-c9906f935159 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Lock "3adc0c85-0f31-4a73-8b98-eb1a4b32434d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:53:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-91c24495-9d6e-4938-9f26-c9906f935159 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Acquiring lock "3adc0c85-0f31-4a73-8b98-eb1a4b32434d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:53:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-91c24495-9d6e-4938-9f26-c9906f935159 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Lock "3adc0c85-0f31-4a73-8b98-eb1a4b32434d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:53:38 user nova-compute[73391]: INFO nova.compute.manager [None req-91c24495-9d6e-4938-9f26-c9906f935159 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Attaching volume 97915103-1b6f-453d-a3af-74137ff0ac5a to /dev/vdb
Aug 15 05:53:38 user nova-compute[73391]: DEBUG os_brick.utils [None req-91c24495-9d6e-4938-9f26-c9906f935159 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:53:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:53:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:53:38 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[65666b56-7c87-4066-a593-36e95755b9cb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:53:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:53:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:53:38 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6af8c5a-8ba8-4aa8-a626-09cdd41e8d91]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:53:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:53:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:53:38 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a5b1f4-9d3b-492c-a23a-ca5eec5cfa71]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:53:38 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[630a753f-7919-4f35-aabe-b46e064259c5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:53:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-91c24495-9d6e-4938-9f26-c9906f935159 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:53:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-91c24495-9d6e-4938-9f26-c9906f935159 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:53:38 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-91c24495-9d6e-4938-9f26-c9906f935159 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 05:53:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:53:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:53:38 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 05:53:38 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9429708-8acc-4d58-9b9d-2b8429dd5af4]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:53:38 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-91c24495-9d6e-4938-9f26-c9906f935159 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 05:53:38 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-91c24495-9d6e-4938-9f26-c9906f935159 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 05:53:38 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-91c24495-9d6e-4938-9f26-c9906f935159 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 05:53:38 user nova-compute[73391]: DEBUG os_brick.utils [None req-91c24495-9d6e-4938-9f26-c9906f935159 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:53:38 user nova-compute[73391]: DEBUG nova.virt.block_device [None req-91c24495-9d6e-4938-9f26-c9906f935159 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Updating existing volume attachment record: 6586643a-624e-4a4c-8c78-85ceb76c7890 {{(pid=73391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 05:53:40 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:53:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:53:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:53:47 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91c24495-9d6e-4938-9f26-c9906f935159 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 05:53:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c24495-9d6e-4938-9f26-c9906f935159 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ITvWxkwA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:53:47 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-91c24495-9d6e-4938-9f26-c9906f935159 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:53:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-91c24495-9d6e-4938-9f26-c9906f935159 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:53:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-91c24495-9d6e-4938-9f26-c9906f935159 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:53:47 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-91c24495-9d6e-4938-9f26-c9906f935159 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:53:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-91c24495-9d6e-4938-9f26-c9906f935159 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:53:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-91c24495-9d6e-4938-9f26-c9906f935159 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:53:47 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-91c24495-9d6e-4938-9f26-c9906f935159 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 05:53:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:53:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:53:47 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe760a8e-df21-43a8-bcf3-8d878077e8fa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:53:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c24495-9d6e-4938-9f26-c9906f935159 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 05:53:47 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:53:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:53:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:53:47 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c761b3-fb7a-4a46-8872-a3f62962fe36]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:53:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c24495-9d6e-4938-9f26-c9906f935159 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a] added
Aug 15 05:53:47 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:53:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:53:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:53:47 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f71fce-fca4-4d77-a90b-506e6a915c14]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:53:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c24495-9d6e-4938-9f26-c9906f935159 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:53:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:53:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:53:47 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3734a877-e9aa-436f-8eb5-c18763ae9629]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:53:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c24495-9d6e-4938-9f26-c9906f935159 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:53:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ITvWxkwA {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:53:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ITvWxkwA" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:53:47 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[93619ae9-535e-4fad-aa8c-1c9271bc63a7]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:53:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c24495-9d6e-4938-9f26-c9906f935159 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ITvWxkwA'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:53:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:53:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:53:47 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf44d126-9545-4a2f-b81b-0ddb06619d32]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:53:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c24495-9d6e-4938-9f26-c9906f935159 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:53:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:53:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:53:47 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7379ddfc-5705-4b60-9276-e3d037505646]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:53:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c24495-9d6e-4938-9f26-c9906f935159 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de (non-flash)
Aug 15 05:53:47 user nova-compute[73391]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 (non-flash)
Aug 15 05:53:47 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:53:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c24495-9d6e-4938-9f26-c9906f935159 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de (non-flash)
Aug 15 05:53:47 user nova-compute[73391]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 (non-flash)
Aug 15 05:53:47 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:53:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:53:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:53:47 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[590be225-559b-4246-b01e-fe983549f3b2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:53:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c24495-9d6e-4938-9f26-c9906f935159 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a, portal: 172.16.0.220,3260]
Aug 15 05:53:47 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a, portal: 172.16.0.220,3260] successful.
Aug 15 05:53:47 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:53:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:53:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:53:47 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3712fb7-2eba-417c-b5c1-fb265d26300c]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:53:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c24495-9d6e-4938-9f26-c9906f935159 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:53:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:53:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:53:47 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[48c48d49-91ed-4939-86c6-3569a71c5848]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:53:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c24495-9d6e-4938-9f26-c9906f935159 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de (non-flash)
Aug 15 05:53:47 user nova-compute[73391]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 (non-flash)
Aug 15 05:53:47 user nova-compute[73391]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a (non-flash)
Aug 15 05:53:47 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:53:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c24495-9d6e-4938-9f26-c9906f935159 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de (non-flash)
Aug 15 05:53:47 user nova-compute[73391]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 (non-flash)
Aug 15 05:53:47 user nova-compute[73391]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a (non-flash)
Aug 15 05:53:47 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:53:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-91c24495-9d6e-4938-9f26-c9906f935159 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:53:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c24495-9d6e-4938-9f26-c9906f935159 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 05:53:47 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-91c24495-9d6e-4938-9f26-c9906f935159 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] HCTL ('35', '-', '-', 0) found on session 56 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 05:53:47 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-91c24495-9d6e-4938-9f26-c9906f935159 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 05:53:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:53:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:53:47 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec79702-9350-4a67-8678-b8ac0637cbb5]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:53:47 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-91c24495-9d6e-4938-9f26-c9906f935159 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Searching for a device in session 56 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:53:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c24495-9d6e-4938-9f26-c9906f935159 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ITvWxkwA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 05:53:48 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-91c24495-9d6e-4938-9f26-c9906f935159 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:53:48 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-91c24495-9d6e-4938-9f26-c9906f935159 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23035306461613733', 'path': '/dev/sdd'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:53:48 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-91c24495-9d6e-4938-9f26-c9906f935159 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035306461613733', 'path': '/dev/sdd'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 05:53:48 user nova-compute[73391]: DEBUG nova.objects.instance [None req-91c24495-9d6e-4938-9f26-c9906f935159 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Lazy-loading 'flavor' on Instance uuid 3adc0c85-0f31-4a73-8b98-eb1a4b32434d {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:53:48 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-91c24495-9d6e-4938-9f26-c9906f935159 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 05:53:48 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:53:48 user nova-compute[73391]:   <source dev="/dev/sdd"/>
Aug 15 05:53:48 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:53:48 user nova-compute[73391]:   <serial>97915103-1b6f-453d-a3af-74137ff0ac5a</serial>
Aug 15 05:53:48 user nova-compute[73391]: </disk>
Aug 15 05:53:48 user nova-compute[73391]:  {{(pid=73391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 05:53:48 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-91c24495-9d6e-4938-9f26-c9906f935159 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:53:48 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-91c24495-9d6e-4938-9f26-c9906f935159 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:53:48 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-91c24495-9d6e-4938-9f26-c9906f935159 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] No VIF found with MAC fa:16:3e:9e:93:8d, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:53:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-91c24495-9d6e-4938-9f26-c9906f935159 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Lock "3adc0c85-0f31-4a73-8b98-eb1a4b32434d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.665s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:53:50 user nova-compute[73391]: INFO nova.compute.manager [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Rescuing
Aug 15 05:53:50 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Acquiring lock "refresh_cache-3adc0c85-0f31-4a73-8b98-eb1a4b32434d" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:53:50 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Acquired lock "refresh_cache-3adc0c85-0f31-4a73-8b98-eb1a4b32434d" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:53:50 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:53:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:53:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:53:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 05:53:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 05:53:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 05:53:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:53:51 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Updating instance_info_cache with network_info: [{"id": "95260c2c-bfa7-42c2-934b-af9874c68201", "address": "fa:16:3e:9e:93:8d", "network": {"id": "6444073e-0d7a-4ecd-a945-4cbbb6bf2c92", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1589197255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d6c4fcd171841d6b59b8b400efd0619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95260c2c-bf", "ovs_interfaceid": "95260c2c-bfa7-42c2-934b-af9874c68201", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:53:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Releasing lock "refresh_cache-3adc0c85-0f31-4a73-8b98-eb1a4b32434d" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:53:51 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:53:51 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:53:51 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:53:51 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:53:51 user nova-compute[73391]: DEBUG nova.compute.manager [req-00f29b68-2e40-4a02-9de1-97623933b497 req-89898a4d-19c1-41fd-9a57-9813bc32bf67 service nova] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Received event network-vif-unplugged-95260c2c-bfa7-42c2-934b-af9874c68201 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:53:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-00f29b68-2e40-4a02-9de1-97623933b497 req-89898a4d-19c1-41fd-9a57-9813bc32bf67 service nova] Acquiring lock "3adc0c85-0f31-4a73-8b98-eb1a4b32434d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:53:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-00f29b68-2e40-4a02-9de1-97623933b497 req-89898a4d-19c1-41fd-9a57-9813bc32bf67 service nova] Lock "3adc0c85-0f31-4a73-8b98-eb1a4b32434d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:53:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-00f29b68-2e40-4a02-9de1-97623933b497 req-89898a4d-19c1-41fd-9a57-9813bc32bf67 service nova] Lock "3adc0c85-0f31-4a73-8b98-eb1a4b32434d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:53:51 user nova-compute[73391]: DEBUG nova.compute.manager [req-00f29b68-2e40-4a02-9de1-97623933b497 req-89898a4d-19c1-41fd-9a57-9813bc32bf67 service nova] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] No waiting events found dispatching network-vif-unplugged-95260c2c-bfa7-42c2-934b-af9874c68201 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:53:51 user nova-compute[73391]: WARNING nova.compute.manager [req-00f29b68-2e40-4a02-9de1-97623933b497 req-89898a4d-19c1-41fd-9a57-9813bc32bf67 service nova] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Received unexpected event network-vif-unplugged-95260c2c-bfa7-42c2-934b-af9874c68201 for instance with vm_state active and task_state rescuing.
Aug 15 05:53:51 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:53:51 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:53:51 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Instance destroyed successfully.
Aug 15 05:53:51 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Attempting a stable device rescue
Aug 15 05:53:51 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=73391) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Aug 15 05:53:51 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Instance directory exists: not creating {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Aug 15 05:53:51 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Creating image(s)
Aug 15 05:53:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Acquiring lock "/opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:53:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Lock "/opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:53:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Lock "/opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:53:51 user nova-compute[73391]: DEBUG nova.objects.instance [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3adc0c85-0f31-4a73-8b98-eb1a4b32434d {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:53:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Acquiring lock "972c65b3edc3d8b6a61d3e430795d1c50e8d8df8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:53:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Lock "972c65b3edc3d8b6a61d3e430795d1c50e8d8df8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:53:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/972c65b3edc3d8b6a61d3e430795d1c50e8d8df8.part --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:53:53 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/972c65b3edc3d8b6a61d3e430795d1c50e8d8df8.part --force-share --output=json" returned: 0 in 0.204s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:53:53 user nova-compute[73391]: DEBUG nova.virt.images [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] 49dc161a-9a71-4261-b833-c077c46f0f8e was qcow2, converting to raw {{(pid=73391) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 05:53:53 user nova-compute[73391]: DEBUG nova.privsep.utils [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73391) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 05:53:53 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/972c65b3edc3d8b6a61d3e430795d1c50e8d8df8.part /opt/stack/data/nova/instances/_base/972c65b3edc3d8b6a61d3e430795d1c50e8d8df8.converted {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:53:53 user nova-compute[73391]: DEBUG nova.compute.manager [req-41cc8e89-db40-4db8-9333-d152bb3c8bab req-758de782-f043-4c6e-bdd5-49b89cbabf0b service nova] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Received event network-vif-plugged-95260c2c-bfa7-42c2-934b-af9874c68201 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:53:53 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-41cc8e89-db40-4db8-9333-d152bb3c8bab req-758de782-f043-4c6e-bdd5-49b89cbabf0b service nova] Acquiring lock "3adc0c85-0f31-4a73-8b98-eb1a4b32434d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:53:53 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-41cc8e89-db40-4db8-9333-d152bb3c8bab req-758de782-f043-4c6e-bdd5-49b89cbabf0b service nova] Lock "3adc0c85-0f31-4a73-8b98-eb1a4b32434d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:53:53 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-41cc8e89-db40-4db8-9333-d152bb3c8bab req-758de782-f043-4c6e-bdd5-49b89cbabf0b service nova] Lock "3adc0c85-0f31-4a73-8b98-eb1a4b32434d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:53:53 user nova-compute[73391]: DEBUG nova.compute.manager [req-41cc8e89-db40-4db8-9333-d152bb3c8bab req-758de782-f043-4c6e-bdd5-49b89cbabf0b service nova] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] No waiting events found dispatching network-vif-plugged-95260c2c-bfa7-42c2-934b-af9874c68201 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:53:53 user nova-compute[73391]: WARNING nova.compute.manager [req-41cc8e89-db40-4db8-9333-d152bb3c8bab req-758de782-f043-4c6e-bdd5-49b89cbabf0b service nova] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Received unexpected event network-vif-plugged-95260c2c-bfa7-42c2-934b-af9874c68201 for instance with vm_state active and task_state rescuing.
Aug 15 05:53:53 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/972c65b3edc3d8b6a61d3e430795d1c50e8d8df8.part /opt/stack/data/nova/instances/_base/972c65b3edc3d8b6a61d3e430795d1c50e8d8df8.converted" returned: 0 in 0.552s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:53:53 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/972c65b3edc3d8b6a61d3e430795d1c50e8d8df8.converted --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:53:53 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/972c65b3edc3d8b6a61d3e430795d1c50e8d8df8.converted --force-share --output=json" returned: 0 in 0.172s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:53:53 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Lock "972c65b3edc3d8b6a61d3e430795d1c50e8d8df8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.834s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:53:53 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Acquiring lock "972c65b3edc3d8b6a61d3e430795d1c50e8d8df8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:53:53 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Lock "972c65b3edc3d8b6a61d3e430795d1c50e8d8df8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:53:53 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/972c65b3edc3d8b6a61d3e430795d1c50e8d8df8 --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/972c65b3edc3d8b6a61d3e430795d1c50e8d8df8 --force-share --output=json" returned: 0 in 0.174s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/972c65b3edc3d8b6a61d3e430795d1c50e8d8df8,backing_fmt=raw /opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/disk.rescue {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/972c65b3edc3d8b6a61d3e430795d1c50e8d8df8,backing_fmt=raw /opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/disk.rescue" returned: 0 in 0.049s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Lock "972c65b3edc3d8b6a61d3e430795d1c50e8d8df8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG nova.objects.instance [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Lazy-loading 'migration_context' on Instance uuid 3adc0c85-0f31-4a73-8b98-eb1a4b32434d {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Created local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Start _get_guest_xml network_info=[{"id": "95260c2c-bfa7-42c2-934b-af9874c68201", "address": "fa:16:3e:9e:93:8d", "network": {"id": "6444073e-0d7a-4ecd-a945-4cbbb6bf2c92", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1589197255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1589197255-network", "vif_mac": "fa:16:3e:9e:93:8d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d6c4fcd171841d6b59b8b400efd0619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95260c2c-bf", "ovs_interfaceid": "95260c2c-bfa7-42c2-934b-af9874c68201", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '49dc161a-9a71-4261-b833-c077c46f0f8e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '191b1dad-305e-4d1c-9b15-515ec59a3278'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ITvWxkwA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '3adc0c85-0f31-4a73-8b98-eb1a4b32434d', 'attached_at': '', 'detached_at': '', 'volume_id': '97915103-1b6f-453d-a3af-74137ff0ac5a', 'serial': '97915103-1b6f-453d-a3af-74137ff0ac5a'}, 'attachment_id': '6586643a-624e-4a4c-8c78-85ceb76c7890', 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG nova.objects.instance [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Lazy-loading 'resources' on Instance uuid 3adc0c85-0f31-4a73-8b98-eb1a4b32434d {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG nova.objects.instance [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Lazy-loading 'numa_topology' on Instance uuid 3adc0c85-0f31-4a73-8b98-eb1a4b32434d {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:53:54 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:53:54 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:53:54 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG nova.objects.instance [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3adc0c85-0f31-4a73-8b98-eb1a4b32434d {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ITvWxkwA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:53:54 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:53:54 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:53:54 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:53:54 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:53:54 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 05:53:54 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a049435e-d0ae-4992-b970-8e037651211d]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = ITvWxkwA\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Aug 15 05:53:54 user nova-compute[73391]: node.name = iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a
Aug 15 05:53:54 user nova-compute[73391]: node.tpgt = -1
Aug 15 05:53:54 user nova-compute[73391]: node.startup = automatic
Aug 15 05:53:54 user nova-compute[73391]: node.leading_login = No
Aug 15 05:53:54 user nova-compute[73391]: iface.iscsi_ifacename = default
Aug 15 05:53:54 user nova-compute[73391]: iface.net_ifacename = <empty>
Aug 15 05:53:54 user nova-compute[73391]: iface.ipaddress = <empty>
Aug 15 05:53:54 user nova-compute[73391]: iface.prefix_len = 0
Aug 15 05:53:54 user nova-compute[73391]: iface.hwaddress = <empty>
Aug 15 05:53:54 user nova-compute[73391]: iface.transport_name = tcp
Aug 15 05:53:54 user nova-compute[73391]: iface.initiatorname = <empty>
Aug 15 05:53:54 user nova-compute[73391]: iface.state = <empty>
Aug 15 05:53:54 user nova-compute[73391]: iface.vlan_id = 0
Aug 15 05:53:54 user nova-compute[73391]: iface.vlan_priority = 0
Aug 15 05:53:54 user nova-compute[73391]: iface.vlan_state = <empty>
Aug 15 05:53:54 user nova-compute[73391]: iface.iface_num = 0
Aug 15 05:53:54 user nova-compute[73391]: iface.mtu = 0
Aug 15 05:53:54 user nova-compute[73391]: iface.port = 0
Aug 15 05:53:54 user nova-compute[73391]: iface.bootproto = <empty>
Aug 15 05:53:54 user nova-compute[73391]: iface.subnet_mask = <empty>
Aug 15 05:53:54 user nova-compute[73391]: iface.gateway = <empty>
Aug 15 05:53:54 user nova-compute[73391]: iface.dhcp_alt_client_id_state = <empty>
Aug 15 05:53:54 user nova-compute[73391]: iface.dhcp_alt_client_id = <empty>
Aug 15 05:53:54 user nova-compute[73391]: iface.dhcp_dns = <empty>
Aug 15 05:53:54 user nova-compute[73391]: iface.dhcp_learn_iqn = <empty>
Aug 15 05:53:54 user nova-compute[73391]: iface.dhcp_req_vendor_id_state = <empty>
Aug 15 05:53:54 user nova-compute[73391]: iface.dhcp_vendor_id_state = <empty>
Aug 15 05:53:54 user nova-compute[73391]: iface.dhcp_vendor_id = <empty>
Aug 15 05:53:54 user nova-compute[73391]: iface.dhcp_slp_da = <empty>
Aug 15 05:53:54 user nova-compute[73391]: iface.fragmentation = <empty>
Aug 15 05:53:54 user nova-compute[73391]: iface.gratuitous_arp = <empty>
Aug 15 05:53:54 user nova-compute[73391]: iface.incoming_forwarding = <empty>
Aug 15 05:53:54 user nova-compute[73391]: iface.tos_state = <empty>
Aug 15 05:53:54 user nova-compute[73391]: iface.tos = 0
Aug 15 05:53:54 user nova-compute[73391]: iface.ttl = 0
Aug 15 05:53:54 user nova-compute[73391]: iface.delayed_ack = <empty>
Aug 15 05:53:54 user nova-compute[73391]: iface.tcp_nagle = <empty>
Aug 15 05:53:54 user nova-compute[73391]: iface.tcp_wsf_state = <empty>
Aug 15 05:53:54 user nova-compute[73391]: iface.tcp_wsf = 0
Aug 15 05:53:54 user nova-compute[73391]: iface.tcp_timer_scale = 0
Aug 15 05:53:54 user nova-compute[73391]: iface.tcp_timestamp = <empty>
Aug 15 05:53:54 user nova-compute[73391]: iface.redirect = <empty>
Aug 15 05:53:54 user nova-compute[73391]: iface.def_task_mgmt_timeout = 0
Aug 15 05:53:54 user nova-compute[73391]: iface.header_digest = <empty>
Aug 15 05:53:54 user nova-compute[73391]: iface.data_digest = <empty>
Aug 15 05:53:54 user nova-compute[73391]: iface.immediate_data = <empty>
Aug 15 05:53:54 user nova-compute[73391]: iface.initial_r2t = <empty>
Aug 15 05:53:54 user nova-compute[73391]: iface.data_seq_inorder = <empty>
Aug 15 05:53:54 user nova-compute[73391]: iface.data_pdu_inorder = <empty>
Aug 15 05:53:54 user nova-compute[73391]: iface.erl = 0
Aug 15 05:53:54 user nova-compute[73391]: iface.max_receive_data_len = 0
Aug 15 05:53:54 user nova-compute[73391]: iface.first_burst_len = 0
Aug 15 05:53:54 user nova-compute[73391]: iface.max_outstanding_r2t = 0
Aug 15 05:53:54 user nova-compute[73391]: iface.max_burst_len = 0
Aug 15 05:53:54 user nova-compute[73391]: iface.chap_auth = <empty>
Aug 15 05:53:54 user nova-compute[73391]: iface.bidi_chap = <empty>
Aug 15 05:53:54 user nova-compute[73391]: iface.strict_login_compliance = <empty>
Aug 15 05:53:54 user nova-compute[73391]: iface.discovery_auth = <empty>
Aug 15 05:53:54 user nova-compute[73391]: iface.discovery_logout = <empty>
Aug 15 05:53:54 user nova-compute[73391]: node.discovery_address = <empty>
Aug 15 05:53:54 user nova-compute[73391]: node.discovery_port = 0
Aug 15 05:53:54 user nova-compute[73391]: node.discovery_type = static
Aug 15 05:53:54 user nova-compute[73391]: node.session.initial_cmdsn = 0
Aug 15 05:53:54 user nova-compute[73391]: node.session.initial_login_retry_max = 8
Aug 15 05:53:54 user nova-compute[73391]: node.session.xmit_thread_priority = -20
Aug 15 05:53:54 user nova-compute[73391]: node.session.cmds_max = 128
Aug 15 05:53:54 user nova-compute[73391]: node.session.queue_depth = 32
Aug 15 05:53:54 user nova-compute[73391]: node.session.nr_sessions = 1
Aug 15 05:53:54 user nova-compute[73391]: node.session.auth.authmethod = CHAP
Aug 15 05:53:54 user nova-compute[73391]: node.session.auth.username = ITvWxkwA
Aug 15 05:53:54 user nova-compute[73391]: node.session.auth.password = ***
Aug 15 05:53:54 user nova-compute[73391]: node.session.auth.username_in = <empty>
Aug 15 05:53:54 user nova-compute[73391]: node.session.auth.password_in = <empty>
Aug 15 05:53:54 user nova-compute[73391]: node.session.auth.chap_algs = MD5
Aug 15 05:53:54 user nova-compute[73391]: node.session.timeo.replacement_timeout = 120
Aug 15 05:53:54 user nova-compute[73391]: node.session.err_timeo.abort_timeout = 15
Aug 15 05:53:54 user nova-compute[73391]: node.session.err_timeo.lu_reset_timeout = 30
Aug 15 05:53:54 user nova-compute[73391]: node.session.err_timeo.tgt_reset_timeout = 30
Aug 15 05:53:54 user nova-compute[73391]: node.session.err_timeo.host_reset_timeout = 60
Aug 15 05:53:54 user nova-compute[73391]: node.session.iscsi.FastAbort = Yes
Aug 15 05:53:54 user nova-compute[73391]: node.session.iscsi.InitialR2T = No
Aug 15 05:53:54 user nova-compute[73391]: node.session.iscsi.ImmediateData = Yes
Aug 15 05:53:54 user nova-compute[73391]: node.session.iscsi.FirstBurstLength = 262144
Aug 15 05:53:54 user nova-compute[73391]: node.session.iscsi.MaxBurstLength = 16776192
Aug 15 05:53:54 user nova-compute[73391]: node.session.iscsi.DefaultTime2Retain = 0
Aug 15 05:53:54 user nova-compute[73391]: node.session.iscsi.DefaultTime2Wait = 2
Aug 15 05:53:54 user nova-compute[73391]: node.session.iscsi.MaxConnections = 1
Aug 15 05:53:54 user nova-compute[73391]: node.session.iscsi.MaxOutstandingR2T = 1
Aug 15 05:53:54 user nova-compute[73391]: node.session.iscsi.ERL = 0
Aug 15 05:53:54 user nova-compute[73391]: node.session.scan = manual
Aug 15 05:53:54 user nova-compute[73391]: node.session.reopen_max = 0
Aug 15 05:53:54 user nova-compute[73391]: node.conn[0].address = 172.16.0.220
Aug 15 05:53:54 user nova-compute[73391]: node.conn[0].port = 3260
Aug 15 05:53:54 user nova-compute[73391]: node.conn[0].startup = manual
Aug 15 05:53:54 user nova-compute[73391]: node.conn[0].tcp.window_size = 524288
Aug 15 05:53:54 user nova-compute[73391]: node.conn[0].tcp.type_of_service = 0
Aug 15 05:53:54 user nova-compute[73391]: node.conn[0].timeo.logout_timeout = 15
Aug 15 05:53:54 user nova-compute[73391]: node.conn[0].timeo.login_timeout = 15
Aug 15 05:53:54 user nova-compute[73391]: node.conn[0].timeo.auth_timeout = 45
Aug 15 05:53:54 user nova-compute[73391]: node.conn[0].timeo.noop_out_interval = 5
Aug 15 05:53:54 user nova-compute[73391]: node.conn[0].timeo.noop_out_timeout = 5
Aug 15 05:53:54 user nova-compute[73391]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Aug 15 05:53:54 user nova-compute[73391]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Aug 15 05:53:54 user nova-compute[73391]: node.conn[0].iscsi.HeaderDigest = None
Aug 15 05:53:54 user nova-compute[73391]: node.conn[0].iscsi.DataDigest = None
Aug 15 05:53:54 user nova-compute[73391]: node.conn[0].iscsi.IFMarker = No
Aug 15 05:53:54 user nova-compute[73391]: node.conn[0].iscsi.OFMarker = No
Aug 15 05:53:54 user nova-compute[73391]: # END RECORD
Aug 15 05:53:54 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce37c86d-29d7-4d9e-83a4-98e85a742066]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[133fc6fa-aa6d-497e-9c51-7946521299f6]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ITvWxkwA {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ITvWxkwA" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92db7b5-daa2-4bba-9879-2947daf58c91]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ITvWxkwA'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[863e91ed-c9db-4bab-bab3-1923d01a1755]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d886a318-003c-4a9e-ad90-c030da99e216]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de (non-flash)
Aug 15 05:53:54 user nova-compute[73391]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 (non-flash)
Aug 15 05:53:54 user nova-compute[73391]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a (non-flash)
Aug 15 05:53:54 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de (non-flash)
Aug 15 05:53:54 user nova-compute[73391]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 (non-flash)
Aug 15 05:53:54 user nova-compute[73391]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a (non-flash)
Aug 15 05:53:54 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.145s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] HCTL ('35', '0', '0', 0) found on session 56 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.013s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2eb76b-d994-4b2c-821d-000ee6b82676]: (4, ('0 0 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Searching for a device in session 56 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Connected to sdd using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ITvWxkwA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.167s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] <== connect_volume: return (169ms) {'type': 'block', 'scsi_wwn': '23035306461613733', 'path': '/dev/sdd'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035306461613733', 'path': '/dev/sdd'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:49:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1266227369',display_name='tempest-ServerStableDeviceRescueTest-server-1266227369',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1266227369',id=40,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClbn+ZluhSwHYHUlfY7kR3eatJoIxOJzOUNz+RPGiKGWCzkk0oGlPS2RkCrWZEexGlaxiCjPu9TAHalxvsHmjvpVHNYRCtECwXpmtDg6eyUHQPHz+qqJmib5EvKgKkJ5A==',key_name='tempest-keypair-1197168403',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:50:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0d6c4fcd171841d6b59b8b400efd0619',ramdisk_id='',reservation_id='r-4hbuvl6a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1604927137',owner_user_name='tempest-ServerStableDeviceRescueTest-1604927137-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:51:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43a914b6a21746b99ec36fb395d2f87f',uuid=3adc0c85-0f31-4a73-8b98-eb1a4b32434d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "95260c2c-bfa7-42c2-934b-af9874c68201", "address": "fa:16:3e:9e:93:8d", "network": {"id": "6444073e-0d7a-4ecd-a945-4cbbb6bf2c92", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1589197255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1589197255-network", "vif_mac": "fa:16:3e:9e:93:8d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d6c4fcd171841d6b59b8b400efd0619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95260c2c-bf", "ovs_interfaceid": "95260c2c-bfa7-42c2-934b-af9874c68201", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Converting VIF {"id": "95260c2c-bfa7-42c2-934b-af9874c68201", "address": "fa:16:3e:9e:93:8d", "network": {"id": "6444073e-0d7a-4ecd-a945-4cbbb6bf2c92", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1589197255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1589197255-network", "vif_mac": "fa:16:3e:9e:93:8d"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d6c4fcd171841d6b59b8b400efd0619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95260c2c-bf", "ovs_interfaceid": "95260c2c-bfa7-42c2-934b-af9874c68201", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:93:8d,bridge_name='br-int',has_traffic_filtering=True,id=95260c2c-bfa7-42c2-934b-af9874c68201,network=Network(6444073e-0d7a-4ecd-a945-4cbbb6bf2c92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95260c2c-bf') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG nova.objects.instance [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Lazy-loading 'pci_devices' on Instance uuid 3adc0c85-0f31-4a73-8b98-eb1a4b32434d {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:53:54 user nova-compute[73391]:   <uuid>3adc0c85-0f31-4a73-8b98-eb1a4b32434d</uuid>
Aug 15 05:53:54 user nova-compute[73391]:   <name>instance-00000028</name>
Aug 15 05:53:54 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:53:54 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:53:54 user nova-compute[73391]:   <metadata>
Aug 15 05:53:54 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:53:54 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:53:54 user nova-compute[73391]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1266227369</nova:name>
Aug 15 05:53:54 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:53:54</nova:creationTime>
Aug 15 05:53:54 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:53:54 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:53:54 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:53:54 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:53:54 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:53:54 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:53:54 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:53:54 user nova-compute[73391]:       <nova:owner>
Aug 15 05:53:54 user nova-compute[73391]:         <nova:user uuid="43a914b6a21746b99ec36fb395d2f87f">tempest-ServerStableDeviceRescueTest-1604927137-project-member</nova:user>
Aug 15 05:53:54 user nova-compute[73391]:         <nova:project uuid="0d6c4fcd171841d6b59b8b400efd0619">tempest-ServerStableDeviceRescueTest-1604927137</nova:project>
Aug 15 05:53:54 user nova-compute[73391]:       </nova:owner>
Aug 15 05:53:54 user nova-compute[73391]:       <nova:root type="image" uuid="191b1dad-305e-4d1c-9b15-515ec59a3278"/>
Aug 15 05:53:54 user nova-compute[73391]:       <nova:ports>
Aug 15 05:53:54 user nova-compute[73391]:         <nova:port uuid="95260c2c-bfa7-42c2-934b-af9874c68201">
Aug 15 05:53:54 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Aug 15 05:53:54 user nova-compute[73391]:         </nova:port>
Aug 15 05:53:54 user nova-compute[73391]:       </nova:ports>
Aug 15 05:53:54 user nova-compute[73391]:     </nova:instance>
Aug 15 05:53:54 user nova-compute[73391]:   </metadata>
Aug 15 05:53:54 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:53:54 user nova-compute[73391]:     <system>
Aug 15 05:53:54 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:53:54 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:53:54 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:53:54 user nova-compute[73391]:       <entry name="serial">3adc0c85-0f31-4a73-8b98-eb1a4b32434d</entry>
Aug 15 05:53:54 user nova-compute[73391]:       <entry name="uuid">3adc0c85-0f31-4a73-8b98-eb1a4b32434d</entry>
Aug 15 05:53:54 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:53:54 user nova-compute[73391]:     </system>
Aug 15 05:53:54 user nova-compute[73391]:   </sysinfo>
Aug 15 05:53:54 user nova-compute[73391]:   <os>
Aug 15 05:53:54 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:53:54 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:53:54 user nova-compute[73391]:   </os>
Aug 15 05:53:54 user nova-compute[73391]:   <features>
Aug 15 05:53:54 user nova-compute[73391]:     <acpi/>
Aug 15 05:53:54 user nova-compute[73391]:     <apic/>
Aug 15 05:53:54 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:53:54 user nova-compute[73391]:   </features>
Aug 15 05:53:54 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:53:54 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:53:54 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:53:54 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:53:54 user nova-compute[73391]:   </clock>
Aug 15 05:53:54 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:53:54 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:53:54 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:53:54 user nova-compute[73391]:   </cpu>
Aug 15 05:53:54 user nova-compute[73391]:   <devices>
Aug 15 05:53:54 user nova-compute[73391]:     <disk type="file" device="disk">
Aug 15 05:53:54 user nova-compute[73391]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 05:53:54 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/disk"/>
Aug 15 05:53:54 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:53:54 user nova-compute[73391]:     </disk>
Aug 15 05:53:54 user nova-compute[73391]:     <disk type="block" device="disk">
Aug 15 05:53:54 user nova-compute[73391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:53:54 user nova-compute[73391]:       <source dev="/dev/sdd"/>
Aug 15 05:53:54 user nova-compute[73391]:       <target dev="vdb" bus="virtio"/>
Aug 15 05:53:54 user nova-compute[73391]:       <serial>97915103-1b6f-453d-a3af-74137ff0ac5a</serial>
Aug 15 05:53:54 user nova-compute[73391]:     </disk>
Aug 15 05:53:54 user nova-compute[73391]:     <disk type="file" device="disk">
Aug 15 05:53:54 user nova-compute[73391]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 05:53:54 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/disk.rescue"/>
Aug 15 05:53:54 user nova-compute[73391]:       <target dev="vdc" bus="virtio"/>
Aug 15 05:53:54 user nova-compute[73391]:       <boot order="1"/>
Aug 15 05:53:54 user nova-compute[73391]:     </disk>
Aug 15 05:53:54 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:53:54 user nova-compute[73391]:       <mac address="fa:16:3e:9e:93:8d"/>
Aug 15 05:53:54 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:53:54 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:53:54 user nova-compute[73391]:       <target dev="tap95260c2c-bf"/>
Aug 15 05:53:54 user nova-compute[73391]:     </interface>
Aug 15 05:53:54 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:53:54 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/console.log" append="off"/>
Aug 15 05:53:54 user nova-compute[73391]:     </serial>
Aug 15 05:53:54 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:53:54 user nova-compute[73391]:     <video>
Aug 15 05:53:54 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:53:54 user nova-compute[73391]:     </video>
Aug 15 05:53:54 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:53:54 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:53:54 user nova-compute[73391]:     </rng>
Aug 15 05:53:54 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:53:54 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:53:54 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:53:54 user nova-compute[73391]:     </memballoon>
Aug 15 05:53:54 user nova-compute[73391]:   </devices>
Aug 15 05:53:54 user nova-compute[73391]: </domain>
Aug 15 05:53:54 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:53:54 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Instance destroyed successfully.
Aug 15 05:53:54 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] No BDM found with device name vdc, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:53:54 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] No VIF found with MAC fa:16:3e:9e:93:8d, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:53:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:53:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:53:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:53:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:53:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:53:56 user nova-compute[73391]: DEBUG nova.compute.manager [req-7ba263d2-d5bd-4aa8-9fcd-1d22dae0ae02 req-b95b3240-ad90-4c33-940a-6a0c6432b8e3 service nova] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Received event network-vif-plugged-95260c2c-bfa7-42c2-934b-af9874c68201 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:53:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-7ba263d2-d5bd-4aa8-9fcd-1d22dae0ae02 req-b95b3240-ad90-4c33-940a-6a0c6432b8e3 service nova] Acquiring lock "3adc0c85-0f31-4a73-8b98-eb1a4b32434d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:53:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-7ba263d2-d5bd-4aa8-9fcd-1d22dae0ae02 req-b95b3240-ad90-4c33-940a-6a0c6432b8e3 service nova] Lock "3adc0c85-0f31-4a73-8b98-eb1a4b32434d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:53:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-7ba263d2-d5bd-4aa8-9fcd-1d22dae0ae02 req-b95b3240-ad90-4c33-940a-6a0c6432b8e3 service nova] Lock "3adc0c85-0f31-4a73-8b98-eb1a4b32434d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:53:56 user nova-compute[73391]: DEBUG nova.compute.manager [req-7ba263d2-d5bd-4aa8-9fcd-1d22dae0ae02 req-b95b3240-ad90-4c33-940a-6a0c6432b8e3 service nova] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] No waiting events found dispatching network-vif-plugged-95260c2c-bfa7-42c2-934b-af9874c68201 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:53:56 user nova-compute[73391]: WARNING nova.compute.manager [req-7ba263d2-d5bd-4aa8-9fcd-1d22dae0ae02 req-b95b3240-ad90-4c33-940a-6a0c6432b8e3 service nova] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Received unexpected event network-vif-plugged-95260c2c-bfa7-42c2-934b-af9874c68201 for instance with vm_state active and task_state rescuing.
Aug 15 05:53:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:53:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:53:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:53:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:53:58 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Removed pending event for 3adc0c85-0f31-4a73-8b98-eb1a4b32434d due to event {{(pid=73391) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 05:53:58 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078838.1587698, 3adc0c85-0f31-4a73-8b98-eb1a4b32434d => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:53:58 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] VM Resumed (Lifecycle Event)
Aug 15 05:53:58 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3186f65f-92f7-4879-b2fb-4bca78caaeed tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:53:58 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:53:58 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:53:58 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 15 05:53:58 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078838.1603792, 3adc0c85-0f31-4a73-8b98-eb1a4b32434d => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:53:58 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] VM Started (Lifecycle Event)
Aug 15 05:53:58 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:53:58 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:53:58 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] During sync_power_state the instance has a pending task (rescuing). Skip.
Aug 15 05:53:58 user nova-compute[73391]: DEBUG nova.compute.manager [req-43d5f2fd-47de-48fa-ae11-357533063c78 req-3635402e-d385-43bd-a435-4ea6c53f117a service nova] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Received event network-vif-plugged-95260c2c-bfa7-42c2-934b-af9874c68201 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:53:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-43d5f2fd-47de-48fa-ae11-357533063c78 req-3635402e-d385-43bd-a435-4ea6c53f117a service nova] Acquiring lock "3adc0c85-0f31-4a73-8b98-eb1a4b32434d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:53:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-43d5f2fd-47de-48fa-ae11-357533063c78 req-3635402e-d385-43bd-a435-4ea6c53f117a service nova] Lock "3adc0c85-0f31-4a73-8b98-eb1a4b32434d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:53:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-43d5f2fd-47de-48fa-ae11-357533063c78 req-3635402e-d385-43bd-a435-4ea6c53f117a service nova] Lock "3adc0c85-0f31-4a73-8b98-eb1a4b32434d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:53:58 user nova-compute[73391]: DEBUG nova.compute.manager [req-43d5f2fd-47de-48fa-ae11-357533063c78 req-3635402e-d385-43bd-a435-4ea6c53f117a service nova] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] No waiting events found dispatching network-vif-plugged-95260c2c-bfa7-42c2-934b-af9874c68201 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:53:58 user nova-compute[73391]: WARNING nova.compute.manager [req-43d5f2fd-47de-48fa-ae11-357533063c78 req-3635402e-d385-43bd-a435-4ea6c53f117a service nova] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Received unexpected event network-vif-plugged-95260c2c-bfa7-42c2-934b-af9874c68201 for instance with vm_state rescued and task_state None.
Aug 15 05:53:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:54:00 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:54:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-fda62595-aa46-42bc-bd0b-b29b9fdea771 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Acquiring lock "a7f591b9-7028-431d-aacc-9725767d8e1d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:54:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-fda62595-aa46-42bc-bd0b-b29b9fdea771 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Lock "a7f591b9-7028-431d-aacc-9725767d8e1d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:54:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-fda62595-aa46-42bc-bd0b-b29b9fdea771 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Acquiring lock "a7f591b9-7028-431d-aacc-9725767d8e1d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:54:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-fda62595-aa46-42bc-bd0b-b29b9fdea771 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Lock "a7f591b9-7028-431d-aacc-9725767d8e1d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:54:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-fda62595-aa46-42bc-bd0b-b29b9fdea771 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Lock "a7f591b9-7028-431d-aacc-9725767d8e1d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:54:05 user nova-compute[73391]: INFO nova.compute.manager [None req-fda62595-aa46-42bc-bd0b-b29b9fdea771 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Terminating instance
Aug 15 05:54:05 user nova-compute[73391]: DEBUG nova.compute.manager [None req-fda62595-aa46-42bc-bd0b-b29b9fdea771 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Start destroying the instance on the hypervisor. {{(pid=73391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 05:54:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:54:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:54:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:54:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:54:05 user nova-compute[73391]: DEBUG nova.compute.manager [req-473fb0a0-cf21-49f4-97eb-5599b6cc4397 req-a30e2d61-ee36-4250-9c12-311b5829091b service nova] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Received event network-vif-unplugged-32d1f42a-cab6-41ee-ae14-2cf842756259 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:54:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-473fb0a0-cf21-49f4-97eb-5599b6cc4397 req-a30e2d61-ee36-4250-9c12-311b5829091b service nova] Acquiring lock "a7f591b9-7028-431d-aacc-9725767d8e1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:54:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-473fb0a0-cf21-49f4-97eb-5599b6cc4397 req-a30e2d61-ee36-4250-9c12-311b5829091b service nova] Lock "a7f591b9-7028-431d-aacc-9725767d8e1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:54:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-473fb0a0-cf21-49f4-97eb-5599b6cc4397 req-a30e2d61-ee36-4250-9c12-311b5829091b service nova] Lock "a7f591b9-7028-431d-aacc-9725767d8e1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:54:05 user nova-compute[73391]: DEBUG nova.compute.manager [req-473fb0a0-cf21-49f4-97eb-5599b6cc4397 req-a30e2d61-ee36-4250-9c12-311b5829091b service nova] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] No waiting events found dispatching network-vif-unplugged-32d1f42a-cab6-41ee-ae14-2cf842756259 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:54:05 user nova-compute[73391]: DEBUG nova.compute.manager [req-473fb0a0-cf21-49f4-97eb-5599b6cc4397 req-a30e2d61-ee36-4250-9c12-311b5829091b service nova] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Received event network-vif-unplugged-32d1f42a-cab6-41ee-ae14-2cf842756259 for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 05:54:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:54:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:54:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:54:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:54:05 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Instance destroyed successfully.
Aug 15 05:54:05 user nova-compute[73391]: DEBUG nova.objects.instance [None req-fda62595-aa46-42bc-bd0b-b29b9fdea771 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Lazy-loading 'resources' on Instance uuid a7f591b9-7028-431d-aacc-9725767d8e1d {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:54:05 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-fda62595-aa46-42bc-bd0b-b29b9fdea771 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:52:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-204804039',display_name='tempest-VolumesNegativeTest-instance-204804039',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-204804039',id=43,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:52:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b63a1678a0274c1084ddccd206711afe',ramdisk_id='',reservation_id='r-vvd0587p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1848425558',owner_user_name='tempest-VolumesNegativeTest-1848425558-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:52:23Z,user_data=None,user_id='4b83572d8f5447c282fb182320d4035f',uuid=a7f591b9-7028-431d-aacc-9725767d8e1d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "32d1f42a-cab6-41ee-ae14-2cf842756259", "address": "fa:16:3e:d6:29:41", "network": {"id": "16e02c7a-c90b-40d7-a58c-59f7fbfb2c14", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b6806eca80d44b87b1a19efa0667e7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32d1f42a-ca", "ovs_interfaceid": "32d1f42a-cab6-41ee-ae14-2cf842756259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:54:05 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-fda62595-aa46-42bc-bd0b-b29b9fdea771 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Converting VIF {"id": "32d1f42a-cab6-41ee-ae14-2cf842756259", "address": "fa:16:3e:d6:29:41", "network": {"id": "16e02c7a-c90b-40d7-a58c-59f7fbfb2c14", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "b6806eca80d44b87b1a19efa0667e7fc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32d1f42a-ca", "ovs_interfaceid": "32d1f42a-cab6-41ee-ae14-2cf842756259", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:54:05 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-fda62595-aa46-42bc-bd0b-b29b9fdea771 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d6:29:41,bridge_name='br-int',has_traffic_filtering=True,id=32d1f42a-cab6-41ee-ae14-2cf842756259,network=Network(16e02c7a-c90b-40d7-a58c-59f7fbfb2c14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32d1f42a-ca') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:54:05 user nova-compute[73391]: DEBUG os_vif [None req-fda62595-aa46-42bc-bd0b-b29b9fdea771 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:29:41,bridge_name='br-int',has_traffic_filtering=True,id=32d1f42a-cab6-41ee-ae14-2cf842756259,network=Network(16e02c7a-c90b-40d7-a58c-59f7fbfb2c14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32d1f42a-ca') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:54:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:54:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap32d1f42a-ca, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:54:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:54:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:54:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:54:05 user nova-compute[73391]: INFO os_vif [None req-fda62595-aa46-42bc-bd0b-b29b9fdea771 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d6:29:41,bridge_name='br-int',has_traffic_filtering=True,id=32d1f42a-cab6-41ee-ae14-2cf842756259,network=Network(16e02c7a-c90b-40d7-a58c-59f7fbfb2c14),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32d1f42a-ca')
Aug 15 05:54:05 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-fda62595-aa46-42bc-bd0b-b29b9fdea771 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Deleting instance files /opt/stack/data/nova/instances/a7f591b9-7028-431d-aacc-9725767d8e1d_del
Aug 15 05:54:05 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-fda62595-aa46-42bc-bd0b-b29b9fdea771 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Deletion of /opt/stack/data/nova/instances/a7f591b9-7028-431d-aacc-9725767d8e1d_del complete
Aug 15 05:54:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:54:06 user nova-compute[73391]: INFO nova.compute.manager [None req-fda62595-aa46-42bc-bd0b-b29b9fdea771 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 15 05:54:06 user nova-compute[73391]: DEBUG oslo.service.loopingcall [None req-fda62595-aa46-42bc-bd0b-b29b9fdea771 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 05:54:06 user nova-compute[73391]: DEBUG nova.compute.manager [-] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Deallocating network for instance {{(pid=73391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 05:54:06 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] deallocate_for_instance() {{(pid=73391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 05:54:06 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:54:06 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:54:06 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:54:06 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:54:06 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:54:06 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:54:07 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:54:07 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Took 1.07 seconds to deallocate network for instance.
Aug 15 05:54:07 user nova-compute[73391]: DEBUG nova.compute.manager [req-b11fb2eb-4f66-4c64-b712-a0af8e8a76e4 req-a52fb1ff-52a2-4397-a3f1-3ec8bb641df0 service nova] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Received event network-vif-deleted-32d1f42a-cab6-41ee-ae14-2cf842756259 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:54:07 user nova-compute[73391]: INFO nova.compute.manager [req-b11fb2eb-4f66-4c64-b712-a0af8e8a76e4 req-a52fb1ff-52a2-4397-a3f1-3ec8bb641df0 service nova] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Neutron deleted interface 32d1f42a-cab6-41ee-ae14-2cf842756259; detaching it from the instance and deleting it from the info cache
Aug 15 05:54:07 user nova-compute[73391]: DEBUG nova.network.neutron [req-b11fb2eb-4f66-4c64-b712-a0af8e8a76e4 req-a52fb1ff-52a2-4397-a3f1-3ec8bb641df0 service nova] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:54:07 user nova-compute[73391]: DEBUG nova.compute.manager [req-b11fb2eb-4f66-4c64-b712-a0af8e8a76e4 req-a52fb1ff-52a2-4397-a3f1-3ec8bb641df0 service nova] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Detach interface failed, port_id=32d1f42a-cab6-41ee-ae14-2cf842756259, reason: Instance a7f591b9-7028-431d-aacc-9725767d8e1d could not be found. {{(pid=73391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 05:54:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-fda62595-aa46-42bc-bd0b-b29b9fdea771 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:54:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-fda62595-aa46-42bc-bd0b-b29b9fdea771 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:54:07 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-fda62595-aa46-42bc-bd0b-b29b9fdea771 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:54:07 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-fda62595-aa46-42bc-bd0b-b29b9fdea771 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:54:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-fda62595-aa46-42bc-bd0b-b29b9fdea771 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.331s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:54:07 user nova-compute[73391]: INFO nova.scheduler.client.report [None req-fda62595-aa46-42bc-bd0b-b29b9fdea771 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Deleted allocations for instance a7f591b9-7028-431d-aacc-9725767d8e1d
Aug 15 05:54:07 user nova-compute[73391]: DEBUG nova.compute.manager [req-dd9edd7b-c3a6-4f17-8084-ba0f8387593d req-85560cee-03a1-4f81-a78b-27ddc7243567 service nova] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Received event network-vif-plugged-32d1f42a-cab6-41ee-ae14-2cf842756259 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:54:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-dd9edd7b-c3a6-4f17-8084-ba0f8387593d req-85560cee-03a1-4f81-a78b-27ddc7243567 service nova] Acquiring lock "a7f591b9-7028-431d-aacc-9725767d8e1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:54:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-dd9edd7b-c3a6-4f17-8084-ba0f8387593d req-85560cee-03a1-4f81-a78b-27ddc7243567 service nova] Lock "a7f591b9-7028-431d-aacc-9725767d8e1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:54:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-dd9edd7b-c3a6-4f17-8084-ba0f8387593d req-85560cee-03a1-4f81-a78b-27ddc7243567 service nova] Lock "a7f591b9-7028-431d-aacc-9725767d8e1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:54:07 user nova-compute[73391]: DEBUG nova.compute.manager [req-dd9edd7b-c3a6-4f17-8084-ba0f8387593d req-85560cee-03a1-4f81-a78b-27ddc7243567 service nova] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] No waiting events found dispatching network-vif-plugged-32d1f42a-cab6-41ee-ae14-2cf842756259 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:54:07 user nova-compute[73391]: WARNING nova.compute.manager [req-dd9edd7b-c3a6-4f17-8084-ba0f8387593d req-85560cee-03a1-4f81-a78b-27ddc7243567 service nova] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Received unexpected event network-vif-plugged-32d1f42a-cab6-41ee-ae14-2cf842756259 for instance with vm_state deleted and task_state None.
Aug 15 05:54:07 user nova-compute[73391]: DEBUG nova.compute.manager [req-dd9edd7b-c3a6-4f17-8084-ba0f8387593d req-85560cee-03a1-4f81-a78b-27ddc7243567 service nova] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Received event network-changed-99504223-260d-420c-b804-62b5a7de9592 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:54:07 user nova-compute[73391]: DEBUG nova.compute.manager [req-dd9edd7b-c3a6-4f17-8084-ba0f8387593d req-85560cee-03a1-4f81-a78b-27ddc7243567 service nova] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Refreshing instance network info cache due to event network-changed-99504223-260d-420c-b804-62b5a7de9592. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:54:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-dd9edd7b-c3a6-4f17-8084-ba0f8387593d req-85560cee-03a1-4f81-a78b-27ddc7243567 service nova] Acquiring lock "refresh_cache-0b14ae94-2a1e-4202-9676-e1ae1c996729" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:54:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-dd9edd7b-c3a6-4f17-8084-ba0f8387593d req-85560cee-03a1-4f81-a78b-27ddc7243567 service nova] Acquired lock "refresh_cache-0b14ae94-2a1e-4202-9676-e1ae1c996729" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:54:07 user nova-compute[73391]: DEBUG nova.network.neutron [req-dd9edd7b-c3a6-4f17-8084-ba0f8387593d req-85560cee-03a1-4f81-a78b-27ddc7243567 service nova] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Refreshing network info cache for port 99504223-260d-420c-b804-62b5a7de9592 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:54:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-fda62595-aa46-42bc-bd0b-b29b9fdea771 tempest-VolumesNegativeTest-1848425558 tempest-VolumesNegativeTest-1848425558-project-member] Lock "a7f591b9-7028-431d-aacc-9725767d8e1d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.602s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:54:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-606db823-0453-4f20-840b-8d6eda2aef0a tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Acquiring lock "0b14ae94-2a1e-4202-9676-e1ae1c996729" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:54:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-606db823-0453-4f20-840b-8d6eda2aef0a tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "0b14ae94-2a1e-4202-9676-e1ae1c996729" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:54:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-606db823-0453-4f20-840b-8d6eda2aef0a tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Acquiring lock "0b14ae94-2a1e-4202-9676-e1ae1c996729-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:54:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-606db823-0453-4f20-840b-8d6eda2aef0a tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "0b14ae94-2a1e-4202-9676-e1ae1c996729-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:54:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-606db823-0453-4f20-840b-8d6eda2aef0a tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "0b14ae94-2a1e-4202-9676-e1ae1c996729-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:54:07 user nova-compute[73391]: INFO nova.compute.manager [None req-606db823-0453-4f20-840b-8d6eda2aef0a tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Terminating instance
Aug 15 05:54:07 user nova-compute[73391]: DEBUG nova.compute.manager [None req-606db823-0453-4f20-840b-8d6eda2aef0a tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Start destroying the instance on the hypervisor. {{(pid=73391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 05:54:07 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:54:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:54:08 user nova-compute[73391]: DEBUG nova.network.neutron [req-dd9edd7b-c3a6-4f17-8084-ba0f8387593d req-85560cee-03a1-4f81-a78b-27ddc7243567 service nova] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Updated VIF entry in instance network info cache for port 99504223-260d-420c-b804-62b5a7de9592. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:54:08 user nova-compute[73391]: DEBUG nova.network.neutron [req-dd9edd7b-c3a6-4f17-8084-ba0f8387593d req-85560cee-03a1-4f81-a78b-27ddc7243567 service nova] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Updating instance_info_cache with network_info: [{"id": "99504223-260d-420c-b804-62b5a7de9592", "address": "fa:16:3e:a3:fd:a4", "network": {"id": "bc2718a2-a5ab-44e0-966d-9b180a30ac75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1022668030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.190", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8086add121594fe8a0bdde99dd9cae90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99504223-26", "ovs_interfaceid": "99504223-260d-420c-b804-62b5a7de9592", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:54:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-dd9edd7b-c3a6-4f17-8084-ba0f8387593d req-85560cee-03a1-4f81-a78b-27ddc7243567 service nova] Releasing lock "refresh_cache-0b14ae94-2a1e-4202-9676-e1ae1c996729" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:54:08 user nova-compute[73391]: DEBUG nova.compute.manager [req-dd9edd7b-c3a6-4f17-8084-ba0f8387593d req-85560cee-03a1-4f81-a78b-27ddc7243567 service nova] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Received event network-vif-plugged-32d1f42a-cab6-41ee-ae14-2cf842756259 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:54:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-dd9edd7b-c3a6-4f17-8084-ba0f8387593d req-85560cee-03a1-4f81-a78b-27ddc7243567 service nova] Acquiring lock "a7f591b9-7028-431d-aacc-9725767d8e1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:54:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-dd9edd7b-c3a6-4f17-8084-ba0f8387593d req-85560cee-03a1-4f81-a78b-27ddc7243567 service nova] Lock "a7f591b9-7028-431d-aacc-9725767d8e1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:54:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-dd9edd7b-c3a6-4f17-8084-ba0f8387593d req-85560cee-03a1-4f81-a78b-27ddc7243567 service nova] Lock "a7f591b9-7028-431d-aacc-9725767d8e1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:54:08 user nova-compute[73391]: DEBUG nova.compute.manager [req-dd9edd7b-c3a6-4f17-8084-ba0f8387593d req-85560cee-03a1-4f81-a78b-27ddc7243567 service nova] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] No waiting events found dispatching network-vif-plugged-32d1f42a-cab6-41ee-ae14-2cf842756259 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:54:08 user nova-compute[73391]: WARNING nova.compute.manager [req-dd9edd7b-c3a6-4f17-8084-ba0f8387593d req-85560cee-03a1-4f81-a78b-27ddc7243567 service nova] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Received unexpected event network-vif-plugged-32d1f42a-cab6-41ee-ae14-2cf842756259 for instance with vm_state deleted and task_state None.
Aug 15 05:54:08 user nova-compute[73391]: DEBUG nova.compute.manager [req-dd9edd7b-c3a6-4f17-8084-ba0f8387593d req-85560cee-03a1-4f81-a78b-27ddc7243567 service nova] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Received event network-vif-plugged-32d1f42a-cab6-41ee-ae14-2cf842756259 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:54:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-dd9edd7b-c3a6-4f17-8084-ba0f8387593d req-85560cee-03a1-4f81-a78b-27ddc7243567 service nova] Acquiring lock "a7f591b9-7028-431d-aacc-9725767d8e1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:54:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-dd9edd7b-c3a6-4f17-8084-ba0f8387593d req-85560cee-03a1-4f81-a78b-27ddc7243567 service nova] Lock "a7f591b9-7028-431d-aacc-9725767d8e1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:54:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-dd9edd7b-c3a6-4f17-8084-ba0f8387593d req-85560cee-03a1-4f81-a78b-27ddc7243567 service nova] Lock "a7f591b9-7028-431d-aacc-9725767d8e1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:54:08 user nova-compute[73391]: DEBUG nova.compute.manager [req-dd9edd7b-c3a6-4f17-8084-ba0f8387593d req-85560cee-03a1-4f81-a78b-27ddc7243567 service nova] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] No waiting events found dispatching network-vif-plugged-32d1f42a-cab6-41ee-ae14-2cf842756259 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:54:08 user nova-compute[73391]: WARNING nova.compute.manager [req-dd9edd7b-c3a6-4f17-8084-ba0f8387593d req-85560cee-03a1-4f81-a78b-27ddc7243567 service nova] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Received unexpected event network-vif-plugged-32d1f42a-cab6-41ee-ae14-2cf842756259 for instance with vm_state deleted and task_state None.
Aug 15 05:54:08 user nova-compute[73391]: DEBUG nova.compute.manager [req-dd9edd7b-c3a6-4f17-8084-ba0f8387593d req-85560cee-03a1-4f81-a78b-27ddc7243567 service nova] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Received event network-vif-unplugged-32d1f42a-cab6-41ee-ae14-2cf842756259 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:54:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-dd9edd7b-c3a6-4f17-8084-ba0f8387593d req-85560cee-03a1-4f81-a78b-27ddc7243567 service nova] Acquiring lock "a7f591b9-7028-431d-aacc-9725767d8e1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:54:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-dd9edd7b-c3a6-4f17-8084-ba0f8387593d req-85560cee-03a1-4f81-a78b-27ddc7243567 service nova] Lock "a7f591b9-7028-431d-aacc-9725767d8e1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:54:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-dd9edd7b-c3a6-4f17-8084-ba0f8387593d req-85560cee-03a1-4f81-a78b-27ddc7243567 service nova] Lock "a7f591b9-7028-431d-aacc-9725767d8e1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:54:08 user nova-compute[73391]: DEBUG nova.compute.manager [req-dd9edd7b-c3a6-4f17-8084-ba0f8387593d req-85560cee-03a1-4f81-a78b-27ddc7243567 service nova] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] No waiting events found dispatching network-vif-unplugged-32d1f42a-cab6-41ee-ae14-2cf842756259 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:54:08 user nova-compute[73391]: WARNING nova.compute.manager [req-dd9edd7b-c3a6-4f17-8084-ba0f8387593d req-85560cee-03a1-4f81-a78b-27ddc7243567 service nova] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Received unexpected event network-vif-unplugged-32d1f42a-cab6-41ee-ae14-2cf842756259 for instance with vm_state deleted and task_state None.
Aug 15 05:54:08 user nova-compute[73391]: DEBUG nova.compute.manager [req-dd9edd7b-c3a6-4f17-8084-ba0f8387593d req-85560cee-03a1-4f81-a78b-27ddc7243567 service nova] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Received event network-vif-plugged-32d1f42a-cab6-41ee-ae14-2cf842756259 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:54:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-dd9edd7b-c3a6-4f17-8084-ba0f8387593d req-85560cee-03a1-4f81-a78b-27ddc7243567 service nova] Acquiring lock "a7f591b9-7028-431d-aacc-9725767d8e1d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:54:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-dd9edd7b-c3a6-4f17-8084-ba0f8387593d req-85560cee-03a1-4f81-a78b-27ddc7243567 service nova] Lock "a7f591b9-7028-431d-aacc-9725767d8e1d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:54:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-dd9edd7b-c3a6-4f17-8084-ba0f8387593d req-85560cee-03a1-4f81-a78b-27ddc7243567 service nova] Lock "a7f591b9-7028-431d-aacc-9725767d8e1d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:54:08 user nova-compute[73391]: DEBUG nova.compute.manager [req-dd9edd7b-c3a6-4f17-8084-ba0f8387593d req-85560cee-03a1-4f81-a78b-27ddc7243567 service nova] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] No waiting events found dispatching network-vif-plugged-32d1f42a-cab6-41ee-ae14-2cf842756259 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:54:08 user nova-compute[73391]: WARNING nova.compute.manager [req-dd9edd7b-c3a6-4f17-8084-ba0f8387593d req-85560cee-03a1-4f81-a78b-27ddc7243567 service nova] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Received unexpected event network-vif-plugged-32d1f42a-cab6-41ee-ae14-2cf842756259 for instance with vm_state deleted and task_state None.
Aug 15 05:54:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:54:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:54:08 user nova-compute[73391]: DEBUG nova.compute.manager [req-ab757551-d12b-4a01-8e3e-4059f4d23926 req-3c2a8a97-6308-4638-a18a-177289e021c9 service nova] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Received event network-vif-unplugged-99504223-260d-420c-b804-62b5a7de9592 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:54:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ab757551-d12b-4a01-8e3e-4059f4d23926 req-3c2a8a97-6308-4638-a18a-177289e021c9 service nova] Acquiring lock "0b14ae94-2a1e-4202-9676-e1ae1c996729-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:54:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ab757551-d12b-4a01-8e3e-4059f4d23926 req-3c2a8a97-6308-4638-a18a-177289e021c9 service nova] Lock "0b14ae94-2a1e-4202-9676-e1ae1c996729-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:54:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ab757551-d12b-4a01-8e3e-4059f4d23926 req-3c2a8a97-6308-4638-a18a-177289e021c9 service nova] Lock "0b14ae94-2a1e-4202-9676-e1ae1c996729-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:54:08 user nova-compute[73391]: DEBUG nova.compute.manager [req-ab757551-d12b-4a01-8e3e-4059f4d23926 req-3c2a8a97-6308-4638-a18a-177289e021c9 service nova] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] No waiting events found dispatching network-vif-unplugged-99504223-260d-420c-b804-62b5a7de9592 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:54:08 user nova-compute[73391]: DEBUG nova.compute.manager [req-ab757551-d12b-4a01-8e3e-4059f4d23926 req-3c2a8a97-6308-4638-a18a-177289e021c9 service nova] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Received event network-vif-unplugged-99504223-260d-420c-b804-62b5a7de9592 for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 05:54:08 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Instance destroyed successfully.
Aug 15 05:54:08 user nova-compute[73391]: DEBUG nova.objects.instance [None req-606db823-0453-4f20-840b-8d6eda2aef0a tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lazy-loading 'resources' on Instance uuid 0b14ae94-2a1e-4202-9676-e1ae1c996729 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:54:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-606db823-0453-4f20-840b-8d6eda2aef0a tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:52:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-580057320',display_name='tempest-AttachVolumeNegativeTest-server-580057320',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-580057320',id=42,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJt0+6930J72EYFBgaP4BWbuf/K4PsIWS9cnonjXjJbH40mXM7+brQsgKb5SEE0gKl60e2aB5RYRm/Lq0AVW7zsLtcv+k7ieJPmvsJjQ9Lhj0vRP+RIUpBInkGtCEaxNiQ==',key_name='tempest-keypair-496769485',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:52:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8086add121594fe8a0bdde99dd9cae90',ramdisk_id='',reservation_id='r-4oxvvamf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1479702824',owner_user_name='tempest-AttachVolumeNegativeTest-1479702824-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:52:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9552a83a6a214c149ddceac64ccbdef6',uuid=0b14ae94-2a1e-4202-9676-e1ae1c996729,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99504223-260d-420c-b804-62b5a7de9592", "address": "fa:16:3e:a3:fd:a4", "network": {"id": "bc2718a2-a5ab-44e0-966d-9b180a30ac75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1022668030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8086add121594fe8a0bdde99dd9cae90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99504223-26", "ovs_interfaceid": "99504223-260d-420c-b804-62b5a7de9592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:54:08 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-606db823-0453-4f20-840b-8d6eda2aef0a tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Converting VIF {"id": "99504223-260d-420c-b804-62b5a7de9592", "address": "fa:16:3e:a3:fd:a4", "network": {"id": "bc2718a2-a5ab-44e0-966d-9b180a30ac75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1022668030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8086add121594fe8a0bdde99dd9cae90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap99504223-26", "ovs_interfaceid": "99504223-260d-420c-b804-62b5a7de9592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:54:08 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-606db823-0453-4f20-840b-8d6eda2aef0a tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:fd:a4,bridge_name='br-int',has_traffic_filtering=True,id=99504223-260d-420c-b804-62b5a7de9592,network=Network(bc2718a2-a5ab-44e0-966d-9b180a30ac75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99504223-26') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:54:08 user nova-compute[73391]: DEBUG os_vif [None req-606db823-0453-4f20-840b-8d6eda2aef0a tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:fd:a4,bridge_name='br-int',has_traffic_filtering=True,id=99504223-260d-420c-b804-62b5a7de9592,network=Network(bc2718a2-a5ab-44e0-966d-9b180a30ac75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99504223-26') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:54:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:54:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap99504223-26, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:54:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:54:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:54:08 user nova-compute[73391]: INFO os_vif [None req-606db823-0453-4f20-840b-8d6eda2aef0a tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:fd:a4,bridge_name='br-int',has_traffic_filtering=True,id=99504223-260d-420c-b804-62b5a7de9592,network=Network(bc2718a2-a5ab-44e0-966d-9b180a30ac75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap99504223-26')
Aug 15 05:54:08 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-606db823-0453-4f20-840b-8d6eda2aef0a tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Deleting instance files /opt/stack/data/nova/instances/0b14ae94-2a1e-4202-9676-e1ae1c996729_del
Aug 15 05:54:08 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-606db823-0453-4f20-840b-8d6eda2aef0a tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Deletion of /opt/stack/data/nova/instances/0b14ae94-2a1e-4202-9676-e1ae1c996729_del complete
Aug 15 05:54:08 user nova-compute[73391]: INFO nova.compute.manager [None req-606db823-0453-4f20-840b-8d6eda2aef0a tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Took 0.73 seconds to destroy the instance on the hypervisor.
Aug 15 05:54:08 user nova-compute[73391]: DEBUG oslo.service.loopingcall [None req-606db823-0453-4f20-840b-8d6eda2aef0a tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 05:54:08 user nova-compute[73391]: DEBUG nova.compute.manager [-] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Deallocating network for instance {{(pid=73391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 05:54:08 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] deallocate_for_instance() {{(pid=73391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 05:54:09 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:54:09 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Took 0.95 seconds to deallocate network for instance.
Aug 15 05:54:09 user nova-compute[73391]: DEBUG nova.compute.manager [req-7f93a5cc-d78c-4fd8-9f14-0467dc400049 req-837c4b77-5bdb-4250-8ce0-d35695c7112b service nova] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Received event network-vif-deleted-99504223-260d-420c-b804-62b5a7de9592 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:54:09 user nova-compute[73391]: INFO nova.compute.manager [req-7f93a5cc-d78c-4fd8-9f14-0467dc400049 req-837c4b77-5bdb-4250-8ce0-d35695c7112b service nova] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Neutron deleted interface 99504223-260d-420c-b804-62b5a7de9592; detaching it from the instance and deleting it from the info cache
Aug 15 05:54:09 user nova-compute[73391]: DEBUG nova.network.neutron [req-7f93a5cc-d78c-4fd8-9f14-0467dc400049 req-837c4b77-5bdb-4250-8ce0-d35695c7112b service nova] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:54:09 user nova-compute[73391]: DEBUG nova.compute.manager [req-7f93a5cc-d78c-4fd8-9f14-0467dc400049 req-837c4b77-5bdb-4250-8ce0-d35695c7112b service nova] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Detach interface failed, port_id=99504223-260d-420c-b804-62b5a7de9592, reason: Instance 0b14ae94-2a1e-4202-9676-e1ae1c996729 could not be found. {{(pid=73391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 05:54:09 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-606db823-0453-4f20-840b-8d6eda2aef0a tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:54:09 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-606db823-0453-4f20-840b-8d6eda2aef0a tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:54:09 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-606db823-0453-4f20-840b-8d6eda2aef0a tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:54:09 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-606db823-0453-4f20-840b-8d6eda2aef0a tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:54:09 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-606db823-0453-4f20-840b-8d6eda2aef0a tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.237s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:54:09 user nova-compute[73391]: INFO nova.scheduler.client.report [None req-606db823-0453-4f20-840b-8d6eda2aef0a tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Deleted allocations for instance 0b14ae94-2a1e-4202-9676-e1ae1c996729
Aug 15 05:54:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:54:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-606db823-0453-4f20-840b-8d6eda2aef0a tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "0b14ae94-2a1e-4202-9676-e1ae1c996729" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.117s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:54:10 user nova-compute[73391]: DEBUG nova.compute.manager [req-64b1921b-4ef0-4244-b22e-7275efb1434c req-480d6465-03d3-47cb-b61e-e6113c5f5613 service nova] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Received event network-vif-plugged-99504223-260d-420c-b804-62b5a7de9592 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:54:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-64b1921b-4ef0-4244-b22e-7275efb1434c req-480d6465-03d3-47cb-b61e-e6113c5f5613 service nova] Acquiring lock "0b14ae94-2a1e-4202-9676-e1ae1c996729-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:54:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-64b1921b-4ef0-4244-b22e-7275efb1434c req-480d6465-03d3-47cb-b61e-e6113c5f5613 service nova] Lock "0b14ae94-2a1e-4202-9676-e1ae1c996729-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:54:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-64b1921b-4ef0-4244-b22e-7275efb1434c req-480d6465-03d3-47cb-b61e-e6113c5f5613 service nova] Lock "0b14ae94-2a1e-4202-9676-e1ae1c996729-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:54:10 user nova-compute[73391]: DEBUG nova.compute.manager [req-64b1921b-4ef0-4244-b22e-7275efb1434c req-480d6465-03d3-47cb-b61e-e6113c5f5613 service nova] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] No waiting events found dispatching network-vif-plugged-99504223-260d-420c-b804-62b5a7de9592 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:54:10 user nova-compute[73391]: WARNING nova.compute.manager [req-64b1921b-4ef0-4244-b22e-7275efb1434c req-480d6465-03d3-47cb-b61e-e6113c5f5613 service nova] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Received unexpected event network-vif-plugged-99504223-260d-420c-b804-62b5a7de9592 for instance with vm_state deleted and task_state None.
Aug 15 05:54:13 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:54:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:54:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:54:19 user nova-compute[73391]: DEBUG nova.compute.manager [req-fb14a45f-c438-44b2-a78b-4be3994003bc req-afbebcd0-3a09-4d5d-8677-8e434c8da358 service nova] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Received event network-changed-164663cf-1c4f-4166-86e2-465351cdaaea {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:54:19 user nova-compute[73391]: DEBUG nova.compute.manager [req-fb14a45f-c438-44b2-a78b-4be3994003bc req-afbebcd0-3a09-4d5d-8677-8e434c8da358 service nova] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Refreshing instance network info cache due to event network-changed-164663cf-1c4f-4166-86e2-465351cdaaea. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:54:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-fb14a45f-c438-44b2-a78b-4be3994003bc req-afbebcd0-3a09-4d5d-8677-8e434c8da358 service nova] Acquiring lock "refresh_cache-f730e539-5371-49d7-8487-d94f400fe0bc" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:54:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-fb14a45f-c438-44b2-a78b-4be3994003bc req-afbebcd0-3a09-4d5d-8677-8e434c8da358 service nova] Acquired lock "refresh_cache-f730e539-5371-49d7-8487-d94f400fe0bc" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:54:19 user nova-compute[73391]: DEBUG nova.network.neutron [req-fb14a45f-c438-44b2-a78b-4be3994003bc req-afbebcd0-3a09-4d5d-8677-8e434c8da358 service nova] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Refreshing network info cache for port 164663cf-1c4f-4166-86e2-465351cdaaea {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:54:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7285caab-3e35-4626-a63f-4eeff2d4dd47 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Acquiring lock "8ff2da51-5bfd-4cdc-8cef-330cdef93d97" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:54:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7285caab-3e35-4626-a63f-4eeff2d4dd47 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "8ff2da51-5bfd-4cdc-8cef-330cdef93d97" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:54:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7285caab-3e35-4626-a63f-4eeff2d4dd47 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Acquiring lock "8ff2da51-5bfd-4cdc-8cef-330cdef93d97-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:54:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7285caab-3e35-4626-a63f-4eeff2d4dd47 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "8ff2da51-5bfd-4cdc-8cef-330cdef93d97-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:54:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7285caab-3e35-4626-a63f-4eeff2d4dd47 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "8ff2da51-5bfd-4cdc-8cef-330cdef93d97-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:54:19 user nova-compute[73391]: INFO nova.compute.manager [None req-7285caab-3e35-4626-a63f-4eeff2d4dd47 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Terminating instance
Aug 15 05:54:19 user nova-compute[73391]: DEBUG nova.compute.manager [None req-7285caab-3e35-4626-a63f-4eeff2d4dd47 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Start destroying the instance on the hypervisor. {{(pid=73391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 05:54:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:54:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:54:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:54:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:54:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:54:20 user nova-compute[73391]: DEBUG nova.compute.manager [req-9ca87dc1-6b3e-4107-b161-99ae9fca0df2 req-74539caa-7f58-4474-9189-3d1f6de18e4f service nova] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Received event network-vif-unplugged-075b72cf-5f6f-443c-a0e1-dd3744944e5b {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:54:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-9ca87dc1-6b3e-4107-b161-99ae9fca0df2 req-74539caa-7f58-4474-9189-3d1f6de18e4f service nova] Acquiring lock "8ff2da51-5bfd-4cdc-8cef-330cdef93d97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:54:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-9ca87dc1-6b3e-4107-b161-99ae9fca0df2 req-74539caa-7f58-4474-9189-3d1f6de18e4f service nova] Lock "8ff2da51-5bfd-4cdc-8cef-330cdef93d97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:54:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-9ca87dc1-6b3e-4107-b161-99ae9fca0df2 req-74539caa-7f58-4474-9189-3d1f6de18e4f service nova] Lock "8ff2da51-5bfd-4cdc-8cef-330cdef93d97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:54:20 user nova-compute[73391]: DEBUG nova.compute.manager [req-9ca87dc1-6b3e-4107-b161-99ae9fca0df2 req-74539caa-7f58-4474-9189-3d1f6de18e4f service nova] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] No waiting events found dispatching network-vif-unplugged-075b72cf-5f6f-443c-a0e1-dd3744944e5b {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:54:20 user nova-compute[73391]: DEBUG nova.compute.manager [req-9ca87dc1-6b3e-4107-b161-99ae9fca0df2 req-74539caa-7f58-4474-9189-3d1f6de18e4f service nova] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Received event network-vif-unplugged-075b72cf-5f6f-443c-a0e1-dd3744944e5b for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 05:54:20 user nova-compute[73391]: DEBUG nova.network.neutron [req-fb14a45f-c438-44b2-a78b-4be3994003bc req-afbebcd0-3a09-4d5d-8677-8e434c8da358 service nova] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Updated VIF entry in instance network info cache for port 164663cf-1c4f-4166-86e2-465351cdaaea. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:54:20 user nova-compute[73391]: DEBUG nova.network.neutron [req-fb14a45f-c438-44b2-a78b-4be3994003bc req-afbebcd0-3a09-4d5d-8677-8e434c8da358 service nova] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Updating instance_info_cache with network_info: [{"id": "164663cf-1c4f-4166-86e2-465351cdaaea", "address": "fa:16:3e:83:de:e8", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap164663cf-1c", "ovs_interfaceid": "164663cf-1c4f-4166-86e2-465351cdaaea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:54:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-fb14a45f-c438-44b2-a78b-4be3994003bc req-afbebcd0-3a09-4d5d-8677-8e434c8da358 service nova] Releasing lock "refresh_cache-f730e539-5371-49d7-8487-d94f400fe0bc" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:54:20 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Instance destroyed successfully.
Aug 15 05:54:20 user nova-compute[73391]: DEBUG nova.objects.instance [None req-7285caab-3e35-4626-a63f-4eeff2d4dd47 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lazy-loading 'resources' on Instance uuid 8ff2da51-5bfd-4cdc-8cef-330cdef93d97 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:54:20 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-7285caab-3e35-4626-a63f-4eeff2d4dd47 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:37:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-43235834',display_name='tempest-ServerRescueNegativeTestJSON-server-43235834',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-43235834',id=25,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:39:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5a7da9448cc34b609120da564a01dba4',ramdisk_id='',reservation_id='r-yhbtlwt4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1933442633',owner_user_name='tempest-ServerRescueNegativeTestJSON-1933442633-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:39:48Z,user_data=None,user_id='1f0f5888b8c44188a17202fad2725256',uuid=8ff2da51-5bfd-4cdc-8cef-330cdef93d97,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "075b72cf-5f6f-443c-a0e1-dd3744944e5b", "address": "fa:16:3e:88:63:d4", "network": {"id": "bec69c6a-b2cb-4b0a-ba6e-ae6dae099818", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7da9448cc34b609120da564a01dba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap075b72cf-5f", "ovs_interfaceid": "075b72cf-5f6f-443c-a0e1-dd3744944e5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:54:20 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-7285caab-3e35-4626-a63f-4eeff2d4dd47 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Converting VIF {"id": "075b72cf-5f6f-443c-a0e1-dd3744944e5b", "address": "fa:16:3e:88:63:d4", "network": {"id": "bec69c6a-b2cb-4b0a-ba6e-ae6dae099818", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7da9448cc34b609120da564a01dba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap075b72cf-5f", "ovs_interfaceid": "075b72cf-5f6f-443c-a0e1-dd3744944e5b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:54:20 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-7285caab-3e35-4626-a63f-4eeff2d4dd47 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:63:d4,bridge_name='br-int',has_traffic_filtering=True,id=075b72cf-5f6f-443c-a0e1-dd3744944e5b,network=Network(bec69c6a-b2cb-4b0a-ba6e-ae6dae099818),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap075b72cf-5f') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:54:20 user nova-compute[73391]: DEBUG os_vif [None req-7285caab-3e35-4626-a63f-4eeff2d4dd47 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:63:d4,bridge_name='br-int',has_traffic_filtering=True,id=075b72cf-5f6f-443c-a0e1-dd3744944e5b,network=Network(bec69c6a-b2cb-4b0a-ba6e-ae6dae099818),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap075b72cf-5f') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:54:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:54:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap075b72cf-5f, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:54:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:54:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:54:20 user nova-compute[73391]: INFO os_vif [None req-7285caab-3e35-4626-a63f-4eeff2d4dd47 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:63:d4,bridge_name='br-int',has_traffic_filtering=True,id=075b72cf-5f6f-443c-a0e1-dd3744944e5b,network=Network(bec69c6a-b2cb-4b0a-ba6e-ae6dae099818),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap075b72cf-5f')
Aug 15 05:54:20 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-7285caab-3e35-4626-a63f-4eeff2d4dd47 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Deleting instance files /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97_del
Aug 15 05:54:20 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-7285caab-3e35-4626-a63f-4eeff2d4dd47 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Deletion of /opt/stack/data/nova/instances/8ff2da51-5bfd-4cdc-8cef-330cdef93d97_del complete
Aug 15 05:54:20 user nova-compute[73391]: INFO nova.compute.manager [None req-7285caab-3e35-4626-a63f-4eeff2d4dd47 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Took 0.89 seconds to destroy the instance on the hypervisor.
Aug 15 05:54:20 user nova-compute[73391]: DEBUG oslo.service.loopingcall [None req-7285caab-3e35-4626-a63f-4eeff2d4dd47 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 05:54:20 user nova-compute[73391]: DEBUG nova.compute.manager [-] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Deallocating network for instance {{(pid=73391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 05:54:20 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] deallocate_for_instance() {{(pid=73391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 05:54:20 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692078845.9073231, a7f591b9-7028-431d-aacc-9725767d8e1d => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:54:20 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] VM Stopped (Lifecycle Event)
Aug 15 05:54:20 user nova-compute[73391]: DEBUG nova.compute.manager [None req-e0a708ef-b015-4d73-9035-11dc5e1c888c None None] [instance: a7f591b9-7028-431d-aacc-9725767d8e1d] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:54:21 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:54:21 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Took 0.55 seconds to deallocate network for instance.
Aug 15 05:54:21 user nova-compute[73391]: DEBUG nova.compute.manager [req-a3c14c52-847c-4149-ad8e-710288450486 req-434e5368-bd38-480e-8ff8-41ca2240c030 service nova] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Received event network-vif-deleted-075b72cf-5f6f-443c-a0e1-dd3744944e5b {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:54:21 user nova-compute[73391]: INFO nova.compute.manager [req-a3c14c52-847c-4149-ad8e-710288450486 req-434e5368-bd38-480e-8ff8-41ca2240c030 service nova] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Neutron deleted interface 075b72cf-5f6f-443c-a0e1-dd3744944e5b; detaching it from the instance and deleting it from the info cache
Aug 15 05:54:21 user nova-compute[73391]: DEBUG nova.network.neutron [req-a3c14c52-847c-4149-ad8e-710288450486 req-434e5368-bd38-480e-8ff8-41ca2240c030 service nova] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:54:21 user nova-compute[73391]: DEBUG nova.compute.manager [req-a3c14c52-847c-4149-ad8e-710288450486 req-434e5368-bd38-480e-8ff8-41ca2240c030 service nova] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Detach interface failed, port_id=075b72cf-5f6f-443c-a0e1-dd3744944e5b, reason: Instance 8ff2da51-5bfd-4cdc-8cef-330cdef93d97 could not be found. {{(pid=73391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 05:54:21 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7285caab-3e35-4626-a63f-4eeff2d4dd47 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:54:21 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7285caab-3e35-4626-a63f-4eeff2d4dd47 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:54:21 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-7285caab-3e35-4626-a63f-4eeff2d4dd47 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:54:21 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-7285caab-3e35-4626-a63f-4eeff2d4dd47 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:54:21 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7285caab-3e35-4626-a63f-4eeff2d4dd47 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.203s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:54:21 user nova-compute[73391]: INFO nova.scheduler.client.report [None req-7285caab-3e35-4626-a63f-4eeff2d4dd47 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Deleted allocations for instance 8ff2da51-5bfd-4cdc-8cef-330cdef93d97
Aug 15 05:54:21 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7285caab-3e35-4626-a63f-4eeff2d4dd47 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "8ff2da51-5bfd-4cdc-8cef-330cdef93d97" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.829s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:54:22 user nova-compute[73391]: DEBUG nova.compute.manager [req-462dc69d-61d8-46e6-aa7d-ea1b72699078 req-93cdbce1-8c4f-458a-b690-4083e0083d1d service nova] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Received event network-vif-plugged-075b72cf-5f6f-443c-a0e1-dd3744944e5b {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:54:22 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-462dc69d-61d8-46e6-aa7d-ea1b72699078 req-93cdbce1-8c4f-458a-b690-4083e0083d1d service nova] Acquiring lock "8ff2da51-5bfd-4cdc-8cef-330cdef93d97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:54:22 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-462dc69d-61d8-46e6-aa7d-ea1b72699078 req-93cdbce1-8c4f-458a-b690-4083e0083d1d service nova] Lock "8ff2da51-5bfd-4cdc-8cef-330cdef93d97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:54:22 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-462dc69d-61d8-46e6-aa7d-ea1b72699078 req-93cdbce1-8c4f-458a-b690-4083e0083d1d service nova] Lock "8ff2da51-5bfd-4cdc-8cef-330cdef93d97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:54:22 user nova-compute[73391]: DEBUG nova.compute.manager [req-462dc69d-61d8-46e6-aa7d-ea1b72699078 req-93cdbce1-8c4f-458a-b690-4083e0083d1d service nova] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] No waiting events found dispatching network-vif-plugged-075b72cf-5f6f-443c-a0e1-dd3744944e5b {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:54:22 user nova-compute[73391]: WARNING nova.compute.manager [req-462dc69d-61d8-46e6-aa7d-ea1b72699078 req-93cdbce1-8c4f-458a-b690-4083e0083d1d service nova] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Received unexpected event network-vif-plugged-075b72cf-5f6f-443c-a0e1-dd3744944e5b for instance with vm_state deleted and task_state None.
Aug 15 05:54:23 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692078848.5129538, 0b14ae94-2a1e-4202-9676-e1ae1c996729 => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:54:23 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] VM Stopped (Lifecycle Event)
Aug 15 05:54:23 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bdefeb5-4abf-48e2-baeb-8f0c3d55ddcc None None] [instance: 0b14ae94-2a1e-4202-9676-e1ae1c996729] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:54:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:54:25 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:54:25 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:54:27 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:54:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:54:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:54:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:54:27 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Auditing locally available compute resources for user (node: user) {{(pid=73391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 05:54:27 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:54:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:54:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:54:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:54:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:54:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:54:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:54:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:54:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:54:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:54:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/disk.rescue --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:54:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:54:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/disk.rescue --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:54:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:54:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/134610fb-ed36-4ecb-a884-a26febb7943d/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:54:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/134610fb-ed36-4ecb-a884-a26febb7943d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:54:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/134610fb-ed36-4ecb-a884-a26febb7943d/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:54:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/134610fb-ed36-4ecb-a884-a26febb7943d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:54:29 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:54:29 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:54:29 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:54:29 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Hypervisor/Node resource view: name=user free_ram=8240MB free_disk=25.039386749267578GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 05:54:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:54:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:54:29 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 730890c6-6999-4a0f-b80c-e4745bff99ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:54:29 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 3adc0c85-0f31-4a73-8b98-eb1a4b32434d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:54:29 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 134610fb-ed36-4ecb-a884-a26febb7943d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:54:29 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance f730e539-5371-49d7-8487-d94f400fe0bc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:54:29 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 05:54:29 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 05:54:29 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:54:30 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:54:30 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:54:30 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Compute_service record updated for user:user {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 05:54:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.278s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:54:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:54:32 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:54:32 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:54:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "5a5cbbb3-3b78-48b5-9eee-342f52f1fc22" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:54:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "5a5cbbb3-3b78-48b5-9eee-342f52f1fc22" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:54:32 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:54:32 user nova-compute[73391]: DEBUG nova.compute.manager [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Starting instance... {{(pid=73391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 05:54:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:54:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:54:32 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 05:54:32 user nova-compute[73391]: INFO nova.compute.claims [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Claim successful on node user
Aug 15 05:54:32 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:54:33 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:54:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.279s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:54:33 user nova-compute[73391]: DEBUG nova.compute.manager [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Start building networks asynchronously for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 05:54:33 user nova-compute[73391]: DEBUG nova.compute.manager [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Allocating IP information in the background. {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 05:54:33 user nova-compute[73391]: DEBUG nova.network.neutron [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] allocate_for_instance() {{(pid=73391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 05:54:33 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 05:54:33 user nova-compute[73391]: DEBUG nova.compute.manager [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Start building block device mappings for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 05:54:33 user nova-compute[73391]: INFO nova.virt.block_device [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Booting with volume a3a56eca-dd83-40fc-8e35-8b719d9eecbf at /dev/vda
Aug 15 05:54:33 user nova-compute[73391]: DEBUG nova.policy [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'aefb6ccab586465dbe56e71a40bcf1f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a8188c2e8ca34ef1982faa49f1058bb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73391) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 05:54:33 user nova-compute[73391]: DEBUG os_brick.utils [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:54:33 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:54:33 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:54:33 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4ac88c-ef71-4355-90b9-10330bbb9f04]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:54:33 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:54:33 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:54:33 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[310d4b30-9b8e-44b4-8326-e6dfc2bda6cc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:54:33 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:54:33 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:54:33 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6802975c-44b3-4d84-a587-abb8d80a6470]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:54:33 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b59d15-a8b3-4a33-95c9-4b7f79b4e094]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:54:33 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:54:33 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:54:33 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 05:54:33 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:54:33 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:54:33 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 05:54:33 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0fe9bd-e091-465d-8bd4-561871e35127]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:54:33 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 05:54:33 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 05:54:33 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 05:54:33 user nova-compute[73391]: DEBUG os_brick.utils [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:54:33 user nova-compute[73391]: DEBUG nova.virt.block_device [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Updating existing volume attachment record: df3490b7-14bd-4697-afbd-b42fb9c4a324 {{(pid=73391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 05:54:33 user nova-compute[73391]: DEBUG nova.network.neutron [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Successfully created port: 4e6843fd-6378-4865-b416-719c63f81bc5 {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 05:54:34 user nova-compute[73391]: DEBUG nova.network.neutron [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Successfully updated port: 4e6843fd-6378-4865-b416-719c63f81bc5 {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:54:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "refresh_cache-5a5cbbb3-3b78-48b5-9eee-342f52f1fc22" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:54:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquired lock "refresh_cache-5a5cbbb3-3b78-48b5-9eee-342f52f1fc22" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:54:34 user nova-compute[73391]: DEBUG nova.network.neutron [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:54:34 user nova-compute[73391]: DEBUG nova.compute.manager [req-917c2c69-7c58-4689-9584-7e788161a608 req-d373c671-b457-48f3-a727-fc4ad1aadd65 service nova] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Received event network-changed-4e6843fd-6378-4865-b416-719c63f81bc5 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:54:34 user nova-compute[73391]: DEBUG nova.compute.manager [req-917c2c69-7c58-4689-9584-7e788161a608 req-d373c671-b457-48f3-a727-fc4ad1aadd65 service nova] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Refreshing instance network info cache due to event network-changed-4e6843fd-6378-4865-b416-719c63f81bc5. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:54:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-917c2c69-7c58-4689-9584-7e788161a608 req-d373c671-b457-48f3-a727-fc4ad1aadd65 service nova] Acquiring lock "refresh_cache-5a5cbbb3-3b78-48b5-9eee-342f52f1fc22" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:54:34 user nova-compute[73391]: DEBUG nova.network.neutron [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:54:34 user nova-compute[73391]: DEBUG nova.network.neutron [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Updating instance_info_cache with network_info: [{"id": "4e6843fd-6378-4865-b416-719c63f81bc5", "address": "fa:16:3e:2d:73:c6", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e6843fd-63", "ovs_interfaceid": "4e6843fd-6378-4865-b416-719c63f81bc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:54:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Releasing lock "refresh_cache-5a5cbbb3-3b78-48b5-9eee-342f52f1fc22" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:54:34 user nova-compute[73391]: DEBUG nova.compute.manager [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Instance network_info: |[{"id": "4e6843fd-6378-4865-b416-719c63f81bc5", "address": "fa:16:3e:2d:73:c6", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e6843fd-63", "ovs_interfaceid": "4e6843fd-6378-4865-b416-719c63f81bc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 05:54:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-917c2c69-7c58-4689-9584-7e788161a608 req-d373c671-b457-48f3-a727-fc4ad1aadd65 service nova] Acquired lock "refresh_cache-5a5cbbb3-3b78-48b5-9eee-342f52f1fc22" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:54:34 user nova-compute[73391]: DEBUG nova.network.neutron [req-917c2c69-7c58-4689-9584-7e788161a608 req-d373c671-b457-48f3-a727-fc4ad1aadd65 service nova] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Refreshing network info cache for port 4e6843fd-6378-4865-b416-719c63f81bc5 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:54:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:54:35 user nova-compute[73391]: DEBUG nova.network.neutron [req-917c2c69-7c58-4689-9584-7e788161a608 req-d373c671-b457-48f3-a727-fc4ad1aadd65 service nova] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Updated VIF entry in instance network info cache for port 4e6843fd-6378-4865-b416-719c63f81bc5. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:54:35 user nova-compute[73391]: DEBUG nova.network.neutron [req-917c2c69-7c58-4689-9584-7e788161a608 req-d373c671-b457-48f3-a727-fc4ad1aadd65 service nova] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Updating instance_info_cache with network_info: [{"id": "4e6843fd-6378-4865-b416-719c63f81bc5", "address": "fa:16:3e:2d:73:c6", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e6843fd-63", "ovs_interfaceid": "4e6843fd-6378-4865-b416-719c63f81bc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:54:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-917c2c69-7c58-4689-9584-7e788161a608 req-d373c671-b457-48f3-a727-fc4ad1aadd65 service nova] Releasing lock "refresh_cache-5a5cbbb3-3b78-48b5-9eee-342f52f1fc22" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:54:35 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692078860.6802685, 8ff2da51-5bfd-4cdc-8cef-330cdef93d97 => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:54:35 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] VM Stopped (Lifecycle Event)
Aug 15 05:54:35 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:54:35 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Starting heal instance info cache {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 05:54:35 user nova-compute[73391]: DEBUG nova.compute.manager [None req-bfffa9b2-c581-4128-b6c5-71bf2d03d864 None None] [instance: 8ff2da51-5bfd-4cdc-8cef-330cdef93d97] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:54:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:54:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "refresh_cache-3adc0c85-0f31-4a73-8b98-eb1a4b32434d" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:54:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquired lock "refresh_cache-3adc0c85-0f31-4a73-8b98-eb1a4b32434d" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:54:35 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Forcefully refreshing network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 05:54:36 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Updating instance_info_cache with network_info: [{"id": "95260c2c-bfa7-42c2-934b-af9874c68201", "address": "fa:16:3e:9e:93:8d", "network": {"id": "6444073e-0d7a-4ecd-a945-4cbbb6bf2c92", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1589197255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d6c4fcd171841d6b59b8b400efd0619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95260c2c-bf", "ovs_interfaceid": "95260c2c-bfa7-42c2-934b-af9874c68201", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:54:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Releasing lock "refresh_cache-3adc0c85-0f31-4a73-8b98-eb1a4b32434d" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:54:36 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Updated the network info_cache for instance {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 05:54:36 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:54:37 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:54:37 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 05:54:38 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:54:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG nova.compute.manager [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Start spawning the instance on the hypervisor. {{(pid=73391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Creating instance directory {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 05:54:42 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Creating image(s)
Aug 15 05:54:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Did not create local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Ensure instance console log exists: /opt/stack/data/nova/instances/5a5cbbb3-3b78-48b5-9eee-342f52f1fc22/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Start _get_guest_xml network_info=[{"id": "4e6843fd-6378-4865-b416-719c63f81bc5", "address": "fa:16:3e:2d:73:c6", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e6843fd-63", "ovs_interfaceid": "4e6843fd-6378-4865-b416-719c63f81bc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:a3a56eca-dd83-40fc-8e35-8b719d9eecbf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MwONctqp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5a5cbbb3-3b78-48b5-9eee-342f52f1fc22', 'attached_at': '', 'detached_at': '', 'volume_id': 'a3a56eca-dd83-40fc-8e35-8b719d9eecbf', 'serial': 'a3a56eca-dd83-40fc-8e35-8b719d9eecbf'}, 'attachment_id': 'df3490b7-14bd-4697-afbd-b42fb9c4a324', 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:54:42 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:54:42 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:54:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a3a56eca-dd83-40fc-8e35-8b719d9eecbf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MwONctqp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:54:42 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:54:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:54:42 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:54:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3a56eca-dd83-40fc-8e35-8b719d9eecbf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3a56eca-dd83-40fc-8e35-8b719d9eecbf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:54:42 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 05:54:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3a56eca-dd83-40fc-8e35-8b719d9eecbf -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3a56eca-dd83-40fc-8e35-8b719d9eecbf -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[262c656c-982c-4201-925b-70257b195f83]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 05:54:42 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3a56eca-dd83-40fc-8e35-8b719d9eecbf -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3a56eca-dd83-40fc-8e35-8b719d9eecbf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dea6fc6-191f-454d-abc8-f9181c106179]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3a56eca-dd83-40fc-8e35-8b719d9eecbf] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3a56eca-dd83-40fc-8e35-8b719d9eecbf] added
Aug 15 05:54:42 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3a56eca-dd83-40fc-8e35-8b719d9eecbf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3a56eca-dd83-40fc-8e35-8b719d9eecbf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2144d1a6-aebf-4712-a42e-3969d7fff90a]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3a56eca-dd83-40fc-8e35-8b719d9eecbf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3a56eca-dd83-40fc-8e35-8b719d9eecbf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be6b8bf-dfeb-434a-be85-bf8f583c180b]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3a56eca-dd83-40fc-8e35-8b719d9eecbf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MwONctqp {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3a56eca-dd83-40fc-8e35-8b719d9eecbf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MwONctqp" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ec3a0f-b8f5-4aae-9e89-8974103d9e9b]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MwONctqp'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3a56eca-dd83-40fc-8e35-8b719d9eecbf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3a56eca-dd83-40fc-8e35-8b719d9eecbf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[99de24a2-f125-46fd-858d-3e9f2ace0bb6]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb34cb2c-9abf-46dc-9bd7-edb5c81d285c]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de (non-flash)
Aug 15 05:54:42 user nova-compute[73391]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 (non-flash)
Aug 15 05:54:42 user nova-compute[73391]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a (non-flash)
Aug 15 05:54:42 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de (non-flash)
Aug 15 05:54:42 user nova-compute[73391]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 (non-flash)
Aug 15 05:54:42 user nova-compute[73391]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a (non-flash)
Aug 15 05:54:42 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3a56eca-dd83-40fc-8e35-8b719d9eecbf -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3a56eca-dd83-40fc-8e35-8b719d9eecbf -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f38a4ca-03f0-4153-9a2d-ec0abc7be829]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3a56eca-dd83-40fc-8e35-8b719d9eecbf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a3a56eca-dd83-40fc-8e35-8b719d9eecbf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3a56eca-dd83-40fc-8e35-8b719d9eecbf, portal: 172.16.0.220,3260]
Aug 15 05:54:42 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:a3a56eca-dd83-40fc-8e35-8b719d9eecbf, portal: 172.16.0.220,3260] successful.
Aug 15 05:54:42 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3a56eca-dd83-40fc-8e35-8b719d9eecbf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3a56eca-dd83-40fc-8e35-8b719d9eecbf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d91931-dd3a-4ae8-98f4-54faecb254ad]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c04a3b3-bca8-42b1-9183-d8175f3ed107]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a56eca-dd83-40fc-8e35-8b719d9eecbf (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de (non-flash)
Aug 15 05:54:42 user nova-compute[73391]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 (non-flash)
Aug 15 05:54:42 user nova-compute[73391]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a (non-flash)
Aug 15 05:54:42 user nova-compute[73391]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a56eca-dd83-40fc-8e35-8b719d9eecbf (non-flash)
Aug 15 05:54:42 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de (non-flash)
Aug 15 05:54:42 user nova-compute[73391]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 (non-flash)
Aug 15 05:54:42 user nova-compute[73391]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a (non-flash)
Aug 15 05:54:42 user nova-compute[73391]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a56eca-dd83-40fc-8e35-8b719d9eecbf (non-flash)
Aug 15 05:54:42 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3a56eca-dd83-40fc-8e35-8b719d9eecbf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] HCTL ('36', '-', '-', 0) found on session 57 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b06a587-da0b-44b9-97aa-622a000bfb76]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:54:42 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Searching for a device in session 57 and hctl ['36', '*', '*', 0] yield: None {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:54:43 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Searching for a device in session 57 and hctl ['36', '*', '*', 0] yield: sde {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:54:43 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Connected to sde using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MwONctqp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 05:54:43 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:54:43 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '26666623038323430', 'path': '/dev/sde'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:54:43 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666623038323430', 'path': '/dev/sde'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 05:54:43 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:54:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-538220195',display_name='tempest-TestVolumeBootPattern-server-538220195',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-538220195',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9jBoYjOy+aqM5q6fYRpW336xJnp1RjcA+ryp4UUPjXWPw7VtxeYktb68BzzUpanNxgDS13R1RxH4S+D0vqFMFtOkREwueXmREiQ22XqN9Aby3PDiDj1ii3iTWuJ+dFag==',key_name='tempest-TestVolumeBootPattern-1057822238',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8188c2e8ca34ef1982faa49f1058bb7',ramdisk_id='',reservation_id='r-90qekll3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1834029963',owner_user_name='tempest-TestVolumeBootPattern-1834029963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:54:33Z,user_data=None,user_id='aefb6ccab586465dbe56e71a40bcf1f0',uuid=5a5cbbb3-3b78-48b5-9eee-342f52f1fc22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e6843fd-6378-4865-b416-719c63f81bc5", "address": "fa:16:3e:2d:73:c6", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e6843fd-63", "ovs_interfaceid": "4e6843fd-6378-4865-b416-719c63f81bc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:54:43 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Converting VIF {"id": "4e6843fd-6378-4865-b416-719c63f81bc5", "address": "fa:16:3e:2d:73:c6", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e6843fd-63", "ovs_interfaceid": "4e6843fd-6378-4865-b416-719c63f81bc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:54:43 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:73:c6,bridge_name='br-int',has_traffic_filtering=True,id=4e6843fd-6378-4865-b416-719c63f81bc5,network=Network(fae0e46a-88e4-499d-bcff-5b7df55eab4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e6843fd-63') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:54:43 user nova-compute[73391]: DEBUG nova.objects.instance [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lazy-loading 'pci_devices' on Instance uuid 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:54:43 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:54:43 user nova-compute[73391]:   <uuid>5a5cbbb3-3b78-48b5-9eee-342f52f1fc22</uuid>
Aug 15 05:54:43 user nova-compute[73391]:   <name>instance-0000002d</name>
Aug 15 05:54:43 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:54:43 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:54:43 user nova-compute[73391]:   <metadata>
Aug 15 05:54:43 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:54:43 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:54:43 user nova-compute[73391]:       <nova:name>tempest-TestVolumeBootPattern-server-538220195</nova:name>
Aug 15 05:54:43 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:54:42</nova:creationTime>
Aug 15 05:54:43 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:54:43 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:54:43 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:54:43 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:54:43 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:54:43 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:54:43 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:54:43 user nova-compute[73391]:       <nova:owner>
Aug 15 05:54:43 user nova-compute[73391]:         <nova:user uuid="aefb6ccab586465dbe56e71a40bcf1f0">tempest-TestVolumeBootPattern-1834029963-project-member</nova:user>
Aug 15 05:54:43 user nova-compute[73391]:         <nova:project uuid="a8188c2e8ca34ef1982faa49f1058bb7">tempest-TestVolumeBootPattern-1834029963</nova:project>
Aug 15 05:54:43 user nova-compute[73391]:       </nova:owner>
Aug 15 05:54:43 user nova-compute[73391]:       <nova:ports>
Aug 15 05:54:43 user nova-compute[73391]:         <nova:port uuid="4e6843fd-6378-4865-b416-719c63f81bc5">
Aug 15 05:54:43 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 05:54:43 user nova-compute[73391]:         </nova:port>
Aug 15 05:54:43 user nova-compute[73391]:       </nova:ports>
Aug 15 05:54:43 user nova-compute[73391]:     </nova:instance>
Aug 15 05:54:43 user nova-compute[73391]:   </metadata>
Aug 15 05:54:43 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:54:43 user nova-compute[73391]:     <system>
Aug 15 05:54:43 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:54:43 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:54:43 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:54:43 user nova-compute[73391]:       <entry name="serial">5a5cbbb3-3b78-48b5-9eee-342f52f1fc22</entry>
Aug 15 05:54:43 user nova-compute[73391]:       <entry name="uuid">5a5cbbb3-3b78-48b5-9eee-342f52f1fc22</entry>
Aug 15 05:54:43 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:54:43 user nova-compute[73391]:     </system>
Aug 15 05:54:43 user nova-compute[73391]:   </sysinfo>
Aug 15 05:54:43 user nova-compute[73391]:   <os>
Aug 15 05:54:43 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:54:43 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:54:43 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:54:43 user nova-compute[73391]:   </os>
Aug 15 05:54:43 user nova-compute[73391]:   <features>
Aug 15 05:54:43 user nova-compute[73391]:     <acpi/>
Aug 15 05:54:43 user nova-compute[73391]:     <apic/>
Aug 15 05:54:43 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:54:43 user nova-compute[73391]:   </features>
Aug 15 05:54:43 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:54:43 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:54:43 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:54:43 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:54:43 user nova-compute[73391]:   </clock>
Aug 15 05:54:43 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:54:43 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:54:43 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:54:43 user nova-compute[73391]:   </cpu>
Aug 15 05:54:43 user nova-compute[73391]:   <devices>
Aug 15 05:54:43 user nova-compute[73391]:     <disk type="block" device="disk">
Aug 15 05:54:43 user nova-compute[73391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:54:43 user nova-compute[73391]:       <source dev="/dev/sde"/>
Aug 15 05:54:43 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:54:43 user nova-compute[73391]:       <serial>a3a56eca-dd83-40fc-8e35-8b719d9eecbf</serial>
Aug 15 05:54:43 user nova-compute[73391]:     </disk>
Aug 15 05:54:43 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:54:43 user nova-compute[73391]:       <mac address="fa:16:3e:2d:73:c6"/>
Aug 15 05:54:43 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:54:43 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:54:43 user nova-compute[73391]:       <target dev="tap4e6843fd-63"/>
Aug 15 05:54:43 user nova-compute[73391]:     </interface>
Aug 15 05:54:43 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:54:43 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/5a5cbbb3-3b78-48b5-9eee-342f52f1fc22/console.log" append="off"/>
Aug 15 05:54:43 user nova-compute[73391]:     </serial>
Aug 15 05:54:43 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:54:43 user nova-compute[73391]:     <video>
Aug 15 05:54:43 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:54:43 user nova-compute[73391]:     </video>
Aug 15 05:54:43 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:54:43 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:54:43 user nova-compute[73391]:     </rng>
Aug 15 05:54:43 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:54:43 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:54:43 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:54:43 user nova-compute[73391]:     </memballoon>
Aug 15 05:54:43 user nova-compute[73391]:   </devices>
Aug 15 05:54:43 user nova-compute[73391]: </domain>
Aug 15 05:54:43 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:54:43 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:54:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-538220195',display_name='tempest-TestVolumeBootPattern-server-538220195',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-538220195',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9jBoYjOy+aqM5q6fYRpW336xJnp1RjcA+ryp4UUPjXWPw7VtxeYktb68BzzUpanNxgDS13R1RxH4S+D0vqFMFtOkREwueXmREiQ22XqN9Aby3PDiDj1ii3iTWuJ+dFag==',key_name='tempest-TestVolumeBootPattern-1057822238',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a8188c2e8ca34ef1982faa49f1058bb7',ramdisk_id='',reservation_id='r-90qekll3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1834029963',owner_user_name='tempest-TestVolumeBootPattern-1834029963-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:54:33Z,user_data=None,user_id='aefb6ccab586465dbe56e71a40bcf1f0',uuid=5a5cbbb3-3b78-48b5-9eee-342f52f1fc22,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e6843fd-6378-4865-b416-719c63f81bc5", "address": "fa:16:3e:2d:73:c6", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e6843fd-63", "ovs_interfaceid": "4e6843fd-6378-4865-b416-719c63f81bc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:54:43 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Converting VIF {"id": "4e6843fd-6378-4865-b416-719c63f81bc5", "address": "fa:16:3e:2d:73:c6", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e6843fd-63", "ovs_interfaceid": "4e6843fd-6378-4865-b416-719c63f81bc5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:54:43 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2d:73:c6,bridge_name='br-int',has_traffic_filtering=True,id=4e6843fd-6378-4865-b416-719c63f81bc5,network=Network(fae0e46a-88e4-499d-bcff-5b7df55eab4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e6843fd-63') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:54:43 user nova-compute[73391]: DEBUG os_vif [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:73:c6,bridge_name='br-int',has_traffic_filtering=True,id=4e6843fd-6378-4865-b416-719c63f81bc5,network=Network(fae0e46a-88e4-499d-bcff-5b7df55eab4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e6843fd-63') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:54:43 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:54:43 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:54:43 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:54:43 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:54:43 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4e6843fd-63, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:54:43 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4e6843fd-63, col_values=(('external_ids', {'iface-id': '4e6843fd-6378-4865-b416-719c63f81bc5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2d:73:c6', 'vm-uuid': '5a5cbbb3-3b78-48b5-9eee-342f52f1fc22'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:54:43 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:54:43 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:54:43 user nova-compute[73391]: INFO os_vif [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2d:73:c6,bridge_name='br-int',has_traffic_filtering=True,id=4e6843fd-6378-4865-b416-719c63f81bc5,network=Network(fae0e46a-88e4-499d-bcff-5b7df55eab4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e6843fd-63')
Aug 15 05:54:43 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:54:43 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] No VIF found with MAC fa:16:3e:2d:73:c6, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:54:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:54:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:54:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:54:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:54:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:54:45 user nova-compute[73391]: DEBUG nova.compute.manager [req-4e5d4d6e-7436-465b-bd46-679800f26511 req-1662a7a8-ba6e-4f68-ae8b-1913bfb4a9cc service nova] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Received event network-vif-plugged-4e6843fd-6378-4865-b416-719c63f81bc5 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:54:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-4e5d4d6e-7436-465b-bd46-679800f26511 req-1662a7a8-ba6e-4f68-ae8b-1913bfb4a9cc service nova] Acquiring lock "5a5cbbb3-3b78-48b5-9eee-342f52f1fc22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:54:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-4e5d4d6e-7436-465b-bd46-679800f26511 req-1662a7a8-ba6e-4f68-ae8b-1913bfb4a9cc service nova] Lock "5a5cbbb3-3b78-48b5-9eee-342f52f1fc22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:54:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-4e5d4d6e-7436-465b-bd46-679800f26511 req-1662a7a8-ba6e-4f68-ae8b-1913bfb4a9cc service nova] Lock "5a5cbbb3-3b78-48b5-9eee-342f52f1fc22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:54:45 user nova-compute[73391]: DEBUG nova.compute.manager [req-4e5d4d6e-7436-465b-bd46-679800f26511 req-1662a7a8-ba6e-4f68-ae8b-1913bfb4a9cc service nova] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] No waiting events found dispatching network-vif-plugged-4e6843fd-6378-4865-b416-719c63f81bc5 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:54:45 user nova-compute[73391]: WARNING nova.compute.manager [req-4e5d4d6e-7436-465b-bd46-679800f26511 req-1662a7a8-ba6e-4f68-ae8b-1913bfb4a9cc service nova] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Received unexpected event network-vif-plugged-4e6843fd-6378-4865-b416-719c63f81bc5 for instance with vm_state building and task_state spawning.
Aug 15 05:54:47 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078887.376306, 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22 => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:54:47 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] VM Resumed (Lifecycle Event)
Aug 15 05:54:47 user nova-compute[73391]: DEBUG nova.compute.manager [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:54:47 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Guest created on hypervisor {{(pid=73391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 05:54:47 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Instance spawned successfully.
Aug 15 05:54:47 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 05:54:47 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:54:47 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:54:47 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Found default for hw_cdrom_bus of ide {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:54:47 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Found default for hw_disk_bus of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:54:47 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Found default for hw_input_bus of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:54:47 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Found default for hw_pointer_model of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:54:47 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Found default for hw_video_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:54:47 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Found default for hw_vif_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:54:47 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:54:47 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078887.3793538, 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22 => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:54:47 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] VM Started (Lifecycle Event)
Aug 15 05:54:47 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:54:47 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:54:47 user nova-compute[73391]: INFO nova.compute.manager [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Took 5.01 seconds to spawn the instance on the hypervisor.
Aug 15 05:54:47 user nova-compute[73391]: DEBUG nova.compute.manager [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:54:47 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:54:47 user nova-compute[73391]: DEBUG nova.compute.manager [req-a6884ec8-4e06-4bc0-9953-f3cab215e72c req-c4224cf5-be1a-477d-baa7-5414c83c0b95 service nova] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Received event network-vif-plugged-4e6843fd-6378-4865-b416-719c63f81bc5 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:54:47 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-a6884ec8-4e06-4bc0-9953-f3cab215e72c req-c4224cf5-be1a-477d-baa7-5414c83c0b95 service nova] Acquiring lock "5a5cbbb3-3b78-48b5-9eee-342f52f1fc22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:54:47 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-a6884ec8-4e06-4bc0-9953-f3cab215e72c req-c4224cf5-be1a-477d-baa7-5414c83c0b95 service nova] Lock "5a5cbbb3-3b78-48b5-9eee-342f52f1fc22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:54:47 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-a6884ec8-4e06-4bc0-9953-f3cab215e72c req-c4224cf5-be1a-477d-baa7-5414c83c0b95 service nova] Lock "5a5cbbb3-3b78-48b5-9eee-342f52f1fc22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:54:47 user nova-compute[73391]: DEBUG nova.compute.manager [req-a6884ec8-4e06-4bc0-9953-f3cab215e72c req-c4224cf5-be1a-477d-baa7-5414c83c0b95 service nova] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] No waiting events found dispatching network-vif-plugged-4e6843fd-6378-4865-b416-719c63f81bc5 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:54:47 user nova-compute[73391]: WARNING nova.compute.manager [req-a6884ec8-4e06-4bc0-9953-f3cab215e72c req-c4224cf5-be1a-477d-baa7-5414c83c0b95 service nova] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Received unexpected event network-vif-plugged-4e6843fd-6378-4865-b416-719c63f81bc5 for instance with vm_state building and task_state spawning.
Aug 15 05:54:47 user nova-compute[73391]: INFO nova.compute.manager [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Took 14.81 seconds to build instance.
Aug 15 05:54:47 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-68c47a70-5ba6-41fb-8605-21091772a8ac tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "5a5cbbb3-3b78-48b5-9eee-342f52f1fc22" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.901s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:54:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:54:49 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:54:53 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:54:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:54:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:54:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-03b620cf-a5a7-4629-9404-0b07df561020 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Acquiring lock "134610fb-ed36-4ecb-a884-a26febb7943d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:54:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-03b620cf-a5a7-4629-9404-0b07df561020 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "134610fb-ed36-4ecb-a884-a26febb7943d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:54:59 user nova-compute[73391]: INFO nova.compute.manager [None req-03b620cf-a5a7-4629-9404-0b07df561020 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Detaching volume 81318dd2-ff3a-4b2e-b510-3bc8759e88de
Aug 15 05:54:59 user nova-compute[73391]: INFO nova.virt.block_device [None req-03b620cf-a5a7-4629-9404-0b07df561020 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Attempting to driver detach volume 81318dd2-ff3a-4b2e-b510-3bc8759e88de from mountpoint /dev/vdb
Aug 15 05:54:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-03b620cf-a5a7-4629-9404-0b07df561020 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Attempting to detach device vdb from instance 134610fb-ed36-4ecb-a884-a26febb7943d from the persistent domain config. {{(pid=73391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 05:54:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-03b620cf-a5a7-4629-9404-0b07df561020 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 05:54:59 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:54:59 user nova-compute[73391]:   <source dev="/dev/sdc"/>
Aug 15 05:54:59 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:54:59 user nova-compute[73391]:   <serial>81318dd2-ff3a-4b2e-b510-3bc8759e88de</serial>
Aug 15 05:54:59 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 05:54:59 user nova-compute[73391]: </disk>
Aug 15 05:54:59 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 05:54:59 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-03b620cf-a5a7-4629-9404-0b07df561020 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Successfully detached device vdb from instance 134610fb-ed36-4ecb-a884-a26febb7943d from the persistent domain config.
Aug 15 05:54:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-03b620cf-a5a7-4629-9404-0b07df561020 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 134610fb-ed36-4ecb-a884-a26febb7943d from the live domain config. {{(pid=73391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 05:54:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-03b620cf-a5a7-4629-9404-0b07df561020 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 05:54:59 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:54:59 user nova-compute[73391]:   <source dev="/dev/sdc"/>
Aug 15 05:54:59 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:54:59 user nova-compute[73391]:   <serial>81318dd2-ff3a-4b2e-b510-3bc8759e88de</serial>
Aug 15 05:54:59 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 05:54:59 user nova-compute[73391]: </disk>
Aug 15 05:54:59 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 05:54:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Received event <DeviceRemovedEvent: 1692078899.830442, 134610fb-ed36-4ecb-a884-a26febb7943d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73391) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 05:54:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-03b620cf-a5a7-4629-9404-0b07df561020 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 134610fb-ed36-4ecb-a884-a26febb7943d {{(pid=73391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 05:54:59 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-03b620cf-a5a7-4629-9404-0b07df561020 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Successfully detached device vdb from instance 134610fb-ed36-4ecb-a884-a26febb7943d from the live domain config.
Aug 15 05:54:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03b620cf-a5a7-4629-9404-0b07df561020 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 05:54:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b620cf-a5a7-4629-9404-0b07df561020 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dnzqHYfX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:54:59 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-03b620cf-a5a7-4629-9404-0b07df561020 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:54:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-03b620cf-a5a7-4629-9404-0b07df561020 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:54:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-03b620cf-a5a7-4629-9404-0b07df561020 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:54:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b620cf-a5a7-4629-9404-0b07df561020 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 05:54:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:54:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:54:59 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef429962-2511-4be2-8ebc-d9d975fbe2ce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3a56eca-dd83-40fc-8e35-8b719d9eecbf\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:54:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:54:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:54:59 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[98683005-c226-4212-a4e7-7519ee192308]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a56eca-dd83-40fc-8e35-8b719d9eecbf (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:54:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b620cf-a5a7-4629-9404-0b07df561020 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de (non-flash)
Aug 15 05:54:59 user nova-compute[73391]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 (non-flash)
Aug 15 05:54:59 user nova-compute[73391]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a (non-flash)
Aug 15 05:54:59 user nova-compute[73391]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a56eca-dd83-40fc-8e35-8b719d9eecbf (non-flash)
Aug 15 05:54:59 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:54:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b620cf-a5a7-4629-9404-0b07df561020 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de (non-flash)
Aug 15 05:54:59 user nova-compute[73391]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 (non-flash)
Aug 15 05:54:59 user nova-compute[73391]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a (non-flash)
Aug 15 05:54:59 user nova-compute[73391]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a56eca-dd83-40fc-8e35-8b719d9eecbf (non-flash)
Aug 15 05:54:59 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:54:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b620cf-a5a7-4629-9404-0b07df561020 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7728373d00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de'): ({'sdc'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 05:54:59 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-03b620cf-a5a7-4629-9404-0b07df561020 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Removing single pathed devices sdc {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 05:54:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:54:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:54:59 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[45bfa8d8-2430-4c5f-80d3-ce61a08a42df]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:54:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:54:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:54:59 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75df2ef-bc0b-421e-9610-4c9ae8f5cfff]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:54:59 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-03b620cf-a5a7-4629-9404-0b07df561020 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Flushing IO for device /dev/sdc {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 05:54:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:54:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:54:59 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[292d8808-1d9b-4100-9ca6-151ca6e57d03]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:54:59 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-03b620cf-a5a7-4629-9404-0b07df561020 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 05:54:59 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:55:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:55:00 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be7505b-b2eb-4560-8711-0f006aca571a]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:55:00 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-03b620cf-a5a7-4629-9404-0b07df561020 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 05:55:00 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-03b620cf-a5a7-4629-9404-0b07df561020 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] SCSI volumes sdc have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 05:55:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b620cf-a5a7-4629-9404-0b07df561020 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 05:55:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:55:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.046s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:55:00 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aae2cd9-b59e-4525-af57-04fa42f20b3c]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:55:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b620cf-a5a7-4629-9404-0b07df561020 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:55:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:55:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de -p 172.16.0.220:3260 --logout" returned: 0 in 0.145s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:55:00 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1676f6cc-6eff-42ee-9288-35f5ee2db4da]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:55:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b620cf-a5a7-4629-9404-0b07df561020 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de, portal: 172.16.0.220,3260]
Aug 15 05:55:00 user nova-compute[73391]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de, portal: 172.16.0.220,3260] successful.
Aug 15 05:55:00 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:55:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:55:00 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81318dd2-ff3a-4b2e-b510-3bc8759e88de -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:55:00 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ad8b2e-e51b-4087-9a4c-856a898a99cf]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:55:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b620cf-a5a7-4629-9404-0b07df561020 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:55:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-03b620cf-a5a7-4629-9404-0b07df561020 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.408s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:55:00 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-03b620cf-a5a7-4629-9404-0b07df561020 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] <== disconnect_volume: return (409ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:55:00 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03b620cf-a5a7-4629-9404-0b07df561020 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 05:55:01 user nova-compute[73391]: DEBUG nova.objects.instance [None req-03b620cf-a5a7-4629-9404-0b07df561020 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lazy-loading 'flavor' on Instance uuid 134610fb-ed36-4ecb-a884-a26febb7943d {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:55:01 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-03b620cf-a5a7-4629-9404-0b07df561020 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "134610fb-ed36-4ecb-a884-a26febb7943d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.856s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:55:03 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:55:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:55:07 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:55:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:55:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:55:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-53b8b119-e867-4d73-b866-a312f35a2581 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Acquiring lock "730890c6-6999-4a0f-b80c-e4745bff99ab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:55:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-53b8b119-e867-4d73-b866-a312f35a2581 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "730890c6-6999-4a0f-b80c-e4745bff99ab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:55:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-53b8b119-e867-4d73-b866-a312f35a2581 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Acquiring lock "730890c6-6999-4a0f-b80c-e4745bff99ab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:55:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-53b8b119-e867-4d73-b866-a312f35a2581 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "730890c6-6999-4a0f-b80c-e4745bff99ab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:55:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-53b8b119-e867-4d73-b866-a312f35a2581 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "730890c6-6999-4a0f-b80c-e4745bff99ab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:55:10 user nova-compute[73391]: INFO nova.compute.manager [None req-53b8b119-e867-4d73-b866-a312f35a2581 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Terminating instance
Aug 15 05:55:10 user nova-compute[73391]: DEBUG nova.compute.manager [None req-53b8b119-e867-4d73-b866-a312f35a2581 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Start destroying the instance on the hypervisor. {{(pid=73391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 05:55:10 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:55:10 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:55:10 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:55:10 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:55:11 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Instance destroyed successfully.
Aug 15 05:55:11 user nova-compute[73391]: DEBUG nova.objects.instance [None req-53b8b119-e867-4d73-b866-a312f35a2581 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lazy-loading 'resources' on Instance uuid 730890c6-6999-4a0f-b80c-e4745bff99ab {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:55:11 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-53b8b119-e867-4d73-b866-a312f35a2581 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:37:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-639325125',display_name='tempest-ServerRescueNegativeTestJSON-server-639325125',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-639325125',id=24,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:42:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5a7da9448cc34b609120da564a01dba4',ramdisk_id='',reservation_id='r-u63o4wgc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1933442633',owner_user_name='tempest-ServerRescueNegativeTestJSON-1933442633-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:44:36Z,user_data=None,user_id='1f0f5888b8c44188a17202fad2725256',uuid=730890c6-6999-4a0f-b80c-e4745bff99ab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f598ee19-8c81-4cf2-a88d-8221516eb1cf", "address": "fa:16:3e:2e:da:40", "network": {"id": "bec69c6a-b2cb-4b0a-ba6e-ae6dae099818", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7da9448cc34b609120da564a01dba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf598ee19-8c", "ovs_interfaceid": "f598ee19-8c81-4cf2-a88d-8221516eb1cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:55:11 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-53b8b119-e867-4d73-b866-a312f35a2581 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Converting VIF {"id": "f598ee19-8c81-4cf2-a88d-8221516eb1cf", "address": "fa:16:3e:2e:da:40", "network": {"id": "bec69c6a-b2cb-4b0a-ba6e-ae6dae099818", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-28679537-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a7da9448cc34b609120da564a01dba4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf598ee19-8c", "ovs_interfaceid": "f598ee19-8c81-4cf2-a88d-8221516eb1cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:55:11 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-53b8b119-e867-4d73-b866-a312f35a2581 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:da:40,bridge_name='br-int',has_traffic_filtering=True,id=f598ee19-8c81-4cf2-a88d-8221516eb1cf,network=Network(bec69c6a-b2cb-4b0a-ba6e-ae6dae099818),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf598ee19-8c') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:55:11 user nova-compute[73391]: DEBUG os_vif [None req-53b8b119-e867-4d73-b866-a312f35a2581 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:da:40,bridge_name='br-int',has_traffic_filtering=True,id=f598ee19-8c81-4cf2-a88d-8221516eb1cf,network=Network(bec69c6a-b2cb-4b0a-ba6e-ae6dae099818),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf598ee19-8c') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:55:11 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:55:11 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf598ee19-8c, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:55:11 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:55:11 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:55:11 user nova-compute[73391]: INFO os_vif [None req-53b8b119-e867-4d73-b866-a312f35a2581 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:da:40,bridge_name='br-int',has_traffic_filtering=True,id=f598ee19-8c81-4cf2-a88d-8221516eb1cf,network=Network(bec69c6a-b2cb-4b0a-ba6e-ae6dae099818),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf598ee19-8c')
Aug 15 05:55:11 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-53b8b119-e867-4d73-b866-a312f35a2581 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Deleting instance files /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab_del
Aug 15 05:55:11 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-53b8b119-e867-4d73-b866-a312f35a2581 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Deletion of /opt/stack/data/nova/instances/730890c6-6999-4a0f-b80c-e4745bff99ab_del complete
Aug 15 05:55:11 user nova-compute[73391]: INFO nova.compute.manager [None req-53b8b119-e867-4d73-b866-a312f35a2581 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 15 05:55:11 user nova-compute[73391]: DEBUG oslo.service.loopingcall [None req-53b8b119-e867-4d73-b866-a312f35a2581 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 05:55:11 user nova-compute[73391]: DEBUG nova.compute.manager [-] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Deallocating network for instance {{(pid=73391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 05:55:11 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] deallocate_for_instance() {{(pid=73391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 05:55:11 user nova-compute[73391]: DEBUG nova.compute.manager [req-7d38c216-1f3c-4da4-b5d8-1dcd86bc4c22 req-8b9dce22-2ee4-40a4-87e2-6c058430babf service nova] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Received event network-vif-unplugged-f598ee19-8c81-4cf2-a88d-8221516eb1cf {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:55:11 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-7d38c216-1f3c-4da4-b5d8-1dcd86bc4c22 req-8b9dce22-2ee4-40a4-87e2-6c058430babf service nova] Acquiring lock "730890c6-6999-4a0f-b80c-e4745bff99ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:55:11 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-7d38c216-1f3c-4da4-b5d8-1dcd86bc4c22 req-8b9dce22-2ee4-40a4-87e2-6c058430babf service nova] Lock "730890c6-6999-4a0f-b80c-e4745bff99ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:55:11 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-7d38c216-1f3c-4da4-b5d8-1dcd86bc4c22 req-8b9dce22-2ee4-40a4-87e2-6c058430babf service nova] Lock "730890c6-6999-4a0f-b80c-e4745bff99ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:55:11 user nova-compute[73391]: DEBUG nova.compute.manager [req-7d38c216-1f3c-4da4-b5d8-1dcd86bc4c22 req-8b9dce22-2ee4-40a4-87e2-6c058430babf service nova] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] No waiting events found dispatching network-vif-unplugged-f598ee19-8c81-4cf2-a88d-8221516eb1cf {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:55:11 user nova-compute[73391]: DEBUG nova.compute.manager [req-7d38c216-1f3c-4da4-b5d8-1dcd86bc4c22 req-8b9dce22-2ee4-40a4-87e2-6c058430babf service nova] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Received event network-vif-unplugged-f598ee19-8c81-4cf2-a88d-8221516eb1cf for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 05:55:12 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:55:12 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Took 0.58 seconds to deallocate network for instance.
Aug 15 05:55:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-53b8b119-e867-4d73-b866-a312f35a2581 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:55:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-53b8b119-e867-4d73-b866-a312f35a2581 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:55:12 user nova-compute[73391]: DEBUG nova.compute.manager [req-1832893f-d944-44d4-8844-8d14c6f0193c req-da5444c1-b237-4f31-b7f5-879ed99560d8 service nova] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Received event network-vif-deleted-f598ee19-8c81-4cf2-a88d-8221516eb1cf {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:55:12 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-53b8b119-e867-4d73-b866-a312f35a2581 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:55:12 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-53b8b119-e867-4d73-b866-a312f35a2581 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:55:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-53b8b119-e867-4d73-b866-a312f35a2581 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.227s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:55:12 user nova-compute[73391]: INFO nova.scheduler.client.report [None req-53b8b119-e867-4d73-b866-a312f35a2581 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Deleted allocations for instance 730890c6-6999-4a0f-b80c-e4745bff99ab
Aug 15 05:55:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-53b8b119-e867-4d73-b866-a312f35a2581 tempest-ServerRescueNegativeTestJSON-1933442633 tempest-ServerRescueNegativeTestJSON-1933442633-project-member] Lock "730890c6-6999-4a0f-b80c-e4745bff99ab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.931s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:55:13 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:55:13 user nova-compute[73391]: DEBUG nova.compute.manager [req-34523396-5ba9-4576-b9cc-bac8fdffaffa req-9733a275-2f8f-4a66-a602-99ef4387a170 service nova] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Received event network-vif-plugged-f598ee19-8c81-4cf2-a88d-8221516eb1cf {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:55:13 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-34523396-5ba9-4576-b9cc-bac8fdffaffa req-9733a275-2f8f-4a66-a602-99ef4387a170 service nova] Acquiring lock "730890c6-6999-4a0f-b80c-e4745bff99ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:55:13 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-34523396-5ba9-4576-b9cc-bac8fdffaffa req-9733a275-2f8f-4a66-a602-99ef4387a170 service nova] Lock "730890c6-6999-4a0f-b80c-e4745bff99ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:55:13 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-34523396-5ba9-4576-b9cc-bac8fdffaffa req-9733a275-2f8f-4a66-a602-99ef4387a170 service nova] Lock "730890c6-6999-4a0f-b80c-e4745bff99ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:55:13 user nova-compute[73391]: DEBUG nova.compute.manager [req-34523396-5ba9-4576-b9cc-bac8fdffaffa req-9733a275-2f8f-4a66-a602-99ef4387a170 service nova] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] No waiting events found dispatching network-vif-plugged-f598ee19-8c81-4cf2-a88d-8221516eb1cf {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:55:13 user nova-compute[73391]: WARNING nova.compute.manager [req-34523396-5ba9-4576-b9cc-bac8fdffaffa req-9733a275-2f8f-4a66-a602-99ef4387a170 service nova] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Received unexpected event network-vif-plugged-f598ee19-8c81-4cf2-a88d-8221516eb1cf for instance with vm_state deleted and task_state None.
Aug 15 05:55:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:55:15 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:55:16 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:55:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:55:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:55:20 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:55:20 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Cleaning up deleted instances {{(pid=73391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 05:55:20 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] There are 0 instances to clean {{(pid=73391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 05:55:21 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:55:21 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:55:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:55:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Acquiring lock "d10508dd-f3f7-4e96-b822-d331ded6809f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:55:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "d10508dd-f3f7-4e96-b822-d331ded6809f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:55:25 user nova-compute[73391]: DEBUG nova.compute.manager [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Starting instance... {{(pid=73391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 05:55:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:55:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:55:25 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 05:55:25 user nova-compute[73391]: INFO nova.compute.claims [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Claim successful on node user
Aug 15 05:55:25 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:55:25 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:55:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.267s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:55:25 user nova-compute[73391]: DEBUG nova.compute.manager [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Start building networks asynchronously for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 05:55:25 user nova-compute[73391]: DEBUG nova.compute.manager [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Allocating IP information in the background. {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 05:55:25 user nova-compute[73391]: DEBUG nova.network.neutron [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] allocate_for_instance() {{(pid=73391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 05:55:25 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 05:55:25 user nova-compute[73391]: DEBUG nova.compute.manager [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Start building block device mappings for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 05:55:25 user nova-compute[73391]: DEBUG nova.policy [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'db323067fefa4b1f8aa28f10a997b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd985a0cd6884c858487187ce252bba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73391) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 05:55:25 user nova-compute[73391]: DEBUG nova.compute.manager [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Start spawning the instance on the hypervisor. {{(pid=73391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 05:55:25 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Creating instance directory {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 05:55:25 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Creating image(s)
Aug 15 05:55:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Acquiring lock "/opt/stack/data/nova/instances/d10508dd-f3f7-4e96-b822-d331ded6809f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:55:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "/opt/stack/data/nova/instances/d10508dd-f3f7-4e96-b822-d331ded6809f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:55:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "/opt/stack/data/nova/instances/d10508dd-f3f7-4e96-b822-d331ded6809f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:55:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Acquiring lock "8fd6a6206a4889a3b85acfa5649b743194df0178" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:55:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "8fd6a6206a4889a3b85acfa5649b743194df0178" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:55:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8fd6a6206a4889a3b85acfa5649b743194df0178.part --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:55:26 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692078911.3698778, 730890c6-6999-4a0f-b80c-e4745bff99ab => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:55:26 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] VM Stopped (Lifecycle Event)
Aug 15 05:55:26 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:55:26 user nova-compute[73391]: DEBUG nova.compute.manager [None req-a3b777ca-f31d-4925-9b16-3319915c0abf None None] [instance: 730890c6-6999-4a0f-b80c-e4745bff99ab] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:55:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8fd6a6206a4889a3b85acfa5649b743194df0178.part --force-share --output=json" returned: 0 in 0.180s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:55:26 user nova-compute[73391]: DEBUG nova.virt.images [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] d9b08b04-9688-4e5e-90eb-5ae0465c6517 was qcow2, converting to raw {{(pid=73391) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 05:55:26 user nova-compute[73391]: DEBUG nova.privsep.utils [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73391) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 05:55:26 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8fd6a6206a4889a3b85acfa5649b743194df0178.part /opt/stack/data/nova/instances/_base/8fd6a6206a4889a3b85acfa5649b743194df0178.converted {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:55:26 user nova-compute[73391]: DEBUG nova.network.neutron [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Successfully created port: bad7b5c4-680d-4f22-9fc0-53e0ac551260 {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 05:55:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8fd6a6206a4889a3b85acfa5649b743194df0178.part /opt/stack/data/nova/instances/_base/8fd6a6206a4889a3b85acfa5649b743194df0178.converted" returned: 0 in 0.450s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:55:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8fd6a6206a4889a3b85acfa5649b743194df0178.converted --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:55:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8fd6a6206a4889a3b85acfa5649b743194df0178.converted --force-share --output=json" returned: 0 in 0.188s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:55:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "8fd6a6206a4889a3b85acfa5649b743194df0178" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.469s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:55:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8fd6a6206a4889a3b85acfa5649b743194df0178 --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:55:27 user nova-compute[73391]: DEBUG nova.network.neutron [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Successfully updated port: bad7b5c4-680d-4f22-9fc0-53e0ac551260 {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:55:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Acquiring lock "refresh_cache-d10508dd-f3f7-4e96-b822-d331ded6809f" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:55:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Acquired lock "refresh_cache-d10508dd-f3f7-4e96-b822-d331ded6809f" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:55:27 user nova-compute[73391]: DEBUG nova.network.neutron [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:55:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8fd6a6206a4889a3b85acfa5649b743194df0178 --force-share --output=json" returned: 0 in 0.189s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:55:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Acquiring lock "8fd6a6206a4889a3b85acfa5649b743194df0178" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:55:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "8fd6a6206a4889a3b85acfa5649b743194df0178" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:55:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8fd6a6206a4889a3b85acfa5649b743194df0178 --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:55:27 user nova-compute[73391]: DEBUG nova.compute.manager [req-fa481947-cf94-4bf5-89b2-f62d77f69eef req-4a5b9c0d-cd25-4c98-8510-5f4aaf160e6a service nova] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Received event network-changed-bad7b5c4-680d-4f22-9fc0-53e0ac551260 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:55:27 user nova-compute[73391]: DEBUG nova.compute.manager [req-fa481947-cf94-4bf5-89b2-f62d77f69eef req-4a5b9c0d-cd25-4c98-8510-5f4aaf160e6a service nova] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Refreshing instance network info cache due to event network-changed-bad7b5c4-680d-4f22-9fc0-53e0ac551260. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:55:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-fa481947-cf94-4bf5-89b2-f62d77f69eef req-4a5b9c0d-cd25-4c98-8510-5f4aaf160e6a service nova] Acquiring lock "refresh_cache-d10508dd-f3f7-4e96-b822-d331ded6809f" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:55:27 user nova-compute[73391]: DEBUG nova.network.neutron [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:55:27 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:55:27 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:55:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:55:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:55:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:55:27 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Auditing locally available compute resources for user (node: user) {{(pid=73391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 05:55:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8fd6a6206a4889a3b85acfa5649b743194df0178 --force-share --output=json" returned: 0 in 0.178s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:55:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8fd6a6206a4889a3b85acfa5649b743194df0178,backing_fmt=raw /opt/stack/data/nova/instances/d10508dd-f3f7-4e96-b822-d331ded6809f/disk 1073741824 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8fd6a6206a4889a3b85acfa5649b743194df0178,backing_fmt=raw /opt/stack/data/nova/instances/d10508dd-f3f7-4e96-b822-d331ded6809f/disk 1073741824" returned: 0 in 0.363s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "8fd6a6206a4889a3b85acfa5649b743194df0178" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.545s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8fd6a6206a4889a3b85acfa5649b743194df0178 --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8fd6a6206a4889a3b85acfa5649b743194df0178 --force-share --output=json" returned: 0 in 0.172s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d10508dd-f3f7-4e96-b822-d331ded6809f/disk. size=1073741824 {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d10508dd-f3f7-4e96-b822-d331ded6809f/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG nova.network.neutron [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Updating instance_info_cache with network_info: [{"id": "bad7b5c4-680d-4f22-9fc0-53e0ac551260", "address": "fa:16:3e:91:71:96", "network": {"id": "2a8063f6-42ce-41b8-86f6-72c17f4c2a7b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1765547969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd985a0cd6884c858487187ce252bba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad7b5c4-68", "ovs_interfaceid": "bad7b5c4-680d-4f22-9fc0-53e0ac551260", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/disk.rescue --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Releasing lock "refresh_cache-d10508dd-f3f7-4e96-b822-d331ded6809f" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG nova.compute.manager [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Instance network_info: |[{"id": "bad7b5c4-680d-4f22-9fc0-53e0ac551260", "address": "fa:16:3e:91:71:96", "network": {"id": "2a8063f6-42ce-41b8-86f6-72c17f4c2a7b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1765547969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd985a0cd6884c858487187ce252bba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad7b5c4-68", "ovs_interfaceid": "bad7b5c4-680d-4f22-9fc0-53e0ac551260", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-fa481947-cf94-4bf5-89b2-f62d77f69eef req-4a5b9c0d-cd25-4c98-8510-5f4aaf160e6a service nova] Acquired lock "refresh_cache-d10508dd-f3f7-4e96-b822-d331ded6809f" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG nova.network.neutron [req-fa481947-cf94-4bf5-89b2-f62d77f69eef req-4a5b9c0d-cd25-4c98-8510-5f4aaf160e6a service nova] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Refreshing network info cache for port bad7b5c4-680d-4f22-9fc0-53e0ac551260 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d10508dd-f3f7-4e96-b822-d331ded6809f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Cannot resize image /opt/stack/data/nova/instances/d10508dd-f3f7-4e96-b822-d331ded6809f/disk to a smaller size. {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG nova.objects.instance [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lazy-loading 'migration_context' on Instance uuid d10508dd-f3f7-4e96-b822-d331ded6809f {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Created local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Ensure instance console log exists: /opt/stack/data/nova/instances/d10508dd-f3f7-4e96-b822-d331ded6809f/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Start _get_guest_xml network_info=[{"id": "bad7b5c4-680d-4f22-9fc0-53e0ac551260", "address": "fa:16:3e:91:71:96", "network": {"id": "2a8063f6-42ce-41b8-86f6-72c17f4c2a7b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1765547969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd985a0cd6884c858487187ce252bba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad7b5c4-68", "ovs_interfaceid": "bad7b5c4-680d-4f22-9fc0-53e0ac551260", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:55:23Z,direct_url=<?>,disk_format='qcow2',id=d9b08b04-9688-4e5e-90eb-5ae0465c6517,min_disk=0,min_ram=0,name='tempest-scenario-img--560574266',owner='cd985a0cd6884c858487187ce252bba5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:55:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': 'd9b08b04-9688-4e5e-90eb-5ae0465c6517'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:55:28 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:55:28 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:55:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:55:23Z,direct_url=<?>,disk_format='qcow2',id=d9b08b04-9688-4e5e-90eb-5ae0465c6517,min_disk=0,min_ram=0,name='tempest-scenario-img--560574266',owner='cd985a0cd6884c858487187ce252bba5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:55:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:55:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1638516350',display_name='tempest-TestMinimumBasicScenario-server-1638516350',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1638516350',id=46,image_ref='d9b08b04-9688-4e5e-90eb-5ae0465c6517',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyWsG9ehEQcqlBsyrmyWtybq7vloOElSYR0j7Ou42ASZEw1IFAr5wdOLp6A6sbdR8fm5tdu1cPwGw1di232sVJtsalZJWCrvAInL7ggWTRRw/y74jndzteUjAIxDm/s8Q==',key_name='tempest-TestMinimumBasicScenario-1867600907',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd985a0cd6884c858487187ce252bba5',ramdisk_id='',reservation_id='r-agv6ww0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d9b08b04-9688-4e5e-90eb-5ae0465c6517',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1535355155',owner_user_name='tempest-TestMinimumBasicScenario-1535355155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:55:26Z,user_data=None,user_id='db323067fefa4b1f8aa28f10a997b9d4',uuid=d10508dd-f3f7-4e96-b822-d331ded6809f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bad7b5c4-680d-4f22-9fc0-53e0ac551260", "address": "fa:16:3e:91:71:96", "network": {"id": "2a8063f6-42ce-41b8-86f6-72c17f4c2a7b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1765547969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd985a0cd6884c858487187ce252bba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad7b5c4-68", "ovs_interfaceid": "bad7b5c4-680d-4f22-9fc0-53e0ac551260", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Converting VIF {"id": "bad7b5c4-680d-4f22-9fc0-53e0ac551260", "address": "fa:16:3e:91:71:96", "network": {"id": "2a8063f6-42ce-41b8-86f6-72c17f4c2a7b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1765547969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd985a0cd6884c858487187ce252bba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad7b5c4-68", "ovs_interfaceid": "bad7b5c4-680d-4f22-9fc0-53e0ac551260", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:71:96,bridge_name='br-int',has_traffic_filtering=True,id=bad7b5c4-680d-4f22-9fc0-53e0ac551260,network=Network(2a8063f6-42ce-41b8-86f6-72c17f4c2a7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbad7b5c4-68') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG nova.objects.instance [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lazy-loading 'pci_devices' on Instance uuid d10508dd-f3f7-4e96-b822-d331ded6809f {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:55:28 user nova-compute[73391]:   <uuid>d10508dd-f3f7-4e96-b822-d331ded6809f</uuid>
Aug 15 05:55:28 user nova-compute[73391]:   <name>instance-0000002e</name>
Aug 15 05:55:28 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:55:28 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:55:28 user nova-compute[73391]:   <metadata>
Aug 15 05:55:28 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:55:28 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:55:28 user nova-compute[73391]:       <nova:name>tempest-TestMinimumBasicScenario-server-1638516350</nova:name>
Aug 15 05:55:28 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:55:28</nova:creationTime>
Aug 15 05:55:28 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:55:28 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:55:28 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:55:28 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:55:28 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:55:28 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:55:28 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:55:28 user nova-compute[73391]:       <nova:owner>
Aug 15 05:55:28 user nova-compute[73391]:         <nova:user uuid="db323067fefa4b1f8aa28f10a997b9d4">tempest-TestMinimumBasicScenario-1535355155-project-member</nova:user>
Aug 15 05:55:28 user nova-compute[73391]:         <nova:project uuid="cd985a0cd6884c858487187ce252bba5">tempest-TestMinimumBasicScenario-1535355155</nova:project>
Aug 15 05:55:28 user nova-compute[73391]:       </nova:owner>
Aug 15 05:55:28 user nova-compute[73391]:       <nova:root type="image" uuid="d9b08b04-9688-4e5e-90eb-5ae0465c6517"/>
Aug 15 05:55:28 user nova-compute[73391]:       <nova:ports>
Aug 15 05:55:28 user nova-compute[73391]:         <nova:port uuid="bad7b5c4-680d-4f22-9fc0-53e0ac551260">
Aug 15 05:55:28 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 05:55:28 user nova-compute[73391]:         </nova:port>
Aug 15 05:55:28 user nova-compute[73391]:       </nova:ports>
Aug 15 05:55:28 user nova-compute[73391]:     </nova:instance>
Aug 15 05:55:28 user nova-compute[73391]:   </metadata>
Aug 15 05:55:28 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:55:28 user nova-compute[73391]:     <system>
Aug 15 05:55:28 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:55:28 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:55:28 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:55:28 user nova-compute[73391]:       <entry name="serial">d10508dd-f3f7-4e96-b822-d331ded6809f</entry>
Aug 15 05:55:28 user nova-compute[73391]:       <entry name="uuid">d10508dd-f3f7-4e96-b822-d331ded6809f</entry>
Aug 15 05:55:28 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:55:28 user nova-compute[73391]:     </system>
Aug 15 05:55:28 user nova-compute[73391]:   </sysinfo>
Aug 15 05:55:28 user nova-compute[73391]:   <os>
Aug 15 05:55:28 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:55:28 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:55:28 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:55:28 user nova-compute[73391]:   </os>
Aug 15 05:55:28 user nova-compute[73391]:   <features>
Aug 15 05:55:28 user nova-compute[73391]:     <acpi/>
Aug 15 05:55:28 user nova-compute[73391]:     <apic/>
Aug 15 05:55:28 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:55:28 user nova-compute[73391]:   </features>
Aug 15 05:55:28 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:55:28 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:55:28 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:55:28 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:55:28 user nova-compute[73391]:   </clock>
Aug 15 05:55:28 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:55:28 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:55:28 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:55:28 user nova-compute[73391]:   </cpu>
Aug 15 05:55:28 user nova-compute[73391]:   <devices>
Aug 15 05:55:28 user nova-compute[73391]:     <disk type="file" device="disk">
Aug 15 05:55:28 user nova-compute[73391]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 05:55:28 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/d10508dd-f3f7-4e96-b822-d331ded6809f/disk"/>
Aug 15 05:55:28 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:55:28 user nova-compute[73391]:     </disk>
Aug 15 05:55:28 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:55:28 user nova-compute[73391]:       <mac address="fa:16:3e:91:71:96"/>
Aug 15 05:55:28 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:55:28 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:55:28 user nova-compute[73391]:       <target dev="tapbad7b5c4-68"/>
Aug 15 05:55:28 user nova-compute[73391]:     </interface>
Aug 15 05:55:28 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:55:28 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/d10508dd-f3f7-4e96-b822-d331ded6809f/console.log" append="off"/>
Aug 15 05:55:28 user nova-compute[73391]:     </serial>
Aug 15 05:55:28 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:55:28 user nova-compute[73391]:     <video>
Aug 15 05:55:28 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:55:28 user nova-compute[73391]:     </video>
Aug 15 05:55:28 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:55:28 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:55:28 user nova-compute[73391]:     </rng>
Aug 15 05:55:28 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:55:28 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:55:28 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:55:28 user nova-compute[73391]:     </memballoon>
Aug 15 05:55:28 user nova-compute[73391]:   </devices>
Aug 15 05:55:28 user nova-compute[73391]: </domain>
Aug 15 05:55:28 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:55:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1638516350',display_name='tempest-TestMinimumBasicScenario-server-1638516350',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1638516350',id=46,image_ref='d9b08b04-9688-4e5e-90eb-5ae0465c6517',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyWsG9ehEQcqlBsyrmyWtybq7vloOElSYR0j7Ou42ASZEw1IFAr5wdOLp6A6sbdR8fm5tdu1cPwGw1di232sVJtsalZJWCrvAInL7ggWTRRw/y74jndzteUjAIxDm/s8Q==',key_name='tempest-TestMinimumBasicScenario-1867600907',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd985a0cd6884c858487187ce252bba5',ramdisk_id='',reservation_id='r-agv6ww0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d9b08b04-9688-4e5e-90eb-5ae0465c6517',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1535355155',owner_user_name='tempest-TestMinimumBasicScenario-1535355155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:55:26Z,user_data=None,user_id='db323067fefa4b1f8aa28f10a997b9d4',uuid=d10508dd-f3f7-4e96-b822-d331ded6809f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bad7b5c4-680d-4f22-9fc0-53e0ac551260", "address": "fa:16:3e:91:71:96", "network": {"id": "2a8063f6-42ce-41b8-86f6-72c17f4c2a7b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1765547969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd985a0cd6884c858487187ce252bba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad7b5c4-68", "ovs_interfaceid": "bad7b5c4-680d-4f22-9fc0-53e0ac551260", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Converting VIF {"id": "bad7b5c4-680d-4f22-9fc0-53e0ac551260", "address": "fa:16:3e:91:71:96", "network": {"id": "2a8063f6-42ce-41b8-86f6-72c17f4c2a7b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1765547969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd985a0cd6884c858487187ce252bba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad7b5c4-68", "ovs_interfaceid": "bad7b5c4-680d-4f22-9fc0-53e0ac551260", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:91:71:96,bridge_name='br-int',has_traffic_filtering=True,id=bad7b5c4-680d-4f22-9fc0-53e0ac551260,network=Network(2a8063f6-42ce-41b8-86f6-72c17f4c2a7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbad7b5c4-68') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG os_vif [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:71:96,bridge_name='br-int',has_traffic_filtering=True,id=bad7b5c4-680d-4f22-9fc0-53e0ac551260,network=Network(2a8063f6-42ce-41b8-86f6-72c17f4c2a7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbad7b5c4-68') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbad7b5c4-68, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbad7b5c4-68, col_values=(('external_ids', {'iface-id': 'bad7b5c4-680d-4f22-9fc0-53e0ac551260', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:71:96', 'vm-uuid': 'd10508dd-f3f7-4e96-b822-d331ded6809f'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:55:28 user nova-compute[73391]: INFO os_vif [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:91:71:96,bridge_name='br-int',has_traffic_filtering=True,id=bad7b5c4-680d-4f22-9fc0-53e0ac551260,network=Network(2a8063f6-42ce-41b8-86f6-72c17f4c2a7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbad7b5c4-68')
Aug 15 05:55:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/disk.rescue --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] No VIF found with MAC fa:16:3e:91:71:96, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/134610fb-ed36-4ecb-a884-a26febb7943d/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG nova.network.neutron [req-fa481947-cf94-4bf5-89b2-f62d77f69eef req-4a5b9c0d-cd25-4c98-8510-5f4aaf160e6a service nova] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Updated VIF entry in instance network info cache for port bad7b5c4-680d-4f22-9fc0-53e0ac551260. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG nova.network.neutron [req-fa481947-cf94-4bf5-89b2-f62d77f69eef req-4a5b9c0d-cd25-4c98-8510-5f4aaf160e6a service nova] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Updating instance_info_cache with network_info: [{"id": "bad7b5c4-680d-4f22-9fc0-53e0ac551260", "address": "fa:16:3e:91:71:96", "network": {"id": "2a8063f6-42ce-41b8-86f6-72c17f4c2a7b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1765547969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd985a0cd6884c858487187ce252bba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad7b5c4-68", "ovs_interfaceid": "bad7b5c4-680d-4f22-9fc0-53e0ac551260", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:55:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-fa481947-cf94-4bf5-89b2-f62d77f69eef req-4a5b9c0d-cd25-4c98-8510-5f4aaf160e6a service nova] Releasing lock "refresh_cache-d10508dd-f3f7-4e96-b822-d331ded6809f" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:55:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/134610fb-ed36-4ecb-a884-a26febb7943d/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:55:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/134610fb-ed36-4ecb-a884-a26febb7943d/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:55:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/134610fb-ed36-4ecb-a884-a26febb7943d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:55:29 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:55:29 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:55:29 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:55:29 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Hypervisor/Node resource view: name=user free_ram=8312MB free_disk=24.99508285522461GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 05:55:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:55:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:55:29 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 3adc0c85-0f31-4a73-8b98-eb1a4b32434d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:55:29 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 134610fb-ed36-4ecb-a884-a26febb7943d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:55:29 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance f730e539-5371-49d7-8487-d94f400fe0bc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:55:29 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:55:29 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance d10508dd-f3f7-4e96-b822-d331ded6809f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:55:29 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 05:55:29 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 05:55:29 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:55:29 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:55:29 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:55:30 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Compute_service record updated for user:user {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 05:55:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.413s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:55:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:55:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:55:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:55:30 user nova-compute[73391]: DEBUG nova.compute.manager [req-af8c2443-e878-4c09-8ae7-4c1359f836e4 req-9aeea762-1fae-4d28-a4b5-13c69ea262fb service nova] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Received event network-vif-plugged-bad7b5c4-680d-4f22-9fc0-53e0ac551260 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:55:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-af8c2443-e878-4c09-8ae7-4c1359f836e4 req-9aeea762-1fae-4d28-a4b5-13c69ea262fb service nova] Acquiring lock "d10508dd-f3f7-4e96-b822-d331ded6809f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:55:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-af8c2443-e878-4c09-8ae7-4c1359f836e4 req-9aeea762-1fae-4d28-a4b5-13c69ea262fb service nova] Lock "d10508dd-f3f7-4e96-b822-d331ded6809f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:55:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-af8c2443-e878-4c09-8ae7-4c1359f836e4 req-9aeea762-1fae-4d28-a4b5-13c69ea262fb service nova] Lock "d10508dd-f3f7-4e96-b822-d331ded6809f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:55:30 user nova-compute[73391]: DEBUG nova.compute.manager [req-af8c2443-e878-4c09-8ae7-4c1359f836e4 req-9aeea762-1fae-4d28-a4b5-13c69ea262fb service nova] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] No waiting events found dispatching network-vif-plugged-bad7b5c4-680d-4f22-9fc0-53e0ac551260 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:55:30 user nova-compute[73391]: WARNING nova.compute.manager [req-af8c2443-e878-4c09-8ae7-4c1359f836e4 req-9aeea762-1fae-4d28-a4b5-13c69ea262fb service nova] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Received unexpected event network-vif-plugged-bad7b5c4-680d-4f22-9fc0-53e0ac551260 for instance with vm_state building and task_state spawning.
Aug 15 05:55:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:55:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:55:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:55:32 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:55:32 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:55:32 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078932.193618, d10508dd-f3f7-4e96-b822-d331ded6809f => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:55:32 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] VM Resumed (Lifecycle Event)
Aug 15 05:55:32 user nova-compute[73391]: DEBUG nova.compute.manager [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:55:32 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Guest created on hypervisor {{(pid=73391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 05:55:32 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Instance spawned successfully.
Aug 15 05:55:32 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 05:55:32 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:55:32 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:55:32 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Found default for hw_cdrom_bus of ide {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:55:32 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Found default for hw_disk_bus of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:55:32 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Found default for hw_input_bus of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:55:32 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Found default for hw_pointer_model of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:55:32 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Found default for hw_video_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:55:32 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Found default for hw_vif_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:55:32 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:55:32 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078932.1949253, d10508dd-f3f7-4e96-b822-d331ded6809f => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:55:32 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] VM Started (Lifecycle Event)
Aug 15 05:55:32 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:55:32 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:55:32 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:55:32 user nova-compute[73391]: INFO nova.compute.manager [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Took 6.37 seconds to spawn the instance on the hypervisor.
Aug 15 05:55:32 user nova-compute[73391]: DEBUG nova.compute.manager [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:55:32 user nova-compute[73391]: DEBUG nova.compute.manager [req-78e552ab-3f5f-46e1-996f-4f4174db34c5 req-d3dc7ef3-ead4-481f-b5da-6b973c0d1c81 service nova] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Received event network-vif-plugged-bad7b5c4-680d-4f22-9fc0-53e0ac551260 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:55:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-78e552ab-3f5f-46e1-996f-4f4174db34c5 req-d3dc7ef3-ead4-481f-b5da-6b973c0d1c81 service nova] Acquiring lock "d10508dd-f3f7-4e96-b822-d331ded6809f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:55:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-78e552ab-3f5f-46e1-996f-4f4174db34c5 req-d3dc7ef3-ead4-481f-b5da-6b973c0d1c81 service nova] Lock "d10508dd-f3f7-4e96-b822-d331ded6809f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:55:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-78e552ab-3f5f-46e1-996f-4f4174db34c5 req-d3dc7ef3-ead4-481f-b5da-6b973c0d1c81 service nova] Lock "d10508dd-f3f7-4e96-b822-d331ded6809f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:55:32 user nova-compute[73391]: DEBUG nova.compute.manager [req-78e552ab-3f5f-46e1-996f-4f4174db34c5 req-d3dc7ef3-ead4-481f-b5da-6b973c0d1c81 service nova] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] No waiting events found dispatching network-vif-plugged-bad7b5c4-680d-4f22-9fc0-53e0ac551260 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:55:32 user nova-compute[73391]: WARNING nova.compute.manager [req-78e552ab-3f5f-46e1-996f-4f4174db34c5 req-d3dc7ef3-ead4-481f-b5da-6b973c0d1c81 service nova] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Received unexpected event network-vif-plugged-bad7b5c4-680d-4f22-9fc0-53e0ac551260 for instance with vm_state building and task_state spawning.
Aug 15 05:55:32 user nova-compute[73391]: INFO nova.compute.manager [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Took 6.98 seconds to build instance.
Aug 15 05:55:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-b02e7b93-399d-45c6-b62e-14e8d4bf052e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "d10508dd-f3f7-4e96-b822-d331ded6809f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.073s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:55:32 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:55:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:55:33 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:55:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:55:35 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:55:37 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:55:37 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Starting heal instance info cache {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 05:55:37 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "refresh_cache-134610fb-ed36-4ecb-a884-a26febb7943d" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:55:37 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquired lock "refresh_cache-134610fb-ed36-4ecb-a884-a26febb7943d" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:55:37 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Forcefully refreshing network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 05:55:38 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Updating instance_info_cache with network_info: [{"id": "26dd9755-2d2e-4165-88ca-e00170b943f1", "address": "fa:16:3e:eb:3c:1d", "network": {"id": "bc2718a2-a5ab-44e0-966d-9b180a30ac75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1022668030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8086add121594fe8a0bdde99dd9cae90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dd9755-2d", "ovs_interfaceid": "26dd9755-2d2e-4165-88ca-e00170b943f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:55:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Releasing lock "refresh_cache-134610fb-ed36-4ecb-a884-a26febb7943d" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:55:38 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Updated the network info_cache for instance {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 05:55:38 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:55:38 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 05:55:38 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:55:38 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:55:40 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:55:41 user nova-compute[73391]: INFO nova.compute.manager [None req-112b4208-8cd9-4b79-94ef-093292e0f210 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Unrescuing
Aug 15 05:55:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-112b4208-8cd9-4b79-94ef-093292e0f210 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Acquiring lock "refresh_cache-3adc0c85-0f31-4a73-8b98-eb1a4b32434d" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:55:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-112b4208-8cd9-4b79-94ef-093292e0f210 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Acquired lock "refresh_cache-3adc0c85-0f31-4a73-8b98-eb1a4b32434d" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:55:41 user nova-compute[73391]: DEBUG nova.network.neutron [None req-112b4208-8cd9-4b79-94ef-093292e0f210 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:55:41 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:55:41 user nova-compute[73391]: DEBUG nova.network.neutron [None req-112b4208-8cd9-4b79-94ef-093292e0f210 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Updating instance_info_cache with network_info: [{"id": "95260c2c-bfa7-42c2-934b-af9874c68201", "address": "fa:16:3e:9e:93:8d", "network": {"id": "6444073e-0d7a-4ecd-a945-4cbbb6bf2c92", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1589197255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d6c4fcd171841d6b59b8b400efd0619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95260c2c-bf", "ovs_interfaceid": "95260c2c-bfa7-42c2-934b-af9874c68201", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:55:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-112b4208-8cd9-4b79-94ef-093292e0f210 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Releasing lock "refresh_cache-3adc0c85-0f31-4a73-8b98-eb1a4b32434d" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:55:41 user nova-compute[73391]: DEBUG nova.objects.instance [None req-112b4208-8cd9-4b79-94ef-093292e0f210 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Lazy-loading 'flavor' on Instance uuid 3adc0c85-0f31-4a73-8b98-eb1a4b32434d {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:55:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:55:42 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:55:42 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:55:42 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:55:42 user nova-compute[73391]: DEBUG nova.compute.manager [req-ab355a4c-cc91-4e47-a632-c7127d9ce961 req-d367b74a-ba11-496f-a55b-75622eed3a01 service nova] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Received event network-vif-unplugged-95260c2c-bfa7-42c2-934b-af9874c68201 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:55:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ab355a4c-cc91-4e47-a632-c7127d9ce961 req-d367b74a-ba11-496f-a55b-75622eed3a01 service nova] Acquiring lock "3adc0c85-0f31-4a73-8b98-eb1a4b32434d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:55:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ab355a4c-cc91-4e47-a632-c7127d9ce961 req-d367b74a-ba11-496f-a55b-75622eed3a01 service nova] Lock "3adc0c85-0f31-4a73-8b98-eb1a4b32434d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:55:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ab355a4c-cc91-4e47-a632-c7127d9ce961 req-d367b74a-ba11-496f-a55b-75622eed3a01 service nova] Lock "3adc0c85-0f31-4a73-8b98-eb1a4b32434d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:55:42 user nova-compute[73391]: DEBUG nova.compute.manager [req-ab355a4c-cc91-4e47-a632-c7127d9ce961 req-d367b74a-ba11-496f-a55b-75622eed3a01 service nova] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] No waiting events found dispatching network-vif-unplugged-95260c2c-bfa7-42c2-934b-af9874c68201 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:55:42 user nova-compute[73391]: WARNING nova.compute.manager [req-ab355a4c-cc91-4e47-a632-c7127d9ce961 req-d367b74a-ba11-496f-a55b-75622eed3a01 service nova] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Received unexpected event network-vif-unplugged-95260c2c-bfa7-42c2-934b-af9874c68201 for instance with vm_state rescued and task_state unrescuing.
Aug 15 05:55:42 user nova-compute[73391]: DEBUG nova.compute.manager [req-dc27c8f0-e822-4fc3-a5b2-cbaf2d13f111 req-b0a16eaf-5518-410a-bc1b-7aed5ca634a7 service nova] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Received event network-changed-95260c2c-bfa7-42c2-934b-af9874c68201 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:55:42 user nova-compute[73391]: DEBUG nova.compute.manager [req-dc27c8f0-e822-4fc3-a5b2-cbaf2d13f111 req-b0a16eaf-5518-410a-bc1b-7aed5ca634a7 service nova] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Refreshing instance network info cache due to event network-changed-95260c2c-bfa7-42c2-934b-af9874c68201. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:55:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-dc27c8f0-e822-4fc3-a5b2-cbaf2d13f111 req-b0a16eaf-5518-410a-bc1b-7aed5ca634a7 service nova] Acquiring lock "refresh_cache-3adc0c85-0f31-4a73-8b98-eb1a4b32434d" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:55:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-dc27c8f0-e822-4fc3-a5b2-cbaf2d13f111 req-b0a16eaf-5518-410a-bc1b-7aed5ca634a7 service nova] Acquired lock "refresh_cache-3adc0c85-0f31-4a73-8b98-eb1a4b32434d" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:55:42 user nova-compute[73391]: DEBUG nova.network.neutron [req-dc27c8f0-e822-4fc3-a5b2-cbaf2d13f111 req-b0a16eaf-5518-410a-bc1b-7aed5ca634a7 service nova] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Refreshing network info cache for port 95260c2c-bfa7-42c2-934b-af9874c68201 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:55:42 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Instance destroyed successfully.
Aug 15 05:55:43 user nova-compute[73391]: DEBUG nova.network.neutron [req-dc27c8f0-e822-4fc3-a5b2-cbaf2d13f111 req-b0a16eaf-5518-410a-bc1b-7aed5ca634a7 service nova] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Updated VIF entry in instance network info cache for port 95260c2c-bfa7-42c2-934b-af9874c68201. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:55:43 user nova-compute[73391]: DEBUG nova.network.neutron [req-dc27c8f0-e822-4fc3-a5b2-cbaf2d13f111 req-b0a16eaf-5518-410a-bc1b-7aed5ca634a7 service nova] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Updating instance_info_cache with network_info: [{"id": "95260c2c-bfa7-42c2-934b-af9874c68201", "address": "fa:16:3e:9e:93:8d", "network": {"id": "6444073e-0d7a-4ecd-a945-4cbbb6bf2c92", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1589197255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d6c4fcd171841d6b59b8b400efd0619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95260c2c-bf", "ovs_interfaceid": "95260c2c-bfa7-42c2-934b-af9874c68201", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:55:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-dc27c8f0-e822-4fc3-a5b2-cbaf2d13f111 req-b0a16eaf-5518-410a-bc1b-7aed5ca634a7 service nova] Releasing lock "refresh_cache-3adc0c85-0f31-4a73-8b98-eb1a4b32434d" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:55:43 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:55:43 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:55:43 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:55:44 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:55:44 user nova-compute[73391]: DEBUG nova.compute.manager [req-b40529d4-68c2-4112-b0d3-718eda72fe0d req-4c1d7d2b-49dd-414b-a5cd-629ebbb1ac7a service nova] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Received event network-vif-plugged-95260c2c-bfa7-42c2-934b-af9874c68201 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:55:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-b40529d4-68c2-4112-b0d3-718eda72fe0d req-4c1d7d2b-49dd-414b-a5cd-629ebbb1ac7a service nova] Acquiring lock "3adc0c85-0f31-4a73-8b98-eb1a4b32434d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:55:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-b40529d4-68c2-4112-b0d3-718eda72fe0d req-4c1d7d2b-49dd-414b-a5cd-629ebbb1ac7a service nova] Lock "3adc0c85-0f31-4a73-8b98-eb1a4b32434d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:55:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-b40529d4-68c2-4112-b0d3-718eda72fe0d req-4c1d7d2b-49dd-414b-a5cd-629ebbb1ac7a service nova] Lock "3adc0c85-0f31-4a73-8b98-eb1a4b32434d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:55:44 user nova-compute[73391]: DEBUG nova.compute.manager [req-b40529d4-68c2-4112-b0d3-718eda72fe0d req-4c1d7d2b-49dd-414b-a5cd-629ebbb1ac7a service nova] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] No waiting events found dispatching network-vif-plugged-95260c2c-bfa7-42c2-934b-af9874c68201 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:55:44 user nova-compute[73391]: WARNING nova.compute.manager [req-b40529d4-68c2-4112-b0d3-718eda72fe0d req-4c1d7d2b-49dd-414b-a5cd-629ebbb1ac7a service nova] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Received unexpected event network-vif-plugged-95260c2c-bfa7-42c2-934b-af9874c68201 for instance with vm_state rescued and task_state unrescuing.
Aug 15 05:55:44 user nova-compute[73391]: DEBUG nova.compute.manager [req-b40529d4-68c2-4112-b0d3-718eda72fe0d req-4c1d7d2b-49dd-414b-a5cd-629ebbb1ac7a service nova] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Received event network-vif-plugged-95260c2c-bfa7-42c2-934b-af9874c68201 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:55:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-b40529d4-68c2-4112-b0d3-718eda72fe0d req-4c1d7d2b-49dd-414b-a5cd-629ebbb1ac7a service nova] Acquiring lock "3adc0c85-0f31-4a73-8b98-eb1a4b32434d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:55:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-b40529d4-68c2-4112-b0d3-718eda72fe0d req-4c1d7d2b-49dd-414b-a5cd-629ebbb1ac7a service nova] Lock "3adc0c85-0f31-4a73-8b98-eb1a4b32434d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:55:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-b40529d4-68c2-4112-b0d3-718eda72fe0d req-4c1d7d2b-49dd-414b-a5cd-629ebbb1ac7a service nova] Lock "3adc0c85-0f31-4a73-8b98-eb1a4b32434d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:55:44 user nova-compute[73391]: DEBUG nova.compute.manager [req-b40529d4-68c2-4112-b0d3-718eda72fe0d req-4c1d7d2b-49dd-414b-a5cd-629ebbb1ac7a service nova] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] No waiting events found dispatching network-vif-plugged-95260c2c-bfa7-42c2-934b-af9874c68201 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:55:44 user nova-compute[73391]: WARNING nova.compute.manager [req-b40529d4-68c2-4112-b0d3-718eda72fe0d req-4c1d7d2b-49dd-414b-a5cd-629ebbb1ac7a service nova] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Received unexpected event network-vif-plugged-95260c2c-bfa7-42c2-934b-af9874c68201 for instance with vm_state rescued and task_state unrescuing.
Aug 15 05:55:44 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:55:44 user nova-compute[73391]: DEBUG nova.compute.manager [req-43e2fbe6-7295-49ca-87a3-8445db463627 req-5477613e-25bc-4f12-9948-c094a1da4b6d service nova] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Received event network-changed-95260c2c-bfa7-42c2-934b-af9874c68201 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:55:44 user nova-compute[73391]: DEBUG nova.compute.manager [req-43e2fbe6-7295-49ca-87a3-8445db463627 req-5477613e-25bc-4f12-9948-c094a1da4b6d service nova] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Refreshing instance network info cache due to event network-changed-95260c2c-bfa7-42c2-934b-af9874c68201. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:55:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-43e2fbe6-7295-49ca-87a3-8445db463627 req-5477613e-25bc-4f12-9948-c094a1da4b6d service nova] Acquiring lock "refresh_cache-3adc0c85-0f31-4a73-8b98-eb1a4b32434d" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:55:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-43e2fbe6-7295-49ca-87a3-8445db463627 req-5477613e-25bc-4f12-9948-c094a1da4b6d service nova] Acquired lock "refresh_cache-3adc0c85-0f31-4a73-8b98-eb1a4b32434d" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:55:44 user nova-compute[73391]: DEBUG nova.network.neutron [req-43e2fbe6-7295-49ca-87a3-8445db463627 req-5477613e-25bc-4f12-9948-c094a1da4b6d service nova] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Refreshing network info cache for port 95260c2c-bfa7-42c2-934b-af9874c68201 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:55:44 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:55:44 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:55:44 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:55:45 user nova-compute[73391]: DEBUG nova.network.neutron [req-43e2fbe6-7295-49ca-87a3-8445db463627 req-5477613e-25bc-4f12-9948-c094a1da4b6d service nova] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Updated VIF entry in instance network info cache for port 95260c2c-bfa7-42c2-934b-af9874c68201. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:55:45 user nova-compute[73391]: DEBUG nova.network.neutron [req-43e2fbe6-7295-49ca-87a3-8445db463627 req-5477613e-25bc-4f12-9948-c094a1da4b6d service nova] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Updating instance_info_cache with network_info: [{"id": "95260c2c-bfa7-42c2-934b-af9874c68201", "address": "fa:16:3e:9e:93:8d", "network": {"id": "6444073e-0d7a-4ecd-a945-4cbbb6bf2c92", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1589197255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d6c4fcd171841d6b59b8b400efd0619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95260c2c-bf", "ovs_interfaceid": "95260c2c-bfa7-42c2-934b-af9874c68201", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:55:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-43e2fbe6-7295-49ca-87a3-8445db463627 req-5477613e-25bc-4f12-9948-c094a1da4b6d service nova] Releasing lock "refresh_cache-3adc0c85-0f31-4a73-8b98-eb1a4b32434d" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:55:46 user nova-compute[73391]: DEBUG nova.compute.manager [req-16eeabd1-7140-42c3-98c0-b7a526d6cb6d req-93afcf17-eb9a-4c92-8f87-deae114c85bd service nova] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Received event network-vif-plugged-95260c2c-bfa7-42c2-934b-af9874c68201 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:55:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-16eeabd1-7140-42c3-98c0-b7a526d6cb6d req-93afcf17-eb9a-4c92-8f87-deae114c85bd service nova] Acquiring lock "3adc0c85-0f31-4a73-8b98-eb1a4b32434d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:55:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-16eeabd1-7140-42c3-98c0-b7a526d6cb6d req-93afcf17-eb9a-4c92-8f87-deae114c85bd service nova] Lock "3adc0c85-0f31-4a73-8b98-eb1a4b32434d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:55:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-16eeabd1-7140-42c3-98c0-b7a526d6cb6d req-93afcf17-eb9a-4c92-8f87-deae114c85bd service nova] Lock "3adc0c85-0f31-4a73-8b98-eb1a4b32434d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:55:46 user nova-compute[73391]: DEBUG nova.compute.manager [req-16eeabd1-7140-42c3-98c0-b7a526d6cb6d req-93afcf17-eb9a-4c92-8f87-deae114c85bd service nova] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] No waiting events found dispatching network-vif-plugged-95260c2c-bfa7-42c2-934b-af9874c68201 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:55:46 user nova-compute[73391]: WARNING nova.compute.manager [req-16eeabd1-7140-42c3-98c0-b7a526d6cb6d req-93afcf17-eb9a-4c92-8f87-deae114c85bd service nova] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Received unexpected event network-vif-plugged-95260c2c-bfa7-42c2-934b-af9874c68201 for instance with vm_state rescued and task_state unrescuing.
Aug 15 05:55:46 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Removed pending event for 3adc0c85-0f31-4a73-8b98-eb1a4b32434d due to event {{(pid=73391) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 05:55:46 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078946.4021943, 3adc0c85-0f31-4a73-8b98-eb1a4b32434d => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:55:46 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] VM Resumed (Lifecycle Event)
Aug 15 05:55:46 user nova-compute[73391]: DEBUG nova.compute.manager [None req-112b4208-8cd9-4b79-94ef-093292e0f210 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:55:46 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:55:46 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:55:46 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] During sync_power_state the instance has a pending task (unrescuing). Skip.
Aug 15 05:55:46 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692078946.4034772, 3adc0c85-0f31-4a73-8b98-eb1a4b32434d => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:55:46 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] VM Started (Lifecycle Event)
Aug 15 05:55:46 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:55:46 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:55:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:55:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3455a9c0-20bb-4d90-a7f0-de83e98b42ef tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Acquiring lock "134610fb-ed36-4ecb-a884-a26febb7943d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:55:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3455a9c0-20bb-4d90-a7f0-de83e98b42ef tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "134610fb-ed36-4ecb-a884-a26febb7943d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:55:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3455a9c0-20bb-4d90-a7f0-de83e98b42ef tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Acquiring lock "134610fb-ed36-4ecb-a884-a26febb7943d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:55:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3455a9c0-20bb-4d90-a7f0-de83e98b42ef tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "134610fb-ed36-4ecb-a884-a26febb7943d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:55:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3455a9c0-20bb-4d90-a7f0-de83e98b42ef tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "134610fb-ed36-4ecb-a884-a26febb7943d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:55:49 user nova-compute[73391]: INFO nova.compute.manager [None req-3455a9c0-20bb-4d90-a7f0-de83e98b42ef tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Terminating instance
Aug 15 05:55:49 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3455a9c0-20bb-4d90-a7f0-de83e98b42ef tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Start destroying the instance on the hypervisor. {{(pid=73391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 05:55:49 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:55:49 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:55:49 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:55:49 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:55:49 user nova-compute[73391]: DEBUG nova.compute.manager [req-4cee5fa3-9bd0-4a2b-8729-3c250b401086 req-c1d689fa-dff9-44f5-b344-77b79369c12e service nova] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Received event network-vif-unplugged-26dd9755-2d2e-4165-88ca-e00170b943f1 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:55:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-4cee5fa3-9bd0-4a2b-8729-3c250b401086 req-c1d689fa-dff9-44f5-b344-77b79369c12e service nova] Acquiring lock "134610fb-ed36-4ecb-a884-a26febb7943d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:55:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-4cee5fa3-9bd0-4a2b-8729-3c250b401086 req-c1d689fa-dff9-44f5-b344-77b79369c12e service nova] Lock "134610fb-ed36-4ecb-a884-a26febb7943d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:55:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-4cee5fa3-9bd0-4a2b-8729-3c250b401086 req-c1d689fa-dff9-44f5-b344-77b79369c12e service nova] Lock "134610fb-ed36-4ecb-a884-a26febb7943d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:55:49 user nova-compute[73391]: DEBUG nova.compute.manager [req-4cee5fa3-9bd0-4a2b-8729-3c250b401086 req-c1d689fa-dff9-44f5-b344-77b79369c12e service nova] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] No waiting events found dispatching network-vif-unplugged-26dd9755-2d2e-4165-88ca-e00170b943f1 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:55:49 user nova-compute[73391]: DEBUG nova.compute.manager [req-4cee5fa3-9bd0-4a2b-8729-3c250b401086 req-c1d689fa-dff9-44f5-b344-77b79369c12e service nova] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Received event network-vif-unplugged-26dd9755-2d2e-4165-88ca-e00170b943f1 for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 05:55:49 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:55:50 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Instance destroyed successfully.
Aug 15 05:55:50 user nova-compute[73391]: DEBUG nova.objects.instance [None req-3455a9c0-20bb-4d90-a7f0-de83e98b42ef tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lazy-loading 'resources' on Instance uuid 134610fb-ed36-4ecb-a884-a26febb7943d {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:55:50 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-3455a9c0-20bb-4d90-a7f0-de83e98b42ef tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:50:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-818670014',display_name='tempest-AttachVolumeNegativeTest-server-818670014',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-818670014',id=41,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImkim6ov9DeYYcyYsOdyj+YvgjCNyYKjKBCOayYji2g5VMN371MxRtS1UBm92iz+0MIF/ApPQzE/qe2gGoDPUZgFmhqem58PMw7/WiRsreIDbkNor0HR7pdNa9wlhUADg==',key_name='tempest-keypair-384761910',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:50:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8086add121594fe8a0bdde99dd9cae90',ramdisk_id='',reservation_id='r-lka2eu2u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1479702824',owner_user_name='tempest-AttachVolumeNegativeTest-1479702824-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:50:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9552a83a6a214c149ddceac64ccbdef6',uuid=134610fb-ed36-4ecb-a884-a26febb7943d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26dd9755-2d2e-4165-88ca-e00170b943f1", "address": "fa:16:3e:eb:3c:1d", "network": {"id": "bc2718a2-a5ab-44e0-966d-9b180a30ac75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1022668030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8086add121594fe8a0bdde99dd9cae90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dd9755-2d", "ovs_interfaceid": "26dd9755-2d2e-4165-88ca-e00170b943f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:55:50 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-3455a9c0-20bb-4d90-a7f0-de83e98b42ef tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Converting VIF {"id": "26dd9755-2d2e-4165-88ca-e00170b943f1", "address": "fa:16:3e:eb:3c:1d", "network": {"id": "bc2718a2-a5ab-44e0-966d-9b180a30ac75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1022668030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8086add121594fe8a0bdde99dd9cae90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26dd9755-2d", "ovs_interfaceid": "26dd9755-2d2e-4165-88ca-e00170b943f1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:55:50 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-3455a9c0-20bb-4d90-a7f0-de83e98b42ef tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:3c:1d,bridge_name='br-int',has_traffic_filtering=True,id=26dd9755-2d2e-4165-88ca-e00170b943f1,network=Network(bc2718a2-a5ab-44e0-966d-9b180a30ac75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26dd9755-2d') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:55:50 user nova-compute[73391]: DEBUG os_vif [None req-3455a9c0-20bb-4d90-a7f0-de83e98b42ef tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:3c:1d,bridge_name='br-int',has_traffic_filtering=True,id=26dd9755-2d2e-4165-88ca-e00170b943f1,network=Network(bc2718a2-a5ab-44e0-966d-9b180a30ac75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26dd9755-2d') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:55:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:55:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26dd9755-2d, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:55:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:55:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:55:50 user nova-compute[73391]: INFO os_vif [None req-3455a9c0-20bb-4d90-a7f0-de83e98b42ef tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:3c:1d,bridge_name='br-int',has_traffic_filtering=True,id=26dd9755-2d2e-4165-88ca-e00170b943f1,network=Network(bc2718a2-a5ab-44e0-966d-9b180a30ac75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26dd9755-2d')
Aug 15 05:55:50 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-3455a9c0-20bb-4d90-a7f0-de83e98b42ef tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Deleting instance files /opt/stack/data/nova/instances/134610fb-ed36-4ecb-a884-a26febb7943d_del
Aug 15 05:55:50 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-3455a9c0-20bb-4d90-a7f0-de83e98b42ef tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Deletion of /opt/stack/data/nova/instances/134610fb-ed36-4ecb-a884-a26febb7943d_del complete
Aug 15 05:55:50 user nova-compute[73391]: INFO nova.compute.manager [None req-3455a9c0-20bb-4d90-a7f0-de83e98b42ef tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 15 05:55:50 user nova-compute[73391]: DEBUG oslo.service.loopingcall [None req-3455a9c0-20bb-4d90-a7f0-de83e98b42ef tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 05:55:50 user nova-compute[73391]: DEBUG nova.compute.manager [-] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Deallocating network for instance {{(pid=73391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 05:55:50 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] deallocate_for_instance() {{(pid=73391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 05:55:51 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:55:51 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Took 1.01 seconds to deallocate network for instance.
Aug 15 05:55:51 user nova-compute[73391]: DEBUG nova.compute.manager [req-961d7b66-5c20-4de6-8198-55694efafe63 req-77591609-f012-46f0-a437-ce1dfe4ecc41 service nova] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Received event network-vif-deleted-26dd9755-2d2e-4165-88ca-e00170b943f1 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:55:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3455a9c0-20bb-4d90-a7f0-de83e98b42ef tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:55:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3455a9c0-20bb-4d90-a7f0-de83e98b42ef tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:55:51 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3455a9c0-20bb-4d90-a7f0-de83e98b42ef tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:55:51 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3455a9c0-20bb-4d90-a7f0-de83e98b42ef tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:55:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3455a9c0-20bb-4d90-a7f0-de83e98b42ef tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.198s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:55:51 user nova-compute[73391]: INFO nova.scheduler.client.report [None req-3455a9c0-20bb-4d90-a7f0-de83e98b42ef tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Deleted allocations for instance 134610fb-ed36-4ecb-a884-a26febb7943d
Aug 15 05:55:51 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3455a9c0-20bb-4d90-a7f0-de83e98b42ef tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "134610fb-ed36-4ecb-a884-a26febb7943d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.312s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:55:52 user nova-compute[73391]: DEBUG nova.compute.manager [req-47064658-b84f-4979-8597-5db824b2c17a req-7cbe248e-2b6b-4016-a85d-2b0941e2f3c9 service nova] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Received event network-vif-plugged-26dd9755-2d2e-4165-88ca-e00170b943f1 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:55:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-47064658-b84f-4979-8597-5db824b2c17a req-7cbe248e-2b6b-4016-a85d-2b0941e2f3c9 service nova] Acquiring lock "134610fb-ed36-4ecb-a884-a26febb7943d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:55:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-47064658-b84f-4979-8597-5db824b2c17a req-7cbe248e-2b6b-4016-a85d-2b0941e2f3c9 service nova] Lock "134610fb-ed36-4ecb-a884-a26febb7943d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:55:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-47064658-b84f-4979-8597-5db824b2c17a req-7cbe248e-2b6b-4016-a85d-2b0941e2f3c9 service nova] Lock "134610fb-ed36-4ecb-a884-a26febb7943d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:55:52 user nova-compute[73391]: DEBUG nova.compute.manager [req-47064658-b84f-4979-8597-5db824b2c17a req-7cbe248e-2b6b-4016-a85d-2b0941e2f3c9 service nova] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] No waiting events found dispatching network-vif-plugged-26dd9755-2d2e-4165-88ca-e00170b943f1 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:55:52 user nova-compute[73391]: WARNING nova.compute.manager [req-47064658-b84f-4979-8597-5db824b2c17a req-7cbe248e-2b6b-4016-a85d-2b0941e2f3c9 service nova] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Received unexpected event network-vif-plugged-26dd9755-2d2e-4165-88ca-e00170b943f1 for instance with vm_state deleted and task_state None.
Aug 15 05:55:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:55:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:55:57 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:55:57 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73391) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 05:55:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:56:00 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:56:03 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:56:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:56:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:56:05 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692078950.4319563, 134610fb-ed36-4ecb-a884-a26febb7943d => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:56:05 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] VM Stopped (Lifecycle Event)
Aug 15 05:56:05 user nova-compute[73391]: DEBUG nova.compute.manager [None req-5bba7a6e-7c82-4a3d-90b8-ba49f862ada5 None None] [instance: 134610fb-ed36-4ecb-a884-a26febb7943d] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:56:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:56:10 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:56:10 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:56:11 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:56:11 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Triggering sync for uuid 3adc0c85-0f31-4a73-8b98-eb1a4b32434d {{(pid=73391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 05:56:11 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Triggering sync for uuid f730e539-5371-49d7-8487-d94f400fe0bc {{(pid=73391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 05:56:11 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Triggering sync for uuid 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22 {{(pid=73391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 05:56:11 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Triggering sync for uuid d10508dd-f3f7-4e96-b822-d331ded6809f {{(pid=73391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 05:56:11 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "3adc0c85-0f31-4a73-8b98-eb1a4b32434d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:56:11 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "3adc0c85-0f31-4a73-8b98-eb1a4b32434d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:56:11 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "f730e539-5371-49d7-8487-d94f400fe0bc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:56:11 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "f730e539-5371-49d7-8487-d94f400fe0bc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:56:11 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "5a5cbbb3-3b78-48b5-9eee-342f52f1fc22" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:56:11 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "5a5cbbb3-3b78-48b5-9eee-342f52f1fc22" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:56:11 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "d10508dd-f3f7-4e96-b822-d331ded6809f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:56:11 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "d10508dd-f3f7-4e96-b822-d331ded6809f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:56:11 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "f730e539-5371-49d7-8487-d94f400fe0bc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:56:11 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "3adc0c85-0f31-4a73-8b98-eb1a4b32434d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:56:11 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "5a5cbbb3-3b78-48b5-9eee-342f52f1fc22" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:56:11 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "d10508dd-f3f7-4e96-b822-d331ded6809f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:56:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-cd8a56b7-0415-4464-b3c0-5af1e96559fd tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Acquiring lock "3adc0c85-0f31-4a73-8b98-eb1a4b32434d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:56:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-cd8a56b7-0415-4464-b3c0-5af1e96559fd tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Lock "3adc0c85-0f31-4a73-8b98-eb1a4b32434d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:56:14 user nova-compute[73391]: INFO nova.compute.manager [None req-cd8a56b7-0415-4464-b3c0-5af1e96559fd tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Detaching volume 97915103-1b6f-453d-a3af-74137ff0ac5a
Aug 15 05:56:14 user nova-compute[73391]: INFO nova.virt.block_device [None req-cd8a56b7-0415-4464-b3c0-5af1e96559fd tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Attempting to driver detach volume 97915103-1b6f-453d-a3af-74137ff0ac5a from mountpoint /dev/vdb
Aug 15 05:56:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-cd8a56b7-0415-4464-b3c0-5af1e96559fd tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Attempting to detach device vdb from instance 3adc0c85-0f31-4a73-8b98-eb1a4b32434d from the persistent domain config. {{(pid=73391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 05:56:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-cd8a56b7-0415-4464-b3c0-5af1e96559fd tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 05:56:14 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:56:14 user nova-compute[73391]:   <source dev="/dev/sdd"/>
Aug 15 05:56:14 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:56:14 user nova-compute[73391]:   <serial>97915103-1b6f-453d-a3af-74137ff0ac5a</serial>
Aug 15 05:56:14 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 05:56:14 user nova-compute[73391]: </disk>
Aug 15 05:56:14 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 05:56:14 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-cd8a56b7-0415-4464-b3c0-5af1e96559fd tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Successfully detached device vdb from instance 3adc0c85-0f31-4a73-8b98-eb1a4b32434d from the persistent domain config.
Aug 15 05:56:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-cd8a56b7-0415-4464-b3c0-5af1e96559fd tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3adc0c85-0f31-4a73-8b98-eb1a4b32434d from the live domain config. {{(pid=73391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 05:56:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-cd8a56b7-0415-4464-b3c0-5af1e96559fd tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 05:56:14 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:56:14 user nova-compute[73391]:   <source dev="/dev/sdd"/>
Aug 15 05:56:14 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:56:14 user nova-compute[73391]:   <serial>97915103-1b6f-453d-a3af-74137ff0ac5a</serial>
Aug 15 05:56:14 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 05:56:14 user nova-compute[73391]: </disk>
Aug 15 05:56:14 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 05:56:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Received event <DeviceRemovedEvent: 1692078974.8480396, 3adc0c85-0f31-4a73-8b98-eb1a4b32434d => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73391) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 05:56:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-cd8a56b7-0415-4464-b3c0-5af1e96559fd tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3adc0c85-0f31-4a73-8b98-eb1a4b32434d {{(pid=73391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 05:56:14 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-cd8a56b7-0415-4464-b3c0-5af1e96559fd tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Successfully detached device vdb from instance 3adc0c85-0f31-4a73-8b98-eb1a4b32434d from the live domain config.
Aug 15 05:56:14 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd8a56b7-0415-4464-b3c0-5af1e96559fd tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 05:56:14 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8a56b7-0415-4464-b3c0-5af1e96559fd tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ITvWxkwA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:56:14 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-cd8a56b7-0415-4464-b3c0-5af1e96559fd tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:56:14 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-cd8a56b7-0415-4464-b3c0-5af1e96559fd tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:56:14 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-cd8a56b7-0415-4464-b3c0-5af1e96559fd tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:56:14 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8a56b7-0415-4464-b3c0-5af1e96559fd tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 05:56:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:56:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:56:14 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7357b5a-5520-42a8-9b60-5683fde70471]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3a56eca-dd83-40fc-8e35-8b719d9eecbf\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:56:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:56:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:56:14 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b46737c-bac0-4a62-9f38-e02a313b021a]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a56eca-dd83-40fc-8e35-8b719d9eecbf (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:56:14 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8a56b7-0415-4464-b3c0-5af1e96559fd tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 (non-flash)
Aug 15 05:56:14 user nova-compute[73391]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a (non-flash)
Aug 15 05:56:14 user nova-compute[73391]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a56eca-dd83-40fc-8e35-8b719d9eecbf (non-flash)
Aug 15 05:56:14 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:56:14 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8a56b7-0415-4464-b3c0-5af1e96559fd tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 (non-flash)
Aug 15 05:56:14 user nova-compute[73391]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a (non-flash)
Aug 15 05:56:14 user nova-compute[73391]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a56eca-dd83-40fc-8e35-8b719d9eecbf (non-flash)
Aug 15 05:56:14 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:56:14 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8a56b7-0415-4464-b3c0-5af1e96559fd tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77282f6b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a'): ({'sdd'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 05:56:14 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-cd8a56b7-0415-4464-b3c0-5af1e96559fd tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Removing single pathed devices sdd {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 05:56:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:56:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:56:14 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e61b205-a7e7-454b-9d24-56bca557c29f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:56:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:56:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:56:14 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23eecdf-4d56-45af-a752-4603d0c75bc2]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:56:14 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-cd8a56b7-0415-4464-b3c0-5af1e96559fd tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Flushing IO for device /dev/sdd {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 05:56:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:56:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:56:14 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[81adaaaf-0ce9-4119-8adb-38bd6fe64a1b]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:56:14 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-cd8a56b7-0415-4464-b3c0-5af1e96559fd tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 05:56:14 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:56:15 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:56:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:56:15 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[726a1321-b287-4417-8e15-bbebafa6c7a8]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:56:15 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-cd8a56b7-0415-4464-b3c0-5af1e96559fd tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 05:56:15 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-cd8a56b7-0415-4464-b3c0-5af1e96559fd tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] SCSI volumes sdd have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 05:56:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8a56b7-0415-4464-b3c0-5af1e96559fd tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 05:56:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:56:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:56:15 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[28891757-955d-4e34-a81a-e215cd10f8a0]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:56:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8a56b7-0415-4464-b3c0-5af1e96559fd tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:56:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:56:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:56:15 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce8332ec-1cec-4c4c-b0d6-0114b3403742]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:56:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8a56b7-0415-4464-b3c0-5af1e96559fd tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a, portal: 172.16.0.220,3260]
Aug 15 05:56:15 user nova-compute[73391]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a, portal: 172.16.0.220,3260] successful.
Aug 15 05:56:15 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:56:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:56:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:97915103-1b6f-453d-a3af-74137ff0ac5a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:56:15 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e3cfd8-fc41-44ba-9b43-6b12f88abf26]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:56:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8a56b7-0415-4464-b3c0-5af1e96559fd tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:56:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-cd8a56b7-0415-4464-b3c0-5af1e96559fd tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:56:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd8a56b7-0415-4464-b3c0-5af1e96559fd tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] <== disconnect_volume: return (293ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:56:15 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd8a56b7-0415-4464-b3c0-5af1e96559fd tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 05:56:15 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:56:15 user nova-compute[73391]: DEBUG nova.objects.instance [None req-cd8a56b7-0415-4464-b3c0-5af1e96559fd tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Lazy-loading 'flavor' on Instance uuid 3adc0c85-0f31-4a73-8b98-eb1a4b32434d {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:56:15 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-cd8a56b7-0415-4464-b3c0-5af1e96559fd tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Lock "3adc0c85-0f31-4a73-8b98-eb1a4b32434d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.669s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:56:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:56:25 user nova-compute[73391]: DEBUG nova.compute.manager [req-da309aa9-4bd9-436e-972d-7ab4a483aa5b req-25b9df80-64e3-41d5-b874-3c9ab2baf104 service nova] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Received event network-changed-4e6843fd-6378-4865-b416-719c63f81bc5 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:56:25 user nova-compute[73391]: DEBUG nova.compute.manager [req-da309aa9-4bd9-436e-972d-7ab4a483aa5b req-25b9df80-64e3-41d5-b874-3c9ab2baf104 service nova] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Refreshing instance network info cache due to event network-changed-4e6843fd-6378-4865-b416-719c63f81bc5. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:56:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-da309aa9-4bd9-436e-972d-7ab4a483aa5b req-25b9df80-64e3-41d5-b874-3c9ab2baf104 service nova] Acquiring lock "refresh_cache-5a5cbbb3-3b78-48b5-9eee-342f52f1fc22" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:56:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-da309aa9-4bd9-436e-972d-7ab4a483aa5b req-25b9df80-64e3-41d5-b874-3c9ab2baf104 service nova] Acquired lock "refresh_cache-5a5cbbb3-3b78-48b5-9eee-342f52f1fc22" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:56:25 user nova-compute[73391]: DEBUG nova.network.neutron [req-da309aa9-4bd9-436e-972d-7ab4a483aa5b req-25b9df80-64e3-41d5-b874-3c9ab2baf104 service nova] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Refreshing network info cache for port 4e6843fd-6378-4865-b416-719c63f81bc5 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:56:25 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:56:25 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:56:25 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 05:56:25 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 05:56:25 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 05:56:25 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:56:25 user nova-compute[73391]: DEBUG nova.network.neutron [req-da309aa9-4bd9-436e-972d-7ab4a483aa5b req-25b9df80-64e3-41d5-b874-3c9ab2baf104 service nova] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Updated VIF entry in instance network info cache for port 4e6843fd-6378-4865-b416-719c63f81bc5. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:56:25 user nova-compute[73391]: DEBUG nova.network.neutron [req-da309aa9-4bd9-436e-972d-7ab4a483aa5b req-25b9df80-64e3-41d5-b874-3c9ab2baf104 service nova] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Updating instance_info_cache with network_info: [{"id": "4e6843fd-6378-4865-b416-719c63f81bc5", "address": "fa:16:3e:2d:73:c6", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e6843fd-63", "ovs_interfaceid": "4e6843fd-6378-4865-b416-719c63f81bc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:56:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-da309aa9-4bd9-436e-972d-7ab4a483aa5b req-25b9df80-64e3-41d5-b874-3c9ab2baf104 service nova] Releasing lock "refresh_cache-5a5cbbb3-3b78-48b5-9eee-342f52f1fc22" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:56:27 user nova-compute[73391]: DEBUG nova.compute.manager [req-29123d00-ba40-4500-8094-95b3b08ea7ac req-3b8cb38d-fedf-4107-b3dc-a7aff98fca5a service nova] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Received event network-changed-4e6843fd-6378-4865-b416-719c63f81bc5 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:56:27 user nova-compute[73391]: DEBUG nova.compute.manager [req-29123d00-ba40-4500-8094-95b3b08ea7ac req-3b8cb38d-fedf-4107-b3dc-a7aff98fca5a service nova] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Refreshing instance network info cache due to event network-changed-4e6843fd-6378-4865-b416-719c63f81bc5. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:56:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-29123d00-ba40-4500-8094-95b3b08ea7ac req-3b8cb38d-fedf-4107-b3dc-a7aff98fca5a service nova] Acquiring lock "refresh_cache-5a5cbbb3-3b78-48b5-9eee-342f52f1fc22" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:56:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-29123d00-ba40-4500-8094-95b3b08ea7ac req-3b8cb38d-fedf-4107-b3dc-a7aff98fca5a service nova] Acquired lock "refresh_cache-5a5cbbb3-3b78-48b5-9eee-342f52f1fc22" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:56:27 user nova-compute[73391]: DEBUG nova.network.neutron [req-29123d00-ba40-4500-8094-95b3b08ea7ac req-3b8cb38d-fedf-4107-b3dc-a7aff98fca5a service nova] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Refreshing network info cache for port 4e6843fd-6378-4865-b416-719c63f81bc5 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:56:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e26dba87-871d-43af-a4ec-fe143b222933 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "5a5cbbb3-3b78-48b5-9eee-342f52f1fc22" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:56:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e26dba87-871d-43af-a4ec-fe143b222933 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "5a5cbbb3-3b78-48b5-9eee-342f52f1fc22" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:56:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e26dba87-871d-43af-a4ec-fe143b222933 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "5a5cbbb3-3b78-48b5-9eee-342f52f1fc22-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:56:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e26dba87-871d-43af-a4ec-fe143b222933 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "5a5cbbb3-3b78-48b5-9eee-342f52f1fc22-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:56:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e26dba87-871d-43af-a4ec-fe143b222933 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "5a5cbbb3-3b78-48b5-9eee-342f52f1fc22-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:56:27 user nova-compute[73391]: INFO nova.compute.manager [None req-e26dba87-871d-43af-a4ec-fe143b222933 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Terminating instance
Aug 15 05:56:27 user nova-compute[73391]: DEBUG nova.compute.manager [None req-e26dba87-871d-43af-a4ec-fe143b222933 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Start destroying the instance on the hypervisor. {{(pid=73391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 05:56:27 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:56:27 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:56:27 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:56:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:56:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:56:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:56:27 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Auditing locally available compute resources for user (node: user) {{(pid=73391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 05:56:27 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:56:27 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG nova.compute.manager [req-2c388e0c-8324-4eb3-a942-7280e82b8ebd req-7d648fa4-0926-4059-bb32-6bb7cb2663db service nova] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Received event network-vif-unplugged-4e6843fd-6378-4865-b416-719c63f81bc5 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2c388e0c-8324-4eb3-a942-7280e82b8ebd req-7d648fa4-0926-4059-bb32-6bb7cb2663db service nova] Acquiring lock "5a5cbbb3-3b78-48b5-9eee-342f52f1fc22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2c388e0c-8324-4eb3-a942-7280e82b8ebd req-7d648fa4-0926-4059-bb32-6bb7cb2663db service nova] Lock "5a5cbbb3-3b78-48b5-9eee-342f52f1fc22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2c388e0c-8324-4eb3-a942-7280e82b8ebd req-7d648fa4-0926-4059-bb32-6bb7cb2663db service nova] Lock "5a5cbbb3-3b78-48b5-9eee-342f52f1fc22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG nova.compute.manager [req-2c388e0c-8324-4eb3-a942-7280e82b8ebd req-7d648fa4-0926-4059-bb32-6bb7cb2663db service nova] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] No waiting events found dispatching network-vif-unplugged-4e6843fd-6378-4865-b416-719c63f81bc5 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG nova.compute.manager [req-2c388e0c-8324-4eb3-a942-7280e82b8ebd req-7d648fa4-0926-4059-bb32-6bb7cb2663db service nova] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Received event network-vif-unplugged-4e6843fd-6378-4865-b416-719c63f81bc5 for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 05:56:28 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Instance destroyed successfully.
Aug 15 05:56:28 user nova-compute[73391]: DEBUG nova.objects.instance [None req-e26dba87-871d-43af-a4ec-fe143b222933 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lazy-loading 'resources' on Instance uuid 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-e26dba87-871d-43af-a4ec-fe143b222933 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:54:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-538220195',display_name='tempest-TestVolumeBootPattern-server-538220195',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-538220195',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9jBoYjOy+aqM5q6fYRpW336xJnp1RjcA+ryp4UUPjXWPw7VtxeYktb68BzzUpanNxgDS13R1RxH4S+D0vqFMFtOkREwueXmREiQ22XqN9Aby3PDiDj1ii3iTWuJ+dFag==',key_name='tempest-TestVolumeBootPattern-1057822238',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:54:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8188c2e8ca34ef1982faa49f1058bb7',ramdisk_id='',reservation_id='r-90qekll3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1834029963',owner_user_name='tempest-TestVolumeBootPattern-1834029963-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:54:48Z,user_data=None,user_id='aefb6ccab586465dbe56e71a40bcf1f0',uuid=5a5cbbb3-3b78-48b5-9eee-342f52f1fc22,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e6843fd-6378-4865-b416-719c63f81bc5", "address": "fa:16:3e:2d:73:c6", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e6843fd-63", "ovs_interfaceid": "4e6843fd-6378-4865-b416-719c63f81bc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-e26dba87-871d-43af-a4ec-fe143b222933 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Converting VIF {"id": "4e6843fd-6378-4865-b416-719c63f81bc5", "address": "fa:16:3e:2d:73:c6", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.189", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e6843fd-63", "ovs_interfaceid": "4e6843fd-6378-4865-b416-719c63f81bc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-e26dba87-871d-43af-a4ec-fe143b222933 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2d:73:c6,bridge_name='br-int',has_traffic_filtering=True,id=4e6843fd-6378-4865-b416-719c63f81bc5,network=Network(fae0e46a-88e4-499d-bcff-5b7df55eab4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e6843fd-63') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG os_vif [None req-e26dba87-871d-43af-a4ec-fe143b222933 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:73:c6,bridge_name='br-int',has_traffic_filtering=True,id=4e6843fd-6378-4865-b416-719c63f81bc5,network=Network(fae0e46a-88e4-499d-bcff-5b7df55eab4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e6843fd-63') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4e6843fd-63, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:56:28 user nova-compute[73391]: INFO os_vif [None req-e26dba87-871d-43af-a4ec-fe143b222933 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2d:73:c6,bridge_name='br-int',has_traffic_filtering=True,id=4e6843fd-6378-4865-b416-719c63f81bc5,network=Network(fae0e46a-88e4-499d-bcff-5b7df55eab4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e6843fd-63')
Aug 15 05:56:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e26dba87-871d-43af-a4ec-fe143b222933 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26dba87-871d-43af-a4ec-fe143b222933 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:a3a56eca-dd83-40fc-8e35-8b719d9eecbf'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MwONctqp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:56:28 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-e26dba87-871d-43af-a4ec-fe143b222933 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:56:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-e26dba87-871d-43af-a4ec-fe143b222933 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-e26dba87-871d-43af-a4ec-fe143b222933 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26dba87-871d-43af-a4ec-fe143b222933 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3a56eca-dd83-40fc-8e35-8b719d9eecbf', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7143f1dd-01f5-4283-ad40-e15470066fe1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3a56eca-dd83-40fc-8e35-8b719d9eecbf\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0561512e-36a7-4255-a792-81dafbeff5be]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a56eca-dd83-40fc-8e35-8b719d9eecbf (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26dba87-871d-43af-a4ec-fe143b222933 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 (non-flash)
Aug 15 05:56:28 user nova-compute[73391]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a56eca-dd83-40fc-8e35-8b719d9eecbf (non-flash)
Aug 15 05:56:28 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26dba87-871d-43af-a4ec-fe143b222933 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 (non-flash)
Aug 15 05:56:28 user nova-compute[73391]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3a56eca-dd83-40fc-8e35-8b719d9eecbf (non-flash)
Aug 15 05:56:28 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26dba87-871d-43af-a4ec-fe143b222933 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7728186cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3a56eca-dd83-40fc-8e35-8b719d9eecbf'): ({'sde'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-e26dba87-871d-43af-a4ec-fe143b222933 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Removing single pathed devices sde {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d3a1af-7f9b-4178-9c39-34ff59d109c8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c133b3-2a27-4103-b604-50592b97ad3f]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-e26dba87-871d-43af-a4ec-fe143b222933 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Flushing IO for device /dev/sde {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG nova.network.neutron [req-29123d00-ba40-4500-8094-95b3b08ea7ac req-3b8cb38d-fedf-4107-b3dc-a7aff98fca5a service nova] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Updated VIF entry in instance network info cache for port 4e6843fd-6378-4865-b416-719c63f81bc5. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG nova.network.neutron [req-29123d00-ba40-4500-8094-95b3b08ea7ac req-3b8cb38d-fedf-4107-b3dc-a7aff98fca5a service nova] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Updating instance_info_cache with network_info: [{"id": "4e6843fd-6378-4865-b416-719c63f81bc5", "address": "fa:16:3e:2d:73:c6", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e6843fd-63", "ovs_interfaceid": "4e6843fd-6378-4865-b416-719c63f81bc5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e6d605-d401-479e-a642-481746c7de3f]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-e26dba87-871d-43af-a4ec-fe143b222933 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-29123d00-ba40-4500-8094-95b3b08ea7ac req-3b8cb38d-fedf-4107-b3dc-a7aff98fca5a service nova] Releasing lock "refresh_cache-5a5cbbb3-3b78-48b5-9eee-342f52f1fc22" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.054s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f021080f-5e17-4028-aa0c-3be72e5d3fab]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-e26dba87-871d-43af-a4ec-fe143b222933 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-e26dba87-871d-43af-a4ec-fe143b222933 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] SCSI volumes sde have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26666623038323430', '/dev/disk/by-id/scsi-1SCST_BIOe82889a9-ffb0824031fc46ed', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e82889a9') {{(pid=84527) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[080b7d8d-05bb-4a72-96b6-b1886bb458f7]: (4, None) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26dba87-871d-43af-a4ec-fe143b222933 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3a56eca-dd83-40fc-8e35-8b719d9eecbf')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3a56eca-dd83-40fc-8e35-8b719d9eecbf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3a56eca-dd83-40fc-8e35-8b719d9eecbf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b21a4c1-a8e7-4568-be3f-1990fb45cf19]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26dba87-871d-43af-a4ec-fe143b222933 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3a56eca-dd83-40fc-8e35-8b719d9eecbf -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3a56eca-dd83-40fc-8e35-8b719d9eecbf -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1164b7d-8386-40f0-b724-b688c8e4223e]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:a3a56eca-dd83-40fc-8e35-8b719d9eecbf, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:a3a56eca-dd83-40fc-8e35-8b719d9eecbf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26dba87-871d-43af-a4ec-fe143b222933 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:a3a56eca-dd83-40fc-8e35-8b719d9eecbf, portal: 172.16.0.220,3260]
Aug 15 05:56:28 user nova-compute[73391]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:a3a56eca-dd83-40fc-8e35-8b719d9eecbf, portal: 172.16.0.220,3260] successful.
Aug 15 05:56:28 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3a56eca-dd83-40fc-8e35-8b719d9eecbf -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3a56eca-dd83-40fc-8e35-8b719d9eecbf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb7932e-f0b6-49fe-8e96-acc3e37a200d]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26dba87-871d-43af-a4ec-fe143b222933 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-e26dba87-871d-43af-a4ec-fe143b222933 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.392s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26dba87-871d-43af-a4ec-fe143b222933 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] <== disconnect_volume: return (393ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e26dba87-871d-43af-a4ec-fe143b222933 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 05:56:28 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-e26dba87-871d-43af-a4ec-fe143b222933 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Deleting instance files /opt/stack/data/nova/instances/5a5cbbb3-3b78-48b5-9eee-342f52f1fc22_del
Aug 15 05:56:28 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-e26dba87-871d-43af-a4ec-fe143b222933 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Deletion of /opt/stack/data/nova/instances/5a5cbbb3-3b78-48b5-9eee-342f52f1fc22_del complete
Aug 15 05:56:28 user nova-compute[73391]: INFO nova.compute.manager [None req-e26dba87-871d-43af-a4ec-fe143b222933 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Took 1.27 seconds to destroy the instance on the hypervisor.
Aug 15 05:56:28 user nova-compute[73391]: DEBUG oslo.service.loopingcall [None req-e26dba87-871d-43af-a4ec-fe143b222933 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG nova.compute.manager [-] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Deallocating network for instance {{(pid=73391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] deallocate_for_instance() {{(pid=73391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:56:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d10508dd-f3f7-4e96-b822-d331ded6809f/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:56:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d10508dd-f3f7-4e96-b822-d331ded6809f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:56:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d10508dd-f3f7-4e96-b822-d331ded6809f/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:56:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d10508dd-f3f7-4e96-b822-d331ded6809f/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:56:29 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Error from libvirt while getting description of instance-0000002d: [Error Code 42] Domain not found: no domain with matching uuid '5a5cbbb3-3b78-48b5-9eee-342f52f1fc22' (instance-0000002d): libvirt.libvirtError: Domain not found: no domain with matching uuid '5a5cbbb3-3b78-48b5-9eee-342f52f1fc22' (instance-0000002d)
Aug 15 05:56:29 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:56:29 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:56:29 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Hypervisor/Node resource view: name=user free_ram=8363MB free_disk=24.992733001708984GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 05:56:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:56:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:56:29 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:56:29 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Took 0.89 seconds to deallocate network for instance.
Aug 15 05:56:29 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 3adc0c85-0f31-4a73-8b98-eb1a4b32434d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:56:29 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance f730e539-5371-49d7-8487-d94f400fe0bc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:56:29 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:56:29 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance d10508dd-f3f7-4e96-b822-d331ded6809f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:56:29 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 05:56:29 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 05:56:29 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Refreshing inventories for resource provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 05:56:29 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Updating ProviderTree inventory for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 05:56:29 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Updating inventory in ProviderTree for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 05:56:29 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Refreshing aggregate associations for resource provider 771708bd-6a2a-4e0c-9869-46d45e6b1896, aggregates: None {{(pid=73391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 05:56:29 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Refreshing trait associations for resource provider 771708bd-6a2a-4e0c-9869-46d45e6b1896, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=73391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 05:56:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:56:30 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:56:30 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:56:30 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Compute_service record updated for user:user {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 05:56:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.422s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:56:30 user nova-compute[73391]: DEBUG nova.compute.manager [req-d449fb97-dbce-418d-8537-e8461f88c384 req-2c29522c-b16c-4bc4-a19a-52bc9bc8ace6 service nova] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Received event network-vif-plugged-4e6843fd-6378-4865-b416-719c63f81bc5 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:56:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d449fb97-dbce-418d-8537-e8461f88c384 req-2c29522c-b16c-4bc4-a19a-52bc9bc8ace6 service nova] Acquiring lock "5a5cbbb3-3b78-48b5-9eee-342f52f1fc22-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:56:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d449fb97-dbce-418d-8537-e8461f88c384 req-2c29522c-b16c-4bc4-a19a-52bc9bc8ace6 service nova] Lock "5a5cbbb3-3b78-48b5-9eee-342f52f1fc22-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:56:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d449fb97-dbce-418d-8537-e8461f88c384 req-2c29522c-b16c-4bc4-a19a-52bc9bc8ace6 service nova] Lock "5a5cbbb3-3b78-48b5-9eee-342f52f1fc22-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:56:30 user nova-compute[73391]: DEBUG nova.compute.manager [req-d449fb97-dbce-418d-8537-e8461f88c384 req-2c29522c-b16c-4bc4-a19a-52bc9bc8ace6 service nova] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] No waiting events found dispatching network-vif-plugged-4e6843fd-6378-4865-b416-719c63f81bc5 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:56:30 user nova-compute[73391]: WARNING nova.compute.manager [req-d449fb97-dbce-418d-8537-e8461f88c384 req-2c29522c-b16c-4bc4-a19a-52bc9bc8ace6 service nova] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Received unexpected event network-vif-plugged-4e6843fd-6378-4865-b416-719c63f81bc5 for instance with vm_state active and task_state deleting.
Aug 15 05:56:30 user nova-compute[73391]: DEBUG nova.compute.manager [req-d449fb97-dbce-418d-8537-e8461f88c384 req-2c29522c-b16c-4bc4-a19a-52bc9bc8ace6 service nova] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Received event network-vif-deleted-4e6843fd-6378-4865-b416-719c63f81bc5 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:56:30 user nova-compute[73391]: INFO nova.compute.manager [None req-e26dba87-871d-43af-a4ec-fe143b222933 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Took 0.77 seconds to detach 1 volumes for instance.
Aug 15 05:56:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e26dba87-871d-43af-a4ec-fe143b222933 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:56:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e26dba87-871d-43af-a4ec-fe143b222933 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:56:30 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-e26dba87-871d-43af-a4ec-fe143b222933 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:56:30 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-e26dba87-871d-43af-a4ec-fe143b222933 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:56:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e26dba87-871d-43af-a4ec-fe143b222933 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.187s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:56:30 user nova-compute[73391]: INFO nova.scheduler.client.report [None req-e26dba87-871d-43af-a4ec-fe143b222933 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Deleted allocations for instance 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22
Aug 15 05:56:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e26dba87-871d-43af-a4ec-fe143b222933 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "5a5cbbb3-3b78-48b5-9eee-342f52f1fc22" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.308s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:56:31 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:56:31 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:56:32 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:56:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:56:33 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:56:38 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:56:39 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:56:39 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Starting heal instance info cache {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 05:56:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "refresh_cache-f730e539-5371-49d7-8487-d94f400fe0bc" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:56:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquired lock "refresh_cache-f730e539-5371-49d7-8487-d94f400fe0bc" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:56:39 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Forcefully refreshing network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 05:56:40 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Updating instance_info_cache with network_info: [{"id": "164663cf-1c4f-4166-86e2-465351cdaaea", "address": "fa:16:3e:83:de:e8", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap164663cf-1c", "ovs_interfaceid": "164663cf-1c4f-4166-86e2-465351cdaaea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:56:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Releasing lock "refresh_cache-f730e539-5371-49d7-8487-d94f400fe0bc" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:56:40 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Updated the network info_cache for instance {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 05:56:40 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:56:40 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:56:40 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 05:56:40 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:56:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Acquiring lock "3d3ab430-d3a3-4003-8337-0f45fdb54e2f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:56:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "3d3ab430-d3a3-4003-8337-0f45fdb54e2f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:56:43 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Starting instance... {{(pid=73391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 05:56:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:56:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:56:43 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 05:56:43 user nova-compute[73391]: INFO nova.compute.claims [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Claim successful on node user
Aug 15 05:56:43 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692078988.297142, 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22 => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:56:43 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] VM Stopped (Lifecycle Event)
Aug 15 05:56:43 user nova-compute[73391]: DEBUG nova.compute.manager [None req-e89a038a-2b10-41f3-b8a4-d712ba2ba755 None None] [instance: 5a5cbbb3-3b78-48b5-9eee-342f52f1fc22] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:56:43 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:56:43 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:56:43 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:56:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.293s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:56:43 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Start building networks asynchronously for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 05:56:43 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Allocating IP information in the background. {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 05:56:43 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] allocate_for_instance() {{(pid=73391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 05:56:43 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 05:56:43 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Start building block device mappings for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 05:56:43 user nova-compute[73391]: DEBUG nova.policy [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9552a83a6a214c149ddceac64ccbdef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8086add121594fe8a0bdde99dd9cae90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73391) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 05:56:43 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Start spawning the instance on the hypervisor. {{(pid=73391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 05:56:43 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Creating instance directory {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 05:56:43 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Creating image(s)
Aug 15 05:56:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Acquiring lock "/opt/stack/data/nova/instances/3d3ab430-d3a3-4003-8337-0f45fdb54e2f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:56:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "/opt/stack/data/nova/instances/3d3ab430-d3a3-4003-8337-0f45fdb54e2f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:56:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "/opt/stack/data/nova/instances/3d3ab430-d3a3-4003-8337-0f45fdb54e2f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:56:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:56:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.181s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:56:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Acquiring lock "999b315ba87151d8252d543312ae7790e7e1583b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:56:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:56:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:56:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.185s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:56:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/3d3ab430-d3a3-4003-8337-0f45fdb54e2f/disk 1073741824 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:56:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/3d3ab430-d3a3-4003-8337-0f45fdb54e2f/disk 1073741824" returned: 0 in 0.049s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:56:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:56:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:56:44 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Successfully created port: 0cdd39d3-7846-438b-9fb2-a1ff7bb61471 {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 05:56:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.188s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:56:44 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3d3ab430-d3a3-4003-8337-0f45fdb54e2f/disk. size=1073741824 {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 05:56:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3ab430-d3a3-4003-8337-0f45fdb54e2f/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:56:44 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3ab430-d3a3-4003-8337-0f45fdb54e2f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:56:44 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Cannot resize image /opt/stack/data/nova/instances/3d3ab430-d3a3-4003-8337-0f45fdb54e2f/disk to a smaller size. {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 05:56:44 user nova-compute[73391]: DEBUG nova.objects.instance [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lazy-loading 'migration_context' on Instance uuid 3d3ab430-d3a3-4003-8337-0f45fdb54e2f {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:56:44 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Created local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 05:56:44 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Ensure instance console log exists: /opt/stack/data/nova/instances/3d3ab430-d3a3-4003-8337-0f45fdb54e2f/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 05:56:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:56:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:56:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:56:45 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Successfully updated port: 0cdd39d3-7846-438b-9fb2-a1ff7bb61471 {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:56:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Acquiring lock "refresh_cache-3d3ab430-d3a3-4003-8337-0f45fdb54e2f" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:56:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Acquired lock "refresh_cache-3d3ab430-d3a3-4003-8337-0f45fdb54e2f" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:56:45 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:56:45 user nova-compute[73391]: DEBUG nova.compute.manager [req-6c1e0d54-dd88-4b96-88d4-6005b04e8dd8 req-d98d9712-25d3-4566-845d-b25c140e2aa0 service nova] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Received event network-changed-0cdd39d3-7846-438b-9fb2-a1ff7bb61471 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:56:45 user nova-compute[73391]: DEBUG nova.compute.manager [req-6c1e0d54-dd88-4b96-88d4-6005b04e8dd8 req-d98d9712-25d3-4566-845d-b25c140e2aa0 service nova] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Refreshing instance network info cache due to event network-changed-0cdd39d3-7846-438b-9fb2-a1ff7bb61471. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:56:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-6c1e0d54-dd88-4b96-88d4-6005b04e8dd8 req-d98d9712-25d3-4566-845d-b25c140e2aa0 service nova] Acquiring lock "refresh_cache-3d3ab430-d3a3-4003-8337-0f45fdb54e2f" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:56:45 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:56:45 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Updating instance_info_cache with network_info: [{"id": "0cdd39d3-7846-438b-9fb2-a1ff7bb61471", "address": "fa:16:3e:09:4d:8c", "network": {"id": "bc2718a2-a5ab-44e0-966d-9b180a30ac75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1022668030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8086add121594fe8a0bdde99dd9cae90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cdd39d3-78", "ovs_interfaceid": "0cdd39d3-7846-438b-9fb2-a1ff7bb61471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:56:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Releasing lock "refresh_cache-3d3ab430-d3a3-4003-8337-0f45fdb54e2f" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:56:45 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Instance network_info: |[{"id": "0cdd39d3-7846-438b-9fb2-a1ff7bb61471", "address": "fa:16:3e:09:4d:8c", "network": {"id": "bc2718a2-a5ab-44e0-966d-9b180a30ac75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1022668030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8086add121594fe8a0bdde99dd9cae90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cdd39d3-78", "ovs_interfaceid": "0cdd39d3-7846-438b-9fb2-a1ff7bb61471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 05:56:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-6c1e0d54-dd88-4b96-88d4-6005b04e8dd8 req-d98d9712-25d3-4566-845d-b25c140e2aa0 service nova] Acquired lock "refresh_cache-3d3ab430-d3a3-4003-8337-0f45fdb54e2f" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:56:45 user nova-compute[73391]: DEBUG nova.network.neutron [req-6c1e0d54-dd88-4b96-88d4-6005b04e8dd8 req-d98d9712-25d3-4566-845d-b25c140e2aa0 service nova] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Refreshing network info cache for port 0cdd39d3-7846-438b-9fb2-a1ff7bb61471 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:56:45 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Start _get_guest_xml network_info=[{"id": "0cdd39d3-7846-438b-9fb2-a1ff7bb61471", "address": "fa:16:3e:09:4d:8c", "network": {"id": "bc2718a2-a5ab-44e0-966d-9b180a30ac75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1022668030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8086add121594fe8a0bdde99dd9cae90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cdd39d3-78", "ovs_interfaceid": "0cdd39d3-7846-438b-9fb2-a1ff7bb61471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '191b1dad-305e-4d1c-9b15-515ec59a3278'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:56:45 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:56:45 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:56:45 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:56:45 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:56:45 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:56:45 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:56:45 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:56:45 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:56:45 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:56:45 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:56:45 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:56:45 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:56:45 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:56:45 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:56:45 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:56:45 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:56:45 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:56:45 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:56:45 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:56:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1205415411',display_name='tempest-AttachVolumeNegativeTest-server-1205415411',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1205415411',id=47,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1MHZ1994+f11LYEhnzF1VekzsSDTuywaGt7mGPbPd37DIuxhscu1C8oovWu2xjH6HdZySW7m66pj29JPR2PGIB/avAwyOOtZfmNzzXrK+IgOHmWhlqqzKt3aihSxHH6w==',key_name='tempest-keypair-749454339',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8086add121594fe8a0bdde99dd9cae90',ramdisk_id='',reservation_id='r-4jhk74eq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1479702824',owner_user_name='tempest-AttachVolumeNegativeTest-1479702824-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:56:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9552a83a6a214c149ddceac64ccbdef6',uuid=3d3ab430-d3a3-4003-8337-0f45fdb54e2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0cdd39d3-7846-438b-9fb2-a1ff7bb61471", "address": "fa:16:3e:09:4d:8c", "network": {"id": "bc2718a2-a5ab-44e0-966d-9b180a30ac75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1022668030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8086add121594fe8a0bdde99dd9cae90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cdd39d3-78", "ovs_interfaceid": "0cdd39d3-7846-438b-9fb2-a1ff7bb61471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:56:45 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Converting VIF {"id": "0cdd39d3-7846-438b-9fb2-a1ff7bb61471", "address": "fa:16:3e:09:4d:8c", "network": {"id": "bc2718a2-a5ab-44e0-966d-9b180a30ac75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1022668030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8086add121594fe8a0bdde99dd9cae90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cdd39d3-78", "ovs_interfaceid": "0cdd39d3-7846-438b-9fb2-a1ff7bb61471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:56:45 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:4d:8c,bridge_name='br-int',has_traffic_filtering=True,id=0cdd39d3-7846-438b-9fb2-a1ff7bb61471,network=Network(bc2718a2-a5ab-44e0-966d-9b180a30ac75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cdd39d3-78') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:56:45 user nova-compute[73391]: DEBUG nova.objects.instance [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d3ab430-d3a3-4003-8337-0f45fdb54e2f {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:56:45 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:56:45 user nova-compute[73391]:   <uuid>3d3ab430-d3a3-4003-8337-0f45fdb54e2f</uuid>
Aug 15 05:56:45 user nova-compute[73391]:   <name>instance-0000002f</name>
Aug 15 05:56:45 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:56:45 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:56:45 user nova-compute[73391]:   <metadata>
Aug 15 05:56:45 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:56:45 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:56:45 user nova-compute[73391]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1205415411</nova:name>
Aug 15 05:56:45 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:56:45</nova:creationTime>
Aug 15 05:56:45 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:56:45 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:56:45 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:56:45 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:56:45 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:56:45 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:56:45 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:56:45 user nova-compute[73391]:       <nova:owner>
Aug 15 05:56:45 user nova-compute[73391]:         <nova:user uuid="9552a83a6a214c149ddceac64ccbdef6">tempest-AttachVolumeNegativeTest-1479702824-project-member</nova:user>
Aug 15 05:56:45 user nova-compute[73391]:         <nova:project uuid="8086add121594fe8a0bdde99dd9cae90">tempest-AttachVolumeNegativeTest-1479702824</nova:project>
Aug 15 05:56:45 user nova-compute[73391]:       </nova:owner>
Aug 15 05:56:45 user nova-compute[73391]:       <nova:root type="image" uuid="191b1dad-305e-4d1c-9b15-515ec59a3278"/>
Aug 15 05:56:45 user nova-compute[73391]:       <nova:ports>
Aug 15 05:56:45 user nova-compute[73391]:         <nova:port uuid="0cdd39d3-7846-438b-9fb2-a1ff7bb61471">
Aug 15 05:56:45 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 15 05:56:45 user nova-compute[73391]:         </nova:port>
Aug 15 05:56:45 user nova-compute[73391]:       </nova:ports>
Aug 15 05:56:45 user nova-compute[73391]:     </nova:instance>
Aug 15 05:56:45 user nova-compute[73391]:   </metadata>
Aug 15 05:56:45 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:56:45 user nova-compute[73391]:     <system>
Aug 15 05:56:45 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:56:45 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:56:45 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:56:45 user nova-compute[73391]:       <entry name="serial">3d3ab430-d3a3-4003-8337-0f45fdb54e2f</entry>
Aug 15 05:56:45 user nova-compute[73391]:       <entry name="uuid">3d3ab430-d3a3-4003-8337-0f45fdb54e2f</entry>
Aug 15 05:56:45 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:56:45 user nova-compute[73391]:     </system>
Aug 15 05:56:45 user nova-compute[73391]:   </sysinfo>
Aug 15 05:56:45 user nova-compute[73391]:   <os>
Aug 15 05:56:45 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:56:45 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:56:45 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:56:45 user nova-compute[73391]:   </os>
Aug 15 05:56:45 user nova-compute[73391]:   <features>
Aug 15 05:56:45 user nova-compute[73391]:     <acpi/>
Aug 15 05:56:45 user nova-compute[73391]:     <apic/>
Aug 15 05:56:45 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:56:45 user nova-compute[73391]:   </features>
Aug 15 05:56:45 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:56:45 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:56:45 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:56:45 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:56:45 user nova-compute[73391]:   </clock>
Aug 15 05:56:45 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:56:45 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:56:45 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:56:45 user nova-compute[73391]:   </cpu>
Aug 15 05:56:45 user nova-compute[73391]:   <devices>
Aug 15 05:56:45 user nova-compute[73391]:     <disk type="file" device="disk">
Aug 15 05:56:45 user nova-compute[73391]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 05:56:45 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/3d3ab430-d3a3-4003-8337-0f45fdb54e2f/disk"/>
Aug 15 05:56:45 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:56:45 user nova-compute[73391]:     </disk>
Aug 15 05:56:45 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:56:45 user nova-compute[73391]:       <mac address="fa:16:3e:09:4d:8c"/>
Aug 15 05:56:45 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:56:45 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:56:45 user nova-compute[73391]:       <target dev="tap0cdd39d3-78"/>
Aug 15 05:56:45 user nova-compute[73391]:     </interface>
Aug 15 05:56:45 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:56:45 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/3d3ab430-d3a3-4003-8337-0f45fdb54e2f/console.log" append="off"/>
Aug 15 05:56:45 user nova-compute[73391]:     </serial>
Aug 15 05:56:45 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:56:45 user nova-compute[73391]:     <video>
Aug 15 05:56:45 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:56:45 user nova-compute[73391]:     </video>
Aug 15 05:56:45 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:56:45 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:56:45 user nova-compute[73391]:     </rng>
Aug 15 05:56:45 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:56:45 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:56:45 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:56:45 user nova-compute[73391]:     </memballoon>
Aug 15 05:56:45 user nova-compute[73391]:   </devices>
Aug 15 05:56:45 user nova-compute[73391]: </domain>
Aug 15 05:56:45 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:56:45 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:56:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1205415411',display_name='tempest-AttachVolumeNegativeTest-server-1205415411',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1205415411',id=47,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1MHZ1994+f11LYEhnzF1VekzsSDTuywaGt7mGPbPd37DIuxhscu1C8oovWu2xjH6HdZySW7m66pj29JPR2PGIB/avAwyOOtZfmNzzXrK+IgOHmWhlqqzKt3aihSxHH6w==',key_name='tempest-keypair-749454339',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8086add121594fe8a0bdde99dd9cae90',ramdisk_id='',reservation_id='r-4jhk74eq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1479702824',owner_user_name='tempest-AttachVolumeNegativeTest-1479702824-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:56:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9552a83a6a214c149ddceac64ccbdef6',uuid=3d3ab430-d3a3-4003-8337-0f45fdb54e2f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0cdd39d3-7846-438b-9fb2-a1ff7bb61471", "address": "fa:16:3e:09:4d:8c", "network": {"id": "bc2718a2-a5ab-44e0-966d-9b180a30ac75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1022668030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8086add121594fe8a0bdde99dd9cae90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cdd39d3-78", "ovs_interfaceid": "0cdd39d3-7846-438b-9fb2-a1ff7bb61471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:56:45 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Converting VIF {"id": "0cdd39d3-7846-438b-9fb2-a1ff7bb61471", "address": "fa:16:3e:09:4d:8c", "network": {"id": "bc2718a2-a5ab-44e0-966d-9b180a30ac75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1022668030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8086add121594fe8a0bdde99dd9cae90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cdd39d3-78", "ovs_interfaceid": "0cdd39d3-7846-438b-9fb2-a1ff7bb61471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:56:45 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:4d:8c,bridge_name='br-int',has_traffic_filtering=True,id=0cdd39d3-7846-438b-9fb2-a1ff7bb61471,network=Network(bc2718a2-a5ab-44e0-966d-9b180a30ac75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cdd39d3-78') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:56:45 user nova-compute[73391]: DEBUG os_vif [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:4d:8c,bridge_name='br-int',has_traffic_filtering=True,id=0cdd39d3-7846-438b-9fb2-a1ff7bb61471,network=Network(bc2718a2-a5ab-44e0-966d-9b180a30ac75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cdd39d3-78') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:56:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:56:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:56:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:56:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:56:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0cdd39d3-78, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:56:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0cdd39d3-78, col_values=(('external_ids', {'iface-id': '0cdd39d3-7846-438b-9fb2-a1ff7bb61471', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:4d:8c', 'vm-uuid': '3d3ab430-d3a3-4003-8337-0f45fdb54e2f'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:56:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:56:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:56:45 user nova-compute[73391]: INFO os_vif [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:4d:8c,bridge_name='br-int',has_traffic_filtering=True,id=0cdd39d3-7846-438b-9fb2-a1ff7bb61471,network=Network(bc2718a2-a5ab-44e0-966d-9b180a30ac75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cdd39d3-78')
Aug 15 05:56:45 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:56:45 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] No VIF found with MAC fa:16:3e:09:4d:8c, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:56:45 user nova-compute[73391]: DEBUG nova.network.neutron [req-6c1e0d54-dd88-4b96-88d4-6005b04e8dd8 req-d98d9712-25d3-4566-845d-b25c140e2aa0 service nova] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Updated VIF entry in instance network info cache for port 0cdd39d3-7846-438b-9fb2-a1ff7bb61471. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:56:45 user nova-compute[73391]: DEBUG nova.network.neutron [req-6c1e0d54-dd88-4b96-88d4-6005b04e8dd8 req-d98d9712-25d3-4566-845d-b25c140e2aa0 service nova] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Updating instance_info_cache with network_info: [{"id": "0cdd39d3-7846-438b-9fb2-a1ff7bb61471", "address": "fa:16:3e:09:4d:8c", "network": {"id": "bc2718a2-a5ab-44e0-966d-9b180a30ac75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1022668030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8086add121594fe8a0bdde99dd9cae90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cdd39d3-78", "ovs_interfaceid": "0cdd39d3-7846-438b-9fb2-a1ff7bb61471", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:56:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-6c1e0d54-dd88-4b96-88d4-6005b04e8dd8 req-d98d9712-25d3-4566-845d-b25c140e2aa0 service nova] Releasing lock "refresh_cache-3d3ab430-d3a3-4003-8337-0f45fdb54e2f" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:56:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:56:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:56:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:56:47 user nova-compute[73391]: DEBUG nova.compute.manager [req-f9b6c64f-2724-4870-9e7e-faa22572e3ea req-7f819580-fb76-44fa-9512-92e3c628135a service nova] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Received event network-vif-plugged-0cdd39d3-7846-438b-9fb2-a1ff7bb61471 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:56:47 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f9b6c64f-2724-4870-9e7e-faa22572e3ea req-7f819580-fb76-44fa-9512-92e3c628135a service nova] Acquiring lock "3d3ab430-d3a3-4003-8337-0f45fdb54e2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:56:47 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f9b6c64f-2724-4870-9e7e-faa22572e3ea req-7f819580-fb76-44fa-9512-92e3c628135a service nova] Lock "3d3ab430-d3a3-4003-8337-0f45fdb54e2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:56:47 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f9b6c64f-2724-4870-9e7e-faa22572e3ea req-7f819580-fb76-44fa-9512-92e3c628135a service nova] Lock "3d3ab430-d3a3-4003-8337-0f45fdb54e2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:56:47 user nova-compute[73391]: DEBUG nova.compute.manager [req-f9b6c64f-2724-4870-9e7e-faa22572e3ea req-7f819580-fb76-44fa-9512-92e3c628135a service nova] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] No waiting events found dispatching network-vif-plugged-0cdd39d3-7846-438b-9fb2-a1ff7bb61471 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:56:47 user nova-compute[73391]: WARNING nova.compute.manager [req-f9b6c64f-2724-4870-9e7e-faa22572e3ea req-7f819580-fb76-44fa-9512-92e3c628135a service nova] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Received unexpected event network-vif-plugged-0cdd39d3-7846-438b-9fb2-a1ff7bb61471 for instance with vm_state building and task_state spawning.
Aug 15 05:56:47 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:56:47 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:56:47 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:56:49 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692079009.07927, 3d3ab430-d3a3-4003-8337-0f45fdb54e2f => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:56:49 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] VM Resumed (Lifecycle Event)
Aug 15 05:56:49 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:56:49 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Guest created on hypervisor {{(pid=73391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 05:56:49 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Instance spawned successfully.
Aug 15 05:56:49 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 05:56:49 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:56:49 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:56:49 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Found default for hw_cdrom_bus of ide {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:56:49 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Found default for hw_disk_bus of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:56:49 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Found default for hw_input_bus of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:56:49 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Found default for hw_pointer_model of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:56:49 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Found default for hw_video_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:56:49 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Found default for hw_vif_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:56:49 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:56:49 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692079009.0815337, 3d3ab430-d3a3-4003-8337-0f45fdb54e2f => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:56:49 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] VM Started (Lifecycle Event)
Aug 15 05:56:49 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:56:49 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:56:49 user nova-compute[73391]: DEBUG nova.compute.manager [req-236c7e45-00e6-431d-ae25-f1e0c035eeca req-7ceaa2bd-ff68-4051-8028-a17f64a37809 service nova] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Received event network-vif-plugged-0cdd39d3-7846-438b-9fb2-a1ff7bb61471 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:56:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-236c7e45-00e6-431d-ae25-f1e0c035eeca req-7ceaa2bd-ff68-4051-8028-a17f64a37809 service nova] Acquiring lock "3d3ab430-d3a3-4003-8337-0f45fdb54e2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:56:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-236c7e45-00e6-431d-ae25-f1e0c035eeca req-7ceaa2bd-ff68-4051-8028-a17f64a37809 service nova] Lock "3d3ab430-d3a3-4003-8337-0f45fdb54e2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:56:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-236c7e45-00e6-431d-ae25-f1e0c035eeca req-7ceaa2bd-ff68-4051-8028-a17f64a37809 service nova] Lock "3d3ab430-d3a3-4003-8337-0f45fdb54e2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:56:49 user nova-compute[73391]: DEBUG nova.compute.manager [req-236c7e45-00e6-431d-ae25-f1e0c035eeca req-7ceaa2bd-ff68-4051-8028-a17f64a37809 service nova] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] No waiting events found dispatching network-vif-plugged-0cdd39d3-7846-438b-9fb2-a1ff7bb61471 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:56:49 user nova-compute[73391]: WARNING nova.compute.manager [req-236c7e45-00e6-431d-ae25-f1e0c035eeca req-7ceaa2bd-ff68-4051-8028-a17f64a37809 service nova] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Received unexpected event network-vif-plugged-0cdd39d3-7846-438b-9fb2-a1ff7bb61471 for instance with vm_state building and task_state spawning.
Aug 15 05:56:49 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:56:49 user nova-compute[73391]: INFO nova.compute.manager [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Took 5.42 seconds to spawn the instance on the hypervisor.
Aug 15 05:56:49 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:56:49 user nova-compute[73391]: INFO nova.compute.manager [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Took 6.01 seconds to build instance.
Aug 15 05:56:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3746affb-1518-476d-bda0-86ae07e1fe75 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "3d3ab430-d3a3-4003-8337-0f45fdb54e2f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.107s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:56:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:56:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:56:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:56:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:56:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 05:56:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 05:56:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 05:56:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:57:00 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:57:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-45b76673-0049-44d8-8994-a60ddab0d3c9 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Acquiring lock "3adc0c85-0f31-4a73-8b98-eb1a4b32434d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:57:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-45b76673-0049-44d8-8994-a60ddab0d3c9 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Lock "3adc0c85-0f31-4a73-8b98-eb1a4b32434d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:57:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-45b76673-0049-44d8-8994-a60ddab0d3c9 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Acquiring lock "3adc0c85-0f31-4a73-8b98-eb1a4b32434d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:57:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-45b76673-0049-44d8-8994-a60ddab0d3c9 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Lock "3adc0c85-0f31-4a73-8b98-eb1a4b32434d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:57:04 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-45b76673-0049-44d8-8994-a60ddab0d3c9 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Lock "3adc0c85-0f31-4a73-8b98-eb1a4b32434d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:57:04 user nova-compute[73391]: INFO nova.compute.manager [None req-45b76673-0049-44d8-8994-a60ddab0d3c9 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Terminating instance
Aug 15 05:57:04 user nova-compute[73391]: DEBUG nova.compute.manager [None req-45b76673-0049-44d8-8994-a60ddab0d3c9 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Start destroying the instance on the hypervisor. {{(pid=73391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 05:57:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:57:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:57:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:57:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:57:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:57:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:57:05 user nova-compute[73391]: DEBUG nova.compute.manager [req-1ef505bb-4072-47a4-83c7-3d79df6ff1f2 req-706608fb-7294-4968-951a-d96be7a4223c service nova] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Received event network-vif-unplugged-95260c2c-bfa7-42c2-934b-af9874c68201 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:57:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-1ef505bb-4072-47a4-83c7-3d79df6ff1f2 req-706608fb-7294-4968-951a-d96be7a4223c service nova] Acquiring lock "3adc0c85-0f31-4a73-8b98-eb1a4b32434d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:57:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-1ef505bb-4072-47a4-83c7-3d79df6ff1f2 req-706608fb-7294-4968-951a-d96be7a4223c service nova] Lock "3adc0c85-0f31-4a73-8b98-eb1a4b32434d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:57:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-1ef505bb-4072-47a4-83c7-3d79df6ff1f2 req-706608fb-7294-4968-951a-d96be7a4223c service nova] Lock "3adc0c85-0f31-4a73-8b98-eb1a4b32434d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:57:05 user nova-compute[73391]: DEBUG nova.compute.manager [req-1ef505bb-4072-47a4-83c7-3d79df6ff1f2 req-706608fb-7294-4968-951a-d96be7a4223c service nova] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] No waiting events found dispatching network-vif-unplugged-95260c2c-bfa7-42c2-934b-af9874c68201 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:57:05 user nova-compute[73391]: DEBUG nova.compute.manager [req-1ef505bb-4072-47a4-83c7-3d79df6ff1f2 req-706608fb-7294-4968-951a-d96be7a4223c service nova] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Received event network-vif-unplugged-95260c2c-bfa7-42c2-934b-af9874c68201 for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 05:57:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:57:05 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Instance destroyed successfully.
Aug 15 05:57:05 user nova-compute[73391]: DEBUG nova.objects.instance [None req-45b76673-0049-44d8-8994-a60ddab0d3c9 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Lazy-loading 'resources' on Instance uuid 3adc0c85-0f31-4a73-8b98-eb1a4b32434d {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:57:05 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-45b76673-0049-44d8-8994-a60ddab0d3c9 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:49:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1266227369',display_name='tempest-ServerStableDeviceRescueTest-server-1266227369',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1266227369',id=40,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBClbn+ZluhSwHYHUlfY7kR3eatJoIxOJzOUNz+RPGiKGWCzkk0oGlPS2RkCrWZEexGlaxiCjPu9TAHalxvsHmjvpVHNYRCtECwXpmtDg6eyUHQPHz+qqJmib5EvKgKkJ5A==',key_name='tempest-keypair-1197168403',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:53:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0d6c4fcd171841d6b59b8b400efd0619',ramdisk_id='',reservation_id='r-4hbuvl6a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1604927137',owner_user_name='tempest-ServerStableDeviceRescueTest-1604927137-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:55:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='43a914b6a21746b99ec36fb395d2f87f',uuid=3adc0c85-0f31-4a73-8b98-eb1a4b32434d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "95260c2c-bfa7-42c2-934b-af9874c68201", "address": "fa:16:3e:9e:93:8d", "network": {"id": "6444073e-0d7a-4ecd-a945-4cbbb6bf2c92", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1589197255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d6c4fcd171841d6b59b8b400efd0619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95260c2c-bf", "ovs_interfaceid": "95260c2c-bfa7-42c2-934b-af9874c68201", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:57:05 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-45b76673-0049-44d8-8994-a60ddab0d3c9 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Converting VIF {"id": "95260c2c-bfa7-42c2-934b-af9874c68201", "address": "fa:16:3e:9e:93:8d", "network": {"id": "6444073e-0d7a-4ecd-a945-4cbbb6bf2c92", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1589197255-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0d6c4fcd171841d6b59b8b400efd0619", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95260c2c-bf", "ovs_interfaceid": "95260c2c-bfa7-42c2-934b-af9874c68201", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:57:05 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-45b76673-0049-44d8-8994-a60ddab0d3c9 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:93:8d,bridge_name='br-int',has_traffic_filtering=True,id=95260c2c-bfa7-42c2-934b-af9874c68201,network=Network(6444073e-0d7a-4ecd-a945-4cbbb6bf2c92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95260c2c-bf') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:57:05 user nova-compute[73391]: DEBUG os_vif [None req-45b76673-0049-44d8-8994-a60ddab0d3c9 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:93:8d,bridge_name='br-int',has_traffic_filtering=True,id=95260c2c-bfa7-42c2-934b-af9874c68201,network=Network(6444073e-0d7a-4ecd-a945-4cbbb6bf2c92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95260c2c-bf') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:57:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:57:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap95260c2c-bf, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:57:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:57:05 user nova-compute[73391]: INFO os_vif [None req-45b76673-0049-44d8-8994-a60ddab0d3c9 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:93:8d,bridge_name='br-int',has_traffic_filtering=True,id=95260c2c-bfa7-42c2-934b-af9874c68201,network=Network(6444073e-0d7a-4ecd-a945-4cbbb6bf2c92),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95260c2c-bf')
Aug 15 05:57:05 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-45b76673-0049-44d8-8994-a60ddab0d3c9 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Deleting instance files /opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d_del
Aug 15 05:57:05 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-45b76673-0049-44d8-8994-a60ddab0d3c9 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Deletion of /opt/stack/data/nova/instances/3adc0c85-0f31-4a73-8b98-eb1a4b32434d_del complete
Aug 15 05:57:05 user nova-compute[73391]: INFO nova.compute.manager [None req-45b76673-0049-44d8-8994-a60ddab0d3c9 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Took 0.97 seconds to destroy the instance on the hypervisor.
Aug 15 05:57:05 user nova-compute[73391]: DEBUG oslo.service.loopingcall [None req-45b76673-0049-44d8-8994-a60ddab0d3c9 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 05:57:05 user nova-compute[73391]: DEBUG nova.compute.manager [-] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Deallocating network for instance {{(pid=73391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 05:57:05 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] deallocate_for_instance() {{(pid=73391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 05:57:06 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:57:06 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Took 0.90 seconds to deallocate network for instance.
Aug 15 05:57:06 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-45b76673-0049-44d8-8994-a60ddab0d3c9 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:57:06 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-45b76673-0049-44d8-8994-a60ddab0d3c9 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:57:07 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:57:07 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-45b76673-0049-44d8-8994-a60ddab0d3c9 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:57:07 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-45b76673-0049-44d8-8994-a60ddab0d3c9 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:57:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-45b76673-0049-44d8-8994-a60ddab0d3c9 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.301s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:57:07 user nova-compute[73391]: INFO nova.scheduler.client.report [None req-45b76673-0049-44d8-8994-a60ddab0d3c9 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Deleted allocations for instance 3adc0c85-0f31-4a73-8b98-eb1a4b32434d
Aug 15 05:57:07 user nova-compute[73391]: DEBUG nova.compute.manager [req-c6f26869-8aa0-4cd6-b085-9cfa64403b41 req-eb2bde36-f777-42eb-81ba-677398f05541 service nova] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Received event network-vif-plugged-95260c2c-bfa7-42c2-934b-af9874c68201 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:57:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-c6f26869-8aa0-4cd6-b085-9cfa64403b41 req-eb2bde36-f777-42eb-81ba-677398f05541 service nova] Acquiring lock "3adc0c85-0f31-4a73-8b98-eb1a4b32434d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:57:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-c6f26869-8aa0-4cd6-b085-9cfa64403b41 req-eb2bde36-f777-42eb-81ba-677398f05541 service nova] Lock "3adc0c85-0f31-4a73-8b98-eb1a4b32434d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:57:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-c6f26869-8aa0-4cd6-b085-9cfa64403b41 req-eb2bde36-f777-42eb-81ba-677398f05541 service nova] Lock "3adc0c85-0f31-4a73-8b98-eb1a4b32434d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:57:07 user nova-compute[73391]: DEBUG nova.compute.manager [req-c6f26869-8aa0-4cd6-b085-9cfa64403b41 req-eb2bde36-f777-42eb-81ba-677398f05541 service nova] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] No waiting events found dispatching network-vif-plugged-95260c2c-bfa7-42c2-934b-af9874c68201 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:57:07 user nova-compute[73391]: WARNING nova.compute.manager [req-c6f26869-8aa0-4cd6-b085-9cfa64403b41 req-eb2bde36-f777-42eb-81ba-677398f05541 service nova] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Received unexpected event network-vif-plugged-95260c2c-bfa7-42c2-934b-af9874c68201 for instance with vm_state deleted and task_state None.
Aug 15 05:57:07 user nova-compute[73391]: DEBUG nova.compute.manager [req-c6f26869-8aa0-4cd6-b085-9cfa64403b41 req-eb2bde36-f777-42eb-81ba-677398f05541 service nova] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Received event network-vif-deleted-95260c2c-bfa7-42c2-934b-af9874c68201 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:57:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-45b76673-0049-44d8-8994-a60ddab0d3c9 tempest-ServerStableDeviceRescueTest-1604927137 tempest-ServerStableDeviceRescueTest-1604927137-project-member] Lock "3adc0c85-0f31-4a73-8b98-eb1a4b32434d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.470s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:57:10 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:57:10 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:57:15 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:57:15 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:57:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6fa462a4-4549-4793-a87d-ce666b33ed2e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Acquiring lock "d10508dd-f3f7-4e96-b822-d331ded6809f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:57:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6fa462a4-4549-4793-a87d-ce666b33ed2e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "d10508dd-f3f7-4e96-b822-d331ded6809f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:57:19 user nova-compute[73391]: DEBUG nova.objects.instance [None req-6fa462a4-4549-4793-a87d-ce666b33ed2e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lazy-loading 'flavor' on Instance uuid d10508dd-f3f7-4e96-b822-d331ded6809f {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:57:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6fa462a4-4549-4793-a87d-ce666b33ed2e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "d10508dd-f3f7-4e96-b822-d331ded6809f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:57:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:57:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6fa462a4-4549-4793-a87d-ce666b33ed2e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Acquiring lock "d10508dd-f3f7-4e96-b822-d331ded6809f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:57:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6fa462a4-4549-4793-a87d-ce666b33ed2e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "d10508dd-f3f7-4e96-b822-d331ded6809f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:57:20 user nova-compute[73391]: INFO nova.compute.manager [None req-6fa462a4-4549-4793-a87d-ce666b33ed2e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Attaching volume e5482919-10aa-44c4-8f50-ee8a3fb6ce75 to /dev/vdb
Aug 15 05:57:20 user nova-compute[73391]: DEBUG os_brick.utils [None req-6fa462a4-4549-4793-a87d-ce666b33ed2e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:57:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:57:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:57:20 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1f17bb-c0c5-4a4c-83b7-f682cadca450]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:57:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:57:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:57:20 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[af96a32a-c3d9-4be0-90e8-926f360372aa]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:57:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:57:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:57:20 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60aab9a-0618-441a-bd45-ae58981aee9e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:57:20 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f380c180-17ee-4b31-9d28-163667c99e33]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:57:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-6fa462a4-4549-4793-a87d-ce666b33ed2e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:57:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-6fa462a4-4549-4793-a87d-ce666b33ed2e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:57:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6fa462a4-4549-4793-a87d-ce666b33ed2e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 05:57:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:57:20 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:57:20 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 05:57:20 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5455e7d9-bd29-4438-b71c-4e056576e24f]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:57:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-6fa462a4-4549-4793-a87d-ce666b33ed2e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 05:57:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-6fa462a4-4549-4793-a87d-ce666b33ed2e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 05:57:20 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-6fa462a4-4549-4793-a87d-ce666b33ed2e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 05:57:20 user nova-compute[73391]: DEBUG os_brick.utils [None req-6fa462a4-4549-4793-a87d-ce666b33ed2e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:57:20 user nova-compute[73391]: DEBUG nova.virt.block_device [None req-6fa462a4-4549-4793-a87d-ce666b33ed2e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Updating existing volume attachment record: 68e53123-9696-4e42-a3cc-b6e5d9a1780c {{(pid=73391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 05:57:20 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692079025.704533, 3adc0c85-0f31-4a73-8b98-eb1a4b32434d => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:57:20 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] VM Stopped (Lifecycle Event)
Aug 15 05:57:20 user nova-compute[73391]: DEBUG nova.compute.manager [None req-6e7efd71-dc82-421c-98ab-aed26374b509 None None] [instance: 3adc0c85-0f31-4a73-8b98-eb1a4b32434d] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:57:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:57:25 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:57:28 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:57:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:57:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:57:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:57:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Auditing locally available compute resources for user (node: user) {{(pid=73391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 05:57:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3ab430-d3a3-4003-8337-0f45fdb54e2f/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:57:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fa462a4-4549-4793-a87d-ce666b33ed2e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 05:57:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa462a4-4549-4793-a87d-ce666b33ed2e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aEUMKbYF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:57:28 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-6fa462a4-4549-4793-a87d-ce666b33ed2e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:57:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-6fa462a4-4549-4793-a87d-ce666b33ed2e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:57:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-6fa462a4-4549-4793-a87d-ce666b33ed2e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:57:28 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-6fa462a4-4549-4793-a87d-ce666b33ed2e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:57:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-6fa462a4-4549-4793-a87d-ce666b33ed2e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:57:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-6fa462a4-4549-4793-a87d-ce666b33ed2e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:57:28 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-6fa462a4-4549-4793-a87d-ce666b33ed2e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 05:57:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:57:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:57:28 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[55478958-8818-4c53-833d-440b8c236b96]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:57:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa462a4-4549-4793-a87d-ce666b33ed2e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 05:57:28 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:57:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:57:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:57:29 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[035d1976-7de4-4eff-98bb-14da4048d1a5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:57:29 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa462a4-4549-4793-a87d-ce666b33ed2e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75] added
Aug 15 05:57:29 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:57:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:57:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:57:29 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f0f9cb-2caa-4104-bee5-126905bcac1d]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:57:29 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa462a4-4549-4793-a87d-ce666b33ed2e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:57:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:57:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:57:29 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd717335-3dc8-425f-bab6-0b151f7c65bc]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:57:29 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa462a4-4549-4793-a87d-ce666b33ed2e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:57:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aEUMKbYF {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:57:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3ab430-d3a3-4003-8337-0f45fdb54e2f/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:57:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3ab430-d3a3-4003-8337-0f45fdb54e2f/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:57:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aEUMKbYF" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:57:29 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac79a1b5-4725-4b41-a551-c8243354147b]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:57:29 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa462a4-4549-4793-a87d-ce666b33ed2e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aEUMKbYF'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:57:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:57:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:57:29 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f7ed3d-1caf-4e66-bacb-f30ba1471979]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:57:29 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa462a4-4549-4793-a87d-ce666b33ed2e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:57:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:57:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:57:29 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3446592-5aec-49d0-9f36-2901a7f64b61]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:57:29 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa462a4-4549-4793-a87d-ce666b33ed2e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 (non-flash)
Aug 15 05:57:29 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:57:29 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa462a4-4549-4793-a87d-ce666b33ed2e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 (non-flash)
Aug 15 05:57:29 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:57:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:57:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:57:29 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab645a46-e50f-4e14-b211-677542c3c5a7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:57:29 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa462a4-4549-4793-a87d-ce666b33ed2e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75, portal: 172.16.0.220,3260]
Aug 15 05:57:29 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75, portal: 172.16.0.220,3260] successful.
Aug 15 05:57:29 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:57:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:57:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:57:29 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc693386-fd76-4fdc-8ae6-af64013abbe8]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:57:29 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa462a4-4549-4793-a87d-ce666b33ed2e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:57:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:57:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3ab430-d3a3-4003-8337-0f45fdb54e2f/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:57:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:57:29 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e164903a-9d67-46dd-bdc6-abfef07a8ab7]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:57:29 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa462a4-4549-4793-a87d-ce666b33ed2e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 (non-flash)
Aug 15 05:57:29 user nova-compute[73391]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 (non-flash)
Aug 15 05:57:29 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:57:29 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa462a4-4549-4793-a87d-ce666b33ed2e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 (non-flash)
Aug 15 05:57:29 user nova-compute[73391]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 (non-flash)
Aug 15 05:57:29 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:57:29 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-6fa462a4-4549-4793-a87d-ce666b33ed2e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:57:29 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa462a4-4549-4793-a87d-ce666b33ed2e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 05:57:29 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-6fa462a4-4549-4793-a87d-ce666b33ed2e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] HCTL ('34', '-', '-', 0) found on session 58 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 05:57:29 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-6fa462a4-4549-4793-a87d-ce666b33ed2e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 05:57:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:57:29 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:57:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d10508dd-f3f7-4e96-b822-d331ded6809f/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:57:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:57:29 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b0f02f-0325-469f-a24c-6ee89489d5fa]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:57:29 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-6fa462a4-4549-4793-a87d-ce666b33ed2e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:57:29 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa462a4-4549-4793-a87d-ce666b33ed2e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aEUMKbYF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 05:57:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d10508dd-f3f7-4e96-b822-d331ded6809f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:57:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d10508dd-f3f7-4e96-b822-d331ded6809f/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:57:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d10508dd-f3f7-4e96-b822-d331ded6809f/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:57:30 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:57:30 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:57:30 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Hypervisor/Node resource view: name=user free_ram=8426MB free_disk=25.07895278930664GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 05:57:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:57:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:57:30 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance f730e539-5371-49d7-8487-d94f400fe0bc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:57:30 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance d10508dd-f3f7-4e96-b822-d331ded6809f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:57:30 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 3d3ab430-d3a3-4003-8337-0f45fdb54e2f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:57:30 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 05:57:30 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 05:57:30 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-6fa462a4-4549-4793-a87d-ce666b33ed2e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:57:30 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-6fa462a4-4549-4793-a87d-ce666b33ed2e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '26466626366633765', 'path': '/dev/sdc'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:57:30 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6fa462a4-4549-4793-a87d-ce666b33ed2e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26466626366633765', 'path': '/dev/sdc'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 05:57:30 user nova-compute[73391]: DEBUG nova.objects.instance [None req-6fa462a4-4549-4793-a87d-ce666b33ed2e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lazy-loading 'flavor' on Instance uuid d10508dd-f3f7-4e96-b822-d331ded6809f {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:57:30 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:57:30 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:57:30 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-6fa462a4-4549-4793-a87d-ce666b33ed2e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 05:57:30 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:57:30 user nova-compute[73391]:   <source dev="/dev/sdc"/>
Aug 15 05:57:30 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:57:30 user nova-compute[73391]:   <serial>e5482919-10aa-44c4-8f50-ee8a3fb6ce75</serial>
Aug 15 05:57:30 user nova-compute[73391]: </disk>
Aug 15 05:57:30 user nova-compute[73391]:  {{(pid=73391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 05:57:30 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Compute_service record updated for user:user {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 05:57:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.366s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:57:30 user nova-compute[73391]: DEBUG nova.compute.manager [req-fbb20a2c-9167-4b6c-a2cb-df416b292436 req-c26240df-17b2-4b59-9629-ad2ffdbe4f73 service nova] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Received event network-changed-164663cf-1c4f-4166-86e2-465351cdaaea {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:57:30 user nova-compute[73391]: DEBUG nova.compute.manager [req-fbb20a2c-9167-4b6c-a2cb-df416b292436 req-c26240df-17b2-4b59-9629-ad2ffdbe4f73 service nova] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Refreshing instance network info cache due to event network-changed-164663cf-1c4f-4166-86e2-465351cdaaea. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:57:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-fbb20a2c-9167-4b6c-a2cb-df416b292436 req-c26240df-17b2-4b59-9629-ad2ffdbe4f73 service nova] Acquiring lock "refresh_cache-f730e539-5371-49d7-8487-d94f400fe0bc" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:57:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-fbb20a2c-9167-4b6c-a2cb-df416b292436 req-c26240df-17b2-4b59-9629-ad2ffdbe4f73 service nova] Acquired lock "refresh_cache-f730e539-5371-49d7-8487-d94f400fe0bc" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:57:30 user nova-compute[73391]: DEBUG nova.network.neutron [req-fbb20a2c-9167-4b6c-a2cb-df416b292436 req-c26240df-17b2-4b59-9629-ad2ffdbe4f73 service nova] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Refreshing network info cache for port 164663cf-1c4f-4166-86e2-465351cdaaea {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:57:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0966c55a-035a-4c8e-9f06-1974674e71c6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "f730e539-5371-49d7-8487-d94f400fe0bc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:57:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0966c55a-035a-4c8e-9f06-1974674e71c6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "f730e539-5371-49d7-8487-d94f400fe0bc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:57:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0966c55a-035a-4c8e-9f06-1974674e71c6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "f730e539-5371-49d7-8487-d94f400fe0bc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:57:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0966c55a-035a-4c8e-9f06-1974674e71c6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "f730e539-5371-49d7-8487-d94f400fe0bc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:57:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0966c55a-035a-4c8e-9f06-1974674e71c6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "f730e539-5371-49d7-8487-d94f400fe0bc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:57:30 user nova-compute[73391]: INFO nova.compute.manager [None req-0966c55a-035a-4c8e-9f06-1974674e71c6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Terminating instance
Aug 15 05:57:30 user nova-compute[73391]: DEBUG nova.compute.manager [None req-0966c55a-035a-4c8e-9f06-1974674e71c6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Start destroying the instance on the hypervisor. {{(pid=73391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 05:57:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:57:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:57:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:57:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:57:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:57:30 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-6fa462a4-4549-4793-a87d-ce666b33ed2e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:57:30 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-6fa462a4-4549-4793-a87d-ce666b33ed2e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:57:30 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-6fa462a4-4549-4793-a87d-ce666b33ed2e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] No VIF found with MAC fa:16:3e:91:71:96, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:57:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6fa462a4-4549-4793-a87d-ce666b33ed2e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "d10508dd-f3f7-4e96-b822-d331ded6809f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.786s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG nova.network.neutron [req-fbb20a2c-9167-4b6c-a2cb-df416b292436 req-c26240df-17b2-4b59-9629-ad2ffdbe4f73 service nova] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Updated VIF entry in instance network info cache for port 164663cf-1c4f-4166-86e2-465351cdaaea. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG nova.network.neutron [req-fbb20a2c-9167-4b6c-a2cb-df416b292436 req-c26240df-17b2-4b59-9629-ad2ffdbe4f73 service nova] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Updating instance_info_cache with network_info: [{"id": "164663cf-1c4f-4166-86e2-465351cdaaea", "address": "fa:16:3e:83:de:e8", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap164663cf-1c", "ovs_interfaceid": "164663cf-1c4f-4166-86e2-465351cdaaea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-fbb20a2c-9167-4b6c-a2cb-df416b292436 req-c26240df-17b2-4b59-9629-ad2ffdbe4f73 service nova] Releasing lock "refresh_cache-f730e539-5371-49d7-8487-d94f400fe0bc" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:57:31 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Instance destroyed successfully.
Aug 15 05:57:31 user nova-compute[73391]: DEBUG nova.objects.instance [None req-0966c55a-035a-4c8e-9f06-1974674e71c6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lazy-loading 'resources' on Instance uuid f730e539-5371-49d7-8487-d94f400fe0bc {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-0966c55a-035a-4c8e-9f06-1974674e71c6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:52:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1674785904',display_name='tempest-TestVolumeBootPattern-server-1674785904',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1674785904',id=44,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG9jBoYjOy+aqM5q6fYRpW336xJnp1RjcA+ryp4UUPjXWPw7VtxeYktb68BzzUpanNxgDS13R1RxH4S+D0vqFMFtOkREwueXmREiQ22XqN9Aby3PDiDj1ii3iTWuJ+dFag==',key_name='tempest-TestVolumeBootPattern-1057822238',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:52:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a8188c2e8ca34ef1982faa49f1058bb7',ramdisk_id='',reservation_id='r-lb7o515p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1834029963',owner_user_name='tempest-TestVolumeBootPattern-1834029963-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:52:43Z,user_data=None,user_id='aefb6ccab586465dbe56e71a40bcf1f0',uuid=f730e539-5371-49d7-8487-d94f400fe0bc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "164663cf-1c4f-4166-86e2-465351cdaaea", "address": "fa:16:3e:83:de:e8", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap164663cf-1c", "ovs_interfaceid": "164663cf-1c4f-4166-86e2-465351cdaaea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-0966c55a-035a-4c8e-9f06-1974674e71c6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Converting VIF {"id": "164663cf-1c4f-4166-86e2-465351cdaaea", "address": "fa:16:3e:83:de:e8", "network": {"id": "fae0e46a-88e4-499d-bcff-5b7df55eab4e", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-2084294488-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.50", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a8188c2e8ca34ef1982faa49f1058bb7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap164663cf-1c", "ovs_interfaceid": "164663cf-1c4f-4166-86e2-465351cdaaea", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-0966c55a-035a-4c8e-9f06-1974674e71c6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:de:e8,bridge_name='br-int',has_traffic_filtering=True,id=164663cf-1c4f-4166-86e2-465351cdaaea,network=Network(fae0e46a-88e4-499d-bcff-5b7df55eab4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap164663cf-1c') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG os_vif [None req-0966c55a-035a-4c8e-9f06-1974674e71c6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:de:e8,bridge_name='br-int',has_traffic_filtering=True,id=164663cf-1c4f-4166-86e2-465351cdaaea,network=Network(fae0e46a-88e4-499d-bcff-5b7df55eab4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap164663cf-1c') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap164663cf-1c, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:57:31 user nova-compute[73391]: INFO os_vif [None req-0966c55a-035a-4c8e-9f06-1974674e71c6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:de:e8,bridge_name='br-int',has_traffic_filtering=True,id=164663cf-1c4f-4166-86e2-465351cdaaea,network=Network(fae0e46a-88e4-499d-bcff-5b7df55eab4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap164663cf-1c')
Aug 15 05:57:31 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0966c55a-035a-4c8e-9f06-1974674e71c6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0966c55a-035a-4c8e-9f06-1974674e71c6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sQZfExwK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:57:31 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-0966c55a-035a-4c8e-9f06-1974674e71c6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:57:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-0966c55a-035a-4c8e-9f06-1974674e71c6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-0966c55a-035a-4c8e-9f06-1974674e71c6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0966c55a-035a-4c8e-9f06-1974674e71c6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[290fa32f-dbc8-452f-86d1-690dcb8976e4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb8ce91-4ed9-4496-8525-2611f9062704]: (4, ('tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0966c55a-035a-4c8e-9f06-1974674e71c6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 (non-flash)
Aug 15 05:57:31 user nova-compute[73391]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 (non-flash)
Aug 15 05:57:31 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0966c55a-035a-4c8e-9f06-1974674e71c6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsi session list stdout=tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 (non-flash)
Aug 15 05:57:31 user nova-compute[73391]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 (non-flash)
Aug 15 05:57:31 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0966c55a-035a-4c8e-9f06-1974674e71c6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7728185870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1'): ({'sdb'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-0966c55a-035a-4c8e-9f06-1974674e71c6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Removing single pathed devices sdb {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b857c56a-5c50-477b-902a-8bc4c583d565]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.029s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[73bf5f67-9182-42bd-b025-1914a002a08f]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-0966c55a-035a-4c8e-9f06-1974674e71c6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Flushing IO for device /dev/sdb {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3b2b92-9b2a-436f-abfc-27d20e017354]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-0966c55a-035a-4c8e-9f06-1974674e71c6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.132s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba344a7-3dfc-4339-a49d-15ea53b8df93]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-0966c55a-035a-4c8e-9f06-1974674e71c6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-0966c55a-035a-4c8e-9f06-1974674e71c6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] SCSI volumes sdb have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0966c55a-035a-4c8e-9f06-1974674e71c6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8c982f-53ed-43bb-acec-f1f557fd3891]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0966c55a-035a-4c8e-9f06-1974674e71c6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[044b9822-34b5-4ce7-9918-684e352c8f7e]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0966c55a-035a-4c8e-9f06-1974674e71c6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1, portal: 172.16.0.220,3260]
Aug 15 05:57:31 user nova-compute[73391]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1, portal: 172.16.0.220,3260] successful.
Aug 15 05:57:31 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7f4a52d4-743f-45db-91c3-b7e42de736c1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac698eb-eb43-4508-85d3-f54b5948560a]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0966c55a-035a-4c8e-9f06-1974674e71c6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-0966c55a-035a-4c8e-9f06-1974674e71c6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0966c55a-035a-4c8e-9f06-1974674e71c6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] <== disconnect_volume: return (386ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0966c55a-035a-4c8e-9f06-1974674e71c6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 05:57:31 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-0966c55a-035a-4c8e-9f06-1974674e71c6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Deleting instance files /opt/stack/data/nova/instances/f730e539-5371-49d7-8487-d94f400fe0bc_del
Aug 15 05:57:31 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-0966c55a-035a-4c8e-9f06-1974674e71c6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Deletion of /opt/stack/data/nova/instances/f730e539-5371-49d7-8487-d94f400fe0bc_del complete
Aug 15 05:57:31 user nova-compute[73391]: INFO nova.compute.manager [None req-0966c55a-035a-4c8e-9f06-1974674e71c6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Took 1.27 seconds to destroy the instance on the hypervisor.
Aug 15 05:57:31 user nova-compute[73391]: DEBUG oslo.service.loopingcall [None req-0966c55a-035a-4c8e-9f06-1974674e71c6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG nova.compute.manager [-] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Deallocating network for instance {{(pid=73391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] deallocate_for_instance() {{(pid=73391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 05:57:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:57:32 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:57:32 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:57:32 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:57:32 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:57:32 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Took 0.58 seconds to deallocate network for instance.
Aug 15 05:57:32 user nova-compute[73391]: DEBUG nova.compute.manager [req-5be8c41d-1426-4826-aa12-7454db162d66 req-c7bda1a7-1050-4f8d-a399-5411895999c6 service nova] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Received event network-vif-unplugged-164663cf-1c4f-4166-86e2-465351cdaaea {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:57:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-5be8c41d-1426-4826-aa12-7454db162d66 req-c7bda1a7-1050-4f8d-a399-5411895999c6 service nova] Acquiring lock "f730e539-5371-49d7-8487-d94f400fe0bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:57:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-5be8c41d-1426-4826-aa12-7454db162d66 req-c7bda1a7-1050-4f8d-a399-5411895999c6 service nova] Lock "f730e539-5371-49d7-8487-d94f400fe0bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:57:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-5be8c41d-1426-4826-aa12-7454db162d66 req-c7bda1a7-1050-4f8d-a399-5411895999c6 service nova] Lock "f730e539-5371-49d7-8487-d94f400fe0bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:57:32 user nova-compute[73391]: DEBUG nova.compute.manager [req-5be8c41d-1426-4826-aa12-7454db162d66 req-c7bda1a7-1050-4f8d-a399-5411895999c6 service nova] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] No waiting events found dispatching network-vif-unplugged-164663cf-1c4f-4166-86e2-465351cdaaea {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:57:32 user nova-compute[73391]: DEBUG nova.compute.manager [req-5be8c41d-1426-4826-aa12-7454db162d66 req-c7bda1a7-1050-4f8d-a399-5411895999c6 service nova] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Received event network-vif-unplugged-164663cf-1c4f-4166-86e2-465351cdaaea for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 05:57:32 user nova-compute[73391]: DEBUG nova.compute.manager [req-5be8c41d-1426-4826-aa12-7454db162d66 req-c7bda1a7-1050-4f8d-a399-5411895999c6 service nova] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Received event network-vif-plugged-164663cf-1c4f-4166-86e2-465351cdaaea {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:57:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-5be8c41d-1426-4826-aa12-7454db162d66 req-c7bda1a7-1050-4f8d-a399-5411895999c6 service nova] Acquiring lock "f730e539-5371-49d7-8487-d94f400fe0bc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:57:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-5be8c41d-1426-4826-aa12-7454db162d66 req-c7bda1a7-1050-4f8d-a399-5411895999c6 service nova] Lock "f730e539-5371-49d7-8487-d94f400fe0bc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:57:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-5be8c41d-1426-4826-aa12-7454db162d66 req-c7bda1a7-1050-4f8d-a399-5411895999c6 service nova] Lock "f730e539-5371-49d7-8487-d94f400fe0bc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:57:32 user nova-compute[73391]: DEBUG nova.compute.manager [req-5be8c41d-1426-4826-aa12-7454db162d66 req-c7bda1a7-1050-4f8d-a399-5411895999c6 service nova] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] No waiting events found dispatching network-vif-plugged-164663cf-1c4f-4166-86e2-465351cdaaea {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:57:32 user nova-compute[73391]: WARNING nova.compute.manager [req-5be8c41d-1426-4826-aa12-7454db162d66 req-c7bda1a7-1050-4f8d-a399-5411895999c6 service nova] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Received unexpected event network-vif-plugged-164663cf-1c4f-4166-86e2-465351cdaaea for instance with vm_state active and task_state deleting.
Aug 15 05:57:32 user nova-compute[73391]: DEBUG nova.compute.manager [req-5be8c41d-1426-4826-aa12-7454db162d66 req-c7bda1a7-1050-4f8d-a399-5411895999c6 service nova] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Received event network-vif-deleted-164663cf-1c4f-4166-86e2-465351cdaaea {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:57:32 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:57:32 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:57:33 user nova-compute[73391]: INFO nova.compute.manager [None req-0966c55a-035a-4c8e-9f06-1974674e71c6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Took 0.78 seconds to detach 1 volumes for instance.
Aug 15 05:57:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0966c55a-035a-4c8e-9f06-1974674e71c6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:57:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0966c55a-035a-4c8e-9f06-1974674e71c6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:57:33 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-0966c55a-035a-4c8e-9f06-1974674e71c6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:57:33 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-0966c55a-035a-4c8e-9f06-1974674e71c6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:57:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0966c55a-035a-4c8e-9f06-1974674e71c6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.188s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:57:33 user nova-compute[73391]: INFO nova.scheduler.client.report [None req-0966c55a-035a-4c8e-9f06-1974674e71c6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Deleted allocations for instance f730e539-5371-49d7-8487-d94f400fe0bc
Aug 15 05:57:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0966c55a-035a-4c8e-9f06-1974674e71c6 tempest-TestVolumeBootPattern-1834029963 tempest-TestVolumeBootPattern-1834029963-project-member] Lock "f730e539-5371-49d7-8487-d94f400fe0bc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.993s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:57:35 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:57:36 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:57:39 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:57:39 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Starting heal instance info cache {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 05:57:39 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Rebuilding the list of instances to heal {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 05:57:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "refresh_cache-d10508dd-f3f7-4e96-b822-d331ded6809f" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:57:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquired lock "refresh_cache-d10508dd-f3f7-4e96-b822-d331ded6809f" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:57:39 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Forcefully refreshing network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 05:57:39 user nova-compute[73391]: DEBUG nova.objects.instance [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lazy-loading 'info_cache' on Instance uuid d10508dd-f3f7-4e96-b822-d331ded6809f {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:57:40 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Updating instance_info_cache with network_info: [{"id": "bad7b5c4-680d-4f22-9fc0-53e0ac551260", "address": "fa:16:3e:91:71:96", "network": {"id": "2a8063f6-42ce-41b8-86f6-72c17f4c2a7b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1765547969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd985a0cd6884c858487187ce252bba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad7b5c4-68", "ovs_interfaceid": "bad7b5c4-680d-4f22-9fc0-53e0ac551260", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:57:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Releasing lock "refresh_cache-d10508dd-f3f7-4e96-b822-d331ded6809f" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:57:40 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Updated the network info_cache for instance {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 05:57:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:57:41 user nova-compute[73391]: DEBUG nova.compute.manager [req-e56d02a6-4ff6-4439-9409-01a6c00550b2 req-ffa8146b-0d4a-4f3d-bed8-1721d649cc2b service nova] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Received event network-changed-bad7b5c4-680d-4f22-9fc0-53e0ac551260 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:57:41 user nova-compute[73391]: DEBUG nova.compute.manager [req-e56d02a6-4ff6-4439-9409-01a6c00550b2 req-ffa8146b-0d4a-4f3d-bed8-1721d649cc2b service nova] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Refreshing instance network info cache due to event network-changed-bad7b5c4-680d-4f22-9fc0-53e0ac551260. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:57:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e56d02a6-4ff6-4439-9409-01a6c00550b2 req-ffa8146b-0d4a-4f3d-bed8-1721d649cc2b service nova] Acquiring lock "refresh_cache-d10508dd-f3f7-4e96-b822-d331ded6809f" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:57:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e56d02a6-4ff6-4439-9409-01a6c00550b2 req-ffa8146b-0d4a-4f3d-bed8-1721d649cc2b service nova] Acquired lock "refresh_cache-d10508dd-f3f7-4e96-b822-d331ded6809f" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:57:41 user nova-compute[73391]: DEBUG nova.network.neutron [req-e56d02a6-4ff6-4439-9409-01a6c00550b2 req-ffa8146b-0d4a-4f3d-bed8-1721d649cc2b service nova] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Refreshing network info cache for port bad7b5c4-680d-4f22-9fc0-53e0ac551260 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:57:41 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:57:41 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:57:41 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 05:57:42 user nova-compute[73391]: DEBUG nova.network.neutron [req-e56d02a6-4ff6-4439-9409-01a6c00550b2 req-ffa8146b-0d4a-4f3d-bed8-1721d649cc2b service nova] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Updated VIF entry in instance network info cache for port bad7b5c4-680d-4f22-9fc0-53e0ac551260. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:57:42 user nova-compute[73391]: DEBUG nova.network.neutron [req-e56d02a6-4ff6-4439-9409-01a6c00550b2 req-ffa8146b-0d4a-4f3d-bed8-1721d649cc2b service nova] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Updating instance_info_cache with network_info: [{"id": "bad7b5c4-680d-4f22-9fc0-53e0ac551260", "address": "fa:16:3e:91:71:96", "network": {"id": "2a8063f6-42ce-41b8-86f6-72c17f4c2a7b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1765547969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd985a0cd6884c858487187ce252bba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad7b5c4-68", "ovs_interfaceid": "bad7b5c4-680d-4f22-9fc0-53e0ac551260", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:57:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-e56d02a6-4ff6-4439-9409-01a6c00550b2 req-ffa8146b-0d4a-4f3d-bed8-1721d649cc2b service nova] Releasing lock "refresh_cache-d10508dd-f3f7-4e96-b822-d331ded6809f" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:57:42 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:57:42 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:57:43 user nova-compute[73391]: DEBUG nova.compute.manager [req-5c36bf9b-0622-47fa-a8c4-323c18da15f2 req-0c12dbdb-1dc1-4a1e-bfc0-88a50d72421f service nova] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Received event network-changed-bad7b5c4-680d-4f22-9fc0-53e0ac551260 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:57:43 user nova-compute[73391]: DEBUG nova.compute.manager [req-5c36bf9b-0622-47fa-a8c4-323c18da15f2 req-0c12dbdb-1dc1-4a1e-bfc0-88a50d72421f service nova] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Refreshing instance network info cache due to event network-changed-bad7b5c4-680d-4f22-9fc0-53e0ac551260. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:57:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-5c36bf9b-0622-47fa-a8c4-323c18da15f2 req-0c12dbdb-1dc1-4a1e-bfc0-88a50d72421f service nova] Acquiring lock "refresh_cache-d10508dd-f3f7-4e96-b822-d331ded6809f" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:57:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-5c36bf9b-0622-47fa-a8c4-323c18da15f2 req-0c12dbdb-1dc1-4a1e-bfc0-88a50d72421f service nova] Acquired lock "refresh_cache-d10508dd-f3f7-4e96-b822-d331ded6809f" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:57:43 user nova-compute[73391]: DEBUG nova.network.neutron [req-5c36bf9b-0622-47fa-a8c4-323c18da15f2 req-0c12dbdb-1dc1-4a1e-bfc0-88a50d72421f service nova] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Refreshing network info cache for port bad7b5c4-680d-4f22-9fc0-53e0ac551260 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:57:43 user nova-compute[73391]: DEBUG nova.network.neutron [req-5c36bf9b-0622-47fa-a8c4-323c18da15f2 req-0c12dbdb-1dc1-4a1e-bfc0-88a50d72421f service nova] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Updated VIF entry in instance network info cache for port bad7b5c4-680d-4f22-9fc0-53e0ac551260. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:57:43 user nova-compute[73391]: DEBUG nova.network.neutron [req-5c36bf9b-0622-47fa-a8c4-323c18da15f2 req-0c12dbdb-1dc1-4a1e-bfc0-88a50d72421f service nova] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Updating instance_info_cache with network_info: [{"id": "bad7b5c4-680d-4f22-9fc0-53e0ac551260", "address": "fa:16:3e:91:71:96", "network": {"id": "2a8063f6-42ce-41b8-86f6-72c17f4c2a7b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1765547969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd985a0cd6884c858487187ce252bba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad7b5c4-68", "ovs_interfaceid": "bad7b5c4-680d-4f22-9fc0-53e0ac551260", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:57:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-5c36bf9b-0622-47fa-a8c4-323c18da15f2 req-0c12dbdb-1dc1-4a1e-bfc0-88a50d72421f service nova] Releasing lock "refresh_cache-d10508dd-f3f7-4e96-b822-d331ded6809f" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:57:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:57:46 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692079051.3447561, f730e539-5371-49d7-8487-d94f400fe0bc => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:57:46 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] VM Stopped (Lifecycle Event)
Aug 15 05:57:46 user nova-compute[73391]: DEBUG nova.compute.manager [None req-e62287cc-f83a-4ebe-a17d-1c3a8c1e4aae None None] [instance: f730e539-5371-49d7-8487-d94f400fe0bc] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:57:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:57:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Acquiring lock "d10508dd-f3f7-4e96-b822-d331ded6809f" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:57:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "d10508dd-f3f7-4e96-b822-d331ded6809f" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:57:49 user nova-compute[73391]: INFO nova.compute.manager [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Rebooting instance
Aug 15 05:57:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Acquiring lock "refresh_cache-d10508dd-f3f7-4e96-b822-d331ded6809f" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:57:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Acquired lock "refresh_cache-d10508dd-f3f7-4e96-b822-d331ded6809f" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:57:49 user nova-compute[73391]: DEBUG nova.network.neutron [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:57:49 user nova-compute[73391]: DEBUG nova.network.neutron [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Updating instance_info_cache with network_info: [{"id": "bad7b5c4-680d-4f22-9fc0-53e0ac551260", "address": "fa:16:3e:91:71:96", "network": {"id": "2a8063f6-42ce-41b8-86f6-72c17f4c2a7b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1765547969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd985a0cd6884c858487187ce252bba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad7b5c4-68", "ovs_interfaceid": "bad7b5c4-680d-4f22-9fc0-53e0ac551260", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:57:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Releasing lock "refresh_cache-d10508dd-f3f7-4e96-b822-d331ded6809f" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:57:49 user nova-compute[73391]: DEBUG nova.compute.manager [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:57:49 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:57:49 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:57:49 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG nova.compute.manager [req-1acc5f18-4a78-406e-94d7-15e0d0cd656f req-7dc484be-60a6-4d03-aabc-b994861a2d56 service nova] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Received event network-vif-unplugged-bad7b5c4-680d-4f22-9fc0-53e0ac551260 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-1acc5f18-4a78-406e-94d7-15e0d0cd656f req-7dc484be-60a6-4d03-aabc-b994861a2d56 service nova] Acquiring lock "d10508dd-f3f7-4e96-b822-d331ded6809f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-1acc5f18-4a78-406e-94d7-15e0d0cd656f req-7dc484be-60a6-4d03-aabc-b994861a2d56 service nova] Lock "d10508dd-f3f7-4e96-b822-d331ded6809f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-1acc5f18-4a78-406e-94d7-15e0d0cd656f req-7dc484be-60a6-4d03-aabc-b994861a2d56 service nova] Lock "d10508dd-f3f7-4e96-b822-d331ded6809f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG nova.compute.manager [req-1acc5f18-4a78-406e-94d7-15e0d0cd656f req-7dc484be-60a6-4d03-aabc-b994861a2d56 service nova] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] No waiting events found dispatching network-vif-unplugged-bad7b5c4-680d-4f22-9fc0-53e0ac551260 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:57:50 user nova-compute[73391]: WARNING nova.compute.manager [req-1acc5f18-4a78-406e-94d7-15e0d0cd656f req-7dc484be-60a6-4d03-aabc-b994861a2d56 service nova] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Received unexpected event network-vif-unplugged-bad7b5c4-680d-4f22-9fc0-53e0ac551260 for instance with vm_state active and task_state reboot_started_hard.
Aug 15 05:57:50 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Instance destroyed successfully.
Aug 15 05:57:50 user nova-compute[73391]: DEBUG nova.objects.instance [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lazy-loading 'resources' on Instance uuid d10508dd-f3f7-4e96-b822-d331ded6809f {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:55:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1638516350',display_name='tempest-TestMinimumBasicScenario-server-1638516350',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1638516350',id=46,image_ref='d9b08b04-9688-4e5e-90eb-5ae0465c6517',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyWsG9ehEQcqlBsyrmyWtybq7vloOElSYR0j7Ou42ASZEw1IFAr5wdOLp6A6sbdR8fm5tdu1cPwGw1di232sVJtsalZJWCrvAInL7ggWTRRw/y74jndzteUjAIxDm/s8Q==',key_name='tempest-TestMinimumBasicScenario-1867600907',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:55:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cd985a0cd6884c858487187ce252bba5',ramdisk_id='',reservation_id='r-agv6ww0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d9b08b04-9688-4e5e-90eb-5ae0465c6517',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1535355155',owner_user_name='tempest-TestMinimumBasicScenario-1535355155-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:57:50Z,user_data=None,user_id='db323067fefa4b1f8aa28f10a997b9d4',uuid=d10508dd-f3f7-4e96-b822-d331ded6809f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bad7b5c4-680d-4f22-9fc0-53e0ac551260", "address": "fa:16:3e:91:71:96", "network": {"id": "2a8063f6-42ce-41b8-86f6-72c17f4c2a7b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1765547969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd985a0cd6884c858487187ce252bba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad7b5c4-68", "ovs_interfaceid": "bad7b5c4-680d-4f22-9fc0-53e0ac551260", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Converting VIF {"id": "bad7b5c4-680d-4f22-9fc0-53e0ac551260", "address": "fa:16:3e:91:71:96", "network": {"id": "2a8063f6-42ce-41b8-86f6-72c17f4c2a7b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1765547969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd985a0cd6884c858487187ce252bba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad7b5c4-68", "ovs_interfaceid": "bad7b5c4-680d-4f22-9fc0-53e0ac551260", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:71:96,bridge_name='br-int',has_traffic_filtering=True,id=bad7b5c4-680d-4f22-9fc0-53e0ac551260,network=Network(2a8063f6-42ce-41b8-86f6-72c17f4c2a7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbad7b5c4-68') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG os_vif [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:71:96,bridge_name='br-int',has_traffic_filtering=True,id=bad7b5c4-680d-4f22-9fc0-53e0ac551260,network=Network(2a8063f6-42ce-41b8-86f6-72c17f4c2a7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbad7b5c4-68') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbad7b5c4-68, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:57:50 user nova-compute[73391]: INFO os_vif [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:71:96,bridge_name='br-int',has_traffic_filtering=True,id=bad7b5c4-680d-4f22-9fc0-53e0ac551260,network=Network(2a8063f6-42ce-41b8-86f6-72c17f4c2a7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbad7b5c4-68')
Aug 15 05:57:50 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aEUMKbYF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:57:50 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:57:50 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[398dc8a7-78c6-41ba-979e-b7f2a52c322b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f3c699-01f8-4562-a411-882a8d301aa5]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 (non-flash)
Aug 15 05:57:50 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 (non-flash)
Aug 15 05:57:50 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f772848de10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75'): ({'sdc'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Removing single pathed devices sdc {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22bbf7f-c36a-4352-8c78-a9c036953959]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd1a195-5434-4d5e-b023-d39bd504b20a]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Flushing IO for device /dev/sdc {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b37bfb-3575-4024-a9e2-b1b63646b369]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c92f141-b0ef-4728-b3a9-f0e59a4bc4e1]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] SCSI volumes sdc have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f83ddfd2-3b92-46d2-bd18-d9f4e3365605]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a423ea-4acb-41b5-bafa-7a97cf2a80fb]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75, portal: 172.16.0.220,3260]
Aug 15 05:57:50 user nova-compute[73391]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75, portal: 172.16.0.220,3260] successful.
Aug 15 05:57:50 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[57083e9e-b3bb-459f-9fd0-509616c2a839]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.247s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] <== disconnect_volume: return (249ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Start _get_guest_xml network_info=[{"id": "bad7b5c4-680d-4f22-9fc0-53e0ac551260", "address": "fa:16:3e:91:71:96", "network": {"id": "2a8063f6-42ce-41b8-86f6-72c17f4c2a7b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1765547969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd985a0cd6884c858487187ce252bba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad7b5c4-68", "ovs_interfaceid": "bad7b5c4-680d-4f22-9fc0-53e0ac551260", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=d9b08b04-9688-4e5e-90eb-5ae0465c6517,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': 'd9b08b04-9688-4e5e-90eb-5ae0465c6517'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aEUMKbYF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'd10508dd-f3f7-4e96-b822-d331ded6809f', 'attached_at': '', 'detached_at': '', 'volume_id': 'e5482919-10aa-44c4-8f50-ee8a3fb6ce75', 'serial': 'e5482919-10aa-44c4-8f50-ee8a3fb6ce75'}, 'attachment_id': '68e53123-9696-4e42-a3cc-b6e5d9a1780c', 'device_type': 'disk', 'disk_bus': 'virtio', 'boot_index': None, 'guest_format': None, 'delete_on_termination': False, 'volume_type': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:57:50 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:57:50 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:57:50 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=d9b08b04-9688-4e5e-90eb-5ae0465c6517,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG nova.objects.instance [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lazy-loading 'vcpu_model' on Instance uuid d10508dd-f3f7-4e96-b822-d331ded6809f {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aEUMKbYF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:57:50 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:57:50 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:57:50 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:57:50 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:57:50 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:57:50 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 05:57:50 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:57:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:57:51 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e244915a-5f2c-40fb-b692-5c22adaa1527]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:57:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 05:57:51 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:57:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:57:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:57:51 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3f0259-0a11-4276-8f3e-9a4d2bc59cf1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:57:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75] added
Aug 15 05:57:51 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:57:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:57:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:57:51 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c02c416-6d87-4b08-b8fa-629e606fe440]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:57:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:57:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:57:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.122s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:57:51 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d83fc61-b784-4f0e-8b8f-99a486cf6ae7]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:57:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:57:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aEUMKbYF {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:57:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aEUMKbYF" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:57:51 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9385f91-1fc8-4728-bdbb-eb858c6359c5]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:57:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aEUMKbYF'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:57:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:57:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:57:51 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef49d579-1b2e-4cde-95ae-30ee16398799]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:57:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:57:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:57:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:57:51 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[74db9cbe-1310-42fc-a873-d9da6eb9e835]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:57:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 05:57:51 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:57:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 05:57:51 user nova-compute[73391]:  {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:57:51 user nova-compute[73391]: WARNING os_brick.initiator.connectors.iscsi [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 05:57:51 user nova-compute[73391]: 
Aug 15 05:57:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:57:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:57:51 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa84ec6-e905-43ac-a2de-58eaf5ad7825]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:57:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75, portal: 172.16.0.220,3260]
Aug 15 05:57:51 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75, portal: 172.16.0.220,3260] successful.
Aug 15 05:57:51 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:57:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:57:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:57:51 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4049611f-1225-48fe-bd24-38fde94fb5bf]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:57:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:57:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:57:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:57:51 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2acb86bc-843d-4ca1-8e1e-eeeb3283ca86]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:57:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 (non-flash)
Aug 15 05:57:51 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:57:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 (non-flash)
Aug 15 05:57:51 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:57:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:57:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 05:57:51 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 05:57:51 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 05:57:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:57:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:57:51 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2220479-e5c1-46f0-9f19-6f942596700c]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:57:51 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: None {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:57:52 user nova-compute[73391]: DEBUG nova.compute.manager [req-2f86aafd-d624-4202-a0d8-3003c75152d2 req-8097af8b-6166-47e2-b371-52648634c9a3 service nova] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Received event network-vif-plugged-bad7b5c4-680d-4f22-9fc0-53e0ac551260 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:57:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2f86aafd-d624-4202-a0d8-3003c75152d2 req-8097af8b-6166-47e2-b371-52648634c9a3 service nova] Acquiring lock "d10508dd-f3f7-4e96-b822-d331ded6809f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:57:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2f86aafd-d624-4202-a0d8-3003c75152d2 req-8097af8b-6166-47e2-b371-52648634c9a3 service nova] Lock "d10508dd-f3f7-4e96-b822-d331ded6809f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:57:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2f86aafd-d624-4202-a0d8-3003c75152d2 req-8097af8b-6166-47e2-b371-52648634c9a3 service nova] Lock "d10508dd-f3f7-4e96-b822-d331ded6809f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:57:52 user nova-compute[73391]: DEBUG nova.compute.manager [req-2f86aafd-d624-4202-a0d8-3003c75152d2 req-8097af8b-6166-47e2-b371-52648634c9a3 service nova] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] No waiting events found dispatching network-vif-plugged-bad7b5c4-680d-4f22-9fc0-53e0ac551260 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:57:52 user nova-compute[73391]: WARNING nova.compute.manager [req-2f86aafd-d624-4202-a0d8-3003c75152d2 req-8097af8b-6166-47e2-b371-52648634c9a3 service nova] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Received unexpected event network-vif-plugged-bad7b5c4-680d-4f22-9fc0-53e0ac551260 for instance with vm_state active and task_state reboot_started_hard.
Aug 15 05:57:52 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:57:52 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aEUMKbYF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 05:57:52 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:57:52 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '26466626366633765', 'path': '/dev/sdb'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:57:52 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26466626366633765', 'path': '/dev/sdb'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 05:57:52 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:55:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1638516350',display_name='tempest-TestMinimumBasicScenario-server-1638516350',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1638516350',id=46,image_ref='d9b08b04-9688-4e5e-90eb-5ae0465c6517',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyWsG9ehEQcqlBsyrmyWtybq7vloOElSYR0j7Ou42ASZEw1IFAr5wdOLp6A6sbdR8fm5tdu1cPwGw1di232sVJtsalZJWCrvAInL7ggWTRRw/y74jndzteUjAIxDm/s8Q==',key_name='tempest-TestMinimumBasicScenario-1867600907',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:55:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cd985a0cd6884c858487187ce252bba5',ramdisk_id='',reservation_id='r-agv6ww0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d9b08b04-9688-4e5e-90eb-5ae0465c6517',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1535355155',owner_user_name='tempest-TestMinimumBasicScenario-1535355155-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:57:50Z,user_data=None,user_id='db323067fefa4b1f8aa28f10a997b9d4',uuid=d10508dd-f3f7-4e96-b822-d331ded6809f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bad7b5c4-680d-4f22-9fc0-53e0ac551260", "address": "fa:16:3e:91:71:96", "network": {"id": "2a8063f6-42ce-41b8-86f6-72c17f4c2a7b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1765547969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd985a0cd6884c858487187ce252bba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad7b5c4-68", "ovs_interfaceid": "bad7b5c4-680d-4f22-9fc0-53e0ac551260", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:57:52 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Converting VIF {"id": "bad7b5c4-680d-4f22-9fc0-53e0ac551260", "address": "fa:16:3e:91:71:96", "network": {"id": "2a8063f6-42ce-41b8-86f6-72c17f4c2a7b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1765547969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd985a0cd6884c858487187ce252bba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad7b5c4-68", "ovs_interfaceid": "bad7b5c4-680d-4f22-9fc0-53e0ac551260", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:57:52 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:71:96,bridge_name='br-int',has_traffic_filtering=True,id=bad7b5c4-680d-4f22-9fc0-53e0ac551260,network=Network(2a8063f6-42ce-41b8-86f6-72c17f4c2a7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbad7b5c4-68') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:57:52 user nova-compute[73391]: DEBUG nova.objects.instance [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lazy-loading 'pci_devices' on Instance uuid d10508dd-f3f7-4e96-b822-d331ded6809f {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:57:52 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:57:52 user nova-compute[73391]:   <uuid>d10508dd-f3f7-4e96-b822-d331ded6809f</uuid>
Aug 15 05:57:52 user nova-compute[73391]:   <name>instance-0000002e</name>
Aug 15 05:57:52 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:57:52 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:57:52 user nova-compute[73391]:   <metadata>
Aug 15 05:57:52 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:57:52 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:57:52 user nova-compute[73391]:       <nova:name>tempest-TestMinimumBasicScenario-server-1638516350</nova:name>
Aug 15 05:57:52 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:57:50</nova:creationTime>
Aug 15 05:57:52 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:57:52 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:57:52 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:57:52 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:57:52 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:57:52 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:57:52 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:57:52 user nova-compute[73391]:       <nova:owner>
Aug 15 05:57:52 user nova-compute[73391]:         <nova:user uuid="db323067fefa4b1f8aa28f10a997b9d4">tempest-TestMinimumBasicScenario-1535355155-project-member</nova:user>
Aug 15 05:57:52 user nova-compute[73391]:         <nova:project uuid="cd985a0cd6884c858487187ce252bba5">tempest-TestMinimumBasicScenario-1535355155</nova:project>
Aug 15 05:57:52 user nova-compute[73391]:       </nova:owner>
Aug 15 05:57:52 user nova-compute[73391]:       <nova:root type="image" uuid="d9b08b04-9688-4e5e-90eb-5ae0465c6517"/>
Aug 15 05:57:52 user nova-compute[73391]:       <nova:ports>
Aug 15 05:57:52 user nova-compute[73391]:         <nova:port uuid="bad7b5c4-680d-4f22-9fc0-53e0ac551260">
Aug 15 05:57:52 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Aug 15 05:57:52 user nova-compute[73391]:         </nova:port>
Aug 15 05:57:52 user nova-compute[73391]:       </nova:ports>
Aug 15 05:57:52 user nova-compute[73391]:     </nova:instance>
Aug 15 05:57:52 user nova-compute[73391]:   </metadata>
Aug 15 05:57:52 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:57:52 user nova-compute[73391]:     <system>
Aug 15 05:57:52 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:57:52 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:57:52 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:57:52 user nova-compute[73391]:       <entry name="serial">d10508dd-f3f7-4e96-b822-d331ded6809f</entry>
Aug 15 05:57:52 user nova-compute[73391]:       <entry name="uuid">d10508dd-f3f7-4e96-b822-d331ded6809f</entry>
Aug 15 05:57:52 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:57:52 user nova-compute[73391]:     </system>
Aug 15 05:57:52 user nova-compute[73391]:   </sysinfo>
Aug 15 05:57:52 user nova-compute[73391]:   <os>
Aug 15 05:57:52 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:57:52 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:57:52 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:57:52 user nova-compute[73391]:   </os>
Aug 15 05:57:52 user nova-compute[73391]:   <features>
Aug 15 05:57:52 user nova-compute[73391]:     <acpi/>
Aug 15 05:57:52 user nova-compute[73391]:     <apic/>
Aug 15 05:57:52 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:57:52 user nova-compute[73391]:   </features>
Aug 15 05:57:52 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:57:52 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:57:52 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:57:52 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:57:52 user nova-compute[73391]:   </clock>
Aug 15 05:57:52 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:57:52 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:57:52 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:57:52 user nova-compute[73391]:   </cpu>
Aug 15 05:57:52 user nova-compute[73391]:   <devices>
Aug 15 05:57:52 user nova-compute[73391]:     <disk type="file" device="disk">
Aug 15 05:57:52 user nova-compute[73391]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 05:57:52 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/d10508dd-f3f7-4e96-b822-d331ded6809f/disk"/>
Aug 15 05:57:52 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:57:52 user nova-compute[73391]:     </disk>
Aug 15 05:57:52 user nova-compute[73391]:     <disk type="block" device="disk">
Aug 15 05:57:52 user nova-compute[73391]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:57:52 user nova-compute[73391]:       <source dev="/dev/sdb"/>
Aug 15 05:57:52 user nova-compute[73391]:       <target dev="vdb" bus="virtio"/>
Aug 15 05:57:52 user nova-compute[73391]:       <serial>e5482919-10aa-44c4-8f50-ee8a3fb6ce75</serial>
Aug 15 05:57:52 user nova-compute[73391]:     </disk>
Aug 15 05:57:52 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:57:52 user nova-compute[73391]:       <mac address="fa:16:3e:91:71:96"/>
Aug 15 05:57:52 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:57:52 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:57:52 user nova-compute[73391]:       <target dev="tapbad7b5c4-68"/>
Aug 15 05:57:52 user nova-compute[73391]:     </interface>
Aug 15 05:57:52 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:57:52 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/d10508dd-f3f7-4e96-b822-d331ded6809f/console.log" append="off"/>
Aug 15 05:57:52 user nova-compute[73391]:     </serial>
Aug 15 05:57:52 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:57:52 user nova-compute[73391]:     <video>
Aug 15 05:57:52 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:57:52 user nova-compute[73391]:     </video>
Aug 15 05:57:52 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:57:52 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:57:52 user nova-compute[73391]:     </rng>
Aug 15 05:57:52 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:57:52 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:57:52 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:57:52 user nova-compute[73391]:     </memballoon>
Aug 15 05:57:52 user nova-compute[73391]:   </devices>
Aug 15 05:57:52 user nova-compute[73391]: </domain>
Aug 15 05:57:52 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:57:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d10508dd-f3f7-4e96-b822-d331ded6809f/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:57:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d10508dd-f3f7-4e96-b822-d331ded6809f/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:57:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d10508dd-f3f7-4e96-b822-d331ded6809f/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:57:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d10508dd-f3f7-4e96-b822-d331ded6809f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:57:52 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:57:52 user nova-compute[73391]: DEBUG nova.objects.instance [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lazy-loading 'trusted_certs' on Instance uuid d10508dd-f3f7-4e96-b822-d331ded6809f {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:57:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8fd6a6206a4889a3b85acfa5649b743194df0178 --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:57:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8fd6a6206a4889a3b85acfa5649b743194df0178 --force-share --output=json" returned: 0 in 0.173s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:57:52 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d10508dd-f3f7-4e96-b822-d331ded6809f/disk. size=1073741824 {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 05:57:52 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d10508dd-f3f7-4e96-b822-d331ded6809f/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:57:53 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d10508dd-f3f7-4e96-b822-d331ded6809f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:57:53 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Cannot resize image /opt/stack/data/nova/instances/d10508dd-f3f7-4e96-b822-d331ded6809f/disk to a smaller size. {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 05:57:53 user nova-compute[73391]: DEBUG nova.objects.instance [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lazy-loading 'migration_context' on Instance uuid d10508dd-f3f7-4e96-b822-d331ded6809f {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:57:53 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:55:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1638516350',display_name='tempest-TestMinimumBasicScenario-server-1638516350',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1638516350',id=46,image_ref='d9b08b04-9688-4e5e-90eb-5ae0465c6517',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyWsG9ehEQcqlBsyrmyWtybq7vloOElSYR0j7Ou42ASZEw1IFAr5wdOLp6A6sbdR8fm5tdu1cPwGw1di232sVJtsalZJWCrvAInL7ggWTRRw/y74jndzteUjAIxDm/s8Q==',key_name='tempest-TestMinimumBasicScenario-1867600907',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:55:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='cd985a0cd6884c858487187ce252bba5',ramdisk_id='',reservation_id='r-agv6ww0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d9b08b04-9688-4e5e-90eb-5ae0465c6517',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1535355155',owner_user_name='tempest-TestMinimumBasicScenario-1535355155-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:57:50Z,user_data=None,user_id='db323067fefa4b1f8aa28f10a997b9d4',uuid=d10508dd-f3f7-4e96-b822-d331ded6809f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bad7b5c4-680d-4f22-9fc0-53e0ac551260", "address": "fa:16:3e:91:71:96", "network": {"id": "2a8063f6-42ce-41b8-86f6-72c17f4c2a7b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1765547969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd985a0cd6884c858487187ce252bba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad7b5c4-68", "ovs_interfaceid": "bad7b5c4-680d-4f22-9fc0-53e0ac551260", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:57:53 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Converting VIF {"id": "bad7b5c4-680d-4f22-9fc0-53e0ac551260", "address": "fa:16:3e:91:71:96", "network": {"id": "2a8063f6-42ce-41b8-86f6-72c17f4c2a7b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1765547969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd985a0cd6884c858487187ce252bba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad7b5c4-68", "ovs_interfaceid": "bad7b5c4-680d-4f22-9fc0-53e0ac551260", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:57:53 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:71:96,bridge_name='br-int',has_traffic_filtering=True,id=bad7b5c4-680d-4f22-9fc0-53e0ac551260,network=Network(2a8063f6-42ce-41b8-86f6-72c17f4c2a7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbad7b5c4-68') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:57:53 user nova-compute[73391]: DEBUG os_vif [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:71:96,bridge_name='br-int',has_traffic_filtering=True,id=bad7b5c4-680d-4f22-9fc0-53e0ac551260,network=Network(2a8063f6-42ce-41b8-86f6-72c17f4c2a7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbad7b5c4-68') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:57:53 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:57:53 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:57:53 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:57:53 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:57:53 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbad7b5c4-68, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:57:53 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapbad7b5c4-68, col_values=(('external_ids', {'iface-id': 'bad7b5c4-680d-4f22-9fc0-53e0ac551260', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:91:71:96', 'vm-uuid': 'd10508dd-f3f7-4e96-b822-d331ded6809f'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:57:53 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:57:53 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:57:53 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:57:53 user nova-compute[73391]: INFO os_vif [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:71:96,bridge_name='br-int',has_traffic_filtering=True,id=bad7b5c4-680d-4f22-9fc0-53e0ac551260,network=Network(2a8063f6-42ce-41b8-86f6-72c17f4c2a7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbad7b5c4-68')
Aug 15 05:57:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:57:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:57:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:57:54 user nova-compute[73391]: DEBUG nova.compute.manager [req-30a79c50-f707-4fce-927f-f734935d4df5 req-b82025c2-1774-4ab8-a1f0-b0e60dfab22f service nova] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Received event network-vif-plugged-bad7b5c4-680d-4f22-9fc0-53e0ac551260 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:57:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-30a79c50-f707-4fce-927f-f734935d4df5 req-b82025c2-1774-4ab8-a1f0-b0e60dfab22f service nova] Acquiring lock "d10508dd-f3f7-4e96-b822-d331ded6809f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:57:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-30a79c50-f707-4fce-927f-f734935d4df5 req-b82025c2-1774-4ab8-a1f0-b0e60dfab22f service nova] Lock "d10508dd-f3f7-4e96-b822-d331ded6809f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:57:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-30a79c50-f707-4fce-927f-f734935d4df5 req-b82025c2-1774-4ab8-a1f0-b0e60dfab22f service nova] Lock "d10508dd-f3f7-4e96-b822-d331ded6809f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:57:54 user nova-compute[73391]: DEBUG nova.compute.manager [req-30a79c50-f707-4fce-927f-f734935d4df5 req-b82025c2-1774-4ab8-a1f0-b0e60dfab22f service nova] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] No waiting events found dispatching network-vif-plugged-bad7b5c4-680d-4f22-9fc0-53e0ac551260 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:57:54 user nova-compute[73391]: WARNING nova.compute.manager [req-30a79c50-f707-4fce-927f-f734935d4df5 req-b82025c2-1774-4ab8-a1f0-b0e60dfab22f service nova] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Received unexpected event network-vif-plugged-bad7b5c4-680d-4f22-9fc0-53e0ac551260 for instance with vm_state active and task_state reboot_started_hard.
Aug 15 05:57:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:57:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:57:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:57:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:57:56 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Removed pending event for d10508dd-f3f7-4e96-b822-d331ded6809f due to event {{(pid=73391) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 05:57:56 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692079076.6129334, d10508dd-f3f7-4e96-b822-d331ded6809f => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:57:56 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] VM Resumed (Lifecycle Event)
Aug 15 05:57:56 user nova-compute[73391]: DEBUG nova.compute.manager [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:57:56 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Instance rebooted successfully.
Aug 15 05:57:56 user nova-compute[73391]: DEBUG nova.compute.manager [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:57:56 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:57:56 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:57:56 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Aug 15 05:57:56 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692079076.6142702, d10508dd-f3f7-4e96-b822-d331ded6809f => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:57:56 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] VM Started (Lifecycle Event)
Aug 15 05:57:56 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:57:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-debc8900-7334-4ce2-ab9e-e2022cc77689 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "d10508dd-f3f7-4e96-b822-d331ded6809f" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.411s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:57:56 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:57:56 user nova-compute[73391]: DEBUG nova.compute.manager [req-f67e2ab4-8333-4a5b-b9a1-8f0b014854e3 req-48006ddc-f7e0-467d-ad75-7f2e166d0e91 service nova] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Received event network-vif-plugged-bad7b5c4-680d-4f22-9fc0-53e0ac551260 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:57:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f67e2ab4-8333-4a5b-b9a1-8f0b014854e3 req-48006ddc-f7e0-467d-ad75-7f2e166d0e91 service nova] Acquiring lock "d10508dd-f3f7-4e96-b822-d331ded6809f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:57:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f67e2ab4-8333-4a5b-b9a1-8f0b014854e3 req-48006ddc-f7e0-467d-ad75-7f2e166d0e91 service nova] Lock "d10508dd-f3f7-4e96-b822-d331ded6809f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:57:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f67e2ab4-8333-4a5b-b9a1-8f0b014854e3 req-48006ddc-f7e0-467d-ad75-7f2e166d0e91 service nova] Lock "d10508dd-f3f7-4e96-b822-d331ded6809f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:57:56 user nova-compute[73391]: DEBUG nova.compute.manager [req-f67e2ab4-8333-4a5b-b9a1-8f0b014854e3 req-48006ddc-f7e0-467d-ad75-7f2e166d0e91 service nova] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] No waiting events found dispatching network-vif-plugged-bad7b5c4-680d-4f22-9fc0-53e0ac551260 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:57:56 user nova-compute[73391]: WARNING nova.compute.manager [req-f67e2ab4-8333-4a5b-b9a1-8f0b014854e3 req-48006ddc-f7e0-467d-ad75-7f2e166d0e91 service nova] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Received unexpected event network-vif-plugged-bad7b5c4-680d-4f22-9fc0-53e0ac551260 for instance with vm_state active and task_state None.
Aug 15 05:57:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:58:00 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:58:03 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:58:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:58:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:58:11 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:58:12 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:58:13 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:58:13 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:58:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Acquiring lock "595be11c-24db-43eb-9d5b-56cbeefd6149" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:58:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Lock "595be11c-24db-43eb-9d5b-56cbeefd6149" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:58:14 user nova-compute[73391]: DEBUG nova.compute.manager [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Starting instance... {{(pid=73391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 05:58:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:58:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:58:14 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 05:58:14 user nova-compute[73391]: INFO nova.compute.claims [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Claim successful on node user
Aug 15 05:58:15 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:58:15 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:58:15 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:58:15 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.301s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:58:15 user nova-compute[73391]: DEBUG nova.compute.manager [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Start building networks asynchronously for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 05:58:15 user nova-compute[73391]: DEBUG nova.compute.manager [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Allocating IP information in the background. {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 05:58:15 user nova-compute[73391]: DEBUG nova.network.neutron [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] allocate_for_instance() {{(pid=73391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 05:58:15 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 05:58:15 user nova-compute[73391]: DEBUG nova.compute.manager [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Start building block device mappings for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 05:58:15 user nova-compute[73391]: DEBUG nova.policy [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a8a6d1c3cc9d46c98e43e9c8c9caabb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94181609a284eb29f8db71cf34c086b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73391) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 05:58:15 user nova-compute[73391]: DEBUG nova.compute.manager [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Start spawning the instance on the hypervisor. {{(pid=73391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 05:58:15 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Creating instance directory {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 05:58:15 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Creating image(s)
Aug 15 05:58:15 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Acquiring lock "/opt/stack/data/nova/instances/595be11c-24db-43eb-9d5b-56cbeefd6149/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:58:15 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Lock "/opt/stack/data/nova/instances/595be11c-24db-43eb-9d5b-56cbeefd6149/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:58:15 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Lock "/opt/stack/data/nova/instances/595be11c-24db-43eb-9d5b-56cbeefd6149/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:58:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:58:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.176s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:58:15 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Acquiring lock "999b315ba87151d8252d543312ae7790e7e1583b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:58:15 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:58:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:58:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.176s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:58:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/595be11c-24db-43eb-9d5b-56cbeefd6149/disk 1073741824 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:58:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/595be11c-24db-43eb-9d5b-56cbeefd6149/disk 1073741824" returned: 0 in 0.049s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:58:15 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:58:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:58:15 user nova-compute[73391]: DEBUG nova.network.neutron [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Successfully created port: 3418de64-8dbd-4951-aca0-0dc87257dbcb {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 05:58:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.225s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:58:16 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Checking if we can resize image /opt/stack/data/nova/instances/595be11c-24db-43eb-9d5b-56cbeefd6149/disk. size=1073741824 {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 05:58:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595be11c-24db-43eb-9d5b-56cbeefd6149/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:58:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595be11c-24db-43eb-9d5b-56cbeefd6149/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:58:16 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Cannot resize image /opt/stack/data/nova/instances/595be11c-24db-43eb-9d5b-56cbeefd6149/disk to a smaller size. {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 05:58:16 user nova-compute[73391]: DEBUG nova.objects.instance [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Lazy-loading 'migration_context' on Instance uuid 595be11c-24db-43eb-9d5b-56cbeefd6149 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:58:16 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Created local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 05:58:16 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Ensure instance console log exists: /opt/stack/data/nova/instances/595be11c-24db-43eb-9d5b-56cbeefd6149/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 05:58:16 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:58:16 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:58:16 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:58:16 user nova-compute[73391]: DEBUG nova.network.neutron [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Successfully updated port: 3418de64-8dbd-4951-aca0-0dc87257dbcb {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 05:58:16 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Acquiring lock "refresh_cache-595be11c-24db-43eb-9d5b-56cbeefd6149" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:58:16 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Acquired lock "refresh_cache-595be11c-24db-43eb-9d5b-56cbeefd6149" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:58:16 user nova-compute[73391]: DEBUG nova.network.neutron [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 05:58:16 user nova-compute[73391]: DEBUG nova.compute.manager [req-ecca4339-8669-40fd-800d-24a52aeef928 req-7a0c2a6e-8a9e-4128-9432-8f8c2905b746 service nova] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Received event network-changed-3418de64-8dbd-4951-aca0-0dc87257dbcb {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:58:16 user nova-compute[73391]: DEBUG nova.compute.manager [req-ecca4339-8669-40fd-800d-24a52aeef928 req-7a0c2a6e-8a9e-4128-9432-8f8c2905b746 service nova] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Refreshing instance network info cache due to event network-changed-3418de64-8dbd-4951-aca0-0dc87257dbcb. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:58:16 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ecca4339-8669-40fd-800d-24a52aeef928 req-7a0c2a6e-8a9e-4128-9432-8f8c2905b746 service nova] Acquiring lock "refresh_cache-595be11c-24db-43eb-9d5b-56cbeefd6149" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:58:16 user nova-compute[73391]: DEBUG nova.network.neutron [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 05:58:17 user nova-compute[73391]: DEBUG nova.network.neutron [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Updating instance_info_cache with network_info: [{"id": "3418de64-8dbd-4951-aca0-0dc87257dbcb", "address": "fa:16:3e:05:b7:5b", "network": {"id": "8e7b9da2-83d1-47d1-a352-a9684e3a2cdf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1697315681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a94181609a284eb29f8db71cf34c086b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3418de64-8d", "ovs_interfaceid": "3418de64-8dbd-4951-aca0-0dc87257dbcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:58:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Releasing lock "refresh_cache-595be11c-24db-43eb-9d5b-56cbeefd6149" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:58:17 user nova-compute[73391]: DEBUG nova.compute.manager [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Instance network_info: |[{"id": "3418de64-8dbd-4951-aca0-0dc87257dbcb", "address": "fa:16:3e:05:b7:5b", "network": {"id": "8e7b9da2-83d1-47d1-a352-a9684e3a2cdf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1697315681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a94181609a284eb29f8db71cf34c086b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3418de64-8d", "ovs_interfaceid": "3418de64-8dbd-4951-aca0-0dc87257dbcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 05:58:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ecca4339-8669-40fd-800d-24a52aeef928 req-7a0c2a6e-8a9e-4128-9432-8f8c2905b746 service nova] Acquired lock "refresh_cache-595be11c-24db-43eb-9d5b-56cbeefd6149" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:58:17 user nova-compute[73391]: DEBUG nova.network.neutron [req-ecca4339-8669-40fd-800d-24a52aeef928 req-7a0c2a6e-8a9e-4128-9432-8f8c2905b746 service nova] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Refreshing network info cache for port 3418de64-8dbd-4951-aca0-0dc87257dbcb {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:58:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Start _get_guest_xml network_info=[{"id": "3418de64-8dbd-4951-aca0-0dc87257dbcb", "address": "fa:16:3e:05:b7:5b", "network": {"id": "8e7b9da2-83d1-47d1-a352-a9684e3a2cdf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1697315681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a94181609a284eb29f8db71cf34c086b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3418de64-8d", "ovs_interfaceid": "3418de64-8dbd-4951-aca0-0dc87257dbcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '191b1dad-305e-4d1c-9b15-515ec59a3278'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 05:58:17 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:58:17 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:58:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 05:58:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 05:58:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 05:58:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 05:58:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 05:58:17 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 05:58:17 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 05:58:17 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 05:58:17 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 05:58:17 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 05:58:17 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 05:58:17 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 05:58:17 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 05:58:17 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 05:58:17 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 05:58:17 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 05:58:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:58:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-968761111',display_name='tempest-ServersNegativeTestJSON-server-968761111',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-968761111',id=48,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a94181609a284eb29f8db71cf34c086b',ramdisk_id='',reservation_id='r-jxk348w3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1203747242',owner_user_name='tempest-ServersNegativeTestJSON-1203747242-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:58:15Z,user_data=None,user_id='a8a6d1c3cc9d46c98e43e9c8c9caabb5',uuid=595be11c-24db-43eb-9d5b-56cbeefd6149,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3418de64-8dbd-4951-aca0-0dc87257dbcb", "address": "fa:16:3e:05:b7:5b", "network": {"id": "8e7b9da2-83d1-47d1-a352-a9684e3a2cdf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1697315681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a94181609a284eb29f8db71cf34c086b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3418de64-8d", "ovs_interfaceid": "3418de64-8dbd-4951-aca0-0dc87257dbcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 05:58:17 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Converting VIF {"id": "3418de64-8dbd-4951-aca0-0dc87257dbcb", "address": "fa:16:3e:05:b7:5b", "network": {"id": "8e7b9da2-83d1-47d1-a352-a9684e3a2cdf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1697315681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a94181609a284eb29f8db71cf34c086b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3418de64-8d", "ovs_interfaceid": "3418de64-8dbd-4951-aca0-0dc87257dbcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:58:17 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:b7:5b,bridge_name='br-int',has_traffic_filtering=True,id=3418de64-8dbd-4951-aca0-0dc87257dbcb,network=Network(8e7b9da2-83d1-47d1-a352-a9684e3a2cdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3418de64-8d') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:58:17 user nova-compute[73391]: DEBUG nova.objects.instance [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Lazy-loading 'pci_devices' on Instance uuid 595be11c-24db-43eb-9d5b-56cbeefd6149 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:58:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] End _get_guest_xml xml=<domain type="kvm">
Aug 15 05:58:17 user nova-compute[73391]:   <uuid>595be11c-24db-43eb-9d5b-56cbeefd6149</uuid>
Aug 15 05:58:17 user nova-compute[73391]:   <name>instance-00000030</name>
Aug 15 05:58:17 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 05:58:17 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 05:58:17 user nova-compute[73391]:   <metadata>
Aug 15 05:58:17 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 05:58:17 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 05:58:17 user nova-compute[73391]:       <nova:name>tempest-ServersNegativeTestJSON-server-968761111</nova:name>
Aug 15 05:58:17 user nova-compute[73391]:       <nova:creationTime>2023-08-15 05:58:17</nova:creationTime>
Aug 15 05:58:17 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 05:58:17 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 05:58:17 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 05:58:17 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 05:58:17 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 05:58:17 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 05:58:17 user nova-compute[73391]:       </nova:flavor>
Aug 15 05:58:17 user nova-compute[73391]:       <nova:owner>
Aug 15 05:58:17 user nova-compute[73391]:         <nova:user uuid="a8a6d1c3cc9d46c98e43e9c8c9caabb5">tempest-ServersNegativeTestJSON-1203747242-project-member</nova:user>
Aug 15 05:58:17 user nova-compute[73391]:         <nova:project uuid="a94181609a284eb29f8db71cf34c086b">tempest-ServersNegativeTestJSON-1203747242</nova:project>
Aug 15 05:58:17 user nova-compute[73391]:       </nova:owner>
Aug 15 05:58:17 user nova-compute[73391]:       <nova:root type="image" uuid="191b1dad-305e-4d1c-9b15-515ec59a3278"/>
Aug 15 05:58:17 user nova-compute[73391]:       <nova:ports>
Aug 15 05:58:17 user nova-compute[73391]:         <nova:port uuid="3418de64-8dbd-4951-aca0-0dc87257dbcb">
Aug 15 05:58:17 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Aug 15 05:58:17 user nova-compute[73391]:         </nova:port>
Aug 15 05:58:17 user nova-compute[73391]:       </nova:ports>
Aug 15 05:58:17 user nova-compute[73391]:     </nova:instance>
Aug 15 05:58:17 user nova-compute[73391]:   </metadata>
Aug 15 05:58:17 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 05:58:17 user nova-compute[73391]:     <system>
Aug 15 05:58:17 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 05:58:17 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 05:58:17 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 05:58:17 user nova-compute[73391]:       <entry name="serial">595be11c-24db-43eb-9d5b-56cbeefd6149</entry>
Aug 15 05:58:17 user nova-compute[73391]:       <entry name="uuid">595be11c-24db-43eb-9d5b-56cbeefd6149</entry>
Aug 15 05:58:17 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 05:58:17 user nova-compute[73391]:     </system>
Aug 15 05:58:17 user nova-compute[73391]:   </sysinfo>
Aug 15 05:58:17 user nova-compute[73391]:   <os>
Aug 15 05:58:17 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 05:58:17 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 05:58:17 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 05:58:17 user nova-compute[73391]:   </os>
Aug 15 05:58:17 user nova-compute[73391]:   <features>
Aug 15 05:58:17 user nova-compute[73391]:     <acpi/>
Aug 15 05:58:17 user nova-compute[73391]:     <apic/>
Aug 15 05:58:17 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 05:58:17 user nova-compute[73391]:   </features>
Aug 15 05:58:17 user nova-compute[73391]:   <clock offset="utc">
Aug 15 05:58:17 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 05:58:17 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 05:58:17 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 05:58:17 user nova-compute[73391]:   </clock>
Aug 15 05:58:17 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 05:58:17 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 05:58:17 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 05:58:17 user nova-compute[73391]:   </cpu>
Aug 15 05:58:17 user nova-compute[73391]:   <devices>
Aug 15 05:58:17 user nova-compute[73391]:     <disk type="file" device="disk">
Aug 15 05:58:17 user nova-compute[73391]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 05:58:17 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/595be11c-24db-43eb-9d5b-56cbeefd6149/disk"/>
Aug 15 05:58:17 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 05:58:17 user nova-compute[73391]:     </disk>
Aug 15 05:58:17 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 05:58:17 user nova-compute[73391]:       <mac address="fa:16:3e:05:b7:5b"/>
Aug 15 05:58:17 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:58:17 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 05:58:17 user nova-compute[73391]:       <target dev="tap3418de64-8d"/>
Aug 15 05:58:17 user nova-compute[73391]:     </interface>
Aug 15 05:58:17 user nova-compute[73391]:     <serial type="pty">
Aug 15 05:58:17 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/595be11c-24db-43eb-9d5b-56cbeefd6149/console.log" append="off"/>
Aug 15 05:58:17 user nova-compute[73391]:     </serial>
Aug 15 05:58:17 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 05:58:17 user nova-compute[73391]:     <video>
Aug 15 05:58:17 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 05:58:17 user nova-compute[73391]:     </video>
Aug 15 05:58:17 user nova-compute[73391]:     <rng model="virtio">
Aug 15 05:58:17 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 05:58:17 user nova-compute[73391]:     </rng>
Aug 15 05:58:17 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 05:58:17 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 05:58:17 user nova-compute[73391]:       <stats period="10"/>
Aug 15 05:58:17 user nova-compute[73391]:     </memballoon>
Aug 15 05:58:17 user nova-compute[73391]:   </devices>
Aug 15 05:58:17 user nova-compute[73391]: </domain>
Aug 15 05:58:17 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 05:58:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:58:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-968761111',display_name='tempest-ServersNegativeTestJSON-server-968761111',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-968761111',id=48,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a94181609a284eb29f8db71cf34c086b',ramdisk_id='',reservation_id='r-jxk348w3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1203747242',owner_user_name='tempest-ServersNegativeTestJSON-1203747242-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T05:58:15Z,user_data=None,user_id='a8a6d1c3cc9d46c98e43e9c8c9caabb5',uuid=595be11c-24db-43eb-9d5b-56cbeefd6149,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3418de64-8dbd-4951-aca0-0dc87257dbcb", "address": "fa:16:3e:05:b7:5b", "network": {"id": "8e7b9da2-83d1-47d1-a352-a9684e3a2cdf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1697315681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a94181609a284eb29f8db71cf34c086b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3418de64-8d", "ovs_interfaceid": "3418de64-8dbd-4951-aca0-0dc87257dbcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 05:58:17 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Converting VIF {"id": "3418de64-8dbd-4951-aca0-0dc87257dbcb", "address": "fa:16:3e:05:b7:5b", "network": {"id": "8e7b9da2-83d1-47d1-a352-a9684e3a2cdf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1697315681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a94181609a284eb29f8db71cf34c086b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3418de64-8d", "ovs_interfaceid": "3418de64-8dbd-4951-aca0-0dc87257dbcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:58:17 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:b7:5b,bridge_name='br-int',has_traffic_filtering=True,id=3418de64-8dbd-4951-aca0-0dc87257dbcb,network=Network(8e7b9da2-83d1-47d1-a352-a9684e3a2cdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3418de64-8d') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:58:17 user nova-compute[73391]: DEBUG os_vif [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:b7:5b,bridge_name='br-int',has_traffic_filtering=True,id=3418de64-8dbd-4951-aca0-0dc87257dbcb,network=Network(8e7b9da2-83d1-47d1-a352-a9684e3a2cdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3418de64-8d') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 05:58:17 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:58:17 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:58:17 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 05:58:17 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:58:17 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3418de64-8d, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:58:17 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3418de64-8d, col_values=(('external_ids', {'iface-id': '3418de64-8dbd-4951-aca0-0dc87257dbcb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:b7:5b', 'vm-uuid': '595be11c-24db-43eb-9d5b-56cbeefd6149'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:58:17 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:58:17 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:58:17 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:58:17 user nova-compute[73391]: INFO os_vif [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:b7:5b,bridge_name='br-int',has_traffic_filtering=True,id=3418de64-8dbd-4951-aca0-0dc87257dbcb,network=Network(8e7b9da2-83d1-47d1-a352-a9684e3a2cdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3418de64-8d')
Aug 15 05:58:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:58:17 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] No VIF found with MAC fa:16:3e:05:b7:5b, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:58:17 user nova-compute[73391]: DEBUG nova.network.neutron [req-ecca4339-8669-40fd-800d-24a52aeef928 req-7a0c2a6e-8a9e-4128-9432-8f8c2905b746 service nova] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Updated VIF entry in instance network info cache for port 3418de64-8dbd-4951-aca0-0dc87257dbcb. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:58:17 user nova-compute[73391]: DEBUG nova.network.neutron [req-ecca4339-8669-40fd-800d-24a52aeef928 req-7a0c2a6e-8a9e-4128-9432-8f8c2905b746 service nova] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Updating instance_info_cache with network_info: [{"id": "3418de64-8dbd-4951-aca0-0dc87257dbcb", "address": "fa:16:3e:05:b7:5b", "network": {"id": "8e7b9da2-83d1-47d1-a352-a9684e3a2cdf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1697315681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a94181609a284eb29f8db71cf34c086b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3418de64-8d", "ovs_interfaceid": "3418de64-8dbd-4951-aca0-0dc87257dbcb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:58:17 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ecca4339-8669-40fd-800d-24a52aeef928 req-7a0c2a6e-8a9e-4128-9432-8f8c2905b746 service nova] Releasing lock "refresh_cache-595be11c-24db-43eb-9d5b-56cbeefd6149" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:58:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:58:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:58:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:58:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:58:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:58:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:58:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:58:20 user nova-compute[73391]: DEBUG nova.compute.manager [req-d868c07c-6521-4955-9dee-b2f822370c9a req-011901ff-1ed2-48ff-ad94-5c128cb24d00 service nova] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Received event network-vif-plugged-3418de64-8dbd-4951-aca0-0dc87257dbcb {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:58:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d868c07c-6521-4955-9dee-b2f822370c9a req-011901ff-1ed2-48ff-ad94-5c128cb24d00 service nova] Acquiring lock "595be11c-24db-43eb-9d5b-56cbeefd6149-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:58:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d868c07c-6521-4955-9dee-b2f822370c9a req-011901ff-1ed2-48ff-ad94-5c128cb24d00 service nova] Lock "595be11c-24db-43eb-9d5b-56cbeefd6149-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:58:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d868c07c-6521-4955-9dee-b2f822370c9a req-011901ff-1ed2-48ff-ad94-5c128cb24d00 service nova] Lock "595be11c-24db-43eb-9d5b-56cbeefd6149-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:58:20 user nova-compute[73391]: DEBUG nova.compute.manager [req-d868c07c-6521-4955-9dee-b2f822370c9a req-011901ff-1ed2-48ff-ad94-5c128cb24d00 service nova] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] No waiting events found dispatching network-vif-plugged-3418de64-8dbd-4951-aca0-0dc87257dbcb {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:58:20 user nova-compute[73391]: WARNING nova.compute.manager [req-d868c07c-6521-4955-9dee-b2f822370c9a req-011901ff-1ed2-48ff-ad94-5c128cb24d00 service nova] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Received unexpected event network-vif-plugged-3418de64-8dbd-4951-aca0-0dc87257dbcb for instance with vm_state building and task_state spawning.
Aug 15 05:58:20 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692079100.6695995, 595be11c-24db-43eb-9d5b-56cbeefd6149 => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:58:20 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] VM Resumed (Lifecycle Event)
Aug 15 05:58:20 user nova-compute[73391]: DEBUG nova.compute.manager [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 05:58:20 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Guest created on hypervisor {{(pid=73391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 05:58:20 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Instance spawned successfully.
Aug 15 05:58:20 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 05:58:20 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:58:20 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:58:20 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Found default for hw_cdrom_bus of ide {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:58:20 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Found default for hw_disk_bus of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:58:20 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Found default for hw_input_bus of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:58:20 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Found default for hw_pointer_model of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:58:20 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Found default for hw_video_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:58:20 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Found default for hw_vif_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 05:58:20 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:58:20 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692079100.673029, 595be11c-24db-43eb-9d5b-56cbeefd6149 => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:58:20 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] VM Started (Lifecycle Event)
Aug 15 05:58:20 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:58:20 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 05:58:20 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 05:58:20 user nova-compute[73391]: INFO nova.compute.manager [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Took 5.38 seconds to spawn the instance on the hypervisor.
Aug 15 05:58:20 user nova-compute[73391]: DEBUG nova.compute.manager [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:58:20 user nova-compute[73391]: INFO nova.compute.manager [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Took 5.98 seconds to build instance.
Aug 15 05:58:20 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-e0d1b9a8-7127-494c-a666-e0cf55d76211 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Lock "595be11c-24db-43eb-9d5b-56cbeefd6149" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.079s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:58:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:58:22 user nova-compute[73391]: DEBUG nova.compute.manager [req-89c4fb50-261b-44f6-9857-c31ac77b77c4 req-44427ef2-ce4c-402f-9f8e-04212c94a2ef service nova] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Received event network-vif-plugged-3418de64-8dbd-4951-aca0-0dc87257dbcb {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:58:22 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-89c4fb50-261b-44f6-9857-c31ac77b77c4 req-44427ef2-ce4c-402f-9f8e-04212c94a2ef service nova] Acquiring lock "595be11c-24db-43eb-9d5b-56cbeefd6149-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:58:22 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-89c4fb50-261b-44f6-9857-c31ac77b77c4 req-44427ef2-ce4c-402f-9f8e-04212c94a2ef service nova] Lock "595be11c-24db-43eb-9d5b-56cbeefd6149-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:58:22 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-89c4fb50-261b-44f6-9857-c31ac77b77c4 req-44427ef2-ce4c-402f-9f8e-04212c94a2ef service nova] Lock "595be11c-24db-43eb-9d5b-56cbeefd6149-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:58:22 user nova-compute[73391]: DEBUG nova.compute.manager [req-89c4fb50-261b-44f6-9857-c31ac77b77c4 req-44427ef2-ce4c-402f-9f8e-04212c94a2ef service nova] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] No waiting events found dispatching network-vif-plugged-3418de64-8dbd-4951-aca0-0dc87257dbcb {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:58:22 user nova-compute[73391]: WARNING nova.compute.manager [req-89c4fb50-261b-44f6-9857-c31ac77b77c4 req-44427ef2-ce4c-402f-9f8e-04212c94a2ef service nova] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Received unexpected event network-vif-plugged-3418de64-8dbd-4951-aca0-0dc87257dbcb for instance with vm_state active and task_state None.
Aug 15 05:58:25 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:58:27 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:58:28 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:58:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:58:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:58:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:58:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Auditing locally available compute resources for user (node: user) {{(pid=73391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 05:58:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3ab430-d3a3-4003-8337-0f45fdb54e2f/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:58:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3ab430-d3a3-4003-8337-0f45fdb54e2f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:58:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3ab430-d3a3-4003-8337-0f45fdb54e2f/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:58:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3ab430-d3a3-4003-8337-0f45fdb54e2f/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:58:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595be11c-24db-43eb-9d5b-56cbeefd6149/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:58:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595be11c-24db-43eb-9d5b-56cbeefd6149/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:58:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595be11c-24db-43eb-9d5b-56cbeefd6149/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:58:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595be11c-24db-43eb-9d5b-56cbeefd6149/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:58:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d10508dd-f3f7-4e96-b822-d331ded6809f/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:58:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d10508dd-f3f7-4e96-b822-d331ded6809f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:58:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d10508dd-f3f7-4e96-b822-d331ded6809f/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:58:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d10508dd-f3f7-4e96-b822-d331ded6809f/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:58:30 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:58:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:58:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:58:30 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:58:30 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:58:30 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Hypervisor/Node resource view: name=user free_ram=8355MB free_disk=25.07424545288086GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 05:58:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:58:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:58:30 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance d10508dd-f3f7-4e96-b822-d331ded6809f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:58:30 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 3d3ab430-d3a3-4003-8337-0f45fdb54e2f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:58:30 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 595be11c-24db-43eb-9d5b-56cbeefd6149 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:58:30 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 05:58:30 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 05:58:30 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:58:30 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:58:30 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Compute_service record updated for user:user {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 05:58:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.300s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:58:32 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:58:33 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:58:33 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:58:33 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:58:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:58:34 user nova-compute[73391]: DEBUG nova.compute.manager [req-990b3b2d-e2e8-4677-a6f8-78f050b8eda5 req-c8d2de66-5bca-4dbf-8ad4-cbb32cd95a73 service nova] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Received event network-changed-0cdd39d3-7846-438b-9fb2-a1ff7bb61471 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:58:34 user nova-compute[73391]: DEBUG nova.compute.manager [req-990b3b2d-e2e8-4677-a6f8-78f050b8eda5 req-c8d2de66-5bca-4dbf-8ad4-cbb32cd95a73 service nova] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Refreshing instance network info cache due to event network-changed-0cdd39d3-7846-438b-9fb2-a1ff7bb61471. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:58:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-990b3b2d-e2e8-4677-a6f8-78f050b8eda5 req-c8d2de66-5bca-4dbf-8ad4-cbb32cd95a73 service nova] Acquiring lock "refresh_cache-3d3ab430-d3a3-4003-8337-0f45fdb54e2f" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:58:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-990b3b2d-e2e8-4677-a6f8-78f050b8eda5 req-c8d2de66-5bca-4dbf-8ad4-cbb32cd95a73 service nova] Acquired lock "refresh_cache-3d3ab430-d3a3-4003-8337-0f45fdb54e2f" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:58:34 user nova-compute[73391]: DEBUG nova.network.neutron [req-990b3b2d-e2e8-4677-a6f8-78f050b8eda5 req-c8d2de66-5bca-4dbf-8ad4-cbb32cd95a73 service nova] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Refreshing network info cache for port 0cdd39d3-7846-438b-9fb2-a1ff7bb61471 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:58:35 user nova-compute[73391]: DEBUG nova.network.neutron [req-990b3b2d-e2e8-4677-a6f8-78f050b8eda5 req-c8d2de66-5bca-4dbf-8ad4-cbb32cd95a73 service nova] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Updated VIF entry in instance network info cache for port 0cdd39d3-7846-438b-9fb2-a1ff7bb61471. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:58:35 user nova-compute[73391]: DEBUG nova.network.neutron [req-990b3b2d-e2e8-4677-a6f8-78f050b8eda5 req-c8d2de66-5bca-4dbf-8ad4-cbb32cd95a73 service nova] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Updating instance_info_cache with network_info: [{"id": "0cdd39d3-7846-438b-9fb2-a1ff7bb61471", "address": "fa:16:3e:09:4d:8c", "network": {"id": "bc2718a2-a5ab-44e0-966d-9b180a30ac75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1022668030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8086add121594fe8a0bdde99dd9cae90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cdd39d3-78", "ovs_interfaceid": "0cdd39d3-7846-438b-9fb2-a1ff7bb61471", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:58:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-990b3b2d-e2e8-4677-a6f8-78f050b8eda5 req-c8d2de66-5bca-4dbf-8ad4-cbb32cd95a73 service nova] Releasing lock "refresh_cache-3d3ab430-d3a3-4003-8337-0f45fdb54e2f" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:58:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:58:36 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:58:37 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:58:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8ffea346-45a1-44f1-a607-564827625175 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Acquiring lock "3d3ab430-d3a3-4003-8337-0f45fdb54e2f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:58:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8ffea346-45a1-44f1-a607-564827625175 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "3d3ab430-d3a3-4003-8337-0f45fdb54e2f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:58:38 user nova-compute[73391]: DEBUG nova.objects.instance [None req-8ffea346-45a1-44f1-a607-564827625175 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lazy-loading 'flavor' on Instance uuid 3d3ab430-d3a3-4003-8337-0f45fdb54e2f {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:58:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8ffea346-45a1-44f1-a607-564827625175 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "3d3ab430-d3a3-4003-8337-0f45fdb54e2f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:58:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8ffea346-45a1-44f1-a607-564827625175 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Acquiring lock "3d3ab430-d3a3-4003-8337-0f45fdb54e2f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:58:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8ffea346-45a1-44f1-a607-564827625175 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "3d3ab430-d3a3-4003-8337-0f45fdb54e2f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:58:38 user nova-compute[73391]: INFO nova.compute.manager [None req-8ffea346-45a1-44f1-a607-564827625175 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Attaching volume 623d0a18-252f-47bf-8606-251f5fabfd16 to /dev/vdb
Aug 15 05:58:38 user nova-compute[73391]: DEBUG os_brick.utils [None req-8ffea346-45a1-44f1-a607-564827625175 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:58:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:58:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:58:38 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4473d196-0d4d-4ab6-8907-790b90d213eb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:58:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:58:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:58:38 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[483f3ce2-98f9-4f5e-8c2b-cafcbaf8f4e5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:58:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:58:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:58:38 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d9c805-7e03-4e33-9053-ba8c615a5b5e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:58:38 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb78ed6b-16d0-409f-860a-e66a60d93d9a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:58:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-8ffea346-45a1-44f1-a607-564827625175 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:58:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-8ffea346-45a1-44f1-a607-564827625175 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:58:38 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8ffea346-45a1-44f1-a607-564827625175 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 05:58:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:58:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 05:58:38 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 05:58:38 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d942be-de7c-43f7-b520-8749201015b9]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:58:38 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-8ffea346-45a1-44f1-a607-564827625175 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 05:58:38 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-8ffea346-45a1-44f1-a607-564827625175 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 05:58:38 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-8ffea346-45a1-44f1-a607-564827625175 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 05:58:38 user nova-compute[73391]: DEBUG os_brick.utils [None req-8ffea346-45a1-44f1-a607-564827625175 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:58:38 user nova-compute[73391]: DEBUG nova.virt.block_device [None req-8ffea346-45a1-44f1-a607-564827625175 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Updating existing volume attachment record: a757c107-97c7-47aa-a490-597fc1650838 {{(pid=73391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 05:58:39 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:58:39 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Starting heal instance info cache {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 05:58:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "refresh_cache-3d3ab430-d3a3-4003-8337-0f45fdb54e2f" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:58:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquired lock "refresh_cache-3d3ab430-d3a3-4003-8337-0f45fdb54e2f" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:58:39 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Forcefully refreshing network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 05:58:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:58:40 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Updating instance_info_cache with network_info: [{"id": "0cdd39d3-7846-438b-9fb2-a1ff7bb61471", "address": "fa:16:3e:09:4d:8c", "network": {"id": "bc2718a2-a5ab-44e0-966d-9b180a30ac75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1022668030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8086add121594fe8a0bdde99dd9cae90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cdd39d3-78", "ovs_interfaceid": "0cdd39d3-7846-438b-9fb2-a1ff7bb61471", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:58:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Releasing lock "refresh_cache-3d3ab430-d3a3-4003-8337-0f45fdb54e2f" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:58:40 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Updated the network info_cache for instance {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 05:58:41 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:58:41 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 05:58:42 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:58:42 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:58:44 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:58:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:58:47 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:58:47 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ffea346-45a1-44f1-a607-564827625175 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 05:58:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ffea346-45a1-44f1-a607-564827625175 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:623d0a18-252f-47bf-8606-251f5fabfd16'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BtnFaZOe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:58:47 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-8ffea346-45a1-44f1-a607-564827625175 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:58:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-8ffea346-45a1-44f1-a607-564827625175 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:58:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-8ffea346-45a1-44f1-a607-564827625175 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:58:47 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-8ffea346-45a1-44f1-a607-564827625175 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:58:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-8ffea346-45a1-44f1-a607-564827625175 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:623d0a18-252f-47bf-8606-251f5fabfd16" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:58:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-8ffea346-45a1-44f1-a607-564827625175 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:623d0a18-252f-47bf-8606-251f5fabfd16" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:58:47 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-8ffea346-45a1-44f1-a607-564827625175 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 05:58:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:623d0a18-252f-47bf-8606-251f5fabfd16 -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:58:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:623d0a18-252f-47bf-8606-251f5fabfd16 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:58:47 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdce0ff5-a4ab-4f70-bc10-6cbf110d7024]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:58:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ffea346-45a1-44f1-a607-564827625175 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 05:58:47 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:58:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:623d0a18-252f-47bf-8606-251f5fabfd16 -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:58:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:623d0a18-252f-47bf-8606-251f5fabfd16 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:58:47 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37319a7-e927-4f09-9daa-54e027aed240]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:623d0a18-252f-47bf-8606-251f5fabfd16] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:58:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ffea346-45a1-44f1-a607-564827625175 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:623d0a18-252f-47bf-8606-251f5fabfd16] added
Aug 15 05:58:47 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:58:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:623d0a18-252f-47bf-8606-251f5fabfd16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:58:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:623d0a18-252f-47bf-8606-251f5fabfd16 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:58:47 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6863655a-a942-48aa-b1bf-09968c25cc55]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:58:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ffea346-45a1-44f1-a607-564827625175 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:58:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:623d0a18-252f-47bf-8606-251f5fabfd16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:58:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:623d0a18-252f-47bf-8606-251f5fabfd16 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:58:47 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be31425-bc65-4479-b829-2bbe796c5146]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:58:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ffea346-45a1-44f1-a607-564827625175 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:58:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:623d0a18-252f-47bf-8606-251f5fabfd16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BtnFaZOe {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:58:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:623d0a18-252f-47bf-8606-251f5fabfd16 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BtnFaZOe" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:58:47 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4d13ce-dda6-463f-9e2d-cc49012184e5]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:58:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ffea346-45a1-44f1-a607-564827625175 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BtnFaZOe'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:58:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:623d0a18-252f-47bf-8606-251f5fabfd16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:58:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:623d0a18-252f-47bf-8606-251f5fabfd16 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:58:47 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[33861217-0fba-4a1c-8483-479b5291a298]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:58:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ffea346-45a1-44f1-a607-564827625175 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:58:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:58:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:58:47 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5093c6df-1775-46f6-af7d-efbec60b42b7]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:58:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ffea346-45a1-44f1-a607-564827625175 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 (non-flash)
Aug 15 05:58:47 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:58:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ffea346-45a1-44f1-a607-564827625175 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 (non-flash)
Aug 15 05:58:47 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:58:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:623d0a18-252f-47bf-8606-251f5fabfd16 -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:58:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:623d0a18-252f-47bf-8606-251f5fabfd16 -p 172.16.0.220:3260 --login" returned: 0 in 0.053s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:58:47 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc1e4bf-7352-4959-b9ff-29ff2a974f45]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:623d0a18-252f-47bf-8606-251f5fabfd16, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:623d0a18-252f-47bf-8606-251f5fabfd16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:58:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ffea346-45a1-44f1-a607-564827625175 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:623d0a18-252f-47bf-8606-251f5fabfd16, portal: 172.16.0.220,3260]
Aug 15 05:58:47 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:623d0a18-252f-47bf-8606-251f5fabfd16, portal: 172.16.0.220,3260] successful.
Aug 15 05:58:47 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:58:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:623d0a18-252f-47bf-8606-251f5fabfd16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:58:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:623d0a18-252f-47bf-8606-251f5fabfd16 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:58:47 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4137922-4b62-42bc-a66f-63c0a8753558]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:58:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ffea346-45a1-44f1-a607-564827625175 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:58:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:58:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:58:47 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7889aad1-e4f0-4541-8cfe-718d14ef1a63]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:623d0a18-252f-47bf-8606-251f5fabfd16 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:58:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ffea346-45a1-44f1-a607-564827625175 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 (non-flash)
Aug 15 05:58:47 user nova-compute[73391]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:623d0a18-252f-47bf-8606-251f5fabfd16 (non-flash)
Aug 15 05:58:47 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:58:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ffea346-45a1-44f1-a607-564827625175 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 (non-flash)
Aug 15 05:58:47 user nova-compute[73391]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:623d0a18-252f-47bf-8606-251f5fabfd16 (non-flash)
Aug 15 05:58:47 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:58:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-8ffea346-45a1-44f1-a607-564827625175 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:623d0a18-252f-47bf-8606-251f5fabfd16" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.268s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:58:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ffea346-45a1-44f1-a607-564827625175 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 05:58:47 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-8ffea346-45a1-44f1-a607-564827625175 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] HCTL ('34', '-', '-', 0) found on session 60 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 05:58:47 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-8ffea346-45a1-44f1-a607-564827625175 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 05:58:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:58:47 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:58:47 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81c8ab3-03be-4f99-8823-bc26c9495d69]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:58:47 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-8ffea346-45a1-44f1-a607-564827625175 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 05:58:47 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ffea346-45a1-44f1-a607-564827625175 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Connected to sdc using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BtnFaZOe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 05:58:48 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-8ffea346-45a1-44f1-a607-564827625175 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:58:48 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-8ffea346-45a1-44f1-a607-564827625175 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '26438643434303062', 'path': '/dev/sdc'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:58:48 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8ffea346-45a1-44f1-a607-564827625175 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438643434303062', 'path': '/dev/sdc'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 05:58:48 user nova-compute[73391]: DEBUG nova.objects.instance [None req-8ffea346-45a1-44f1-a607-564827625175 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lazy-loading 'flavor' on Instance uuid 3d3ab430-d3a3-4003-8337-0f45fdb54e2f {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:58:48 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-8ffea346-45a1-44f1-a607-564827625175 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 05:58:48 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:58:48 user nova-compute[73391]:   <source dev="/dev/sdc"/>
Aug 15 05:58:48 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:58:48 user nova-compute[73391]:   <serial>623d0a18-252f-47bf-8606-251f5fabfd16</serial>
Aug 15 05:58:48 user nova-compute[73391]: </disk>
Aug 15 05:58:48 user nova-compute[73391]:  {{(pid=73391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 05:58:49 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-8ffea346-45a1-44f1-a607-564827625175 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:58:49 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-8ffea346-45a1-44f1-a607-564827625175 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 05:58:49 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-8ffea346-45a1-44f1-a607-564827625175 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] No VIF found with MAC fa:16:3e:09:4d:8c, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 05:58:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8ffea346-45a1-44f1-a607-564827625175 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "3d3ab430-d3a3-4003-8337-0f45fdb54e2f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.067s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:58:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:58:50 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-69e7e7df-b1fe-42cf-a36c-0edbc3f151b6 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Acquiring lock "3d3ab430-d3a3-4003-8337-0f45fdb54e2f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:58:50 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-69e7e7df-b1fe-42cf-a36c-0edbc3f151b6 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "3d3ab430-d3a3-4003-8337-0f45fdb54e2f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:58:50 user nova-compute[73391]: INFO nova.compute.manager [None req-69e7e7df-b1fe-42cf-a36c-0edbc3f151b6 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Detaching volume 623d0a18-252f-47bf-8606-251f5fabfd16
Aug 15 05:58:50 user nova-compute[73391]: INFO nova.virt.block_device [None req-69e7e7df-b1fe-42cf-a36c-0edbc3f151b6 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Attempting to driver detach volume 623d0a18-252f-47bf-8606-251f5fabfd16 from mountpoint /dev/vdb
Aug 15 05:58:50 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-69e7e7df-b1fe-42cf-a36c-0edbc3f151b6 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Attempting to detach device vdb from instance 3d3ab430-d3a3-4003-8337-0f45fdb54e2f from the persistent domain config. {{(pid=73391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 05:58:50 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-69e7e7df-b1fe-42cf-a36c-0edbc3f151b6 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 05:58:50 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:58:50 user nova-compute[73391]:   <source dev="/dev/sdc"/>
Aug 15 05:58:50 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:58:50 user nova-compute[73391]:   <serial>623d0a18-252f-47bf-8606-251f5fabfd16</serial>
Aug 15 05:58:50 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 05:58:50 user nova-compute[73391]: </disk>
Aug 15 05:58:50 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 05:58:50 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-69e7e7df-b1fe-42cf-a36c-0edbc3f151b6 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Successfully detached device vdb from instance 3d3ab430-d3a3-4003-8337-0f45fdb54e2f from the persistent domain config.
Aug 15 05:58:50 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-69e7e7df-b1fe-42cf-a36c-0edbc3f151b6 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3d3ab430-d3a3-4003-8337-0f45fdb54e2f from the live domain config. {{(pid=73391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 05:58:50 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-69e7e7df-b1fe-42cf-a36c-0edbc3f151b6 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 05:58:50 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:58:50 user nova-compute[73391]:   <source dev="/dev/sdc"/>
Aug 15 05:58:50 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:58:50 user nova-compute[73391]:   <serial>623d0a18-252f-47bf-8606-251f5fabfd16</serial>
Aug 15 05:58:50 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 05:58:50 user nova-compute[73391]: </disk>
Aug 15 05:58:50 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 05:58:51 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Received event <DeviceRemovedEvent: 1692079131.1518738, 3d3ab430-d3a3-4003-8337-0f45fdb54e2f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73391) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 05:58:51 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-69e7e7df-b1fe-42cf-a36c-0edbc3f151b6 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3d3ab430-d3a3-4003-8337-0f45fdb54e2f {{(pid=73391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 05:58:51 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-69e7e7df-b1fe-42cf-a36c-0edbc3f151b6 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Successfully detached device vdb from instance 3d3ab430-d3a3-4003-8337-0f45fdb54e2f from the live domain config.
Aug 15 05:58:51 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69e7e7df-b1fe-42cf-a36c-0edbc3f151b6 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 05:58:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-69e7e7df-b1fe-42cf-a36c-0edbc3f151b6 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:623d0a18-252f-47bf-8606-251f5fabfd16'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BtnFaZOe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:58:51 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-69e7e7df-b1fe-42cf-a36c-0edbc3f151b6 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:58:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-69e7e7df-b1fe-42cf-a36c-0edbc3f151b6 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:58:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-69e7e7df-b1fe-42cf-a36c-0edbc3f151b6 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:58:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-69e7e7df-b1fe-42cf-a36c-0edbc3f151b6 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:623d0a18-252f-47bf-8606-251f5fabfd16', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 05:58:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:58:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:58:51 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fe21eb8-d663-4d2a-b087-fe28a602d180]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:623d0a18-252f-47bf-8606-251f5fabfd16\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:58:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:58:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:58:51 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8225e10-fefb-4486-8c35-2fcb338dda53]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:623d0a18-252f-47bf-8606-251f5fabfd16 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:58:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-69e7e7df-b1fe-42cf-a36c-0edbc3f151b6 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 (non-flash)
Aug 15 05:58:51 user nova-compute[73391]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:623d0a18-252f-47bf-8606-251f5fabfd16 (non-flash)
Aug 15 05:58:51 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:58:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-69e7e7df-b1fe-42cf-a36c-0edbc3f151b6 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 (non-flash)
Aug 15 05:58:51 user nova-compute[73391]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:623d0a18-252f-47bf-8606-251f5fabfd16 (non-flash)
Aug 15 05:58:51 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:58:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-69e7e7df-b1fe-42cf-a36c-0edbc3f151b6 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f774859d7e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:623d0a18-252f-47bf-8606-251f5fabfd16'): ({'sdc'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 05:58:51 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-69e7e7df-b1fe-42cf-a36c-0edbc3f151b6 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Removing single pathed devices sdc {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 05:58:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:58:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:58:51 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c69c6bbd-a0a8-4668-aca8-d75b580662c6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:58:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:58:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:58:51 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d246c9f-1542-4bd5-a735-e2a8c4f232e7]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:58:51 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-69e7e7df-b1fe-42cf-a36c-0edbc3f151b6 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Flushing IO for device /dev/sdc {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 05:58:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:58:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:58:51 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8270c9c0-381e-4838-8a06-18a7e7841cd9]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:58:51 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-69e7e7df-b1fe-42cf-a36c-0edbc3f151b6 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 05:58:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:58:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.028s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:58:51 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a4a982-03e4-477e-8be0-70bb64d285a0]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:58:51 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-69e7e7df-b1fe-42cf-a36c-0edbc3f151b6 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 05:58:51 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-69e7e7df-b1fe-42cf-a36c-0edbc3f151b6 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] SCSI volumes sdc have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 05:58:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-69e7e7df-b1fe-42cf-a36c-0edbc3f151b6 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:623d0a18-252f-47bf-8606-251f5fabfd16')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 05:58:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:623d0a18-252f-47bf-8606-251f5fabfd16 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:58:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:623d0a18-252f-47bf-8606-251f5fabfd16 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:58:51 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a01ff5fa-6fcc-4a7c-b86f-6a36861523f7]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:58:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-69e7e7df-b1fe-42cf-a36c-0edbc3f151b6 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:58:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:623d0a18-252f-47bf-8606-251f5fabfd16 -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:58:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:623d0a18-252f-47bf-8606-251f5fabfd16 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:58:51 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c20990-df26-4018-af8d-774cf058afc9]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:623d0a18-252f-47bf-8606-251f5fabfd16, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:623d0a18-252f-47bf-8606-251f5fabfd16, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:58:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-69e7e7df-b1fe-42cf-a36c-0edbc3f151b6 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:623d0a18-252f-47bf-8606-251f5fabfd16, portal: 172.16.0.220,3260]
Aug 15 05:58:51 user nova-compute[73391]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:623d0a18-252f-47bf-8606-251f5fabfd16, portal: 172.16.0.220,3260] successful.
Aug 15 05:58:51 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:58:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:623d0a18-252f-47bf-8606-251f5fabfd16 -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:58:51 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:623d0a18-252f-47bf-8606-251f5fabfd16 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:58:51 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b3ac56-e09f-487e-b8f0-f3988c47166d]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:58:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-69e7e7df-b1fe-42cf-a36c-0edbc3f151b6 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:58:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-69e7e7df-b1fe-42cf-a36c-0edbc3f151b6 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.245s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:58:51 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-69e7e7df-b1fe-42cf-a36c-0edbc3f151b6 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] <== disconnect_volume: return (246ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:58:51 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69e7e7df-b1fe-42cf-a36c-0edbc3f151b6 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 05:58:52 user nova-compute[73391]: DEBUG nova.objects.instance [None req-69e7e7df-b1fe-42cf-a36c-0edbc3f151b6 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lazy-loading 'flavor' on Instance uuid 3d3ab430-d3a3-4003-8337-0f45fdb54e2f {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:58:52 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-69e7e7df-b1fe-42cf-a36c-0edbc3f151b6 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "3d3ab430-d3a3-4003-8337-0f45fdb54e2f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.554s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:58:52 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:58:57 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:59:02 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:59:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:59:07 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:59:12 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:59:17 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:59:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:59:27 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:59:28 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:59:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:59:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:59:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:59:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Auditing locally available compute resources for user (node: user) {{(pid=73391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 05:59:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3ab430-d3a3-4003-8337-0f45fdb54e2f/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:59:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3ab430-d3a3-4003-8337-0f45fdb54e2f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:59:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3ab430-d3a3-4003-8337-0f45fdb54e2f/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:59:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d3ab430-d3a3-4003-8337-0f45fdb54e2f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:59:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595be11c-24db-43eb-9d5b-56cbeefd6149/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:59:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595be11c-24db-43eb-9d5b-56cbeefd6149/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:59:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595be11c-24db-43eb-9d5b-56cbeefd6149/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:59:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595be11c-24db-43eb-9d5b-56cbeefd6149/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:59:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d10508dd-f3f7-4e96-b822-d331ded6809f/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:59:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d10508dd-f3f7-4e96-b822-d331ded6809f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:59:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d10508dd-f3f7-4e96-b822-d331ded6809f/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:59:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d10508dd-f3f7-4e96-b822-d331ded6809f/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:59:29 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 05:59:30 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:59:30 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 05:59:30 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Hypervisor/Node resource view: name=user free_ram=8543MB free_disk=25.036617279052734GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 05:59:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:59:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:59:30 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance d10508dd-f3f7-4e96-b822-d331ded6809f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:59:30 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 3d3ab430-d3a3-4003-8337-0f45fdb54e2f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:59:30 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 595be11c-24db-43eb-9d5b-56cbeefd6149 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 05:59:30 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 05:59:30 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 05:59:30 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:59:30 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:59:30 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Compute_service record updated for user:user {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 05:59:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.219s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:59:32 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:59:33 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:59:33 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:59:34 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:59:36 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:59:37 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:59:39 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:59:39 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Starting heal instance info cache {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 05:59:39 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Rebuilding the list of instances to heal {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 05:59:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "refresh_cache-d10508dd-f3f7-4e96-b822-d331ded6809f" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:59:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquired lock "refresh_cache-d10508dd-f3f7-4e96-b822-d331ded6809f" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:59:40 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Forcefully refreshing network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 05:59:40 user nova-compute[73391]: DEBUG nova.objects.instance [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lazy-loading 'info_cache' on Instance uuid d10508dd-f3f7-4e96-b822-d331ded6809f {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:59:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:59:40 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Updating instance_info_cache with network_info: [{"id": "bad7b5c4-680d-4f22-9fc0-53e0ac551260", "address": "fa:16:3e:91:71:96", "network": {"id": "2a8063f6-42ce-41b8-86f6-72c17f4c2a7b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1765547969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd985a0cd6884c858487187ce252bba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad7b5c4-68", "ovs_interfaceid": "bad7b5c4-680d-4f22-9fc0-53e0ac551260", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:59:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Releasing lock "refresh_cache-d10508dd-f3f7-4e96-b822-d331ded6809f" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:59:40 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Updated the network info_cache for instance {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 05:59:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-bb7d6ee7-7e80-415f-8d7a-2dc4c0bc1496 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Acquiring lock "3d3ab430-d3a3-4003-8337-0f45fdb54e2f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:59:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-bb7d6ee7-7e80-415f-8d7a-2dc4c0bc1496 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "3d3ab430-d3a3-4003-8337-0f45fdb54e2f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:59:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-bb7d6ee7-7e80-415f-8d7a-2dc4c0bc1496 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Acquiring lock "3d3ab430-d3a3-4003-8337-0f45fdb54e2f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:59:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-bb7d6ee7-7e80-415f-8d7a-2dc4c0bc1496 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "3d3ab430-d3a3-4003-8337-0f45fdb54e2f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:59:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-bb7d6ee7-7e80-415f-8d7a-2dc4c0bc1496 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "3d3ab430-d3a3-4003-8337-0f45fdb54e2f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:59:41 user nova-compute[73391]: INFO nova.compute.manager [None req-bb7d6ee7-7e80-415f-8d7a-2dc4c0bc1496 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Terminating instance
Aug 15 05:59:41 user nova-compute[73391]: DEBUG nova.compute.manager [None req-bb7d6ee7-7e80-415f-8d7a-2dc4c0bc1496 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Start destroying the instance on the hypervisor. {{(pid=73391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 05:59:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:59:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:59:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:59:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:59:41 user nova-compute[73391]: DEBUG nova.compute.manager [req-f0d1235c-2d6a-4eeb-8977-224cd58e6e0a req-c5317c44-210e-4b34-9185-7363fdd13104 service nova] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Received event network-vif-unplugged-0cdd39d3-7846-438b-9fb2-a1ff7bb61471 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:59:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f0d1235c-2d6a-4eeb-8977-224cd58e6e0a req-c5317c44-210e-4b34-9185-7363fdd13104 service nova] Acquiring lock "3d3ab430-d3a3-4003-8337-0f45fdb54e2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:59:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f0d1235c-2d6a-4eeb-8977-224cd58e6e0a req-c5317c44-210e-4b34-9185-7363fdd13104 service nova] Lock "3d3ab430-d3a3-4003-8337-0f45fdb54e2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:59:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-f0d1235c-2d6a-4eeb-8977-224cd58e6e0a req-c5317c44-210e-4b34-9185-7363fdd13104 service nova] Lock "3d3ab430-d3a3-4003-8337-0f45fdb54e2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:59:41 user nova-compute[73391]: DEBUG nova.compute.manager [req-f0d1235c-2d6a-4eeb-8977-224cd58e6e0a req-c5317c44-210e-4b34-9185-7363fdd13104 service nova] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] No waiting events found dispatching network-vif-unplugged-0cdd39d3-7846-438b-9fb2-a1ff7bb61471 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:59:41 user nova-compute[73391]: DEBUG nova.compute.manager [req-f0d1235c-2d6a-4eeb-8977-224cd58e6e0a req-c5317c44-210e-4b34-9185-7363fdd13104 service nova] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Received event network-vif-unplugged-0cdd39d3-7846-438b-9fb2-a1ff7bb61471 for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 05:59:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:59:41 user nova-compute[73391]: DEBUG nova.compute.manager [req-b44a2dc7-1a43-400b-9926-dade78e9c6e8 req-8c785754-0cb7-4c65-ace1-7c4f295dc78d service nova] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Received event network-changed-bad7b5c4-680d-4f22-9fc0-53e0ac551260 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:59:41 user nova-compute[73391]: DEBUG nova.compute.manager [req-b44a2dc7-1a43-400b-9926-dade78e9c6e8 req-8c785754-0cb7-4c65-ace1-7c4f295dc78d service nova] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Refreshing instance network info cache due to event network-changed-bad7b5c4-680d-4f22-9fc0-53e0ac551260. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:59:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-b44a2dc7-1a43-400b-9926-dade78e9c6e8 req-8c785754-0cb7-4c65-ace1-7c4f295dc78d service nova] Acquiring lock "refresh_cache-d10508dd-f3f7-4e96-b822-d331ded6809f" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:59:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-b44a2dc7-1a43-400b-9926-dade78e9c6e8 req-8c785754-0cb7-4c65-ace1-7c4f295dc78d service nova] Acquired lock "refresh_cache-d10508dd-f3f7-4e96-b822-d331ded6809f" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:59:41 user nova-compute[73391]: DEBUG nova.network.neutron [req-b44a2dc7-1a43-400b-9926-dade78e9c6e8 req-8c785754-0cb7-4c65-ace1-7c4f295dc78d service nova] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Refreshing network info cache for port bad7b5c4-680d-4f22-9fc0-53e0ac551260 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:59:41 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Instance destroyed successfully.
Aug 15 05:59:41 user nova-compute[73391]: DEBUG nova.objects.instance [None req-bb7d6ee7-7e80-415f-8d7a-2dc4c0bc1496 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lazy-loading 'resources' on Instance uuid 3d3ab430-d3a3-4003-8337-0f45fdb54e2f {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:59:41 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-bb7d6ee7-7e80-415f-8d7a-2dc4c0bc1496 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:56:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1205415411',display_name='tempest-AttachVolumeNegativeTest-server-1205415411',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1205415411',id=47,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD1MHZ1994+f11LYEhnzF1VekzsSDTuywaGt7mGPbPd37DIuxhscu1C8oovWu2xjH6HdZySW7m66pj29JPR2PGIB/avAwyOOtZfmNzzXrK+IgOHmWhlqqzKt3aihSxHH6w==',key_name='tempest-keypair-749454339',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:56:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8086add121594fe8a0bdde99dd9cae90',ramdisk_id='',reservation_id='r-4jhk74eq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1479702824',owner_user_name='tempest-AttachVolumeNegativeTest-1479702824-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:56:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9552a83a6a214c149ddceac64ccbdef6',uuid=3d3ab430-d3a3-4003-8337-0f45fdb54e2f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0cdd39d3-7846-438b-9fb2-a1ff7bb61471", "address": "fa:16:3e:09:4d:8c", "network": {"id": "bc2718a2-a5ab-44e0-966d-9b180a30ac75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1022668030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8086add121594fe8a0bdde99dd9cae90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cdd39d3-78", "ovs_interfaceid": "0cdd39d3-7846-438b-9fb2-a1ff7bb61471", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 05:59:41 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-bb7d6ee7-7e80-415f-8d7a-2dc4c0bc1496 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Converting VIF {"id": "0cdd39d3-7846-438b-9fb2-a1ff7bb61471", "address": "fa:16:3e:09:4d:8c", "network": {"id": "bc2718a2-a5ab-44e0-966d-9b180a30ac75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1022668030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8086add121594fe8a0bdde99dd9cae90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cdd39d3-78", "ovs_interfaceid": "0cdd39d3-7846-438b-9fb2-a1ff7bb61471", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 05:59:41 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-bb7d6ee7-7e80-415f-8d7a-2dc4c0bc1496 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:4d:8c,bridge_name='br-int',has_traffic_filtering=True,id=0cdd39d3-7846-438b-9fb2-a1ff7bb61471,network=Network(bc2718a2-a5ab-44e0-966d-9b180a30ac75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cdd39d3-78') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 05:59:41 user nova-compute[73391]: DEBUG os_vif [None req-bb7d6ee7-7e80-415f-8d7a-2dc4c0bc1496 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:4d:8c,bridge_name='br-int',has_traffic_filtering=True,id=0cdd39d3-7846-438b-9fb2-a1ff7bb61471,network=Network(bc2718a2-a5ab-44e0-966d-9b180a30ac75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cdd39d3-78') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 05:59:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:59:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0cdd39d3-78, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 05:59:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:59:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:59:41 user nova-compute[73391]: INFO os_vif [None req-bb7d6ee7-7e80-415f-8d7a-2dc4c0bc1496 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:4d:8c,bridge_name='br-int',has_traffic_filtering=True,id=0cdd39d3-7846-438b-9fb2-a1ff7bb61471,network=Network(bc2718a2-a5ab-44e0-966d-9b180a30ac75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cdd39d3-78')
Aug 15 05:59:41 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-bb7d6ee7-7e80-415f-8d7a-2dc4c0bc1496 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Deleting instance files /opt/stack/data/nova/instances/3d3ab430-d3a3-4003-8337-0f45fdb54e2f_del
Aug 15 05:59:41 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-bb7d6ee7-7e80-415f-8d7a-2dc4c0bc1496 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Deletion of /opt/stack/data/nova/instances/3d3ab430-d3a3-4003-8337-0f45fdb54e2f_del complete
Aug 15 05:59:41 user nova-compute[73391]: INFO nova.compute.manager [None req-bb7d6ee7-7e80-415f-8d7a-2dc4c0bc1496 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 15 05:59:41 user nova-compute[73391]: DEBUG oslo.service.loopingcall [None req-bb7d6ee7-7e80-415f-8d7a-2dc4c0bc1496 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 05:59:41 user nova-compute[73391]: DEBUG nova.compute.manager [-] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Deallocating network for instance {{(pid=73391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 05:59:41 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] deallocate_for_instance() {{(pid=73391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 05:59:42 user nova-compute[73391]: DEBUG nova.network.neutron [req-b44a2dc7-1a43-400b-9926-dade78e9c6e8 req-8c785754-0cb7-4c65-ace1-7c4f295dc78d service nova] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Updated VIF entry in instance network info cache for port bad7b5c4-680d-4f22-9fc0-53e0ac551260. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:59:42 user nova-compute[73391]: DEBUG nova.network.neutron [req-b44a2dc7-1a43-400b-9926-dade78e9c6e8 req-8c785754-0cb7-4c65-ace1-7c4f295dc78d service nova] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Updating instance_info_cache with network_info: [{"id": "bad7b5c4-680d-4f22-9fc0-53e0ac551260", "address": "fa:16:3e:91:71:96", "network": {"id": "2a8063f6-42ce-41b8-86f6-72c17f4c2a7b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1765547969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.137", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd985a0cd6884c858487187ce252bba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad7b5c4-68", "ovs_interfaceid": "bad7b5c4-680d-4f22-9fc0-53e0ac551260", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:59:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-b44a2dc7-1a43-400b-9926-dade78e9c6e8 req-8c785754-0cb7-4c65-ace1-7c4f295dc78d service nova] Releasing lock "refresh_cache-d10508dd-f3f7-4e96-b822-d331ded6809f" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:59:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c7013156-e98c-4f4a-ac55-17055fad5fa4 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Acquiring lock "d10508dd-f3f7-4e96-b822-d331ded6809f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:59:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c7013156-e98c-4f4a-ac55-17055fad5fa4 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "d10508dd-f3f7-4e96-b822-d331ded6809f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:59:42 user nova-compute[73391]: INFO nova.compute.manager [None req-c7013156-e98c-4f4a-ac55-17055fad5fa4 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Detaching volume e5482919-10aa-44c4-8f50-ee8a3fb6ce75
Aug 15 05:59:42 user nova-compute[73391]: INFO nova.virt.block_device [None req-c7013156-e98c-4f4a-ac55-17055fad5fa4 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Attempting to driver detach volume e5482919-10aa-44c4-8f50-ee8a3fb6ce75 from mountpoint /dev/vdb
Aug 15 05:59:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-c7013156-e98c-4f4a-ac55-17055fad5fa4 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Attempting to detach device vdb from instance d10508dd-f3f7-4e96-b822-d331ded6809f from the persistent domain config. {{(pid=73391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 05:59:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-c7013156-e98c-4f4a-ac55-17055fad5fa4 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 05:59:42 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:59:42 user nova-compute[73391]:   <source dev="/dev/sdb"/>
Aug 15 05:59:42 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:59:42 user nova-compute[73391]:   <serial>e5482919-10aa-44c4-8f50-ee8a3fb6ce75</serial>
Aug 15 05:59:42 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 05:59:42 user nova-compute[73391]: </disk>
Aug 15 05:59:42 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 05:59:42 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-c7013156-e98c-4f4a-ac55-17055fad5fa4 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Successfully detached device vdb from instance d10508dd-f3f7-4e96-b822-d331ded6809f from the persistent domain config.
Aug 15 05:59:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-c7013156-e98c-4f4a-ac55-17055fad5fa4 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d10508dd-f3f7-4e96-b822-d331ded6809f from the live domain config. {{(pid=73391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 05:59:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-c7013156-e98c-4f4a-ac55-17055fad5fa4 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 05:59:42 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 05:59:42 user nova-compute[73391]:   <source dev="/dev/sdb"/>
Aug 15 05:59:42 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 05:59:42 user nova-compute[73391]:   <serial>e5482919-10aa-44c4-8f50-ee8a3fb6ce75</serial>
Aug 15 05:59:42 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Aug 15 05:59:42 user nova-compute[73391]: </disk>
Aug 15 05:59:42 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG nova.compute.manager [req-a5f2097f-e358-4272-8a24-0d78759a1575 req-98441919-de55-46cf-b7f7-33ef32d6e7aa service nova] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Received event network-vif-plugged-0cdd39d3-7846-438b-9fb2-a1ff7bb61471 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-a5f2097f-e358-4272-8a24-0d78759a1575 req-98441919-de55-46cf-b7f7-33ef32d6e7aa service nova] Acquiring lock "3d3ab430-d3a3-4003-8337-0f45fdb54e2f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-a5f2097f-e358-4272-8a24-0d78759a1575 req-98441919-de55-46cf-b7f7-33ef32d6e7aa service nova] Lock "3d3ab430-d3a3-4003-8337-0f45fdb54e2f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-a5f2097f-e358-4272-8a24-0d78759a1575 req-98441919-de55-46cf-b7f7-33ef32d6e7aa service nova] Lock "3d3ab430-d3a3-4003-8337-0f45fdb54e2f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG nova.compute.manager [req-a5f2097f-e358-4272-8a24-0d78759a1575 req-98441919-de55-46cf-b7f7-33ef32d6e7aa service nova] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] No waiting events found dispatching network-vif-plugged-0cdd39d3-7846-438b-9fb2-a1ff7bb61471 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 05:59:43 user nova-compute[73391]: WARNING nova.compute.manager [req-a5f2097f-e358-4272-8a24-0d78759a1575 req-98441919-de55-46cf-b7f7-33ef32d6e7aa service nova] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Received unexpected event network-vif-plugged-0cdd39d3-7846-438b-9fb2-a1ff7bb61471 for instance with vm_state active and task_state deleting.
Aug 15 05:59:43 user nova-compute[73391]: DEBUG nova.compute.manager [req-a5f2097f-e358-4272-8a24-0d78759a1575 req-98441919-de55-46cf-b7f7-33ef32d6e7aa service nova] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Received event network-changed-bad7b5c4-680d-4f22-9fc0-53e0ac551260 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG nova.compute.manager [req-a5f2097f-e358-4272-8a24-0d78759a1575 req-98441919-de55-46cf-b7f7-33ef32d6e7aa service nova] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Refreshing instance network info cache due to event network-changed-bad7b5c4-680d-4f22-9fc0-53e0ac551260. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-a5f2097f-e358-4272-8a24-0d78759a1575 req-98441919-de55-46cf-b7f7-33ef32d6e7aa service nova] Acquiring lock "refresh_cache-d10508dd-f3f7-4e96-b822-d331ded6809f" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-a5f2097f-e358-4272-8a24-0d78759a1575 req-98441919-de55-46cf-b7f7-33ef32d6e7aa service nova] Acquired lock "refresh_cache-d10508dd-f3f7-4e96-b822-d331ded6809f" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG nova.network.neutron [req-a5f2097f-e358-4272-8a24-0d78759a1575 req-98441919-de55-46cf-b7f7-33ef32d6e7aa service nova] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Refreshing network info cache for port bad7b5c4-680d-4f22-9fc0-53e0ac551260 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Received event <DeviceRemovedEvent: 1692079183.430943, d10508dd-f3f7-4e96-b822-d331ded6809f => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73391) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-c7013156-e98c-4f4a-ac55-17055fad5fa4 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d10508dd-f3f7-4e96-b822-d331ded6809f {{(pid=73391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 05:59:43 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-c7013156-e98c-4f4a-ac55-17055fad5fa4 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Successfully detached device vdb from instance d10508dd-f3f7-4e96-b822-d331ded6809f from the live domain config.
Aug 15 05:59:43 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7013156-e98c-4f4a-ac55-17055fad5fa4 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7013156-e98c-4f4a-ac55-17055fad5fa4 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aEUMKbYF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 05:59:43 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-c7013156-e98c-4f4a-ac55-17055fad5fa4 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 05:59:43 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-c7013156-e98c-4f4a-ac55-17055fad5fa4 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-c7013156-e98c-4f4a-ac55-17055fad5fa4 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7013156-e98c-4f4a-ac55-17055fad5fa4 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4daa63b4-c27b-4333-86da-f361d83a1e1e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa5dafd-b5c6-4409-b403-a5721bf4b01c]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7013156-e98c-4f4a-ac55-17055fad5fa4 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 (non-flash)
Aug 15 05:59:43 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7013156-e98c-4f4a-ac55-17055fad5fa4 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 (non-flash)
Aug 15 05:59:43 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7013156-e98c-4f4a-ac55-17055fad5fa4 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77482d9900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75'): ({'sdb'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-c7013156-e98c-4f4a-ac55-17055fad5fa4 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Removing single pathed devices sdb {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc3c153-c307-4b3f-833f-bd6d000ddf27]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb3aecb-feee-4672-aabf-9311f1a937d3]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-c7013156-e98c-4f4a-ac55-17055fad5fa4 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Flushing IO for device /dev/sdb {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db3f23f-e2df-4916-a1bb-50a3517f432c]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-c7013156-e98c-4f4a-ac55-17055fad5fa4 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dccbe3c-19bc-4842-88b0-dd60e0f79975]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-c7013156-e98c-4f4a-ac55-17055fad5fa4 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-c7013156-e98c-4f4a-ac55-17055fad5fa4 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] SCSI volumes sdb have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7013156-e98c-4f4a-ac55-17055fad5fa4 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b65c442-ccd7-45c9-aea7-9983ca6306f8]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7013156-e98c-4f4a-ac55-17055fad5fa4 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[50650d20-21ac-43e4-b3b7-96f59cba644c]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7013156-e98c-4f4a-ac55-17055fad5fa4 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75, portal: 172.16.0.220,3260]
Aug 15 05:59:43 user nova-compute[73391]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75, portal: 172.16.0.220,3260] successful.
Aug 15 05:59:43 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e5482919-10aa-44c4-8f50-ee8a3fb6ce75 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9b7d72-ddc0-44c0-b4d8-af9c04c9cc40]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7013156-e98c-4f4a-ac55-17055fad5fa4 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-c7013156-e98c-4f4a-ac55-17055fad5fa4 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-c7013156-e98c-4f4a-ac55-17055fad5fa4 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] <== disconnect_volume: return (280ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c7013156-e98c-4f4a-ac55-17055fad5fa4 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:59:43 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Took 1.91 seconds to deallocate network for instance.
Aug 15 05:59:43 user nova-compute[73391]: DEBUG nova.compute.manager [req-46e32223-356c-4794-8115-a9746fa0d8bf req-a2562e6e-a50d-4513-b5bc-7e022e200b64 service nova] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Received event network-vif-deleted-0cdd39d3-7846-438b-9fb2-a1ff7bb61471 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-bb7d6ee7-7e80-415f-8d7a-2dc4c0bc1496 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-bb7d6ee7-7e80-415f-8d7a-2dc4c0bc1496 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG nova.network.neutron [req-a5f2097f-e358-4272-8a24-0d78759a1575 req-98441919-de55-46cf-b7f7-33ef32d6e7aa service nova] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Updated VIF entry in instance network info cache for port bad7b5c4-680d-4f22-9fc0-53e0ac551260. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG nova.network.neutron [req-a5f2097f-e358-4272-8a24-0d78759a1575 req-98441919-de55-46cf-b7f7-33ef32d6e7aa service nova] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Updating instance_info_cache with network_info: [{"id": "bad7b5c4-680d-4f22-9fc0-53e0ac551260", "address": "fa:16:3e:91:71:96", "network": {"id": "2a8063f6-42ce-41b8-86f6-72c17f4c2a7b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1765547969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd985a0cd6884c858487187ce252bba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad7b5c4-68", "ovs_interfaceid": "bad7b5c4-680d-4f22-9fc0-53e0ac551260", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 05:59:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-a5f2097f-e358-4272-8a24-0d78759a1575 req-98441919-de55-46cf-b7f7-33ef32d6e7aa service nova] Releasing lock "refresh_cache-d10508dd-f3f7-4e96-b822-d331ded6809f" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 05:59:44 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-bb7d6ee7-7e80-415f-8d7a-2dc4c0bc1496 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 05:59:44 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-bb7d6ee7-7e80-415f-8d7a-2dc4c0bc1496 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 05:59:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-bb7d6ee7-7e80-415f-8d7a-2dc4c0bc1496 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.172s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:59:44 user nova-compute[73391]: INFO nova.scheduler.client.report [None req-bb7d6ee7-7e80-415f-8d7a-2dc4c0bc1496 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Deleted allocations for instance 3d3ab430-d3a3-4003-8337-0f45fdb54e2f
Aug 15 05:59:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-bb7d6ee7-7e80-415f-8d7a-2dc4c0bc1496 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "3d3ab430-d3a3-4003-8337-0f45fdb54e2f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.194s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:59:44 user nova-compute[73391]: DEBUG nova.objects.instance [None req-c7013156-e98c-4f4a-ac55-17055fad5fa4 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lazy-loading 'flavor' on Instance uuid d10508dd-f3f7-4e96-b822-d331ded6809f {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 05:59:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-c7013156-e98c-4f4a-ac55-17055fad5fa4 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "d10508dd-f3f7-4e96-b822-d331ded6809f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.744s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 05:59:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:59:46 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:59:46 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 05:59:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 05:59:51 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 05:59:56 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692079181.775411, 3d3ab430-d3a3-4003-8337-0f45fdb54e2f => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 05:59:56 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] VM Stopped (Lifecycle Event)
Aug 15 05:59:56 user nova-compute[73391]: DEBUG nova.compute.manager [None req-e143a439-a1cb-4972-9012-cb3f73d9365f None None] [instance: 3d3ab430-d3a3-4003-8337-0f45fdb54e2f] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 05:59:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:00:01 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:00:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Acquiring lock "a7144a2f-78f6-48aa-9801-5c00b0171414" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:00:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Lock "a7144a2f-78f6-48aa-9801-5c00b0171414" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:00:05 user nova-compute[73391]: DEBUG nova.compute.manager [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Starting instance... {{(pid=73391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 06:00:06 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:00:06 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:00:06 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 06:00:06 user nova-compute[73391]: INFO nova.compute.claims [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Claim successful on node user
Aug 15 06:00:06 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:00:06 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:00:06 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.239s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:00:06 user nova-compute[73391]: DEBUG nova.compute.manager [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Start building networks asynchronously for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 06:00:06 user nova-compute[73391]: DEBUG nova.compute.manager [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Allocating IP information in the background. {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 06:00:06 user nova-compute[73391]: DEBUG nova.network.neutron [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] allocate_for_instance() {{(pid=73391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 06:00:06 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 06:00:06 user nova-compute[73391]: DEBUG nova.compute.manager [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Start building block device mappings for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 06:00:06 user nova-compute[73391]: DEBUG nova.policy [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a8a6d1c3cc9d46c98e43e9c8c9caabb5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a94181609a284eb29f8db71cf34c086b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73391) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 06:00:06 user nova-compute[73391]: DEBUG nova.compute.manager [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Start spawning the instance on the hypervisor. {{(pid=73391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 06:00:06 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Creating instance directory {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 06:00:06 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Creating image(s)
Aug 15 06:00:06 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Acquiring lock "/opt/stack/data/nova/instances/a7144a2f-78f6-48aa-9801-5c00b0171414/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:00:06 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Lock "/opt/stack/data/nova/instances/a7144a2f-78f6-48aa-9801-5c00b0171414/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:00:06 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Lock "/opt/stack/data/nova/instances/a7144a2f-78f6-48aa-9801-5c00b0171414/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:00:06 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:00:06 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.177s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:00:06 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Acquiring lock "999b315ba87151d8252d543312ae7790e7e1583b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:00:06 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:00:06 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:00:06 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.171s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:00:06 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/a7144a2f-78f6-48aa-9801-5c00b0171414/disk 1073741824 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:00:06 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:00:06 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/a7144a2f-78f6-48aa-9801-5c00b0171414/disk 1073741824" returned: 0 in 0.063s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:00:06 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:00:06 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:00:07 user nova-compute[73391]: DEBUG nova.network.neutron [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Successfully created port: 7fd5b250-a86e-421a-9daf-73c948b63644 {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 06:00:07 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.186s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:00:07 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a7144a2f-78f6-48aa-9801-5c00b0171414/disk. size=1073741824 {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 06:00:07 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7144a2f-78f6-48aa-9801-5c00b0171414/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:00:07 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7144a2f-78f6-48aa-9801-5c00b0171414/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:00:07 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Cannot resize image /opt/stack/data/nova/instances/a7144a2f-78f6-48aa-9801-5c00b0171414/disk to a smaller size. {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 06:00:07 user nova-compute[73391]: DEBUG nova.objects.instance [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Lazy-loading 'migration_context' on Instance uuid a7144a2f-78f6-48aa-9801-5c00b0171414 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:00:07 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Created local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 06:00:07 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Ensure instance console log exists: /opt/stack/data/nova/instances/a7144a2f-78f6-48aa-9801-5c00b0171414/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 06:00:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:00:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:00:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:00:07 user nova-compute[73391]: DEBUG nova.network.neutron [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Successfully updated port: 7fd5b250-a86e-421a-9daf-73c948b63644 {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 06:00:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Acquiring lock "refresh_cache-a7144a2f-78f6-48aa-9801-5c00b0171414" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:00:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Acquired lock "refresh_cache-a7144a2f-78f6-48aa-9801-5c00b0171414" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:00:07 user nova-compute[73391]: DEBUG nova.network.neutron [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 06:00:07 user nova-compute[73391]: DEBUG nova.compute.manager [req-b9cfe82a-cc38-4bae-a750-86f144a4591b req-cae3d948-89e4-4503-ae4e-e4a21a867c7e service nova] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Received event network-changed-7fd5b250-a86e-421a-9daf-73c948b63644 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:00:07 user nova-compute[73391]: DEBUG nova.compute.manager [req-b9cfe82a-cc38-4bae-a750-86f144a4591b req-cae3d948-89e4-4503-ae4e-e4a21a867c7e service nova] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Refreshing instance network info cache due to event network-changed-7fd5b250-a86e-421a-9daf-73c948b63644. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 06:00:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-b9cfe82a-cc38-4bae-a750-86f144a4591b req-cae3d948-89e4-4503-ae4e-e4a21a867c7e service nova] Acquiring lock "refresh_cache-a7144a2f-78f6-48aa-9801-5c00b0171414" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:00:08 user nova-compute[73391]: DEBUG nova.network.neutron [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 06:00:08 user nova-compute[73391]: DEBUG nova.network.neutron [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Updating instance_info_cache with network_info: [{"id": "7fd5b250-a86e-421a-9daf-73c948b63644", "address": "fa:16:3e:50:18:55", "network": {"id": "8e7b9da2-83d1-47d1-a352-a9684e3a2cdf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1697315681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a94181609a284eb29f8db71cf34c086b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fd5b250-a8", "ovs_interfaceid": "7fd5b250-a86e-421a-9daf-73c948b63644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:00:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Releasing lock "refresh_cache-a7144a2f-78f6-48aa-9801-5c00b0171414" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:00:08 user nova-compute[73391]: DEBUG nova.compute.manager [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Instance network_info: |[{"id": "7fd5b250-a86e-421a-9daf-73c948b63644", "address": "fa:16:3e:50:18:55", "network": {"id": "8e7b9da2-83d1-47d1-a352-a9684e3a2cdf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1697315681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a94181609a284eb29f8db71cf34c086b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fd5b250-a8", "ovs_interfaceid": "7fd5b250-a86e-421a-9daf-73c948b63644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 06:00:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-b9cfe82a-cc38-4bae-a750-86f144a4591b req-cae3d948-89e4-4503-ae4e-e4a21a867c7e service nova] Acquired lock "refresh_cache-a7144a2f-78f6-48aa-9801-5c00b0171414" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:00:08 user nova-compute[73391]: DEBUG nova.network.neutron [req-b9cfe82a-cc38-4bae-a750-86f144a4591b req-cae3d948-89e4-4503-ae4e-e4a21a867c7e service nova] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Refreshing network info cache for port 7fd5b250-a86e-421a-9daf-73c948b63644 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 06:00:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Start _get_guest_xml network_info=[{"id": "7fd5b250-a86e-421a-9daf-73c948b63644", "address": "fa:16:3e:50:18:55", "network": {"id": "8e7b9da2-83d1-47d1-a352-a9684e3a2cdf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1697315681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a94181609a284eb29f8db71cf34c086b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fd5b250-a8", "ovs_interfaceid": "7fd5b250-a86e-421a-9daf-73c948b63644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '191b1dad-305e-4d1c-9b15-515ec59a3278'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 06:00:08 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:00:08 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:00:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 06:00:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 06:00:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 06:00:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 06:00:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 06:00:08 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 06:00:08 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 06:00:08 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 06:00:08 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 06:00:08 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 06:00:08 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 06:00:08 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 06:00:08 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 06:00:08 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 06:00:08 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 06:00:08 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 06:00:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T06:00:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1065521132',display_name='tempest-ServersNegativeTestJSON-server-1065521132',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1065521132',id=49,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a94181609a284eb29f8db71cf34c086b',ramdisk_id='',reservation_id='r-m7hd11rl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1203747242',owner_user_name='tempest-ServersNegativeTestJSON-1203747242-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:00:06Z,user_data=None,user_id='a8a6d1c3cc9d46c98e43e9c8c9caabb5',uuid=a7144a2f-78f6-48aa-9801-5c00b0171414,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7fd5b250-a86e-421a-9daf-73c948b63644", "address": "fa:16:3e:50:18:55", "network": {"id": "8e7b9da2-83d1-47d1-a352-a9684e3a2cdf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1697315681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a94181609a284eb29f8db71cf34c086b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fd5b250-a8", "ovs_interfaceid": "7fd5b250-a86e-421a-9daf-73c948b63644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 06:00:08 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Converting VIF {"id": "7fd5b250-a86e-421a-9daf-73c948b63644", "address": "fa:16:3e:50:18:55", "network": {"id": "8e7b9da2-83d1-47d1-a352-a9684e3a2cdf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1697315681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a94181609a284eb29f8db71cf34c086b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fd5b250-a8", "ovs_interfaceid": "7fd5b250-a86e-421a-9daf-73c948b63644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:00:08 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:18:55,bridge_name='br-int',has_traffic_filtering=True,id=7fd5b250-a86e-421a-9daf-73c948b63644,network=Network(8e7b9da2-83d1-47d1-a352-a9684e3a2cdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fd5b250-a8') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:00:08 user nova-compute[73391]: DEBUG nova.objects.instance [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Lazy-loading 'pci_devices' on Instance uuid a7144a2f-78f6-48aa-9801-5c00b0171414 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:00:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] End _get_guest_xml xml=<domain type="kvm">
Aug 15 06:00:08 user nova-compute[73391]:   <uuid>a7144a2f-78f6-48aa-9801-5c00b0171414</uuid>
Aug 15 06:00:08 user nova-compute[73391]:   <name>instance-00000031</name>
Aug 15 06:00:08 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 06:00:08 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 06:00:08 user nova-compute[73391]:   <metadata>
Aug 15 06:00:08 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 06:00:08 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 06:00:08 user nova-compute[73391]:       <nova:name>tempest-ServersNegativeTestJSON-server-1065521132</nova:name>
Aug 15 06:00:08 user nova-compute[73391]:       <nova:creationTime>2023-08-15 06:00:08</nova:creationTime>
Aug 15 06:00:08 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 06:00:08 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 06:00:08 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 06:00:08 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 06:00:08 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 06:00:08 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 06:00:08 user nova-compute[73391]:       </nova:flavor>
Aug 15 06:00:08 user nova-compute[73391]:       <nova:owner>
Aug 15 06:00:08 user nova-compute[73391]:         <nova:user uuid="a8a6d1c3cc9d46c98e43e9c8c9caabb5">tempest-ServersNegativeTestJSON-1203747242-project-member</nova:user>
Aug 15 06:00:08 user nova-compute[73391]:         <nova:project uuid="a94181609a284eb29f8db71cf34c086b">tempest-ServersNegativeTestJSON-1203747242</nova:project>
Aug 15 06:00:08 user nova-compute[73391]:       </nova:owner>
Aug 15 06:00:08 user nova-compute[73391]:       <nova:root type="image" uuid="191b1dad-305e-4d1c-9b15-515ec59a3278"/>
Aug 15 06:00:08 user nova-compute[73391]:       <nova:ports>
Aug 15 06:00:08 user nova-compute[73391]:         <nova:port uuid="7fd5b250-a86e-421a-9daf-73c948b63644">
Aug 15 06:00:08 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 06:00:08 user nova-compute[73391]:         </nova:port>
Aug 15 06:00:08 user nova-compute[73391]:       </nova:ports>
Aug 15 06:00:08 user nova-compute[73391]:     </nova:instance>
Aug 15 06:00:08 user nova-compute[73391]:   </metadata>
Aug 15 06:00:08 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 06:00:08 user nova-compute[73391]:     <system>
Aug 15 06:00:08 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 06:00:08 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 06:00:08 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 06:00:08 user nova-compute[73391]:       <entry name="serial">a7144a2f-78f6-48aa-9801-5c00b0171414</entry>
Aug 15 06:00:08 user nova-compute[73391]:       <entry name="uuid">a7144a2f-78f6-48aa-9801-5c00b0171414</entry>
Aug 15 06:00:08 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 06:00:08 user nova-compute[73391]:     </system>
Aug 15 06:00:08 user nova-compute[73391]:   </sysinfo>
Aug 15 06:00:08 user nova-compute[73391]:   <os>
Aug 15 06:00:08 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 06:00:08 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 06:00:08 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 06:00:08 user nova-compute[73391]:   </os>
Aug 15 06:00:08 user nova-compute[73391]:   <features>
Aug 15 06:00:08 user nova-compute[73391]:     <acpi/>
Aug 15 06:00:08 user nova-compute[73391]:     <apic/>
Aug 15 06:00:08 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 06:00:08 user nova-compute[73391]:   </features>
Aug 15 06:00:08 user nova-compute[73391]:   <clock offset="utc">
Aug 15 06:00:08 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 06:00:08 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 06:00:08 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 06:00:08 user nova-compute[73391]:   </clock>
Aug 15 06:00:08 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 06:00:08 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 06:00:08 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 06:00:08 user nova-compute[73391]:   </cpu>
Aug 15 06:00:08 user nova-compute[73391]:   <devices>
Aug 15 06:00:08 user nova-compute[73391]:     <disk type="file" device="disk">
Aug 15 06:00:08 user nova-compute[73391]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 06:00:08 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/a7144a2f-78f6-48aa-9801-5c00b0171414/disk"/>
Aug 15 06:00:08 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 06:00:08 user nova-compute[73391]:     </disk>
Aug 15 06:00:08 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 06:00:08 user nova-compute[73391]:       <mac address="fa:16:3e:50:18:55"/>
Aug 15 06:00:08 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 06:00:08 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 06:00:08 user nova-compute[73391]:       <target dev="tap7fd5b250-a8"/>
Aug 15 06:00:08 user nova-compute[73391]:     </interface>
Aug 15 06:00:08 user nova-compute[73391]:     <serial type="pty">
Aug 15 06:00:08 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/a7144a2f-78f6-48aa-9801-5c00b0171414/console.log" append="off"/>
Aug 15 06:00:08 user nova-compute[73391]:     </serial>
Aug 15 06:00:08 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 06:00:08 user nova-compute[73391]:     <video>
Aug 15 06:00:08 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 06:00:08 user nova-compute[73391]:     </video>
Aug 15 06:00:08 user nova-compute[73391]:     <rng model="virtio">
Aug 15 06:00:08 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 06:00:08 user nova-compute[73391]:     </rng>
Aug 15 06:00:08 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 06:00:08 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 06:00:08 user nova-compute[73391]:       <stats period="10"/>
Aug 15 06:00:08 user nova-compute[73391]:     </memballoon>
Aug 15 06:00:08 user nova-compute[73391]:   </devices>
Aug 15 06:00:08 user nova-compute[73391]: </domain>
Aug 15 06:00:08 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 06:00:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T06:00:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1065521132',display_name='tempest-ServersNegativeTestJSON-server-1065521132',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1065521132',id=49,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a94181609a284eb29f8db71cf34c086b',ramdisk_id='',reservation_id='r-m7hd11rl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1203747242',owner_user_name='tempest-ServersNegativeTestJSON-1203747242-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:00:06Z,user_data=None,user_id='a8a6d1c3cc9d46c98e43e9c8c9caabb5',uuid=a7144a2f-78f6-48aa-9801-5c00b0171414,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7fd5b250-a86e-421a-9daf-73c948b63644", "address": "fa:16:3e:50:18:55", "network": {"id": "8e7b9da2-83d1-47d1-a352-a9684e3a2cdf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1697315681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a94181609a284eb29f8db71cf34c086b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fd5b250-a8", "ovs_interfaceid": "7fd5b250-a86e-421a-9daf-73c948b63644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 06:00:08 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Converting VIF {"id": "7fd5b250-a86e-421a-9daf-73c948b63644", "address": "fa:16:3e:50:18:55", "network": {"id": "8e7b9da2-83d1-47d1-a352-a9684e3a2cdf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1697315681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a94181609a284eb29f8db71cf34c086b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fd5b250-a8", "ovs_interfaceid": "7fd5b250-a86e-421a-9daf-73c948b63644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:00:08 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:18:55,bridge_name='br-int',has_traffic_filtering=True,id=7fd5b250-a86e-421a-9daf-73c948b63644,network=Network(8e7b9da2-83d1-47d1-a352-a9684e3a2cdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fd5b250-a8') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:00:08 user nova-compute[73391]: DEBUG os_vif [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:18:55,bridge_name='br-int',has_traffic_filtering=True,id=7fd5b250-a86e-421a-9daf-73c948b63644,network=Network(8e7b9da2-83d1-47d1-a352-a9684e3a2cdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fd5b250-a8') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 06:00:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:00:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:00:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 06:00:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:00:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7fd5b250-a8, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:00:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7fd5b250-a8, col_values=(('external_ids', {'iface-id': '7fd5b250-a86e-421a-9daf-73c948b63644', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:18:55', 'vm-uuid': 'a7144a2f-78f6-48aa-9801-5c00b0171414'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:00:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:00:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:00:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:00:08 user nova-compute[73391]: INFO os_vif [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:18:55,bridge_name='br-int',has_traffic_filtering=True,id=7fd5b250-a86e-421a-9daf-73c948b63644,network=Network(8e7b9da2-83d1-47d1-a352-a9684e3a2cdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fd5b250-a8')
Aug 15 06:00:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 06:00:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] No VIF found with MAC fa:16:3e:50:18:55, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 06:00:08 user nova-compute[73391]: DEBUG nova.network.neutron [req-b9cfe82a-cc38-4bae-a750-86f144a4591b req-cae3d948-89e4-4503-ae4e-e4a21a867c7e service nova] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Updated VIF entry in instance network info cache for port 7fd5b250-a86e-421a-9daf-73c948b63644. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 06:00:08 user nova-compute[73391]: DEBUG nova.network.neutron [req-b9cfe82a-cc38-4bae-a750-86f144a4591b req-cae3d948-89e4-4503-ae4e-e4a21a867c7e service nova] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Updating instance_info_cache with network_info: [{"id": "7fd5b250-a86e-421a-9daf-73c948b63644", "address": "fa:16:3e:50:18:55", "network": {"id": "8e7b9da2-83d1-47d1-a352-a9684e3a2cdf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1697315681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a94181609a284eb29f8db71cf34c086b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fd5b250-a8", "ovs_interfaceid": "7fd5b250-a86e-421a-9daf-73c948b63644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:00:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-b9cfe82a-cc38-4bae-a750-86f144a4591b req-cae3d948-89e4-4503-ae4e-e4a21a867c7e service nova] Releasing lock "refresh_cache-a7144a2f-78f6-48aa-9801-5c00b0171414" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:00:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:00:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:00:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:00:10 user nova-compute[73391]: DEBUG nova.compute.manager [req-8901f1ee-77d0-48b4-a2bd-d81dd0b7f66c req-49118faa-57b6-4c15-aca7-bbd533c3e370 service nova] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Received event network-vif-plugged-7fd5b250-a86e-421a-9daf-73c948b63644 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:00:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-8901f1ee-77d0-48b4-a2bd-d81dd0b7f66c req-49118faa-57b6-4c15-aca7-bbd533c3e370 service nova] Acquiring lock "a7144a2f-78f6-48aa-9801-5c00b0171414-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:00:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-8901f1ee-77d0-48b4-a2bd-d81dd0b7f66c req-49118faa-57b6-4c15-aca7-bbd533c3e370 service nova] Lock "a7144a2f-78f6-48aa-9801-5c00b0171414-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:00:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-8901f1ee-77d0-48b4-a2bd-d81dd0b7f66c req-49118faa-57b6-4c15-aca7-bbd533c3e370 service nova] Lock "a7144a2f-78f6-48aa-9801-5c00b0171414-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:00:10 user nova-compute[73391]: DEBUG nova.compute.manager [req-8901f1ee-77d0-48b4-a2bd-d81dd0b7f66c req-49118faa-57b6-4c15-aca7-bbd533c3e370 service nova] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] No waiting events found dispatching network-vif-plugged-7fd5b250-a86e-421a-9daf-73c948b63644 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:00:10 user nova-compute[73391]: WARNING nova.compute.manager [req-8901f1ee-77d0-48b4-a2bd-d81dd0b7f66c req-49118faa-57b6-4c15-aca7-bbd533c3e370 service nova] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Received unexpected event network-vif-plugged-7fd5b250-a86e-421a-9daf-73c948b63644 for instance with vm_state building and task_state spawning.
Aug 15 06:00:11 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692079211.8286264, a7144a2f-78f6-48aa-9801-5c00b0171414 => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:00:11 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] VM Resumed (Lifecycle Event)
Aug 15 06:00:11 user nova-compute[73391]: DEBUG nova.compute.manager [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 06:00:11 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Guest created on hypervisor {{(pid=73391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 06:00:11 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Instance spawned successfully.
Aug 15 06:00:11 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 06:00:11 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:00:11 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 06:00:11 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Found default for hw_cdrom_bus of ide {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:00:11 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Found default for hw_disk_bus of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:00:11 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Found default for hw_input_bus of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:00:11 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Found default for hw_pointer_model of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:00:11 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Found default for hw_video_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:00:11 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Found default for hw_vif_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:00:11 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 06:00:11 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692079211.8297727, a7144a2f-78f6-48aa-9801-5c00b0171414 => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:00:11 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] VM Started (Lifecycle Event)
Aug 15 06:00:11 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:00:11 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 06:00:11 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 06:00:11 user nova-compute[73391]: INFO nova.compute.manager [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Took 5.49 seconds to spawn the instance on the hypervisor.
Aug 15 06:00:11 user nova-compute[73391]: DEBUG nova.compute.manager [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:00:12 user nova-compute[73391]: INFO nova.compute.manager [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Took 6.01 seconds to build instance.
Aug 15 06:00:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0947c0e0-019c-4bcc-83a1-eea9cb2ed5a8 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Lock "a7144a2f-78f6-48aa-9801-5c00b0171414" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.108s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:00:12 user nova-compute[73391]: DEBUG nova.compute.manager [req-41c4b813-e3ca-4bd2-932f-91a4ea3b3737 req-5cf4ccc2-1cc4-4f27-9331-ceacc9366431 service nova] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Received event network-vif-plugged-7fd5b250-a86e-421a-9daf-73c948b63644 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:00:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-41c4b813-e3ca-4bd2-932f-91a4ea3b3737 req-5cf4ccc2-1cc4-4f27-9331-ceacc9366431 service nova] Acquiring lock "a7144a2f-78f6-48aa-9801-5c00b0171414-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:00:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-41c4b813-e3ca-4bd2-932f-91a4ea3b3737 req-5cf4ccc2-1cc4-4f27-9331-ceacc9366431 service nova] Lock "a7144a2f-78f6-48aa-9801-5c00b0171414-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:00:12 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-41c4b813-e3ca-4bd2-932f-91a4ea3b3737 req-5cf4ccc2-1cc4-4f27-9331-ceacc9366431 service nova] Lock "a7144a2f-78f6-48aa-9801-5c00b0171414-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:00:12 user nova-compute[73391]: DEBUG nova.compute.manager [req-41c4b813-e3ca-4bd2-932f-91a4ea3b3737 req-5cf4ccc2-1cc4-4f27-9331-ceacc9366431 service nova] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] No waiting events found dispatching network-vif-plugged-7fd5b250-a86e-421a-9daf-73c948b63644 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:00:12 user nova-compute[73391]: WARNING nova.compute.manager [req-41c4b813-e3ca-4bd2-932f-91a4ea3b3737 req-5cf4ccc2-1cc4-4f27-9331-ceacc9366431 service nova] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Received unexpected event network-vif-plugged-7fd5b250-a86e-421a-9daf-73c948b63644 for instance with vm_state active and task_state None.
Aug 15 06:00:13 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:00:15 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:00:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:00:23 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:00:25 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:00:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:00:28 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:00:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:00:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:00:28 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:00:28 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Auditing locally available compute resources for user (node: user) {{(pid=73391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 06:00:28 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595be11c-24db-43eb-9d5b-56cbeefd6149/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:00:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595be11c-24db-43eb-9d5b-56cbeefd6149/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:00:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595be11c-24db-43eb-9d5b-56cbeefd6149/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:00:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595be11c-24db-43eb-9d5b-56cbeefd6149/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:00:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d10508dd-f3f7-4e96-b822-d331ded6809f/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:00:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d10508dd-f3f7-4e96-b822-d331ded6809f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:00:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d10508dd-f3f7-4e96-b822-d331ded6809f/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:00:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d10508dd-f3f7-4e96-b822-d331ded6809f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:00:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7144a2f-78f6-48aa-9801-5c00b0171414/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:00:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7144a2f-78f6-48aa-9801-5c00b0171414/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:00:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7144a2f-78f6-48aa-9801-5c00b0171414/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:00:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7144a2f-78f6-48aa-9801-5c00b0171414/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:00:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:00:30 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:00:30 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:00:30 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Hypervisor/Node resource view: name=user free_ram=8442MB free_disk=25.036460876464844GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 06:00:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:00:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:00:30 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance d10508dd-f3f7-4e96-b822-d331ded6809f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:00:30 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 595be11c-24db-43eb-9d5b-56cbeefd6149 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:00:30 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance a7144a2f-78f6-48aa-9801-5c00b0171414 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:00:30 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 06:00:30 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 06:00:30 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:00:30 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:00:30 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Compute_service record updated for user:user {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 06:00:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.373s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:00:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:00:33 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:00:33 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:00:33 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:00:33 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Cleaning up deleted instances {{(pid=73391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 06:00:33 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] There are 0 instances to clean {{(pid=73391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 06:00:34 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:00:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:00:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Acquiring lock "6d01f99d-fbd3-475e-93ac-3c39e6ca5980" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:00:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "6d01f99d-fbd3-475e-93ac-3c39e6ca5980" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:00:35 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Starting instance... {{(pid=73391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 06:00:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:00:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:00:35 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 06:00:35 user nova-compute[73391]: INFO nova.compute.claims [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Claim successful on node user
Aug 15 06:00:35 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:00:35 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:00:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.259s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:00:35 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Start building networks asynchronously for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 06:00:35 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Allocating IP information in the background. {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 06:00:35 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] allocate_for_instance() {{(pid=73391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 06:00:35 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 06:00:35 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Start building block device mappings for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 06:00:35 user nova-compute[73391]: DEBUG nova.policy [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9552a83a6a214c149ddceac64ccbdef6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8086add121594fe8a0bdde99dd9cae90', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73391) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 06:00:36 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Start spawning the instance on the hypervisor. {{(pid=73391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 06:00:36 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Creating instance directory {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 06:00:36 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Creating image(s)
Aug 15 06:00:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Acquiring lock "/opt/stack/data/nova/instances/6d01f99d-fbd3-475e-93ac-3c39e6ca5980/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:00:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "/opt/stack/data/nova/instances/6d01f99d-fbd3-475e-93ac-3c39e6ca5980/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:00:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "/opt/stack/data/nova/instances/6d01f99d-fbd3-475e-93ac-3c39e6ca5980/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:00:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:00:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.172s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:00:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Acquiring lock "999b315ba87151d8252d543312ae7790e7e1583b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:00:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:00:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:00:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.174s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:00:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/6d01f99d-fbd3-475e-93ac-3c39e6ca5980/disk 1073741824 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:00:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/6d01f99d-fbd3-475e-93ac-3c39e6ca5980/disk 1073741824" returned: 0 in 0.049s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:00:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:00:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:00:36 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Successfully created port: 528573da-c249-4b80-af98-00d6da4fd06b {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 06:00:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.176s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:00:36 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6d01f99d-fbd3-475e-93ac-3c39e6ca5980/disk. size=1073741824 {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 06:00:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d01f99d-fbd3-475e-93ac-3c39e6ca5980/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:00:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d01f99d-fbd3-475e-93ac-3c39e6ca5980/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:00:36 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Cannot resize image /opt/stack/data/nova/instances/6d01f99d-fbd3-475e-93ac-3c39e6ca5980/disk to a smaller size. {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 06:00:36 user nova-compute[73391]: DEBUG nova.objects.instance [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lazy-loading 'migration_context' on Instance uuid 6d01f99d-fbd3-475e-93ac-3c39e6ca5980 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:00:36 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Created local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 06:00:36 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Ensure instance console log exists: /opt/stack/data/nova/instances/6d01f99d-fbd3-475e-93ac-3c39e6ca5980/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 06:00:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:00:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:00:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:00:37 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Successfully updated port: 528573da-c249-4b80-af98-00d6da4fd06b {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 06:00:37 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Acquiring lock "refresh_cache-6d01f99d-fbd3-475e-93ac-3c39e6ca5980" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:00:37 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Acquired lock "refresh_cache-6d01f99d-fbd3-475e-93ac-3c39e6ca5980" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:00:37 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 06:00:37 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 06:00:37 user nova-compute[73391]: DEBUG nova.compute.manager [req-5dc69ee4-d9bd-4eb0-a358-44898ca5214e req-c7d55f34-aff1-437c-8d01-1bfbb697e7d2 service nova] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Received event network-changed-528573da-c249-4b80-af98-00d6da4fd06b {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:00:37 user nova-compute[73391]: DEBUG nova.compute.manager [req-5dc69ee4-d9bd-4eb0-a358-44898ca5214e req-c7d55f34-aff1-437c-8d01-1bfbb697e7d2 service nova] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Refreshing instance network info cache due to event network-changed-528573da-c249-4b80-af98-00d6da4fd06b. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 06:00:37 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-5dc69ee4-d9bd-4eb0-a358-44898ca5214e req-c7d55f34-aff1-437c-8d01-1bfbb697e7d2 service nova] Acquiring lock "refresh_cache-6d01f99d-fbd3-475e-93ac-3c39e6ca5980" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:00:37 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Updating instance_info_cache with network_info: [{"id": "528573da-c249-4b80-af98-00d6da4fd06b", "address": "fa:16:3e:78:7a:a7", "network": {"id": "bc2718a2-a5ab-44e0-966d-9b180a30ac75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1022668030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8086add121594fe8a0bdde99dd9cae90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap528573da-c2", "ovs_interfaceid": "528573da-c249-4b80-af98-00d6da4fd06b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:00:37 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Releasing lock "refresh_cache-6d01f99d-fbd3-475e-93ac-3c39e6ca5980" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:00:37 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Instance network_info: |[{"id": "528573da-c249-4b80-af98-00d6da4fd06b", "address": "fa:16:3e:78:7a:a7", "network": {"id": "bc2718a2-a5ab-44e0-966d-9b180a30ac75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1022668030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8086add121594fe8a0bdde99dd9cae90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap528573da-c2", "ovs_interfaceid": "528573da-c249-4b80-af98-00d6da4fd06b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 06:00:37 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-5dc69ee4-d9bd-4eb0-a358-44898ca5214e req-c7d55f34-aff1-437c-8d01-1bfbb697e7d2 service nova] Acquired lock "refresh_cache-6d01f99d-fbd3-475e-93ac-3c39e6ca5980" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:00:37 user nova-compute[73391]: DEBUG nova.network.neutron [req-5dc69ee4-d9bd-4eb0-a358-44898ca5214e req-c7d55f34-aff1-437c-8d01-1bfbb697e7d2 service nova] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Refreshing network info cache for port 528573da-c249-4b80-af98-00d6da4fd06b {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 06:00:37 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:00:37 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Start _get_guest_xml network_info=[{"id": "528573da-c249-4b80-af98-00d6da4fd06b", "address": "fa:16:3e:78:7a:a7", "network": {"id": "bc2718a2-a5ab-44e0-966d-9b180a30ac75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1022668030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8086add121594fe8a0bdde99dd9cae90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap528573da-c2", "ovs_interfaceid": "528573da-c249-4b80-af98-00d6da4fd06b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '191b1dad-305e-4d1c-9b15-515ec59a3278'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 06:00:37 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:00:37 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:00:37 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 06:00:37 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 06:00:37 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 06:00:37 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 06:00:37 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 06:00:37 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 06:00:37 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 06:00:37 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 06:00:37 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 06:00:37 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 06:00:37 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 06:00:37 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 06:00:37 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 06:00:37 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 06:00:37 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 06:00:37 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 06:00:37 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T06:00:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-938062758',display_name='tempest-AttachVolumeNegativeTest-server-938062758',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-938062758',id=50,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBynwDX0Mi5yHH8aBsBXNm2jC9PL46Xr++z/8yeggazai7Q30Ay5pATWHj/uKDXViL9OKj6rQ2chw6a751ZCk0MMETrgE5ZhKBglST8vTxAcZSkRYyk/bLA46YnKKDQupw==',key_name='tempest-keypair-1250796984',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8086add121594fe8a0bdde99dd9cae90',ramdisk_id='',reservation_id='r-6fmq3j82',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1479702824',owner_user_name='tempest-AttachVolumeNegativeTest-1479702824-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:00:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9552a83a6a214c149ddceac64ccbdef6',uuid=6d01f99d-fbd3-475e-93ac-3c39e6ca5980,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "528573da-c249-4b80-af98-00d6da4fd06b", "address": "fa:16:3e:78:7a:a7", "network": {"id": "bc2718a2-a5ab-44e0-966d-9b180a30ac75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1022668030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8086add121594fe8a0bdde99dd9cae90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap528573da-c2", "ovs_interfaceid": "528573da-c249-4b80-af98-00d6da4fd06b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 06:00:37 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Converting VIF {"id": "528573da-c249-4b80-af98-00d6da4fd06b", "address": "fa:16:3e:78:7a:a7", "network": {"id": "bc2718a2-a5ab-44e0-966d-9b180a30ac75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1022668030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8086add121594fe8a0bdde99dd9cae90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap528573da-c2", "ovs_interfaceid": "528573da-c249-4b80-af98-00d6da4fd06b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:00:37 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:7a:a7,bridge_name='br-int',has_traffic_filtering=True,id=528573da-c249-4b80-af98-00d6da4fd06b,network=Network(bc2718a2-a5ab-44e0-966d-9b180a30ac75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap528573da-c2') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:00:37 user nova-compute[73391]: DEBUG nova.objects.instance [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lazy-loading 'pci_devices' on Instance uuid 6d01f99d-fbd3-475e-93ac-3c39e6ca5980 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:00:37 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] End _get_guest_xml xml=<domain type="kvm">
Aug 15 06:00:37 user nova-compute[73391]:   <uuid>6d01f99d-fbd3-475e-93ac-3c39e6ca5980</uuid>
Aug 15 06:00:37 user nova-compute[73391]:   <name>instance-00000032</name>
Aug 15 06:00:37 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 06:00:37 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 06:00:37 user nova-compute[73391]:   <metadata>
Aug 15 06:00:37 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 06:00:37 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 06:00:37 user nova-compute[73391]:       <nova:name>tempest-AttachVolumeNegativeTest-server-938062758</nova:name>
Aug 15 06:00:37 user nova-compute[73391]:       <nova:creationTime>2023-08-15 06:00:37</nova:creationTime>
Aug 15 06:00:37 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 06:00:37 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 06:00:37 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 06:00:37 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 06:00:37 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 06:00:37 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 06:00:37 user nova-compute[73391]:       </nova:flavor>
Aug 15 06:00:37 user nova-compute[73391]:       <nova:owner>
Aug 15 06:00:37 user nova-compute[73391]:         <nova:user uuid="9552a83a6a214c149ddceac64ccbdef6">tempest-AttachVolumeNegativeTest-1479702824-project-member</nova:user>
Aug 15 06:00:37 user nova-compute[73391]:         <nova:project uuid="8086add121594fe8a0bdde99dd9cae90">tempest-AttachVolumeNegativeTest-1479702824</nova:project>
Aug 15 06:00:37 user nova-compute[73391]:       </nova:owner>
Aug 15 06:00:37 user nova-compute[73391]:       <nova:root type="image" uuid="191b1dad-305e-4d1c-9b15-515ec59a3278"/>
Aug 15 06:00:37 user nova-compute[73391]:       <nova:ports>
Aug 15 06:00:37 user nova-compute[73391]:         <nova:port uuid="528573da-c249-4b80-af98-00d6da4fd06b">
Aug 15 06:00:37 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Aug 15 06:00:37 user nova-compute[73391]:         </nova:port>
Aug 15 06:00:37 user nova-compute[73391]:       </nova:ports>
Aug 15 06:00:37 user nova-compute[73391]:     </nova:instance>
Aug 15 06:00:37 user nova-compute[73391]:   </metadata>
Aug 15 06:00:37 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 06:00:37 user nova-compute[73391]:     <system>
Aug 15 06:00:37 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 06:00:37 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 06:00:37 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 06:00:37 user nova-compute[73391]:       <entry name="serial">6d01f99d-fbd3-475e-93ac-3c39e6ca5980</entry>
Aug 15 06:00:37 user nova-compute[73391]:       <entry name="uuid">6d01f99d-fbd3-475e-93ac-3c39e6ca5980</entry>
Aug 15 06:00:37 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 06:00:37 user nova-compute[73391]:     </system>
Aug 15 06:00:37 user nova-compute[73391]:   </sysinfo>
Aug 15 06:00:37 user nova-compute[73391]:   <os>
Aug 15 06:00:37 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 06:00:37 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 06:00:37 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 06:00:37 user nova-compute[73391]:   </os>
Aug 15 06:00:37 user nova-compute[73391]:   <features>
Aug 15 06:00:37 user nova-compute[73391]:     <acpi/>
Aug 15 06:00:37 user nova-compute[73391]:     <apic/>
Aug 15 06:00:37 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 06:00:37 user nova-compute[73391]:   </features>
Aug 15 06:00:37 user nova-compute[73391]:   <clock offset="utc">
Aug 15 06:00:37 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 06:00:37 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 06:00:37 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 06:00:37 user nova-compute[73391]:   </clock>
Aug 15 06:00:37 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 06:00:37 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 06:00:37 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 06:00:37 user nova-compute[73391]:   </cpu>
Aug 15 06:00:37 user nova-compute[73391]:   <devices>
Aug 15 06:00:37 user nova-compute[73391]:     <disk type="file" device="disk">
Aug 15 06:00:37 user nova-compute[73391]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 06:00:37 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/6d01f99d-fbd3-475e-93ac-3c39e6ca5980/disk"/>
Aug 15 06:00:37 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 06:00:37 user nova-compute[73391]:     </disk>
Aug 15 06:00:37 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 06:00:37 user nova-compute[73391]:       <mac address="fa:16:3e:78:7a:a7"/>
Aug 15 06:00:37 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 06:00:37 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 06:00:37 user nova-compute[73391]:       <target dev="tap528573da-c2"/>
Aug 15 06:00:37 user nova-compute[73391]:     </interface>
Aug 15 06:00:37 user nova-compute[73391]:     <serial type="pty">
Aug 15 06:00:37 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/6d01f99d-fbd3-475e-93ac-3c39e6ca5980/console.log" append="off"/>
Aug 15 06:00:37 user nova-compute[73391]:     </serial>
Aug 15 06:00:37 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 06:00:37 user nova-compute[73391]:     <video>
Aug 15 06:00:37 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 06:00:37 user nova-compute[73391]:     </video>
Aug 15 06:00:37 user nova-compute[73391]:     <rng model="virtio">
Aug 15 06:00:37 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 06:00:37 user nova-compute[73391]:     </rng>
Aug 15 06:00:37 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 06:00:37 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 06:00:37 user nova-compute[73391]:       <stats period="10"/>
Aug 15 06:00:37 user nova-compute[73391]:     </memballoon>
Aug 15 06:00:37 user nova-compute[73391]:   </devices>
Aug 15 06:00:37 user nova-compute[73391]: </domain>
Aug 15 06:00:37 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 06:00:37 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T06:00:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-938062758',display_name='tempest-AttachVolumeNegativeTest-server-938062758',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-938062758',id=50,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBynwDX0Mi5yHH8aBsBXNm2jC9PL46Xr++z/8yeggazai7Q30Ay5pATWHj/uKDXViL9OKj6rQ2chw6a751ZCk0MMETrgE5ZhKBglST8vTxAcZSkRYyk/bLA46YnKKDQupw==',key_name='tempest-keypair-1250796984',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8086add121594fe8a0bdde99dd9cae90',ramdisk_id='',reservation_id='r-6fmq3j82',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1479702824',owner_user_name='tempest-AttachVolumeNegativeTest-1479702824-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:00:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9552a83a6a214c149ddceac64ccbdef6',uuid=6d01f99d-fbd3-475e-93ac-3c39e6ca5980,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "528573da-c249-4b80-af98-00d6da4fd06b", "address": "fa:16:3e:78:7a:a7", "network": {"id": "bc2718a2-a5ab-44e0-966d-9b180a30ac75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1022668030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8086add121594fe8a0bdde99dd9cae90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap528573da-c2", "ovs_interfaceid": "528573da-c249-4b80-af98-00d6da4fd06b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 06:00:37 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Converting VIF {"id": "528573da-c249-4b80-af98-00d6da4fd06b", "address": "fa:16:3e:78:7a:a7", "network": {"id": "bc2718a2-a5ab-44e0-966d-9b180a30ac75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1022668030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8086add121594fe8a0bdde99dd9cae90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap528573da-c2", "ovs_interfaceid": "528573da-c249-4b80-af98-00d6da4fd06b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:00:37 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:7a:a7,bridge_name='br-int',has_traffic_filtering=True,id=528573da-c249-4b80-af98-00d6da4fd06b,network=Network(bc2718a2-a5ab-44e0-966d-9b180a30ac75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap528573da-c2') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:00:37 user nova-compute[73391]: DEBUG os_vif [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:7a:a7,bridge_name='br-int',has_traffic_filtering=True,id=528573da-c249-4b80-af98-00d6da4fd06b,network=Network(bc2718a2-a5ab-44e0-966d-9b180a30ac75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap528573da-c2') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 06:00:37 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:00:37 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:00:37 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 06:00:37 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:00:37 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap528573da-c2, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:00:37 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap528573da-c2, col_values=(('external_ids', {'iface-id': '528573da-c249-4b80-af98-00d6da4fd06b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:7a:a7', 'vm-uuid': '6d01f99d-fbd3-475e-93ac-3c39e6ca5980'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:00:37 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:00:37 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:00:37 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:00:37 user nova-compute[73391]: INFO os_vif [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:7a:a7,bridge_name='br-int',has_traffic_filtering=True,id=528573da-c249-4b80-af98-00d6da4fd06b,network=Network(bc2718a2-a5ab-44e0-966d-9b180a30ac75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap528573da-c2')
Aug 15 06:00:37 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 06:00:37 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] No VIF found with MAC fa:16:3e:78:7a:a7, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 06:00:38 user nova-compute[73391]: DEBUG nova.network.neutron [req-5dc69ee4-d9bd-4eb0-a358-44898ca5214e req-c7d55f34-aff1-437c-8d01-1bfbb697e7d2 service nova] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Updated VIF entry in instance network info cache for port 528573da-c249-4b80-af98-00d6da4fd06b. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 06:00:38 user nova-compute[73391]: DEBUG nova.network.neutron [req-5dc69ee4-d9bd-4eb0-a358-44898ca5214e req-c7d55f34-aff1-437c-8d01-1bfbb697e7d2 service nova] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Updating instance_info_cache with network_info: [{"id": "528573da-c249-4b80-af98-00d6da4fd06b", "address": "fa:16:3e:78:7a:a7", "network": {"id": "bc2718a2-a5ab-44e0-966d-9b180a30ac75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1022668030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8086add121594fe8a0bdde99dd9cae90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap528573da-c2", "ovs_interfaceid": "528573da-c249-4b80-af98-00d6da4fd06b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:00:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-5dc69ee4-d9bd-4eb0-a358-44898ca5214e req-c7d55f34-aff1-437c-8d01-1bfbb697e7d2 service nova] Releasing lock "refresh_cache-6d01f99d-fbd3-475e-93ac-3c39e6ca5980" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:00:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:00:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:00:39 user nova-compute[73391]: DEBUG nova.compute.manager [req-86c7ec08-3393-4233-afcf-3476b77f388d req-94ed0655-7376-4ffe-8191-5fd1ffe3c2e2 service nova] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Received event network-vif-plugged-528573da-c249-4b80-af98-00d6da4fd06b {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:00:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-86c7ec08-3393-4233-afcf-3476b77f388d req-94ed0655-7376-4ffe-8191-5fd1ffe3c2e2 service nova] Acquiring lock "6d01f99d-fbd3-475e-93ac-3c39e6ca5980-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:00:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-86c7ec08-3393-4233-afcf-3476b77f388d req-94ed0655-7376-4ffe-8191-5fd1ffe3c2e2 service nova] Lock "6d01f99d-fbd3-475e-93ac-3c39e6ca5980-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:00:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-86c7ec08-3393-4233-afcf-3476b77f388d req-94ed0655-7376-4ffe-8191-5fd1ffe3c2e2 service nova] Lock "6d01f99d-fbd3-475e-93ac-3c39e6ca5980-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:00:39 user nova-compute[73391]: DEBUG nova.compute.manager [req-86c7ec08-3393-4233-afcf-3476b77f388d req-94ed0655-7376-4ffe-8191-5fd1ffe3c2e2 service nova] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] No waiting events found dispatching network-vif-plugged-528573da-c249-4b80-af98-00d6da4fd06b {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:00:39 user nova-compute[73391]: WARNING nova.compute.manager [req-86c7ec08-3393-4233-afcf-3476b77f388d req-94ed0655-7376-4ffe-8191-5fd1ffe3c2e2 service nova] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Received unexpected event network-vif-plugged-528573da-c249-4b80-af98-00d6da4fd06b for instance with vm_state building and task_state spawning.
Aug 15 06:00:39 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:00:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:00:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:00:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:00:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:00:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:00:40 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:00:40 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Starting heal instance info cache {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 06:00:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "refresh_cache-595be11c-24db-43eb-9d5b-56cbeefd6149" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:00:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquired lock "refresh_cache-595be11c-24db-43eb-9d5b-56cbeefd6149" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:00:40 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Forcefully refreshing network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 06:00:41 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Updating instance_info_cache with network_info: [{"id": "3418de64-8dbd-4951-aca0-0dc87257dbcb", "address": "fa:16:3e:05:b7:5b", "network": {"id": "8e7b9da2-83d1-47d1-a352-a9684e3a2cdf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1697315681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a94181609a284eb29f8db71cf34c086b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3418de64-8d", "ovs_interfaceid": "3418de64-8dbd-4951-aca0-0dc87257dbcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:00:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Releasing lock "refresh_cache-595be11c-24db-43eb-9d5b-56cbeefd6149" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:00:41 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Updated the network info_cache for instance {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 06:00:41 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692079241.2894728, 6d01f99d-fbd3-475e-93ac-3c39e6ca5980 => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:00:41 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] VM Resumed (Lifecycle Event)
Aug 15 06:00:41 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 06:00:41 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Guest created on hypervisor {{(pid=73391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 06:00:41 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Instance spawned successfully.
Aug 15 06:00:41 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 06:00:41 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:00:41 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 06:00:41 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Found default for hw_cdrom_bus of ide {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:00:41 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Found default for hw_disk_bus of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:00:41 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Found default for hw_input_bus of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:00:41 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Found default for hw_pointer_model of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:00:41 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Found default for hw_video_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:00:41 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Found default for hw_vif_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:00:41 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 06:00:41 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692079241.2909977, 6d01f99d-fbd3-475e-93ac-3c39e6ca5980 => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:00:41 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] VM Started (Lifecycle Event)
Aug 15 06:00:41 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:00:41 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 06:00:41 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 06:00:41 user nova-compute[73391]: INFO nova.compute.manager [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Took 5.34 seconds to spawn the instance on the hypervisor.
Aug 15 06:00:41 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:00:41 user nova-compute[73391]: DEBUG nova.compute.manager [req-87f92772-a49c-49c7-b1ba-21cdc221a09c req-fe8c741e-a1f5-42db-a510-c22b32fe8d64 service nova] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Received event network-vif-plugged-528573da-c249-4b80-af98-00d6da4fd06b {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:00:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-87f92772-a49c-49c7-b1ba-21cdc221a09c req-fe8c741e-a1f5-42db-a510-c22b32fe8d64 service nova] Acquiring lock "6d01f99d-fbd3-475e-93ac-3c39e6ca5980-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:00:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-87f92772-a49c-49c7-b1ba-21cdc221a09c req-fe8c741e-a1f5-42db-a510-c22b32fe8d64 service nova] Lock "6d01f99d-fbd3-475e-93ac-3c39e6ca5980-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:00:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-87f92772-a49c-49c7-b1ba-21cdc221a09c req-fe8c741e-a1f5-42db-a510-c22b32fe8d64 service nova] Lock "6d01f99d-fbd3-475e-93ac-3c39e6ca5980-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:00:41 user nova-compute[73391]: DEBUG nova.compute.manager [req-87f92772-a49c-49c7-b1ba-21cdc221a09c req-fe8c741e-a1f5-42db-a510-c22b32fe8d64 service nova] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] No waiting events found dispatching network-vif-plugged-528573da-c249-4b80-af98-00d6da4fd06b {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:00:41 user nova-compute[73391]: WARNING nova.compute.manager [req-87f92772-a49c-49c7-b1ba-21cdc221a09c req-fe8c741e-a1f5-42db-a510-c22b32fe8d64 service nova] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Received unexpected event network-vif-plugged-528573da-c249-4b80-af98-00d6da4fd06b for instance with vm_state building and task_state spawning.
Aug 15 06:00:41 user nova-compute[73391]: INFO nova.compute.manager [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Took 5.96 seconds to build instance.
Aug 15 06:00:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3f65f0bc-5a04-430c-b022-f12512647003 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "6d01f99d-fbd3-475e-93ac-3c39e6ca5980" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.054s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:00:42 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:00:43 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:00:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:00:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3ac4910f-5c5e-4d56-9d19-16f787ae4d5e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Acquiring lock "d10508dd-f3f7-4e96-b822-d331ded6809f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:00:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3ac4910f-5c5e-4d56-9d19-16f787ae4d5e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "d10508dd-f3f7-4e96-b822-d331ded6809f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:00:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3ac4910f-5c5e-4d56-9d19-16f787ae4d5e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Acquiring lock "d10508dd-f3f7-4e96-b822-d331ded6809f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:00:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3ac4910f-5c5e-4d56-9d19-16f787ae4d5e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "d10508dd-f3f7-4e96-b822-d331ded6809f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:00:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3ac4910f-5c5e-4d56-9d19-16f787ae4d5e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "d10508dd-f3f7-4e96-b822-d331ded6809f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:00:45 user nova-compute[73391]: INFO nova.compute.manager [None req-3ac4910f-5c5e-4d56-9d19-16f787ae4d5e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Terminating instance
Aug 15 06:00:45 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3ac4910f-5c5e-4d56-9d19-16f787ae4d5e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Start destroying the instance on the hypervisor. {{(pid=73391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 06:00:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:00:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:00:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:00:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:00:45 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:00:45 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 06:00:45 user nova-compute[73391]: DEBUG nova.compute.manager [req-be85da70-56cd-49cf-a828-8d0fc0727c94 req-67556505-107e-4203-b32d-9c57f869c1d2 service nova] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Received event network-vif-unplugged-bad7b5c4-680d-4f22-9fc0-53e0ac551260 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:00:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-be85da70-56cd-49cf-a828-8d0fc0727c94 req-67556505-107e-4203-b32d-9c57f869c1d2 service nova] Acquiring lock "d10508dd-f3f7-4e96-b822-d331ded6809f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:00:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-be85da70-56cd-49cf-a828-8d0fc0727c94 req-67556505-107e-4203-b32d-9c57f869c1d2 service nova] Lock "d10508dd-f3f7-4e96-b822-d331ded6809f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:00:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-be85da70-56cd-49cf-a828-8d0fc0727c94 req-67556505-107e-4203-b32d-9c57f869c1d2 service nova] Lock "d10508dd-f3f7-4e96-b822-d331ded6809f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:00:45 user nova-compute[73391]: DEBUG nova.compute.manager [req-be85da70-56cd-49cf-a828-8d0fc0727c94 req-67556505-107e-4203-b32d-9c57f869c1d2 service nova] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] No waiting events found dispatching network-vif-unplugged-bad7b5c4-680d-4f22-9fc0-53e0ac551260 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:00:45 user nova-compute[73391]: DEBUG nova.compute.manager [req-be85da70-56cd-49cf-a828-8d0fc0727c94 req-67556505-107e-4203-b32d-9c57f869c1d2 service nova] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Received event network-vif-unplugged-bad7b5c4-680d-4f22-9fc0-53e0ac551260 for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 06:00:46 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Instance destroyed successfully.
Aug 15 06:00:46 user nova-compute[73391]: DEBUG nova.objects.instance [None req-3ac4910f-5c5e-4d56-9d19-16f787ae4d5e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lazy-loading 'resources' on Instance uuid d10508dd-f3f7-4e96-b822-d331ded6809f {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:00:46 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-3ac4910f-5c5e-4d56-9d19-16f787ae4d5e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:55:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1638516350',display_name='tempest-TestMinimumBasicScenario-server-1638516350',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1638516350',id=46,image_ref='d9b08b04-9688-4e5e-90eb-5ae0465c6517',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyWsG9ehEQcqlBsyrmyWtybq7vloOElSYR0j7Ou42ASZEw1IFAr5wdOLp6A6sbdR8fm5tdu1cPwGw1di232sVJtsalZJWCrvAInL7ggWTRRw/y74jndzteUjAIxDm/s8Q==',key_name='tempest-TestMinimumBasicScenario-1867600907',keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:55:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cd985a0cd6884c858487187ce252bba5',ramdisk_id='',reservation_id='r-agv6ww0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='d9b08b04-9688-4e5e-90eb-5ae0465c6517',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1535355155',owner_user_name='tempest-TestMinimumBasicScenario-1535355155-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:57:57Z,user_data=None,user_id='db323067fefa4b1f8aa28f10a997b9d4',uuid=d10508dd-f3f7-4e96-b822-d331ded6809f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bad7b5c4-680d-4f22-9fc0-53e0ac551260", "address": "fa:16:3e:91:71:96", "network": {"id": "2a8063f6-42ce-41b8-86f6-72c17f4c2a7b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1765547969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd985a0cd6884c858487187ce252bba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad7b5c4-68", "ovs_interfaceid": "bad7b5c4-680d-4f22-9fc0-53e0ac551260", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 06:00:46 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-3ac4910f-5c5e-4d56-9d19-16f787ae4d5e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Converting VIF {"id": "bad7b5c4-680d-4f22-9fc0-53e0ac551260", "address": "fa:16:3e:91:71:96", "network": {"id": "2a8063f6-42ce-41b8-86f6-72c17f4c2a7b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1765547969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd985a0cd6884c858487187ce252bba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbad7b5c4-68", "ovs_interfaceid": "bad7b5c4-680d-4f22-9fc0-53e0ac551260", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:00:46 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-3ac4910f-5c5e-4d56-9d19-16f787ae4d5e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:91:71:96,bridge_name='br-int',has_traffic_filtering=True,id=bad7b5c4-680d-4f22-9fc0-53e0ac551260,network=Network(2a8063f6-42ce-41b8-86f6-72c17f4c2a7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbad7b5c4-68') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:00:46 user nova-compute[73391]: DEBUG os_vif [None req-3ac4910f-5c5e-4d56-9d19-16f787ae4d5e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:71:96,bridge_name='br-int',has_traffic_filtering=True,id=bad7b5c4-680d-4f22-9fc0-53e0ac551260,network=Network(2a8063f6-42ce-41b8-86f6-72c17f4c2a7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbad7b5c4-68') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 06:00:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:00:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbad7b5c4-68, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:00:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:00:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:00:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:00:46 user nova-compute[73391]: INFO os_vif [None req-3ac4910f-5c5e-4d56-9d19-16f787ae4d5e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:91:71:96,bridge_name='br-int',has_traffic_filtering=True,id=bad7b5c4-680d-4f22-9fc0-53e0ac551260,network=Network(2a8063f6-42ce-41b8-86f6-72c17f4c2a7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbad7b5c4-68')
Aug 15 06:00:46 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-3ac4910f-5c5e-4d56-9d19-16f787ae4d5e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Deleting instance files /opt/stack/data/nova/instances/d10508dd-f3f7-4e96-b822-d331ded6809f_del
Aug 15 06:00:46 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-3ac4910f-5c5e-4d56-9d19-16f787ae4d5e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Deletion of /opt/stack/data/nova/instances/d10508dd-f3f7-4e96-b822-d331ded6809f_del complete
Aug 15 06:00:46 user nova-compute[73391]: INFO nova.compute.manager [None req-3ac4910f-5c5e-4d56-9d19-16f787ae4d5e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Took 0.92 seconds to destroy the instance on the hypervisor.
Aug 15 06:00:46 user nova-compute[73391]: DEBUG oslo.service.loopingcall [None req-3ac4910f-5c5e-4d56-9d19-16f787ae4d5e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 06:00:46 user nova-compute[73391]: DEBUG nova.compute.manager [-] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Deallocating network for instance {{(pid=73391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 06:00:46 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] deallocate_for_instance() {{(pid=73391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 06:00:46 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:00:46 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Took 0.52 seconds to deallocate network for instance.
Aug 15 06:00:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3ac4910f-5c5e-4d56-9d19-16f787ae4d5e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:00:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3ac4910f-5c5e-4d56-9d19-16f787ae4d5e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:00:46 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3ac4910f-5c5e-4d56-9d19-16f787ae4d5e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:00:46 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3ac4910f-5c5e-4d56-9d19-16f787ae4d5e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:00:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3ac4910f-5c5e-4d56-9d19-16f787ae4d5e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.186s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:00:46 user nova-compute[73391]: INFO nova.scheduler.client.report [None req-3ac4910f-5c5e-4d56-9d19-16f787ae4d5e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Deleted allocations for instance d10508dd-f3f7-4e96-b822-d331ded6809f
Aug 15 06:00:47 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3ac4910f-5c5e-4d56-9d19-16f787ae4d5e tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "d10508dd-f3f7-4e96-b822-d331ded6809f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.805s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:00:47 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:00:47 user nova-compute[73391]: DEBUG nova.compute.manager [req-b74d4934-027f-408b-a48b-04e489c4306b req-058b6ff9-7b34-46eb-a356-0f61c19996fe service nova] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Received event network-vif-plugged-bad7b5c4-680d-4f22-9fc0-53e0ac551260 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:00:47 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-b74d4934-027f-408b-a48b-04e489c4306b req-058b6ff9-7b34-46eb-a356-0f61c19996fe service nova] Acquiring lock "d10508dd-f3f7-4e96-b822-d331ded6809f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:00:47 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-b74d4934-027f-408b-a48b-04e489c4306b req-058b6ff9-7b34-46eb-a356-0f61c19996fe service nova] Lock "d10508dd-f3f7-4e96-b822-d331ded6809f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:00:47 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-b74d4934-027f-408b-a48b-04e489c4306b req-058b6ff9-7b34-46eb-a356-0f61c19996fe service nova] Lock "d10508dd-f3f7-4e96-b822-d331ded6809f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:00:47 user nova-compute[73391]: DEBUG nova.compute.manager [req-b74d4934-027f-408b-a48b-04e489c4306b req-058b6ff9-7b34-46eb-a356-0f61c19996fe service nova] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] No waiting events found dispatching network-vif-plugged-bad7b5c4-680d-4f22-9fc0-53e0ac551260 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:00:47 user nova-compute[73391]: WARNING nova.compute.manager [req-b74d4934-027f-408b-a48b-04e489c4306b req-058b6ff9-7b34-46eb-a356-0f61c19996fe service nova] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Received unexpected event network-vif-plugged-bad7b5c4-680d-4f22-9fc0-53e0ac551260 for instance with vm_state deleted and task_state None.
Aug 15 06:00:47 user nova-compute[73391]: DEBUG nova.compute.manager [req-b74d4934-027f-408b-a48b-04e489c4306b req-058b6ff9-7b34-46eb-a356-0f61c19996fe service nova] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Received event network-vif-deleted-bad7b5c4-680d-4f22-9fc0-53e0ac551260 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:00:51 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:00:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:00:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:01:00 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:01:01 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692079246.0781343, d10508dd-f3f7-4e96-b822-d331ded6809f => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:01:01 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] VM Stopped (Lifecycle Event)
Aug 15 06:01:01 user nova-compute[73391]: DEBUG nova.compute.manager [None req-66bf153c-943e-4e94-a057-50132f7fef99 None None] [instance: d10508dd-f3f7-4e96-b822-d331ded6809f] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:01:01 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:01:03 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:01:03 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73391) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 06:01:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:01:06 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:01:10 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:01:11 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:01:16 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:01:16 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:01:16 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:01:16 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:01:16 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:01:16 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:01:21 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:01:26 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:01:26 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:01:26 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:01:26 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:01:26 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:01:26 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:01:29 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:01:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:01:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:01:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:01:29 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Auditing locally available compute resources for user (node: user) {{(pid=73391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 06:01:29 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595be11c-24db-43eb-9d5b-56cbeefd6149/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:01:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595be11c-24db-43eb-9d5b-56cbeefd6149/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:01:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595be11c-24db-43eb-9d5b-56cbeefd6149/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:01:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595be11c-24db-43eb-9d5b-56cbeefd6149/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:01:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d01f99d-fbd3-475e-93ac-3c39e6ca5980/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:01:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d01f99d-fbd3-475e-93ac-3c39e6ca5980/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:01:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d01f99d-fbd3-475e-93ac-3c39e6ca5980/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:01:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d01f99d-fbd3-475e-93ac-3c39e6ca5980/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:01:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7144a2f-78f6-48aa-9801-5c00b0171414/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:01:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7144a2f-78f6-48aa-9801-5c00b0171414/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:01:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7144a2f-78f6-48aa-9801-5c00b0171414/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:01:30 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a7144a2f-78f6-48aa-9801-5c00b0171414/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:01:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:01:31 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:01:31 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:01:31 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Hypervisor/Node resource view: name=user free_ram=8532MB free_disk=25.032878875732422GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 06:01:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:01:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:01:31 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 595be11c-24db-43eb-9d5b-56cbeefd6149 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:01:31 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance a7144a2f-78f6-48aa-9801-5c00b0171414 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:01:31 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 6d01f99d-fbd3-475e-93ac-3c39e6ca5980 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:01:31 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 06:01:31 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 06:01:31 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Refreshing inventories for resource provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 06:01:31 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Updating ProviderTree inventory for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 06:01:31 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Updating inventory in ProviderTree for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 06:01:31 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Refreshing aggregate associations for resource provider 771708bd-6a2a-4e0c-9869-46d45e6b1896, aggregates: None {{(pid=73391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 06:01:31 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Refreshing trait associations for resource provider 771708bd-6a2a-4e0c-9869-46d45e6b1896, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=73391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 06:01:31 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:01:31 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:01:31 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Compute_service record updated for user:user {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 06:01:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.372s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:01:36 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:01:36 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:01:36 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:01:36 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:01:37 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:01:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Acquiring lock "1633a986-77f2-41b2-a436-8c5029d4c7f6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:01:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "1633a986-77f2-41b2-a436-8c5029d4c7f6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:01:39 user nova-compute[73391]: DEBUG nova.compute.manager [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Starting instance... {{(pid=73391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 06:01:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:01:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:01:39 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 06:01:39 user nova-compute[73391]: INFO nova.compute.claims [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Claim successful on node user
Aug 15 06:01:39 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:01:39 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:01:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.235s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:01:39 user nova-compute[73391]: DEBUG nova.compute.manager [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Start building networks asynchronously for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 06:01:39 user nova-compute[73391]: DEBUG nova.compute.manager [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Allocating IP information in the background. {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 06:01:39 user nova-compute[73391]: DEBUG nova.network.neutron [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] allocate_for_instance() {{(pid=73391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 06:01:39 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 06:01:39 user nova-compute[73391]: DEBUG nova.compute.manager [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Start building block device mappings for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 06:01:39 user nova-compute[73391]: DEBUG nova.policy [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'db323067fefa4b1f8aa28f10a997b9d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd985a0cd6884c858487187ce252bba5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73391) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 06:01:39 user nova-compute[73391]: DEBUG nova.compute.manager [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Start spawning the instance on the hypervisor. {{(pid=73391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 06:01:39 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Creating instance directory {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 06:01:39 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Creating image(s)
Aug 15 06:01:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Acquiring lock "/opt/stack/data/nova/instances/1633a986-77f2-41b2-a436-8c5029d4c7f6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:01:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "/opt/stack/data/nova/instances/1633a986-77f2-41b2-a436-8c5029d4c7f6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:01:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "/opt/stack/data/nova/instances/1633a986-77f2-41b2-a436-8c5029d4c7f6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:01:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Acquiring lock "cbee69d9bb3d2af939a422103b0abc1d98d60371" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:01:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "cbee69d9bb3d2af939a422103b0abc1d98d60371" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:01:40 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbee69d9bb3d2af939a422103b0abc1d98d60371.part --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:01:40 user nova-compute[73391]: DEBUG nova.network.neutron [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Successfully created port: 08226f47-93f7-4b29-a752-7e8e37a665f8 {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 06:01:40 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbee69d9bb3d2af939a422103b0abc1d98d60371.part --force-share --output=json" returned: 0 in 0.197s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:01:40 user nova-compute[73391]: DEBUG nova.virt.images [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] 5dcc1e41-6efd-4557-94fe-47a802151660 was qcow2, converting to raw {{(pid=73391) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Aug 15 06:01:40 user nova-compute[73391]: DEBUG nova.privsep.utils [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=73391) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Aug 15 06:01:40 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cbee69d9bb3d2af939a422103b0abc1d98d60371.part /opt/stack/data/nova/instances/_base/cbee69d9bb3d2af939a422103b0abc1d98d60371.converted {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:01:40 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cbee69d9bb3d2af939a422103b0abc1d98d60371.part /opt/stack/data/nova/instances/_base/cbee69d9bb3d2af939a422103b0abc1d98d60371.converted" returned: 0 in 0.297s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:01:40 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbee69d9bb3d2af939a422103b0abc1d98d60371.converted --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:01:40 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbee69d9bb3d2af939a422103b0abc1d98d60371.converted --force-share --output=json" returned: 0 in 0.179s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:01:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "cbee69d9bb3d2af939a422103b0abc1d98d60371" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.192s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:01:40 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbee69d9bb3d2af939a422103b0abc1d98d60371 --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:01:40 user nova-compute[73391]: DEBUG nova.network.neutron [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Successfully updated port: 08226f47-93f7-4b29-a752-7e8e37a665f8 {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Acquiring lock "refresh_cache-1633a986-77f2-41b2-a436-8c5029d4c7f6" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Acquired lock "refresh_cache-1633a986-77f2-41b2-a436-8c5029d4c7f6" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG nova.network.neutron [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbee69d9bb3d2af939a422103b0abc1d98d60371 --force-share --output=json" returned: 0 in 0.188s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Acquiring lock "cbee69d9bb3d2af939a422103b0abc1d98d60371" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "cbee69d9bb3d2af939a422103b0abc1d98d60371" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbee69d9bb3d2af939a422103b0abc1d98d60371 --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG nova.compute.manager [req-90148037-c228-46de-b736-b8d989dcbcb8 req-b68a8855-34d9-4dbd-af88-bc9c727be429 service nova] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Received event network-changed-08226f47-93f7-4b29-a752-7e8e37a665f8 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG nova.compute.manager [req-90148037-c228-46de-b736-b8d989dcbcb8 req-b68a8855-34d9-4dbd-af88-bc9c727be429 service nova] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Refreshing instance network info cache due to event network-changed-08226f47-93f7-4b29-a752-7e8e37a665f8. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-90148037-c228-46de-b736-b8d989dcbcb8 req-b68a8855-34d9-4dbd-af88-bc9c727be429 service nova] Acquiring lock "refresh_cache-1633a986-77f2-41b2-a436-8c5029d4c7f6" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG nova.network.neutron [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbee69d9bb3d2af939a422103b0abc1d98d60371 --force-share --output=json" returned: 0 in 0.173s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbee69d9bb3d2af939a422103b0abc1d98d60371,backing_fmt=raw /opt/stack/data/nova/instances/1633a986-77f2-41b2-a436-8c5029d4c7f6/disk 1073741824 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbee69d9bb3d2af939a422103b0abc1d98d60371,backing_fmt=raw /opt/stack/data/nova/instances/1633a986-77f2-41b2-a436-8c5029d4c7f6/disk 1073741824" returned: 0 in 0.101s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "cbee69d9bb3d2af939a422103b0abc1d98d60371" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbee69d9bb3d2af939a422103b0abc1d98d60371 --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbee69d9bb3d2af939a422103b0abc1d98d60371 --force-share --output=json" returned: 0 in 0.173s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1633a986-77f2-41b2-a436-8c5029d4c7f6/disk. size=1073741824 {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1633a986-77f2-41b2-a436-8c5029d4c7f6/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG nova.network.neutron [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Updating instance_info_cache with network_info: [{"id": "08226f47-93f7-4b29-a752-7e8e37a665f8", "address": "fa:16:3e:3c:b3:e7", "network": {"id": "2a8063f6-42ce-41b8-86f6-72c17f4c2a7b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1765547969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd985a0cd6884c858487187ce252bba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08226f47-93", "ovs_interfaceid": "08226f47-93f7-4b29-a752-7e8e37a665f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Releasing lock "refresh_cache-1633a986-77f2-41b2-a436-8c5029d4c7f6" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG nova.compute.manager [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Instance network_info: |[{"id": "08226f47-93f7-4b29-a752-7e8e37a665f8", "address": "fa:16:3e:3c:b3:e7", "network": {"id": "2a8063f6-42ce-41b8-86f6-72c17f4c2a7b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1765547969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd985a0cd6884c858487187ce252bba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08226f47-93", "ovs_interfaceid": "08226f47-93f7-4b29-a752-7e8e37a665f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-90148037-c228-46de-b736-b8d989dcbcb8 req-b68a8855-34d9-4dbd-af88-bc9c727be429 service nova] Acquired lock "refresh_cache-1633a986-77f2-41b2-a436-8c5029d4c7f6" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG nova.network.neutron [req-90148037-c228-46de-b736-b8d989dcbcb8 req-b68a8855-34d9-4dbd-af88-bc9c727be429 service nova] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Refreshing network info cache for port 08226f47-93f7-4b29-a752-7e8e37a665f8 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1633a986-77f2-41b2-a436-8c5029d4c7f6/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Cannot resize image /opt/stack/data/nova/instances/1633a986-77f2-41b2-a436-8c5029d4c7f6/disk to a smaller size. {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG nova.objects.instance [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lazy-loading 'migration_context' on Instance uuid 1633a986-77f2-41b2-a436-8c5029d4c7f6 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Created local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Ensure instance console log exists: /opt/stack/data/nova/instances/1633a986-77f2-41b2-a436-8c5029d4c7f6/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Start _get_guest_xml network_info=[{"id": "08226f47-93f7-4b29-a752-7e8e37a665f8", "address": "fa:16:3e:3c:b3:e7", "network": {"id": "2a8063f6-42ce-41b8-86f6-72c17f4c2a7b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1765547969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd985a0cd6884c858487187ce252bba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08226f47-93", "ovs_interfaceid": "08226f47-93f7-4b29-a752-7e8e37a665f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:01:37Z,direct_url=<?>,disk_format='qcow2',id=5dcc1e41-6efd-4557-94fe-47a802151660,min_disk=0,min_ram=0,name='tempest-scenario-img--22185820',owner='cd985a0cd6884c858487187ce252bba5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:01:38Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '5dcc1e41-6efd-4557-94fe-47a802151660'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Starting heal instance info cache {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Rebuilding the list of instances to heal {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 06:01:41 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:01:41 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:01:41 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Skipping network cache update for instance because it is Building. {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T06:01:37Z,direct_url=<?>,disk_format='qcow2',id=5dcc1e41-6efd-4557-94fe-47a802151660,min_disk=0,min_ram=0,name='tempest-scenario-img--22185820',owner='cd985a0cd6884c858487187ce252bba5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T06:01:38Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T06:01:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1839119576',display_name='tempest-TestMinimumBasicScenario-server-1839119576',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1839119576',id=51,image_ref='5dcc1e41-6efd-4557-94fe-47a802151660',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4OcgfFfoCatXKKK7xyUgXJIEGR6qLzFsKkLlMAbbk4KIABOAR8rcawhjQaetz6FNgj1otrzQC6HrGrfCulXQ878JbQ7qSbX7cWn3eWPTIKr241YOKw60gQZSKR05fYww==',key_name='tempest-TestMinimumBasicScenario-892419766',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd985a0cd6884c858487187ce252bba5',ramdisk_id='',reservation_id='r-xvx09grf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5dcc1e41-6efd-4557-94fe-47a802151660',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1535355155',owner_user_name='tempest-TestMinimumBasicScenario-1535355155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:01:40Z,user_data=None,user_id='db323067fefa4b1f8aa28f10a997b9d4',uuid=1633a986-77f2-41b2-a436-8c5029d4c7f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08226f47-93f7-4b29-a752-7e8e37a665f8", "address": "fa:16:3e:3c:b3:e7", "network": {"id": "2a8063f6-42ce-41b8-86f6-72c17f4c2a7b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1765547969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd985a0cd6884c858487187ce252bba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08226f47-93", "ovs_interfaceid": "08226f47-93f7-4b29-a752-7e8e37a665f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Converting VIF {"id": "08226f47-93f7-4b29-a752-7e8e37a665f8", "address": "fa:16:3e:3c:b3:e7", "network": {"id": "2a8063f6-42ce-41b8-86f6-72c17f4c2a7b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1765547969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd985a0cd6884c858487187ce252bba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08226f47-93", "ovs_interfaceid": "08226f47-93f7-4b29-a752-7e8e37a665f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:b3:e7,bridge_name='br-int',has_traffic_filtering=True,id=08226f47-93f7-4b29-a752-7e8e37a665f8,network=Network(2a8063f6-42ce-41b8-86f6-72c17f4c2a7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08226f47-93') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG nova.objects.instance [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lazy-loading 'pci_devices' on Instance uuid 1633a986-77f2-41b2-a436-8c5029d4c7f6 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] End _get_guest_xml xml=<domain type="kvm">
Aug 15 06:01:41 user nova-compute[73391]:   <uuid>1633a986-77f2-41b2-a436-8c5029d4c7f6</uuid>
Aug 15 06:01:41 user nova-compute[73391]:   <name>instance-00000033</name>
Aug 15 06:01:41 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 06:01:41 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 06:01:41 user nova-compute[73391]:   <metadata>
Aug 15 06:01:41 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 06:01:41 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 06:01:41 user nova-compute[73391]:       <nova:name>tempest-TestMinimumBasicScenario-server-1839119576</nova:name>
Aug 15 06:01:41 user nova-compute[73391]:       <nova:creationTime>2023-08-15 06:01:41</nova:creationTime>
Aug 15 06:01:41 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 06:01:41 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 06:01:41 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 06:01:41 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 06:01:41 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 06:01:41 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 06:01:41 user nova-compute[73391]:       </nova:flavor>
Aug 15 06:01:41 user nova-compute[73391]:       <nova:owner>
Aug 15 06:01:41 user nova-compute[73391]:         <nova:user uuid="db323067fefa4b1f8aa28f10a997b9d4">tempest-TestMinimumBasicScenario-1535355155-project-member</nova:user>
Aug 15 06:01:41 user nova-compute[73391]:         <nova:project uuid="cd985a0cd6884c858487187ce252bba5">tempest-TestMinimumBasicScenario-1535355155</nova:project>
Aug 15 06:01:41 user nova-compute[73391]:       </nova:owner>
Aug 15 06:01:41 user nova-compute[73391]:       <nova:root type="image" uuid="5dcc1e41-6efd-4557-94fe-47a802151660"/>
Aug 15 06:01:41 user nova-compute[73391]:       <nova:ports>
Aug 15 06:01:41 user nova-compute[73391]:         <nova:port uuid="08226f47-93f7-4b29-a752-7e8e37a665f8">
Aug 15 06:01:41 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Aug 15 06:01:41 user nova-compute[73391]:         </nova:port>
Aug 15 06:01:41 user nova-compute[73391]:       </nova:ports>
Aug 15 06:01:41 user nova-compute[73391]:     </nova:instance>
Aug 15 06:01:41 user nova-compute[73391]:   </metadata>
Aug 15 06:01:41 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 06:01:41 user nova-compute[73391]:     <system>
Aug 15 06:01:41 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 06:01:41 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 06:01:41 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 06:01:41 user nova-compute[73391]:       <entry name="serial">1633a986-77f2-41b2-a436-8c5029d4c7f6</entry>
Aug 15 06:01:41 user nova-compute[73391]:       <entry name="uuid">1633a986-77f2-41b2-a436-8c5029d4c7f6</entry>
Aug 15 06:01:41 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 06:01:41 user nova-compute[73391]:     </system>
Aug 15 06:01:41 user nova-compute[73391]:   </sysinfo>
Aug 15 06:01:41 user nova-compute[73391]:   <os>
Aug 15 06:01:41 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 06:01:41 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 06:01:41 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 06:01:41 user nova-compute[73391]:   </os>
Aug 15 06:01:41 user nova-compute[73391]:   <features>
Aug 15 06:01:41 user nova-compute[73391]:     <acpi/>
Aug 15 06:01:41 user nova-compute[73391]:     <apic/>
Aug 15 06:01:41 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 06:01:41 user nova-compute[73391]:   </features>
Aug 15 06:01:41 user nova-compute[73391]:   <clock offset="utc">
Aug 15 06:01:41 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 06:01:41 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 06:01:41 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 06:01:41 user nova-compute[73391]:   </clock>
Aug 15 06:01:41 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 06:01:41 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 06:01:41 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 06:01:41 user nova-compute[73391]:   </cpu>
Aug 15 06:01:41 user nova-compute[73391]:   <devices>
Aug 15 06:01:41 user nova-compute[73391]:     <disk type="file" device="disk">
Aug 15 06:01:41 user nova-compute[73391]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 06:01:41 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/1633a986-77f2-41b2-a436-8c5029d4c7f6/disk"/>
Aug 15 06:01:41 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 06:01:41 user nova-compute[73391]:     </disk>
Aug 15 06:01:41 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 06:01:41 user nova-compute[73391]:       <mac address="fa:16:3e:3c:b3:e7"/>
Aug 15 06:01:41 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 06:01:41 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 06:01:41 user nova-compute[73391]:       <target dev="tap08226f47-93"/>
Aug 15 06:01:41 user nova-compute[73391]:     </interface>
Aug 15 06:01:41 user nova-compute[73391]:     <serial type="pty">
Aug 15 06:01:41 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/1633a986-77f2-41b2-a436-8c5029d4c7f6/console.log" append="off"/>
Aug 15 06:01:41 user nova-compute[73391]:     </serial>
Aug 15 06:01:41 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 06:01:41 user nova-compute[73391]:     <video>
Aug 15 06:01:41 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 06:01:41 user nova-compute[73391]:     </video>
Aug 15 06:01:41 user nova-compute[73391]:     <rng model="virtio">
Aug 15 06:01:41 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 06:01:41 user nova-compute[73391]:     </rng>
Aug 15 06:01:41 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 06:01:41 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 06:01:41 user nova-compute[73391]:       <stats period="10"/>
Aug 15 06:01:41 user nova-compute[73391]:     </memballoon>
Aug 15 06:01:41 user nova-compute[73391]:   </devices>
Aug 15 06:01:41 user nova-compute[73391]: </domain>
Aug 15 06:01:41 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T06:01:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1839119576',display_name='tempest-TestMinimumBasicScenario-server-1839119576',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1839119576',id=51,image_ref='5dcc1e41-6efd-4557-94fe-47a802151660',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4OcgfFfoCatXKKK7xyUgXJIEGR6qLzFsKkLlMAbbk4KIABOAR8rcawhjQaetz6FNgj1otrzQC6HrGrfCulXQ878JbQ7qSbX7cWn3eWPTIKr241YOKw60gQZSKR05fYww==',key_name='tempest-TestMinimumBasicScenario-892419766',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd985a0cd6884c858487187ce252bba5',ramdisk_id='',reservation_id='r-xvx09grf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5dcc1e41-6efd-4557-94fe-47a802151660',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-1535355155',owner_user_name='tempest-TestMinimumBasicScenario-1535355155-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:01:40Z,user_data=None,user_id='db323067fefa4b1f8aa28f10a997b9d4',uuid=1633a986-77f2-41b2-a436-8c5029d4c7f6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08226f47-93f7-4b29-a752-7e8e37a665f8", "address": "fa:16:3e:3c:b3:e7", "network": {"id": "2a8063f6-42ce-41b8-86f6-72c17f4c2a7b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1765547969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd985a0cd6884c858487187ce252bba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08226f47-93", "ovs_interfaceid": "08226f47-93f7-4b29-a752-7e8e37a665f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Converting VIF {"id": "08226f47-93f7-4b29-a752-7e8e37a665f8", "address": "fa:16:3e:3c:b3:e7", "network": {"id": "2a8063f6-42ce-41b8-86f6-72c17f4c2a7b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1765547969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd985a0cd6884c858487187ce252bba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08226f47-93", "ovs_interfaceid": "08226f47-93f7-4b29-a752-7e8e37a665f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:b3:e7,bridge_name='br-int',has_traffic_filtering=True,id=08226f47-93f7-4b29-a752-7e8e37a665f8,network=Network(2a8063f6-42ce-41b8-86f6-72c17f4c2a7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08226f47-93') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG os_vif [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:b3:e7,bridge_name='br-int',has_traffic_filtering=True,id=08226f47-93f7-4b29-a752-7e8e37a665f8,network=Network(2a8063f6-42ce-41b8-86f6-72c17f4c2a7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08226f47-93') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "refresh_cache-595be11c-24db-43eb-9d5b-56cbeefd6149" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquired lock "refresh_cache-595be11c-24db-43eb-9d5b-56cbeefd6149" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Forcefully refreshing network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG nova.objects.instance [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lazy-loading 'info_cache' on Instance uuid 595be11c-24db-43eb-9d5b-56cbeefd6149 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap08226f47-93, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap08226f47-93, col_values=(('external_ids', {'iface-id': '08226f47-93f7-4b29-a752-7e8e37a665f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:b3:e7', 'vm-uuid': '1633a986-77f2-41b2-a436-8c5029d4c7f6'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:01:41 user nova-compute[73391]: INFO os_vif [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:b3:e7,bridge_name='br-int',has_traffic_filtering=True,id=08226f47-93f7-4b29-a752-7e8e37a665f8,network=Network(2a8063f6-42ce-41b8-86f6-72c17f4c2a7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08226f47-93')
Aug 15 06:01:41 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 06:01:41 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] No VIF found with MAC fa:16:3e:3c:b3:e7, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 06:01:42 user nova-compute[73391]: DEBUG nova.network.neutron [req-90148037-c228-46de-b736-b8d989dcbcb8 req-b68a8855-34d9-4dbd-af88-bc9c727be429 service nova] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Updated VIF entry in instance network info cache for port 08226f47-93f7-4b29-a752-7e8e37a665f8. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 06:01:42 user nova-compute[73391]: DEBUG nova.network.neutron [req-90148037-c228-46de-b736-b8d989dcbcb8 req-b68a8855-34d9-4dbd-af88-bc9c727be429 service nova] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Updating instance_info_cache with network_info: [{"id": "08226f47-93f7-4b29-a752-7e8e37a665f8", "address": "fa:16:3e:3c:b3:e7", "network": {"id": "2a8063f6-42ce-41b8-86f6-72c17f4c2a7b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1765547969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd985a0cd6884c858487187ce252bba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08226f47-93", "ovs_interfaceid": "08226f47-93f7-4b29-a752-7e8e37a665f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:01:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-90148037-c228-46de-b736-b8d989dcbcb8 req-b68a8855-34d9-4dbd-af88-bc9c727be429 service nova] Releasing lock "refresh_cache-1633a986-77f2-41b2-a436-8c5029d4c7f6" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:01:42 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Updating instance_info_cache with network_info: [{"id": "3418de64-8dbd-4951-aca0-0dc87257dbcb", "address": "fa:16:3e:05:b7:5b", "network": {"id": "8e7b9da2-83d1-47d1-a352-a9684e3a2cdf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1697315681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a94181609a284eb29f8db71cf34c086b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3418de64-8d", "ovs_interfaceid": "3418de64-8dbd-4951-aca0-0dc87257dbcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:01:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Releasing lock "refresh_cache-595be11c-24db-43eb-9d5b-56cbeefd6149" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:01:42 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Updated the network info_cache for instance {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 06:01:43 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:01:43 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:01:43 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:01:43 user nova-compute[73391]: DEBUG nova.compute.manager [req-181cbf51-91a6-4e6f-b2b8-ce41d5a0ba92 req-e7f97570-a421-4dea-b438-94b8012ee11f service nova] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Received event network-vif-plugged-08226f47-93f7-4b29-a752-7e8e37a665f8 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:01:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-181cbf51-91a6-4e6f-b2b8-ce41d5a0ba92 req-e7f97570-a421-4dea-b438-94b8012ee11f service nova] Acquiring lock "1633a986-77f2-41b2-a436-8c5029d4c7f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:01:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-181cbf51-91a6-4e6f-b2b8-ce41d5a0ba92 req-e7f97570-a421-4dea-b438-94b8012ee11f service nova] Lock "1633a986-77f2-41b2-a436-8c5029d4c7f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:01:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-181cbf51-91a6-4e6f-b2b8-ce41d5a0ba92 req-e7f97570-a421-4dea-b438-94b8012ee11f service nova] Lock "1633a986-77f2-41b2-a436-8c5029d4c7f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:01:43 user nova-compute[73391]: DEBUG nova.compute.manager [req-181cbf51-91a6-4e6f-b2b8-ce41d5a0ba92 req-e7f97570-a421-4dea-b438-94b8012ee11f service nova] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] No waiting events found dispatching network-vif-plugged-08226f47-93f7-4b29-a752-7e8e37a665f8 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:01:43 user nova-compute[73391]: WARNING nova.compute.manager [req-181cbf51-91a6-4e6f-b2b8-ce41d5a0ba92 req-e7f97570-a421-4dea-b438-94b8012ee11f service nova] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Received unexpected event network-vif-plugged-08226f47-93f7-4b29-a752-7e8e37a665f8 for instance with vm_state building and task_state spawning.
Aug 15 06:01:43 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:01:43 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:01:43 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:01:43 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:01:43 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:01:43 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:01:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:01:45 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692079305.2494276, 1633a986-77f2-41b2-a436-8c5029d4c7f6 => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:01:45 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] VM Resumed (Lifecycle Event)
Aug 15 06:01:45 user nova-compute[73391]: DEBUG nova.compute.manager [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 06:01:45 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Guest created on hypervisor {{(pid=73391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 06:01:45 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Instance spawned successfully.
Aug 15 06:01:45 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 06:01:45 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:01:45 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 06:01:45 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Found default for hw_cdrom_bus of ide {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:01:45 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Found default for hw_disk_bus of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:01:45 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Found default for hw_input_bus of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:01:45 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Found default for hw_pointer_model of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:01:45 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Found default for hw_video_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:01:45 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Found default for hw_vif_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:01:45 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 06:01:45 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692079305.2510011, 1633a986-77f2-41b2-a436-8c5029d4c7f6 => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:01:45 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] VM Started (Lifecycle Event)
Aug 15 06:01:45 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:01:45 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 06:01:45 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 06:01:45 user nova-compute[73391]: INFO nova.compute.manager [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Took 5.78 seconds to spawn the instance on the hypervisor.
Aug 15 06:01:45 user nova-compute[73391]: DEBUG nova.compute.manager [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:01:45 user nova-compute[73391]: DEBUG nova.compute.manager [req-77dfb93c-87c9-47eb-adf0-487d522266ac req-fd393e86-2dc8-465e-8d8a-1b0b3fc90050 service nova] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Received event network-vif-plugged-08226f47-93f7-4b29-a752-7e8e37a665f8 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:01:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-77dfb93c-87c9-47eb-adf0-487d522266ac req-fd393e86-2dc8-465e-8d8a-1b0b3fc90050 service nova] Acquiring lock "1633a986-77f2-41b2-a436-8c5029d4c7f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:01:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-77dfb93c-87c9-47eb-adf0-487d522266ac req-fd393e86-2dc8-465e-8d8a-1b0b3fc90050 service nova] Lock "1633a986-77f2-41b2-a436-8c5029d4c7f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:01:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-77dfb93c-87c9-47eb-adf0-487d522266ac req-fd393e86-2dc8-465e-8d8a-1b0b3fc90050 service nova] Lock "1633a986-77f2-41b2-a436-8c5029d4c7f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:01:45 user nova-compute[73391]: DEBUG nova.compute.manager [req-77dfb93c-87c9-47eb-adf0-487d522266ac req-fd393e86-2dc8-465e-8d8a-1b0b3fc90050 service nova] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] No waiting events found dispatching network-vif-plugged-08226f47-93f7-4b29-a752-7e8e37a665f8 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:01:45 user nova-compute[73391]: WARNING nova.compute.manager [req-77dfb93c-87c9-47eb-adf0-487d522266ac req-fd393e86-2dc8-465e-8d8a-1b0b3fc90050 service nova] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Received unexpected event network-vif-plugged-08226f47-93f7-4b29-a752-7e8e37a665f8 for instance with vm_state building and task_state spawning.
Aug 15 06:01:45 user nova-compute[73391]: INFO nova.compute.manager [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Took 6.34 seconds to build instance.
Aug 15 06:01:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-6c4bec83-f4f7-4d9f-b8d8-745344262f7d tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "1633a986-77f2-41b2-a436-8c5029d4c7f6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.432s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:01:45 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:01:45 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 06:01:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:01:48 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:01:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:01:51 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:01:51 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:01:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-544a702e-92ac-49b4-80da-0bfc3d8c0732 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Acquiring lock "a7144a2f-78f6-48aa-9801-5c00b0171414" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:01:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-544a702e-92ac-49b4-80da-0bfc3d8c0732 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Lock "a7144a2f-78f6-48aa-9801-5c00b0171414" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:01:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-544a702e-92ac-49b4-80da-0bfc3d8c0732 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Acquiring lock "a7144a2f-78f6-48aa-9801-5c00b0171414-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:01:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-544a702e-92ac-49b4-80da-0bfc3d8c0732 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Lock "a7144a2f-78f6-48aa-9801-5c00b0171414-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:01:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-544a702e-92ac-49b4-80da-0bfc3d8c0732 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Lock "a7144a2f-78f6-48aa-9801-5c00b0171414-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:01:56 user nova-compute[73391]: INFO nova.compute.manager [None req-544a702e-92ac-49b4-80da-0bfc3d8c0732 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Terminating instance
Aug 15 06:01:56 user nova-compute[73391]: DEBUG nova.compute.manager [None req-544a702e-92ac-49b4-80da-0bfc3d8c0732 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Start destroying the instance on the hypervisor. {{(pid=73391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 06:01:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:01:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:01:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:01:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:01:56 user nova-compute[73391]: DEBUG nova.compute.manager [req-1681d2a7-445b-46f9-b15a-5c2d5e327a28 req-037cae2d-7d80-4d02-bcc5-8d92190a1713 service nova] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Received event network-vif-unplugged-7fd5b250-a86e-421a-9daf-73c948b63644 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:01:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-1681d2a7-445b-46f9-b15a-5c2d5e327a28 req-037cae2d-7d80-4d02-bcc5-8d92190a1713 service nova] Acquiring lock "a7144a2f-78f6-48aa-9801-5c00b0171414-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:01:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-1681d2a7-445b-46f9-b15a-5c2d5e327a28 req-037cae2d-7d80-4d02-bcc5-8d92190a1713 service nova] Lock "a7144a2f-78f6-48aa-9801-5c00b0171414-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:01:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-1681d2a7-445b-46f9-b15a-5c2d5e327a28 req-037cae2d-7d80-4d02-bcc5-8d92190a1713 service nova] Lock "a7144a2f-78f6-48aa-9801-5c00b0171414-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:01:56 user nova-compute[73391]: DEBUG nova.compute.manager [req-1681d2a7-445b-46f9-b15a-5c2d5e327a28 req-037cae2d-7d80-4d02-bcc5-8d92190a1713 service nova] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] No waiting events found dispatching network-vif-unplugged-7fd5b250-a86e-421a-9daf-73c948b63644 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:01:56 user nova-compute[73391]: DEBUG nova.compute.manager [req-1681d2a7-445b-46f9-b15a-5c2d5e327a28 req-037cae2d-7d80-4d02-bcc5-8d92190a1713 service nova] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Received event network-vif-unplugged-7fd5b250-a86e-421a-9daf-73c948b63644 for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 06:01:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:01:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:01:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:01:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:01:57 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Instance destroyed successfully.
Aug 15 06:01:57 user nova-compute[73391]: DEBUG nova.objects.instance [None req-544a702e-92ac-49b4-80da-0bfc3d8c0732 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Lazy-loading 'resources' on Instance uuid a7144a2f-78f6-48aa-9801-5c00b0171414 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:01:57 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-544a702e-92ac-49b4-80da-0bfc3d8c0732 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T06:00:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1065521132',display_name='tempest-ServersNegativeTestJSON-server-1065521132',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1065521132',id=49,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T06:00:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a94181609a284eb29f8db71cf34c086b',ramdisk_id='',reservation_id='r-m7hd11rl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1203747242',owner_user_name='tempest-ServersNegativeTestJSON-1203747242-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T06:00:12Z,user_data=None,user_id='a8a6d1c3cc9d46c98e43e9c8c9caabb5',uuid=a7144a2f-78f6-48aa-9801-5c00b0171414,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7fd5b250-a86e-421a-9daf-73c948b63644", "address": "fa:16:3e:50:18:55", "network": {"id": "8e7b9da2-83d1-47d1-a352-a9684e3a2cdf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1697315681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a94181609a284eb29f8db71cf34c086b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fd5b250-a8", "ovs_interfaceid": "7fd5b250-a86e-421a-9daf-73c948b63644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 06:01:57 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-544a702e-92ac-49b4-80da-0bfc3d8c0732 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Converting VIF {"id": "7fd5b250-a86e-421a-9daf-73c948b63644", "address": "fa:16:3e:50:18:55", "network": {"id": "8e7b9da2-83d1-47d1-a352-a9684e3a2cdf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1697315681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a94181609a284eb29f8db71cf34c086b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fd5b250-a8", "ovs_interfaceid": "7fd5b250-a86e-421a-9daf-73c948b63644", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:01:57 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-544a702e-92ac-49b4-80da-0bfc3d8c0732 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:18:55,bridge_name='br-int',has_traffic_filtering=True,id=7fd5b250-a86e-421a-9daf-73c948b63644,network=Network(8e7b9da2-83d1-47d1-a352-a9684e3a2cdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fd5b250-a8') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:01:57 user nova-compute[73391]: DEBUG os_vif [None req-544a702e-92ac-49b4-80da-0bfc3d8c0732 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:18:55,bridge_name='br-int',has_traffic_filtering=True,id=7fd5b250-a86e-421a-9daf-73c948b63644,network=Network(8e7b9da2-83d1-47d1-a352-a9684e3a2cdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fd5b250-a8') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 06:01:57 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:01:57 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7fd5b250-a8, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:01:57 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:01:57 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:01:57 user nova-compute[73391]: INFO os_vif [None req-544a702e-92ac-49b4-80da-0bfc3d8c0732 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:18:55,bridge_name='br-int',has_traffic_filtering=True,id=7fd5b250-a86e-421a-9daf-73c948b63644,network=Network(8e7b9da2-83d1-47d1-a352-a9684e3a2cdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fd5b250-a8')
Aug 15 06:01:57 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-544a702e-92ac-49b4-80da-0bfc3d8c0732 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Deleting instance files /opt/stack/data/nova/instances/a7144a2f-78f6-48aa-9801-5c00b0171414_del
Aug 15 06:01:57 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-544a702e-92ac-49b4-80da-0bfc3d8c0732 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Deletion of /opt/stack/data/nova/instances/a7144a2f-78f6-48aa-9801-5c00b0171414_del complete
Aug 15 06:01:57 user nova-compute[73391]: INFO nova.compute.manager [None req-544a702e-92ac-49b4-80da-0bfc3d8c0732 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Took 0.87 seconds to destroy the instance on the hypervisor.
Aug 15 06:01:57 user nova-compute[73391]: DEBUG oslo.service.loopingcall [None req-544a702e-92ac-49b4-80da-0bfc3d8c0732 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 06:01:57 user nova-compute[73391]: DEBUG nova.compute.manager [-] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Deallocating network for instance {{(pid=73391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 06:01:57 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] deallocate_for_instance() {{(pid=73391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 06:01:57 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:01:57 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:01:57 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:01:57 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:01:57 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Took 0.58 seconds to deallocate network for instance.
Aug 15 06:01:57 user nova-compute[73391]: DEBUG nova.compute.manager [req-73b86b90-a284-4fc5-972c-972fe3d39077 req-fdb7441a-b92b-4ca7-97dc-e6218d15998f service nova] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Received event network-vif-deleted-7fd5b250-a86e-421a-9daf-73c948b63644 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:01:57 user nova-compute[73391]: INFO nova.compute.manager [req-73b86b90-a284-4fc5-972c-972fe3d39077 req-fdb7441a-b92b-4ca7-97dc-e6218d15998f service nova] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Neutron deleted interface 7fd5b250-a86e-421a-9daf-73c948b63644; detaching it from the instance and deleting it from the info cache
Aug 15 06:01:57 user nova-compute[73391]: DEBUG nova.network.neutron [req-73b86b90-a284-4fc5-972c-972fe3d39077 req-fdb7441a-b92b-4ca7-97dc-e6218d15998f service nova] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:01:57 user nova-compute[73391]: DEBUG nova.compute.manager [req-73b86b90-a284-4fc5-972c-972fe3d39077 req-fdb7441a-b92b-4ca7-97dc-e6218d15998f service nova] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Detach interface failed, port_id=7fd5b250-a86e-421a-9daf-73c948b63644, reason: Instance a7144a2f-78f6-48aa-9801-5c00b0171414 could not be found. {{(pid=73391) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Aug 15 06:01:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-544a702e-92ac-49b4-80da-0bfc3d8c0732 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:01:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-544a702e-92ac-49b4-80da-0bfc3d8c0732 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:01:57 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-544a702e-92ac-49b4-80da-0bfc3d8c0732 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:01:57 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-544a702e-92ac-49b4-80da-0bfc3d8c0732 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:01:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-544a702e-92ac-49b4-80da-0bfc3d8c0732 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.326s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:01:58 user nova-compute[73391]: INFO nova.scheduler.client.report [None req-544a702e-92ac-49b4-80da-0bfc3d8c0732 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Deleted allocations for instance a7144a2f-78f6-48aa-9801-5c00b0171414
Aug 15 06:01:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-544a702e-92ac-49b4-80da-0bfc3d8c0732 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Lock "a7144a2f-78f6-48aa-9801-5c00b0171414" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.988s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:01:58 user nova-compute[73391]: DEBUG nova.compute.manager [req-353017c3-d769-4313-96f3-b1d9ac631a3a req-c4d32e8d-2450-423c-99dd-9039e27ecdc9 service nova] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Received event network-vif-plugged-7fd5b250-a86e-421a-9daf-73c948b63644 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:01:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-353017c3-d769-4313-96f3-b1d9ac631a3a req-c4d32e8d-2450-423c-99dd-9039e27ecdc9 service nova] Acquiring lock "a7144a2f-78f6-48aa-9801-5c00b0171414-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:01:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-353017c3-d769-4313-96f3-b1d9ac631a3a req-c4d32e8d-2450-423c-99dd-9039e27ecdc9 service nova] Lock "a7144a2f-78f6-48aa-9801-5c00b0171414-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:01:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-353017c3-d769-4313-96f3-b1d9ac631a3a req-c4d32e8d-2450-423c-99dd-9039e27ecdc9 service nova] Lock "a7144a2f-78f6-48aa-9801-5c00b0171414-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:01:58 user nova-compute[73391]: DEBUG nova.compute.manager [req-353017c3-d769-4313-96f3-b1d9ac631a3a req-c4d32e8d-2450-423c-99dd-9039e27ecdc9 service nova] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] No waiting events found dispatching network-vif-plugged-7fd5b250-a86e-421a-9daf-73c948b63644 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:01:58 user nova-compute[73391]: WARNING nova.compute.manager [req-353017c3-d769-4313-96f3-b1d9ac631a3a req-c4d32e8d-2450-423c-99dd-9039e27ecdc9 service nova] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Received unexpected event network-vif-plugged-7fd5b250-a86e-421a-9daf-73c948b63644 for instance with vm_state deleted and task_state None.
Aug 15 06:01:58 user nova-compute[73391]: DEBUG nova.compute.manager [req-353017c3-d769-4313-96f3-b1d9ac631a3a req-c4d32e8d-2450-423c-99dd-9039e27ecdc9 service nova] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Received event network-vif-plugged-7fd5b250-a86e-421a-9daf-73c948b63644 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:01:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-353017c3-d769-4313-96f3-b1d9ac631a3a req-c4d32e8d-2450-423c-99dd-9039e27ecdc9 service nova] Acquiring lock "a7144a2f-78f6-48aa-9801-5c00b0171414-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:01:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-353017c3-d769-4313-96f3-b1d9ac631a3a req-c4d32e8d-2450-423c-99dd-9039e27ecdc9 service nova] Lock "a7144a2f-78f6-48aa-9801-5c00b0171414-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:01:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-353017c3-d769-4313-96f3-b1d9ac631a3a req-c4d32e8d-2450-423c-99dd-9039e27ecdc9 service nova] Lock "a7144a2f-78f6-48aa-9801-5c00b0171414-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:01:58 user nova-compute[73391]: DEBUG nova.compute.manager [req-353017c3-d769-4313-96f3-b1d9ac631a3a req-c4d32e8d-2450-423c-99dd-9039e27ecdc9 service nova] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] No waiting events found dispatching network-vif-plugged-7fd5b250-a86e-421a-9daf-73c948b63644 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:01:58 user nova-compute[73391]: WARNING nova.compute.manager [req-353017c3-d769-4313-96f3-b1d9ac631a3a req-c4d32e8d-2450-423c-99dd-9039e27ecdc9 service nova] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Received unexpected event network-vif-plugged-7fd5b250-a86e-421a-9daf-73c948b63644 for instance with vm_state deleted and task_state None.
Aug 15 06:01:58 user nova-compute[73391]: DEBUG nova.compute.manager [req-353017c3-d769-4313-96f3-b1d9ac631a3a req-c4d32e8d-2450-423c-99dd-9039e27ecdc9 service nova] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Received event network-vif-plugged-7fd5b250-a86e-421a-9daf-73c948b63644 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:01:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-353017c3-d769-4313-96f3-b1d9ac631a3a req-c4d32e8d-2450-423c-99dd-9039e27ecdc9 service nova] Acquiring lock "a7144a2f-78f6-48aa-9801-5c00b0171414-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:01:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-353017c3-d769-4313-96f3-b1d9ac631a3a req-c4d32e8d-2450-423c-99dd-9039e27ecdc9 service nova] Lock "a7144a2f-78f6-48aa-9801-5c00b0171414-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:01:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-353017c3-d769-4313-96f3-b1d9ac631a3a req-c4d32e8d-2450-423c-99dd-9039e27ecdc9 service nova] Lock "a7144a2f-78f6-48aa-9801-5c00b0171414-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:01:58 user nova-compute[73391]: DEBUG nova.compute.manager [req-353017c3-d769-4313-96f3-b1d9ac631a3a req-c4d32e8d-2450-423c-99dd-9039e27ecdc9 service nova] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] No waiting events found dispatching network-vif-plugged-7fd5b250-a86e-421a-9daf-73c948b63644 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:01:58 user nova-compute[73391]: WARNING nova.compute.manager [req-353017c3-d769-4313-96f3-b1d9ac631a3a req-c4d32e8d-2450-423c-99dd-9039e27ecdc9 service nova] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Received unexpected event network-vif-plugged-7fd5b250-a86e-421a-9daf-73c948b63644 for instance with vm_state deleted and task_state None.
Aug 15 06:01:58 user nova-compute[73391]: DEBUG nova.compute.manager [req-353017c3-d769-4313-96f3-b1d9ac631a3a req-c4d32e8d-2450-423c-99dd-9039e27ecdc9 service nova] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Received event network-vif-plugged-7fd5b250-a86e-421a-9daf-73c948b63644 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:01:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-353017c3-d769-4313-96f3-b1d9ac631a3a req-c4d32e8d-2450-423c-99dd-9039e27ecdc9 service nova] Acquiring lock "a7144a2f-78f6-48aa-9801-5c00b0171414-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:01:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-353017c3-d769-4313-96f3-b1d9ac631a3a req-c4d32e8d-2450-423c-99dd-9039e27ecdc9 service nova] Lock "a7144a2f-78f6-48aa-9801-5c00b0171414-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:01:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-353017c3-d769-4313-96f3-b1d9ac631a3a req-c4d32e8d-2450-423c-99dd-9039e27ecdc9 service nova] Lock "a7144a2f-78f6-48aa-9801-5c00b0171414-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:01:58 user nova-compute[73391]: DEBUG nova.compute.manager [req-353017c3-d769-4313-96f3-b1d9ac631a3a req-c4d32e8d-2450-423c-99dd-9039e27ecdc9 service nova] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] No waiting events found dispatching network-vif-plugged-7fd5b250-a86e-421a-9daf-73c948b63644 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:01:58 user nova-compute[73391]: WARNING nova.compute.manager [req-353017c3-d769-4313-96f3-b1d9ac631a3a req-c4d32e8d-2450-423c-99dd-9039e27ecdc9 service nova] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Received unexpected event network-vif-plugged-7fd5b250-a86e-421a-9daf-73c948b63644 for instance with vm_state deleted and task_state None.
Aug 15 06:02:00 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:02:02 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:02:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:02:07 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:02:10 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:02:11 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692079316.9957986, a7144a2f-78f6-48aa-9801-5c00b0171414 => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:02:11 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] VM Stopped (Lifecycle Event)
Aug 15 06:02:12 user nova-compute[73391]: DEBUG nova.compute.manager [None req-6037a150-87b9-4249-b119-42dd8af93cca None None] [instance: a7144a2f-78f6-48aa-9801-5c00b0171414] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:02:12 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:02:15 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:02:17 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:02:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:02:27 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:02:27 user nova-compute[73391]: DEBUG nova.compute.manager [req-01e13505-c116-4005-9c0c-31e57d723c66 req-c5a21df0-3a12-46bd-b407-7441ac3e1b6f service nova] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Received event network-changed-528573da-c249-4b80-af98-00d6da4fd06b {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:02:27 user nova-compute[73391]: DEBUG nova.compute.manager [req-01e13505-c116-4005-9c0c-31e57d723c66 req-c5a21df0-3a12-46bd-b407-7441ac3e1b6f service nova] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Refreshing instance network info cache due to event network-changed-528573da-c249-4b80-af98-00d6da4fd06b. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 06:02:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-01e13505-c116-4005-9c0c-31e57d723c66 req-c5a21df0-3a12-46bd-b407-7441ac3e1b6f service nova] Acquiring lock "refresh_cache-6d01f99d-fbd3-475e-93ac-3c39e6ca5980" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:02:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-01e13505-c116-4005-9c0c-31e57d723c66 req-c5a21df0-3a12-46bd-b407-7441ac3e1b6f service nova] Acquired lock "refresh_cache-6d01f99d-fbd3-475e-93ac-3c39e6ca5980" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:02:27 user nova-compute[73391]: DEBUG nova.network.neutron [req-01e13505-c116-4005-9c0c-31e57d723c66 req-c5a21df0-3a12-46bd-b407-7441ac3e1b6f service nova] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Refreshing network info cache for port 528573da-c249-4b80-af98-00d6da4fd06b {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 06:02:27 user nova-compute[73391]: DEBUG nova.network.neutron [req-01e13505-c116-4005-9c0c-31e57d723c66 req-c5a21df0-3a12-46bd-b407-7441ac3e1b6f service nova] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Updated VIF entry in instance network info cache for port 528573da-c249-4b80-af98-00d6da4fd06b. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 06:02:27 user nova-compute[73391]: DEBUG nova.network.neutron [req-01e13505-c116-4005-9c0c-31e57d723c66 req-c5a21df0-3a12-46bd-b407-7441ac3e1b6f service nova] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Updating instance_info_cache with network_info: [{"id": "528573da-c249-4b80-af98-00d6da4fd06b", "address": "fa:16:3e:78:7a:a7", "network": {"id": "bc2718a2-a5ab-44e0-966d-9b180a30ac75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1022668030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8086add121594fe8a0bdde99dd9cae90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap528573da-c2", "ovs_interfaceid": "528573da-c249-4b80-af98-00d6da4fd06b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:02:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-01e13505-c116-4005-9c0c-31e57d723c66 req-c5a21df0-3a12-46bd-b407-7441ac3e1b6f service nova] Releasing lock "refresh_cache-6d01f99d-fbd3-475e-93ac-3c39e6ca5980" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:02:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:02:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7d619edf-0f63-4c22-b547-098724f995c8 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Acquiring lock "6d01f99d-fbd3-475e-93ac-3c39e6ca5980" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:02:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7d619edf-0f63-4c22-b547-098724f995c8 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "6d01f99d-fbd3-475e-93ac-3c39e6ca5980" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:02:30 user nova-compute[73391]: DEBUG nova.objects.instance [None req-7d619edf-0f63-4c22-b547-098724f995c8 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lazy-loading 'flavor' on Instance uuid 6d01f99d-fbd3-475e-93ac-3c39e6ca5980 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:02:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7d619edf-0f63-4c22-b547-098724f995c8 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "6d01f99d-fbd3-475e-93ac-3c39e6ca5980" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:02:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7d619edf-0f63-4c22-b547-098724f995c8 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Acquiring lock "6d01f99d-fbd3-475e-93ac-3c39e6ca5980" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:02:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7d619edf-0f63-4c22-b547-098724f995c8 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "6d01f99d-fbd3-475e-93ac-3c39e6ca5980" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:02:31 user nova-compute[73391]: INFO nova.compute.manager [None req-7d619edf-0f63-4c22-b547-098724f995c8 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Attaching volume d7012f60-3d64-4795-bf5f-2ceae828ab6f to /dev/vdb
Aug 15 06:02:31 user nova-compute[73391]: DEBUG os_brick.utils [None req-7d619edf-0f63-4c22-b547-098724f995c8 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:02:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:02:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:02:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e2db51-39ac-4ce1-be03-d59868c0a0e0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:02:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:02:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:02:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[614cd55e-cb01-4747-be5e-65da7bbc4e74]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:02:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:02:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:02:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b902623e-5c28-4a18-938d-8cb15e6d461b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:02:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[74fafe9f-40dd-42dc-9369-3d637b05f908]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:02:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-7d619edf-0f63-4c22-b547-098724f995c8 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:02:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-7d619edf-0f63-4c22-b547-098724f995c8 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 06:02:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7d619edf-0f63-4c22-b547-098724f995c8 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 06:02:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:02:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 06:02:31 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 06:02:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[04870776-09b8-4a2b-b4a6-5fc5ef4a5ab8]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:02:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-7d619edf-0f63-4c22-b547-098724f995c8 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 06:02:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-7d619edf-0f63-4c22-b547-098724f995c8 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 06:02:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-7d619edf-0f63-4c22-b547-098724f995c8 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 06:02:31 user nova-compute[73391]: DEBUG os_brick.utils [None req-7d619edf-0f63-4c22-b547-098724f995c8 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:02:31 user nova-compute[73391]: DEBUG nova.virt.block_device [None req-7d619edf-0f63-4c22-b547-098724f995c8 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Updating existing volume attachment record: 038cf671-b108-485e-a4f8-0f2f2e2ba37b {{(pid=73391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 06:02:31 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:02:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:02:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:02:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:02:31 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Auditing locally available compute resources for user (node: user) {{(pid=73391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 06:02:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1633a986-77f2-41b2-a436-8c5029d4c7f6/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:02:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1633a986-77f2-41b2-a436-8c5029d4c7f6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:02:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1633a986-77f2-41b2-a436-8c5029d4c7f6/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:02:32 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:02:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1633a986-77f2-41b2-a436-8c5029d4c7f6/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:02:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595be11c-24db-43eb-9d5b-56cbeefd6149/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:02:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595be11c-24db-43eb-9d5b-56cbeefd6149/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:02:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595be11c-24db-43eb-9d5b-56cbeefd6149/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:02:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595be11c-24db-43eb-9d5b-56cbeefd6149/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:02:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d01f99d-fbd3-475e-93ac-3c39e6ca5980/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:02:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d01f99d-fbd3-475e-93ac-3c39e6ca5980/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:02:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d01f99d-fbd3-475e-93ac-3c39e6ca5980/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:02:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6d01f99d-fbd3-475e-93ac-3c39e6ca5980/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:02:33 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:02:33 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:02:33 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Hypervisor/Node resource view: name=user free_ram=8515MB free_disk=25.002094268798828GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 06:02:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:02:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:02:33 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 595be11c-24db-43eb-9d5b-56cbeefd6149 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:02:33 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 6d01f99d-fbd3-475e-93ac-3c39e6ca5980 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:02:33 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 1633a986-77f2-41b2-a436-8c5029d4c7f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:02:33 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 06:02:33 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 06:02:33 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:02:33 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:02:33 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Compute_service record updated for user:user {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 06:02:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.271s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:02:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:02:36 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:02:36 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:02:37 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:02:37 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:02:39 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d619edf-0f63-4c22-b547-098724f995c8 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 06:02:39 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d619edf-0f63-4c22-b547-098724f995c8 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:d7012f60-3d64-4795-bf5f-2ceae828ab6f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BtAEFsuS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:02:39 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-7d619edf-0f63-4c22-b547-098724f995c8 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:02:39 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-7d619edf-0f63-4c22-b547-098724f995c8 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:02:39 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-7d619edf-0f63-4c22-b547-098724f995c8 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:02:39 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-7d619edf-0f63-4c22-b547-098724f995c8 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:02:39 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-7d619edf-0f63-4c22-b547-098724f995c8 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7012f60-3d64-4795-bf5f-2ceae828ab6f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:02:39 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-7d619edf-0f63-4c22-b547-098724f995c8 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7012f60-3d64-4795-bf5f-2ceae828ab6f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:02:39 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-7d619edf-0f63-4c22-b547-098724f995c8 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 06:02:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7012f60-3d64-4795-bf5f-2ceae828ab6f -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:02:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7012f60-3d64-4795-bf5f-2ceae828ab6f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:02:39 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbbf23a5-3f77-488a-b9c5-2bb989b818a2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:02:39 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d619edf-0f63-4c22-b547-098724f995c8 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 06:02:39 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:02:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7012f60-3d64-4795-bf5f-2ceae828ab6f -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:02:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7012f60-3d64-4795-bf5f-2ceae828ab6f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:02:39 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[303e8142-53c2-490e-8425-cf0794c75e32]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7012f60-3d64-4795-bf5f-2ceae828ab6f] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:02:39 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d619edf-0f63-4c22-b547-098724f995c8 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d7012f60-3d64-4795-bf5f-2ceae828ab6f] added
Aug 15 06:02:39 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:02:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7012f60-3d64-4795-bf5f-2ceae828ab6f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:02:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7012f60-3d64-4795-bf5f-2ceae828ab6f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:02:39 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[463dc6c3-b5e4-4fdf-b74f-46ea48342c90]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:02:39 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d619edf-0f63-4c22-b547-098724f995c8 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:02:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7012f60-3d64-4795-bf5f-2ceae828ab6f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:02:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7012f60-3d64-4795-bf5f-2ceae828ab6f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:02:39 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf8a2ae-b119-4343-9f5a-0f66563ae4d9]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:02:39 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d619edf-0f63-4c22-b547-098724f995c8 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:02:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7012f60-3d64-4795-bf5f-2ceae828ab6f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BtAEFsuS {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:02:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7012f60-3d64-4795-bf5f-2ceae828ab6f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BtAEFsuS" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:02:39 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d499bc8a-6636-4fda-b87b-ffbb8e47e8b8]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:02:39 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d619edf-0f63-4c22-b547-098724f995c8 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BtAEFsuS'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:02:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7012f60-3d64-4795-bf5f-2ceae828ab6f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:02:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7012f60-3d64-4795-bf5f-2ceae828ab6f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:02:39 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[616d5e10-3d3e-4555-b085-a383ade3e59a]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:02:39 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d619edf-0f63-4c22-b547-098724f995c8 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:02:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:02:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:02:39 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4219df6a-46e7-4494-92b2-84f6ad4730f6]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:02:39 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d619edf-0f63-4c22-b547-098724f995c8 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 06:02:39 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:02:39 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d619edf-0f63-4c22-b547-098724f995c8 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 06:02:39 user nova-compute[73391]:  {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:02:39 user nova-compute[73391]: WARNING os_brick.initiator.connectors.iscsi [None req-7d619edf-0f63-4c22-b547-098724f995c8 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 06:02:39 user nova-compute[73391]: 
Aug 15 06:02:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7012f60-3d64-4795-bf5f-2ceae828ab6f -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:02:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7012f60-3d64-4795-bf5f-2ceae828ab6f -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:02:39 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[121f749c-261b-47e7-88c4-a50a27c753fe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7012f60-3d64-4795-bf5f-2ceae828ab6f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d7012f60-3d64-4795-bf5f-2ceae828ab6f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:02:39 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d619edf-0f63-4c22-b547-098724f995c8 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d7012f60-3d64-4795-bf5f-2ceae828ab6f, portal: 172.16.0.220,3260]
Aug 15 06:02:39 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:d7012f60-3d64-4795-bf5f-2ceae828ab6f, portal: 172.16.0.220,3260] successful.
Aug 15 06:02:39 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:02:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7012f60-3d64-4795-bf5f-2ceae828ab6f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:02:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7012f60-3d64-4795-bf5f-2ceae828ab6f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:02:39 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[707cc9a9-f096-46ba-b740-321f3508bc0d]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:02:39 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d619edf-0f63-4c22-b547-098724f995c8 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:02:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:02:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:02:39 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de96dfa-d240-4c93-8d44-207faa269c49]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7012f60-3d64-4795-bf5f-2ceae828ab6f (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:02:39 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d619edf-0f63-4c22-b547-098724f995c8 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7012f60-3d64-4795-bf5f-2ceae828ab6f (non-flash)
Aug 15 06:02:39 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:02:39 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d619edf-0f63-4c22-b547-098724f995c8 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7012f60-3d64-4795-bf5f-2ceae828ab6f (non-flash)
Aug 15 06:02:39 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:02:39 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-7d619edf-0f63-4c22-b547-098724f995c8 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d7012f60-3d64-4795-bf5f-2ceae828ab6f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:02:39 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d619edf-0f63-4c22-b547-098724f995c8 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 06:02:39 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-7d619edf-0f63-4c22-b547-098724f995c8 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 06:02:39 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-7d619edf-0f63-4c22-b547-098724f995c8 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 06:02:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:02:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:02:39 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[612e985c-99b5-4371-a5f7-948d4faba853]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:02:39 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-7d619edf-0f63-4c22-b547-098724f995c8 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: None {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 06:02:39 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:02:40 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-7d619edf-0f63-4c22-b547-098724f995c8 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 06:02:40 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d619edf-0f63-4c22-b547-098724f995c8 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BtAEFsuS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 06:02:40 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-7d619edf-0f63-4c22-b547-098724f995c8 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:02:40 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d619edf-0f63-4c22-b547-098724f995c8 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '23030323032616232', 'path': '/dev/sdb'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:02:40 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d619edf-0f63-4c22-b547-098724f995c8 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030323032616232', 'path': '/dev/sdb'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 06:02:40 user nova-compute[73391]: DEBUG nova.objects.instance [None req-7d619edf-0f63-4c22-b547-098724f995c8 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lazy-loading 'flavor' on Instance uuid 6d01f99d-fbd3-475e-93ac-3c39e6ca5980 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:02:40 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-7d619edf-0f63-4c22-b547-098724f995c8 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 06:02:40 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 06:02:40 user nova-compute[73391]:   <source dev="/dev/sdb"/>
Aug 15 06:02:40 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 06:02:40 user nova-compute[73391]:   <serial>d7012f60-3d64-4795-bf5f-2ceae828ab6f</serial>
Aug 15 06:02:40 user nova-compute[73391]: </disk>
Aug 15 06:02:40 user nova-compute[73391]:  {{(pid=73391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 06:02:41 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-7d619edf-0f63-4c22-b547-098724f995c8 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 06:02:41 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-7d619edf-0f63-4c22-b547-098724f995c8 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 06:02:41 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-7d619edf-0f63-4c22-b547-098724f995c8 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] No VIF found with MAC fa:16:3e:78:7a:a7, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 06:02:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-7d619edf-0f63-4c22-b547-098724f995c8 tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "6d01f99d-fbd3-475e-93ac-3c39e6ca5980" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.221s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:02:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-caa80bf3-9738-490c-aa42-a2c1d782c41e tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Acquiring lock "6d01f99d-fbd3-475e-93ac-3c39e6ca5980" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:02:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-caa80bf3-9738-490c-aa42-a2c1d782c41e tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "6d01f99d-fbd3-475e-93ac-3c39e6ca5980" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:02:42 user nova-compute[73391]: INFO nova.compute.manager [None req-caa80bf3-9738-490c-aa42-a2c1d782c41e tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Detaching volume d7012f60-3d64-4795-bf5f-2ceae828ab6f
Aug 15 06:02:42 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:02:42 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:02:42 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5005 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:02:42 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:02:42 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:02:42 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:02:42 user nova-compute[73391]: INFO nova.virt.block_device [None req-caa80bf3-9738-490c-aa42-a2c1d782c41e tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Attempting to driver detach volume d7012f60-3d64-4795-bf5f-2ceae828ab6f from mountpoint /dev/vdb
Aug 15 06:02:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-caa80bf3-9738-490c-aa42-a2c1d782c41e tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Attempting to detach device vdb from instance 6d01f99d-fbd3-475e-93ac-3c39e6ca5980 from the persistent domain config. {{(pid=73391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 06:02:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-caa80bf3-9738-490c-aa42-a2c1d782c41e tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 06:02:42 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 06:02:42 user nova-compute[73391]:   <source dev="/dev/sdb"/>
Aug 15 06:02:42 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 06:02:42 user nova-compute[73391]:   <serial>d7012f60-3d64-4795-bf5f-2ceae828ab6f</serial>
Aug 15 06:02:42 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 06:02:42 user nova-compute[73391]: </disk>
Aug 15 06:02:42 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 06:02:42 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-caa80bf3-9738-490c-aa42-a2c1d782c41e tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Successfully detached device vdb from instance 6d01f99d-fbd3-475e-93ac-3c39e6ca5980 from the persistent domain config.
Aug 15 06:02:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-caa80bf3-9738-490c-aa42-a2c1d782c41e tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 6d01f99d-fbd3-475e-93ac-3c39e6ca5980 from the live domain config. {{(pid=73391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 06:02:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-caa80bf3-9738-490c-aa42-a2c1d782c41e tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 06:02:42 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 06:02:42 user nova-compute[73391]:   <source dev="/dev/sdb"/>
Aug 15 06:02:42 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 06:02:42 user nova-compute[73391]:   <serial>d7012f60-3d64-4795-bf5f-2ceae828ab6f</serial>
Aug 15 06:02:42 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 06:02:42 user nova-compute[73391]: </disk>
Aug 15 06:02:42 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 06:02:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Received event <DeviceRemovedEvent: 1692079362.567289, 6d01f99d-fbd3-475e-93ac-3c39e6ca5980 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73391) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 06:02:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-caa80bf3-9738-490c-aa42-a2c1d782c41e tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 6d01f99d-fbd3-475e-93ac-3c39e6ca5980 {{(pid=73391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 06:02:42 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-caa80bf3-9738-490c-aa42-a2c1d782c41e tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Successfully detached device vdb from instance 6d01f99d-fbd3-475e-93ac-3c39e6ca5980 from the live domain config.
Aug 15 06:02:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-caa80bf3-9738-490c-aa42-a2c1d782c41e tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 06:02:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa80bf3-9738-490c-aa42-a2c1d782c41e tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:d7012f60-3d64-4795-bf5f-2ceae828ab6f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BtAEFsuS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:02:42 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-caa80bf3-9738-490c-aa42-a2c1d782c41e tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:02:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-caa80bf3-9738-490c-aa42-a2c1d782c41e tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:02:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-caa80bf3-9738-490c-aa42-a2c1d782c41e tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:02:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa80bf3-9738-490c-aa42-a2c1d782c41e tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7012f60-3d64-4795-bf5f-2ceae828ab6f', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 06:02:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:02:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:02:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7879514c-53ca-4949-9888-511e4a6d0e54]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d7012f60-3d64-4795-bf5f-2ceae828ab6f\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:02:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:02:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:02:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db4ffe3-43cf-442f-a91d-8d7c4cad49b2]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7012f60-3d64-4795-bf5f-2ceae828ab6f (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:02:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa80bf3-9738-490c-aa42-a2c1d782c41e tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7012f60-3d64-4795-bf5f-2ceae828ab6f (non-flash)
Aug 15 06:02:42 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:02:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa80bf3-9738-490c-aa42-a2c1d782c41e tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d7012f60-3d64-4795-bf5f-2ceae828ab6f (non-flash)
Aug 15 06:02:42 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:02:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa80bf3-9738-490c-aa42-a2c1d782c41e tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f772833ae60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7012f60-3d64-4795-bf5f-2ceae828ab6f'): ({'sdb'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 06:02:42 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-caa80bf3-9738-490c-aa42-a2c1d782c41e tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Removing single pathed devices sdb {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 06:02:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:02:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:02:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e7d3a8-d634-4ec7-a8da-a1be469f8d65]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:02:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:02:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:02:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ca9b71-d965-4354-8ee1-f12618b6d627]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:02:42 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-caa80bf3-9738-490c-aa42-a2c1d782c41e tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Flushing IO for device /dev/sdb {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 06:02:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:02:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:02:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f58c2a-6a99-466e-9f2e-dbe860cb0eae]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:02:42 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-caa80bf3-9738-490c-aa42-a2c1d782c41e tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 06:02:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:02:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:02:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9266f825-3313-489e-b66e-4c16519334e5]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:02:42 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-caa80bf3-9738-490c-aa42-a2c1d782c41e tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 06:02:42 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-caa80bf3-9738-490c-aa42-a2c1d782c41e tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] SCSI volumes sdb have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 06:02:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa80bf3-9738-490c-aa42-a2c1d782c41e tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d7012f60-3d64-4795-bf5f-2ceae828ab6f')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 06:02:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7012f60-3d64-4795-bf5f-2ceae828ab6f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:02:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7012f60-3d64-4795-bf5f-2ceae828ab6f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:02:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2051a7a2-da9a-4083-80ed-b8eeff85364e]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:02:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa80bf3-9738-490c-aa42-a2c1d782c41e tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:02:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7012f60-3d64-4795-bf5f-2ceae828ab6f -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:02:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7012f60-3d64-4795-bf5f-2ceae828ab6f -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:02:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e32031-3d85-4448-9401-85e996d6e4a9]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:d7012f60-3d64-4795-bf5f-2ceae828ab6f, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:d7012f60-3d64-4795-bf5f-2ceae828ab6f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:02:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa80bf3-9738-490c-aa42-a2c1d782c41e tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:d7012f60-3d64-4795-bf5f-2ceae828ab6f, portal: 172.16.0.220,3260]
Aug 15 06:02:42 user nova-compute[73391]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:d7012f60-3d64-4795-bf5f-2ceae828ab6f, portal: 172.16.0.220,3260] successful.
Aug 15 06:02:42 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:02:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d7012f60-3d64-4795-bf5f-2ceae828ab6f -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:02:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d7012f60-3d64-4795-bf5f-2ceae828ab6f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:02:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6e43b6-39f6-420e-885f-fdd827af8224]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:02:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa80bf3-9738-490c-aa42-a2c1d782c41e tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:02:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-caa80bf3-9738-490c-aa42-a2c1d782c41e tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.256s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:02:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa80bf3-9738-490c-aa42-a2c1d782c41e tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] <== disconnect_volume: return (257ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:02:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-caa80bf3-9738-490c-aa42-a2c1d782c41e tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 06:02:43 user nova-compute[73391]: DEBUG nova.objects.instance [None req-caa80bf3-9738-490c-aa42-a2c1d782c41e tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lazy-loading 'flavor' on Instance uuid 6d01f99d-fbd3-475e-93ac-3c39e6ca5980 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:02:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-caa80bf3-9738-490c-aa42-a2c1d782c41e tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "6d01f99d-fbd3-475e-93ac-3c39e6ca5980" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.603s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:02:43 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:02:43 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Starting heal instance info cache {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 06:02:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "refresh_cache-6d01f99d-fbd3-475e-93ac-3c39e6ca5980" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:02:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquired lock "refresh_cache-6d01f99d-fbd3-475e-93ac-3c39e6ca5980" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:02:43 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Forcefully refreshing network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 06:02:44 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Updating instance_info_cache with network_info: [{"id": "528573da-c249-4b80-af98-00d6da4fd06b", "address": "fa:16:3e:78:7a:a7", "network": {"id": "bc2718a2-a5ab-44e0-966d-9b180a30ac75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1022668030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8086add121594fe8a0bdde99dd9cae90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap528573da-c2", "ovs_interfaceid": "528573da-c249-4b80-af98-00d6da4fd06b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:02:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Releasing lock "refresh_cache-6d01f99d-fbd3-475e-93ac-3c39e6ca5980" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:02:44 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Updated the network info_cache for instance {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 06:02:44 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:02:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:02:45 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:02:45 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 06:02:47 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:02:49 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:02:52 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:02:57 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:03:00 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:03:02 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:03:07 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:03:12 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:03:17 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:03:17 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:03:17 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:03:17 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:03:17 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:03:17 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:03:22 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:03:27 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:03:32 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:03:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8b3c969a-5714-4f3a-b9ed-8bfaaaf4685e tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Acquiring lock "6d01f99d-fbd3-475e-93ac-3c39e6ca5980" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:03:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8b3c969a-5714-4f3a-b9ed-8bfaaaf4685e tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "6d01f99d-fbd3-475e-93ac-3c39e6ca5980" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:03:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8b3c969a-5714-4f3a-b9ed-8bfaaaf4685e tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Acquiring lock "6d01f99d-fbd3-475e-93ac-3c39e6ca5980-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:03:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8b3c969a-5714-4f3a-b9ed-8bfaaaf4685e tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "6d01f99d-fbd3-475e-93ac-3c39e6ca5980-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.003s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:03:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8b3c969a-5714-4f3a-b9ed-8bfaaaf4685e tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "6d01f99d-fbd3-475e-93ac-3c39e6ca5980-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:03:32 user nova-compute[73391]: INFO nova.compute.manager [None req-8b3c969a-5714-4f3a-b9ed-8bfaaaf4685e tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Terminating instance
Aug 15 06:03:32 user nova-compute[73391]: DEBUG nova.compute.manager [None req-8b3c969a-5714-4f3a-b9ed-8bfaaaf4685e tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Start destroying the instance on the hypervisor. {{(pid=73391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 06:03:32 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:03:32 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:03:32 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:03:32 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:03:32 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:03:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:03:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:03:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:03:32 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Auditing locally available compute resources for user (node: user) {{(pid=73391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 06:03:32 user nova-compute[73391]: DEBUG nova.compute.manager [req-4589cac1-a4a7-4ae0-a7d1-7e668d5cdd80 req-191e3458-a82f-4956-bd59-ea40158af6ea service nova] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Received event network-vif-unplugged-528573da-c249-4b80-af98-00d6da4fd06b {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:03:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-4589cac1-a4a7-4ae0-a7d1-7e668d5cdd80 req-191e3458-a82f-4956-bd59-ea40158af6ea service nova] Acquiring lock "6d01f99d-fbd3-475e-93ac-3c39e6ca5980-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:03:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-4589cac1-a4a7-4ae0-a7d1-7e668d5cdd80 req-191e3458-a82f-4956-bd59-ea40158af6ea service nova] Lock "6d01f99d-fbd3-475e-93ac-3c39e6ca5980-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:03:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-4589cac1-a4a7-4ae0-a7d1-7e668d5cdd80 req-191e3458-a82f-4956-bd59-ea40158af6ea service nova] Lock "6d01f99d-fbd3-475e-93ac-3c39e6ca5980-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:03:32 user nova-compute[73391]: DEBUG nova.compute.manager [req-4589cac1-a4a7-4ae0-a7d1-7e668d5cdd80 req-191e3458-a82f-4956-bd59-ea40158af6ea service nova] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] No waiting events found dispatching network-vif-unplugged-528573da-c249-4b80-af98-00d6da4fd06b {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:03:32 user nova-compute[73391]: DEBUG nova.compute.manager [req-4589cac1-a4a7-4ae0-a7d1-7e668d5cdd80 req-191e3458-a82f-4956-bd59-ea40158af6ea service nova] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Received event network-vif-unplugged-528573da-c249-4b80-af98-00d6da4fd06b for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 06:03:32 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:03:33 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Instance destroyed successfully.
Aug 15 06:03:33 user nova-compute[73391]: DEBUG nova.objects.instance [None req-8b3c969a-5714-4f3a-b9ed-8bfaaaf4685e tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lazy-loading 'resources' on Instance uuid 6d01f99d-fbd3-475e-93ac-3c39e6ca5980 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:03:33 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-8b3c969a-5714-4f3a-b9ed-8bfaaaf4685e tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T06:00:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-938062758',display_name='tempest-AttachVolumeNegativeTest-server-938062758',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-938062758',id=50,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBynwDX0Mi5yHH8aBsBXNm2jC9PL46Xr++z/8yeggazai7Q30Ay5pATWHj/uKDXViL9OKj6rQ2chw6a751ZCk0MMETrgE5ZhKBglST8vTxAcZSkRYyk/bLA46YnKKDQupw==',key_name='tempest-keypair-1250796984',keypairs=<?>,launch_index=0,launched_at=2023-08-15T06:00:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8086add121594fe8a0bdde99dd9cae90',ramdisk_id='',reservation_id='r-6fmq3j82',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1479702824',owner_user_name='tempest-AttachVolumeNegativeTest-1479702824-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T06:00:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='9552a83a6a214c149ddceac64ccbdef6',uuid=6d01f99d-fbd3-475e-93ac-3c39e6ca5980,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "528573da-c249-4b80-af98-00d6da4fd06b", "address": "fa:16:3e:78:7a:a7", "network": {"id": "bc2718a2-a5ab-44e0-966d-9b180a30ac75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1022668030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8086add121594fe8a0bdde99dd9cae90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap528573da-c2", "ovs_interfaceid": "528573da-c249-4b80-af98-00d6da4fd06b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 06:03:33 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-8b3c969a-5714-4f3a-b9ed-8bfaaaf4685e tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Converting VIF {"id": "528573da-c249-4b80-af98-00d6da4fd06b", "address": "fa:16:3e:78:7a:a7", "network": {"id": "bc2718a2-a5ab-44e0-966d-9b180a30ac75", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1022668030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.75", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8086add121594fe8a0bdde99dd9cae90", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap528573da-c2", "ovs_interfaceid": "528573da-c249-4b80-af98-00d6da4fd06b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:03:33 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-8b3c969a-5714-4f3a-b9ed-8bfaaaf4685e tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:7a:a7,bridge_name='br-int',has_traffic_filtering=True,id=528573da-c249-4b80-af98-00d6da4fd06b,network=Network(bc2718a2-a5ab-44e0-966d-9b180a30ac75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap528573da-c2') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:03:33 user nova-compute[73391]: DEBUG os_vif [None req-8b3c969a-5714-4f3a-b9ed-8bfaaaf4685e tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:7a:a7,bridge_name='br-int',has_traffic_filtering=True,id=528573da-c249-4b80-af98-00d6da4fd06b,network=Network(bc2718a2-a5ab-44e0-966d-9b180a30ac75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap528573da-c2') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 06:03:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:03:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap528573da-c2, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:03:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:03:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:03:33 user nova-compute[73391]: INFO os_vif [None req-8b3c969a-5714-4f3a-b9ed-8bfaaaf4685e tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:7a:a7,bridge_name='br-int',has_traffic_filtering=True,id=528573da-c249-4b80-af98-00d6da4fd06b,network=Network(bc2718a2-a5ab-44e0-966d-9b180a30ac75),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap528573da-c2')
Aug 15 06:03:33 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-8b3c969a-5714-4f3a-b9ed-8bfaaaf4685e tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Deleting instance files /opt/stack/data/nova/instances/6d01f99d-fbd3-475e-93ac-3c39e6ca5980_del
Aug 15 06:03:33 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-8b3c969a-5714-4f3a-b9ed-8bfaaaf4685e tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Deletion of /opt/stack/data/nova/instances/6d01f99d-fbd3-475e-93ac-3c39e6ca5980_del complete
Aug 15 06:03:33 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1633a986-77f2-41b2-a436-8c5029d4c7f6/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:03:33 user nova-compute[73391]: INFO nova.compute.manager [None req-8b3c969a-5714-4f3a-b9ed-8bfaaaf4685e tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Took 0.94 seconds to destroy the instance on the hypervisor.
Aug 15 06:03:33 user nova-compute[73391]: DEBUG oslo.service.loopingcall [None req-8b3c969a-5714-4f3a-b9ed-8bfaaaf4685e tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 06:03:33 user nova-compute[73391]: DEBUG nova.compute.manager [-] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Deallocating network for instance {{(pid=73391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 06:03:33 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] deallocate_for_instance() {{(pid=73391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 06:03:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-304a0548-75c1-448a-90a4-e08ca4df1deb tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Acquiring lock "1633a986-77f2-41b2-a436-8c5029d4c7f6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:03:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-304a0548-75c1-448a-90a4-e08ca4df1deb tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "1633a986-77f2-41b2-a436-8c5029d4c7f6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:03:33 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1633a986-77f2-41b2-a436-8c5029d4c7f6/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:03:33 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1633a986-77f2-41b2-a436-8c5029d4c7f6/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:03:33 user nova-compute[73391]: DEBUG nova.objects.instance [None req-304a0548-75c1-448a-90a4-e08ca4df1deb tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lazy-loading 'flavor' on Instance uuid 1633a986-77f2-41b2-a436-8c5029d4c7f6 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:03:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-304a0548-75c1-448a-90a4-e08ca4df1deb tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "1633a986-77f2-41b2-a436-8c5029d4c7f6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.104s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:03:33 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1633a986-77f2-41b2-a436-8c5029d4c7f6/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:03:33 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595be11c-24db-43eb-9d5b-56cbeefd6149/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:03:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-304a0548-75c1-448a-90a4-e08ca4df1deb tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Acquiring lock "1633a986-77f2-41b2-a436-8c5029d4c7f6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:03:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-304a0548-75c1-448a-90a4-e08ca4df1deb tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "1633a986-77f2-41b2-a436-8c5029d4c7f6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:03:33 user nova-compute[73391]: INFO nova.compute.manager [None req-304a0548-75c1-448a-90a4-e08ca4df1deb tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Attaching volume 9cd06168-d542-4dc3-8682-81400bf9fb26 to /dev/vdb
Aug 15 06:03:33 user nova-compute[73391]: DEBUG os_brick.utils [None req-304a0548-75c1-448a-90a4-e08ca4df1deb tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:03:33 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:03:33 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:03:33 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1abb11dc-d2f3-44d3-a8c4-9036e095427d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:03:33 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:03:33 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:03:33 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1bb4cb-d20a-4d69-803e-c0784ae697c7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:03:33 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:03:33 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595be11c-24db-43eb-9d5b-56cbeefd6149/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:03:33 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595be11c-24db-43eb-9d5b-56cbeefd6149/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:03:33 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:03:33 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[187955d8-128b-4f8f-a8a1-b23f3370494d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:03:33 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c41546b7-dfc2-4954-b9b7-0fa694ed5a6b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:03:33 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-304a0548-75c1-448a-90a4-e08ca4df1deb tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:03:33 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-304a0548-75c1-448a-90a4-e08ca4df1deb tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 06:03:33 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-304a0548-75c1-448a-90a4-e08ca4df1deb tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 06:03:33 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:03:33 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 06:03:33 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 06:03:33 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c137aa4-8520-464c-8be4-a32d9d6b7704]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:03:33 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-304a0548-75c1-448a-90a4-e08ca4df1deb tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 06:03:33 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-304a0548-75c1-448a-90a4-e08ca4df1deb tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 06:03:33 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-304a0548-75c1-448a-90a4-e08ca4df1deb tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 06:03:33 user nova-compute[73391]: DEBUG os_brick.utils [None req-304a0548-75c1-448a-90a4-e08ca4df1deb tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] <== get_connector_properties: return (178ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:03:33 user nova-compute[73391]: DEBUG nova.virt.block_device [None req-304a0548-75c1-448a-90a4-e08ca4df1deb tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Updating existing volume attachment record: 3c1b0f15-1e91-4564-85de-ab062d022f80 {{(pid=73391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 06:03:34 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595be11c-24db-43eb-9d5b-56cbeefd6149/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:03:34 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Error from libvirt while getting description of instance-00000032: [Error Code 42] Domain not found: no domain with matching uuid '6d01f99d-fbd3-475e-93ac-3c39e6ca5980' (instance-00000032): libvirt.libvirtError: Domain not found: no domain with matching uuid '6d01f99d-fbd3-475e-93ac-3c39e6ca5980' (instance-00000032)
Aug 15 06:03:34 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:03:34 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:03:34 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Hypervisor/Node resource view: name=user free_ram=8608MB free_disk=25.00094985961914GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 06:03:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:03:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:03:34 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:03:34 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Took 1.46 seconds to deallocate network for instance.
Aug 15 06:03:34 user nova-compute[73391]: DEBUG nova.compute.manager [req-022568a5-341e-4ddf-b8c5-c4a7ecf198e2 req-e46893c0-05b4-4688-8b95-4288858be403 service nova] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Received event network-vif-deleted-528573da-c249-4b80-af98-00d6da4fd06b {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:03:34 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 595be11c-24db-43eb-9d5b-56cbeefd6149 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:03:34 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 6d01f99d-fbd3-475e-93ac-3c39e6ca5980 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:03:34 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 1633a986-77f2-41b2-a436-8c5029d4c7f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:03:34 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 06:03:34 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 06:03:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8b3c969a-5714-4f3a-b9ed-8bfaaaf4685e tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:03:34 user nova-compute[73391]: DEBUG nova.compute.manager [req-87cb055e-fbdb-459d-9011-d37e9164a1e9 req-6103bb60-e856-43fa-b16c-05be32d252ea service nova] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Received event network-vif-plugged-528573da-c249-4b80-af98-00d6da4fd06b {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:03:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-87cb055e-fbdb-459d-9011-d37e9164a1e9 req-6103bb60-e856-43fa-b16c-05be32d252ea service nova] Acquiring lock "6d01f99d-fbd3-475e-93ac-3c39e6ca5980-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:03:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-87cb055e-fbdb-459d-9011-d37e9164a1e9 req-6103bb60-e856-43fa-b16c-05be32d252ea service nova] Lock "6d01f99d-fbd3-475e-93ac-3c39e6ca5980-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:03:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-87cb055e-fbdb-459d-9011-d37e9164a1e9 req-6103bb60-e856-43fa-b16c-05be32d252ea service nova] Lock "6d01f99d-fbd3-475e-93ac-3c39e6ca5980-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:03:34 user nova-compute[73391]: DEBUG nova.compute.manager [req-87cb055e-fbdb-459d-9011-d37e9164a1e9 req-6103bb60-e856-43fa-b16c-05be32d252ea service nova] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] No waiting events found dispatching network-vif-plugged-528573da-c249-4b80-af98-00d6da4fd06b {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:03:34 user nova-compute[73391]: WARNING nova.compute.manager [req-87cb055e-fbdb-459d-9011-d37e9164a1e9 req-6103bb60-e856-43fa-b16c-05be32d252ea service nova] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Received unexpected event network-vif-plugged-528573da-c249-4b80-af98-00d6da4fd06b for instance with vm_state deleted and task_state None.
Aug 15 06:03:34 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:03:34 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:03:35 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Compute_service record updated for user:user {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 06:03:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.295s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:03:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8b3c969a-5714-4f3a-b9ed-8bfaaaf4685e tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.173s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:03:35 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-8b3c969a-5714-4f3a-b9ed-8bfaaaf4685e tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:03:35 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-8b3c969a-5714-4f3a-b9ed-8bfaaaf4685e tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:03:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8b3c969a-5714-4f3a-b9ed-8bfaaaf4685e tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.155s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:03:35 user nova-compute[73391]: INFO nova.scheduler.client.report [None req-8b3c969a-5714-4f3a-b9ed-8bfaaaf4685e tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Deleted allocations for instance 6d01f99d-fbd3-475e-93ac-3c39e6ca5980
Aug 15 06:03:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-8b3c969a-5714-4f3a-b9ed-8bfaaaf4685e tempest-AttachVolumeNegativeTest-1479702824 tempest-AttachVolumeNegativeTest-1479702824-project-member] Lock "6d01f99d-fbd3-475e-93ac-3c39e6ca5980" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.949s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:03:36 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:03:36 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:03:38 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:03:38 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:03:41 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:03:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-304a0548-75c1-448a-90a4-e08ca4df1deb tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 06:03:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-304a0548-75c1-448a-90a4-e08ca4df1deb tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:9cd06168-d542-4dc3-8682-81400bf9fb26'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HevPWfKm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:03:42 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-304a0548-75c1-448a-90a4-e08ca4df1deb tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:03:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-304a0548-75c1-448a-90a4-e08ca4df1deb tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:03:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-304a0548-75c1-448a-90a4-e08ca4df1deb tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:03:42 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-304a0548-75c1-448a-90a4-e08ca4df1deb tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:03:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-304a0548-75c1-448a-90a4-e08ca4df1deb tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9cd06168-d542-4dc3-8682-81400bf9fb26" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:03:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-304a0548-75c1-448a-90a4-e08ca4df1deb tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9cd06168-d542-4dc3-8682-81400bf9fb26" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:03:42 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-304a0548-75c1-448a-90a4-e08ca4df1deb tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 06:03:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cd06168-d542-4dc3-8682-81400bf9fb26 -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:03:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cd06168-d542-4dc3-8682-81400bf9fb26 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:03:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a78d9bf-f775-4b1f-8261-936246797ec8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:03:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-304a0548-75c1-448a-90a4-e08ca4df1deb tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 06:03:42 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:03:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cd06168-d542-4dc3-8682-81400bf9fb26 -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:03:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cd06168-d542-4dc3-8682-81400bf9fb26 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:03:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97d00e6-fa82-489d-ab09-5e361f5eee21]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9cd06168-d542-4dc3-8682-81400bf9fb26] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:03:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-304a0548-75c1-448a-90a4-e08ca4df1deb tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9cd06168-d542-4dc3-8682-81400bf9fb26] added
Aug 15 06:03:42 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:03:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cd06168-d542-4dc3-8682-81400bf9fb26 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:03:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cd06168-d542-4dc3-8682-81400bf9fb26 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:03:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[829032f0-56d5-4b33-98ad-9d58b25bc78a]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:03:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-304a0548-75c1-448a-90a4-e08ca4df1deb tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:03:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cd06168-d542-4dc3-8682-81400bf9fb26 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:03:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cd06168-d542-4dc3-8682-81400bf9fb26 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:03:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[005dcb2d-fbf9-4b1b-afb4-830525da1295]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:03:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-304a0548-75c1-448a-90a4-e08ca4df1deb tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:03:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cd06168-d542-4dc3-8682-81400bf9fb26 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HevPWfKm {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:03:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cd06168-d542-4dc3-8682-81400bf9fb26 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HevPWfKm" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:03:42 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb228c8-b5eb-42db-b936-03494097d1c6]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:03:42 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-304a0548-75c1-448a-90a4-e08ca4df1deb tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HevPWfKm'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:03:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cd06168-d542-4dc3-8682-81400bf9fb26 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:03:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cd06168-d542-4dc3-8682-81400bf9fb26 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:03:43 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[054733bc-9c6a-494d-bacd-d609d9d1ba87]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:03:43 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-304a0548-75c1-448a-90a4-e08ca4df1deb tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:03:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:03:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:03:43 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1dcc97-8b68-4ba2-91b5-ed61af3dda4d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:03:43 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-304a0548-75c1-448a-90a4-e08ca4df1deb tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 06:03:43 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:03:43 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-304a0548-75c1-448a-90a4-e08ca4df1deb tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 06:03:43 user nova-compute[73391]:  {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:03:43 user nova-compute[73391]: WARNING os_brick.initiator.connectors.iscsi [None req-304a0548-75c1-448a-90a4-e08ca4df1deb tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 06:03:43 user nova-compute[73391]: 
Aug 15 06:03:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cd06168-d542-4dc3-8682-81400bf9fb26 -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:03:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cd06168-d542-4dc3-8682-81400bf9fb26 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:03:43 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5d28a7-cd48-4378-9ff8-f0f7089e2028]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9cd06168-d542-4dc3-8682-81400bf9fb26, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9cd06168-d542-4dc3-8682-81400bf9fb26, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:03:43 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-304a0548-75c1-448a-90a4-e08ca4df1deb tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9cd06168-d542-4dc3-8682-81400bf9fb26, portal: 172.16.0.220,3260]
Aug 15 06:03:43 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:9cd06168-d542-4dc3-8682-81400bf9fb26, portal: 172.16.0.220,3260] successful.
Aug 15 06:03:43 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:03:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cd06168-d542-4dc3-8682-81400bf9fb26 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:03:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cd06168-d542-4dc3-8682-81400bf9fb26 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:03:43 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e55bb7e-db0d-4bcd-be3e-8cf982147bc4]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:03:43 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-304a0548-75c1-448a-90a4-e08ca4df1deb tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:03:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:03:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:03:43 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[400f2253-0af3-475b-9055-b9c82a1d49b2]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd06168-d542-4dc3-8682-81400bf9fb26 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:03:43 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-304a0548-75c1-448a-90a4-e08ca4df1deb tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd06168-d542-4dc3-8682-81400bf9fb26 (non-flash)
Aug 15 06:03:43 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:03:43 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-304a0548-75c1-448a-90a4-e08ca4df1deb tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd06168-d542-4dc3-8682-81400bf9fb26 (non-flash)
Aug 15 06:03:43 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:03:43 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-304a0548-75c1-448a-90a4-e08ca4df1deb tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9cd06168-d542-4dc3-8682-81400bf9fb26" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:03:43 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-304a0548-75c1-448a-90a4-e08ca4df1deb tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 06:03:43 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-304a0548-75c1-448a-90a4-e08ca4df1deb tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 06:03:43 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-304a0548-75c1-448a-90a4-e08ca4df1deb tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 06:03:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:03:43 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:03:43 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:03:43 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:03:43 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:03:43 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:03:43 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:03:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:03:43 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f885bb3-000b-4cdb-9e5a-2de37675cfbb]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:03:43 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-304a0548-75c1-448a-90a4-e08ca4df1deb tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 06:03:43 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-304a0548-75c1-448a-90a4-e08ca4df1deb tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HevPWfKm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 06:03:43 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:03:43 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Starting heal instance info cache {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 06:03:43 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Rebuilding the list of instances to heal {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 06:03:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "refresh_cache-595be11c-24db-43eb-9d5b-56cbeefd6149" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:03:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquired lock "refresh_cache-595be11c-24db-43eb-9d5b-56cbeefd6149" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:03:43 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Forcefully refreshing network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 06:03:43 user nova-compute[73391]: DEBUG nova.objects.instance [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lazy-loading 'info_cache' on Instance uuid 595be11c-24db-43eb-9d5b-56cbeefd6149 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:03:44 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-304a0548-75c1-448a-90a4-e08ca4df1deb tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:03:44 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-304a0548-75c1-448a-90a4-e08ca4df1deb tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23438653663326635', 'path': '/dev/sdb'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:03:44 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-304a0548-75c1-448a-90a4-e08ca4df1deb tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23438653663326635', 'path': '/dev/sdb'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 06:03:44 user nova-compute[73391]: DEBUG nova.objects.instance [None req-304a0548-75c1-448a-90a4-e08ca4df1deb tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lazy-loading 'flavor' on Instance uuid 1633a986-77f2-41b2-a436-8c5029d4c7f6 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:03:44 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-304a0548-75c1-448a-90a4-e08ca4df1deb tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 06:03:44 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 06:03:44 user nova-compute[73391]:   <source dev="/dev/sdb"/>
Aug 15 06:03:44 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 06:03:44 user nova-compute[73391]:   <serial>9cd06168-d542-4dc3-8682-81400bf9fb26</serial>
Aug 15 06:03:44 user nova-compute[73391]: </disk>
Aug 15 06:03:44 user nova-compute[73391]:  {{(pid=73391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 06:03:44 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-304a0548-75c1-448a-90a4-e08ca4df1deb tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 06:03:44 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-304a0548-75c1-448a-90a4-e08ca4df1deb tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 06:03:44 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-304a0548-75c1-448a-90a4-e08ca4df1deb tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] No VIF found with MAC fa:16:3e:3c:b3:e7, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 06:03:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-304a0548-75c1-448a-90a4-e08ca4df1deb tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "1633a986-77f2-41b2-a436-8c5029d4c7f6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.072s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:03:44 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Updating instance_info_cache with network_info: [{"id": "3418de64-8dbd-4951-aca0-0dc87257dbcb", "address": "fa:16:3e:05:b7:5b", "network": {"id": "8e7b9da2-83d1-47d1-a352-a9684e3a2cdf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1697315681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a94181609a284eb29f8db71cf34c086b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3418de64-8d", "ovs_interfaceid": "3418de64-8dbd-4951-aca0-0dc87257dbcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:03:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Releasing lock "refresh_cache-595be11c-24db-43eb-9d5b-56cbeefd6149" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:03:44 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Updated the network info_cache for instance {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 06:03:46 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:03:46 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:03:46 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 06:03:47 user nova-compute[73391]: DEBUG nova.compute.manager [req-d5588e25-62ef-469f-b242-91d6db6400bd req-bcb7f7d6-1105-48ef-8e73-6c078680e046 service nova] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Received event network-changed-08226f47-93f7-4b29-a752-7e8e37a665f8 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:03:47 user nova-compute[73391]: DEBUG nova.compute.manager [req-d5588e25-62ef-469f-b242-91d6db6400bd req-bcb7f7d6-1105-48ef-8e73-6c078680e046 service nova] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Refreshing instance network info cache due to event network-changed-08226f47-93f7-4b29-a752-7e8e37a665f8. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 06:03:47 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d5588e25-62ef-469f-b242-91d6db6400bd req-bcb7f7d6-1105-48ef-8e73-6c078680e046 service nova] Acquiring lock "refresh_cache-1633a986-77f2-41b2-a436-8c5029d4c7f6" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:03:47 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d5588e25-62ef-469f-b242-91d6db6400bd req-bcb7f7d6-1105-48ef-8e73-6c078680e046 service nova] Acquired lock "refresh_cache-1633a986-77f2-41b2-a436-8c5029d4c7f6" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:03:47 user nova-compute[73391]: DEBUG nova.network.neutron [req-d5588e25-62ef-469f-b242-91d6db6400bd req-bcb7f7d6-1105-48ef-8e73-6c078680e046 service nova] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Refreshing network info cache for port 08226f47-93f7-4b29-a752-7e8e37a665f8 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 06:03:48 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692079413.1079621, 6d01f99d-fbd3-475e-93ac-3c39e6ca5980 => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:03:48 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] VM Stopped (Lifecycle Event)
Aug 15 06:03:48 user nova-compute[73391]: DEBUG nova.compute.manager [None req-bd3f8a0e-f833-4723-a6b1-bd5a720552cd None None] [instance: 6d01f99d-fbd3-475e-93ac-3c39e6ca5980] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:03:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:03:48 user nova-compute[73391]: DEBUG nova.network.neutron [req-d5588e25-62ef-469f-b242-91d6db6400bd req-bcb7f7d6-1105-48ef-8e73-6c078680e046 service nova] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Updated VIF entry in instance network info cache for port 08226f47-93f7-4b29-a752-7e8e37a665f8. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 06:03:48 user nova-compute[73391]: DEBUG nova.network.neutron [req-d5588e25-62ef-469f-b242-91d6db6400bd req-bcb7f7d6-1105-48ef-8e73-6c078680e046 service nova] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Updating instance_info_cache with network_info: [{"id": "08226f47-93f7-4b29-a752-7e8e37a665f8", "address": "fa:16:3e:3c:b3:e7", "network": {"id": "2a8063f6-42ce-41b8-86f6-72c17f4c2a7b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1765547969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd985a0cd6884c858487187ce252bba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08226f47-93", "ovs_interfaceid": "08226f47-93f7-4b29-a752-7e8e37a665f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:03:48 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d5588e25-62ef-469f-b242-91d6db6400bd req-bcb7f7d6-1105-48ef-8e73-6c078680e046 service nova] Releasing lock "refresh_cache-1633a986-77f2-41b2-a436-8c5029d4c7f6" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:03:49 user nova-compute[73391]: DEBUG nova.compute.manager [req-6315cca1-57eb-4360-9f0d-28b51ea74c05 req-857cebeb-b2f4-427a-a694-9bec21e092fc service nova] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Received event network-changed-08226f47-93f7-4b29-a752-7e8e37a665f8 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:03:49 user nova-compute[73391]: DEBUG nova.compute.manager [req-6315cca1-57eb-4360-9f0d-28b51ea74c05 req-857cebeb-b2f4-427a-a694-9bec21e092fc service nova] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Refreshing instance network info cache due to event network-changed-08226f47-93f7-4b29-a752-7e8e37a665f8. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 06:03:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-6315cca1-57eb-4360-9f0d-28b51ea74c05 req-857cebeb-b2f4-427a-a694-9bec21e092fc service nova] Acquiring lock "refresh_cache-1633a986-77f2-41b2-a436-8c5029d4c7f6" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:03:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-6315cca1-57eb-4360-9f0d-28b51ea74c05 req-857cebeb-b2f4-427a-a694-9bec21e092fc service nova] Acquired lock "refresh_cache-1633a986-77f2-41b2-a436-8c5029d4c7f6" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:03:49 user nova-compute[73391]: DEBUG nova.network.neutron [req-6315cca1-57eb-4360-9f0d-28b51ea74c05 req-857cebeb-b2f4-427a-a694-9bec21e092fc service nova] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Refreshing network info cache for port 08226f47-93f7-4b29-a752-7e8e37a665f8 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 06:03:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2bde4c22-85ce-48eb-b33d-e7627f58a8d0 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Acquiring lock "1633a986-77f2-41b2-a436-8c5029d4c7f6" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:03:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2bde4c22-85ce-48eb-b33d-e7627f58a8d0 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "1633a986-77f2-41b2-a436-8c5029d4c7f6" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:03:49 user nova-compute[73391]: INFO nova.compute.manager [None req-2bde4c22-85ce-48eb-b33d-e7627f58a8d0 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Rebooting instance
Aug 15 06:03:50 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2bde4c22-85ce-48eb-b33d-e7627f58a8d0 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Acquiring lock "refresh_cache-1633a986-77f2-41b2-a436-8c5029d4c7f6" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:03:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:03:50 user nova-compute[73391]: DEBUG nova.network.neutron [req-6315cca1-57eb-4360-9f0d-28b51ea74c05 req-857cebeb-b2f4-427a-a694-9bec21e092fc service nova] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Updated VIF entry in instance network info cache for port 08226f47-93f7-4b29-a752-7e8e37a665f8. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 06:03:50 user nova-compute[73391]: DEBUG nova.network.neutron [req-6315cca1-57eb-4360-9f0d-28b51ea74c05 req-857cebeb-b2f4-427a-a694-9bec21e092fc service nova] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Updating instance_info_cache with network_info: [{"id": "08226f47-93f7-4b29-a752-7e8e37a665f8", "address": "fa:16:3e:3c:b3:e7", "network": {"id": "2a8063f6-42ce-41b8-86f6-72c17f4c2a7b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1765547969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd985a0cd6884c858487187ce252bba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08226f47-93", "ovs_interfaceid": "08226f47-93f7-4b29-a752-7e8e37a665f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:03:50 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-6315cca1-57eb-4360-9f0d-28b51ea74c05 req-857cebeb-b2f4-427a-a694-9bec21e092fc service nova] Releasing lock "refresh_cache-1633a986-77f2-41b2-a436-8c5029d4c7f6" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:03:50 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2bde4c22-85ce-48eb-b33d-e7627f58a8d0 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Acquired lock "refresh_cache-1633a986-77f2-41b2-a436-8c5029d4c7f6" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:03:50 user nova-compute[73391]: DEBUG nova.network.neutron [None req-2bde4c22-85ce-48eb-b33d-e7627f58a8d0 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 06:03:50 user nova-compute[73391]: DEBUG nova.network.neutron [None req-2bde4c22-85ce-48eb-b33d-e7627f58a8d0 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Updating instance_info_cache with network_info: [{"id": "08226f47-93f7-4b29-a752-7e8e37a665f8", "address": "fa:16:3e:3c:b3:e7", "network": {"id": "2a8063f6-42ce-41b8-86f6-72c17f4c2a7b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1765547969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd985a0cd6884c858487187ce252bba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08226f47-93", "ovs_interfaceid": "08226f47-93f7-4b29-a752-7e8e37a665f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:03:50 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2bde4c22-85ce-48eb-b33d-e7627f58a8d0 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Releasing lock "refresh_cache-1633a986-77f2-41b2-a436-8c5029d4c7f6" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:03:50 user nova-compute[73391]: DEBUG nova.compute.manager [None req-2bde4c22-85ce-48eb-b33d-e7627f58a8d0 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:03:51 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:03:52 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:03:52 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:03:52 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:03:52 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:03:53 user nova-compute[73391]: DEBUG nova.compute.manager [req-492bdb2a-afac-4d45-8e46-31abcfbccf71 req-4f4c353e-a39d-484a-a407-af7163574db6 service nova] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Received event network-vif-unplugged-08226f47-93f7-4b29-a752-7e8e37a665f8 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:03:53 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-492bdb2a-afac-4d45-8e46-31abcfbccf71 req-4f4c353e-a39d-484a-a407-af7163574db6 service nova] Acquiring lock "1633a986-77f2-41b2-a436-8c5029d4c7f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:03:53 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-492bdb2a-afac-4d45-8e46-31abcfbccf71 req-4f4c353e-a39d-484a-a407-af7163574db6 service nova] Lock "1633a986-77f2-41b2-a436-8c5029d4c7f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:03:53 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-492bdb2a-afac-4d45-8e46-31abcfbccf71 req-4f4c353e-a39d-484a-a407-af7163574db6 service nova] Lock "1633a986-77f2-41b2-a436-8c5029d4c7f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:03:53 user nova-compute[73391]: DEBUG nova.compute.manager [req-492bdb2a-afac-4d45-8e46-31abcfbccf71 req-4f4c353e-a39d-484a-a407-af7163574db6 service nova] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] No waiting events found dispatching network-vif-unplugged-08226f47-93f7-4b29-a752-7e8e37a665f8 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:03:53 user nova-compute[73391]: WARNING nova.compute.manager [req-492bdb2a-afac-4d45-8e46-31abcfbccf71 req-4f4c353e-a39d-484a-a407-af7163574db6 service nova] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Received unexpected event network-vif-unplugged-08226f47-93f7-4b29-a752-7e8e37a665f8 for instance with vm_state active and task_state reboot_started.
Aug 15 06:03:53 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:03:53 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-2bde4c22-85ce-48eb-b33d-e7627f58a8d0 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Instance shutdown successfully.
Aug 15 06:03:54 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:03:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:03:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:03:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:03:55 user nova-compute[73391]: DEBUG nova.compute.manager [req-4cf1de55-1621-4300-8b9a-168caad5ed4c req-a544df6b-7e40-4bfe-881e-8ca936261501 service nova] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Received event network-vif-plugged-08226f47-93f7-4b29-a752-7e8e37a665f8 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:03:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-4cf1de55-1621-4300-8b9a-168caad5ed4c req-a544df6b-7e40-4bfe-881e-8ca936261501 service nova] Acquiring lock "1633a986-77f2-41b2-a436-8c5029d4c7f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:03:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-4cf1de55-1621-4300-8b9a-168caad5ed4c req-a544df6b-7e40-4bfe-881e-8ca936261501 service nova] Lock "1633a986-77f2-41b2-a436-8c5029d4c7f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:03:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-4cf1de55-1621-4300-8b9a-168caad5ed4c req-a544df6b-7e40-4bfe-881e-8ca936261501 service nova] Lock "1633a986-77f2-41b2-a436-8c5029d4c7f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:03:55 user nova-compute[73391]: DEBUG nova.compute.manager [req-4cf1de55-1621-4300-8b9a-168caad5ed4c req-a544df6b-7e40-4bfe-881e-8ca936261501 service nova] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] No waiting events found dispatching network-vif-plugged-08226f47-93f7-4b29-a752-7e8e37a665f8 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:03:55 user nova-compute[73391]: WARNING nova.compute.manager [req-4cf1de55-1621-4300-8b9a-168caad5ed4c req-a544df6b-7e40-4bfe-881e-8ca936261501 service nova] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Received unexpected event network-vif-plugged-08226f47-93f7-4b29-a752-7e8e37a665f8 for instance with vm_state active and task_state reboot_started.
Aug 15 06:03:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:03:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:03:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:03:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:03:57 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Removed pending event for 1633a986-77f2-41b2-a436-8c5029d4c7f6 due to event {{(pid=73391) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Aug 15 06:03:57 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692079437.1488109, 1633a986-77f2-41b2-a436-8c5029d4c7f6 => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:03:57 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] VM Resumed (Lifecycle Event)
Aug 15 06:03:57 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Instance running successfully.
Aug 15 06:03:57 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-2bde4c22-85ce-48eb-b33d-e7627f58a8d0 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Instance soft rebooted successfully.
Aug 15 06:03:57 user nova-compute[73391]: DEBUG nova.compute.manager [None req-2bde4c22-85ce-48eb-b33d-e7627f58a8d0 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:03:57 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:03:57 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 06:03:57 user nova-compute[73391]: DEBUG nova.compute.manager [req-ad58c38d-5f41-4af9-b970-25fb95a22c35 req-06c1c450-c9b5-4f66-b424-fa61f019e3be service nova] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Received event network-vif-plugged-08226f47-93f7-4b29-a752-7e8e37a665f8 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:03:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ad58c38d-5f41-4af9-b970-25fb95a22c35 req-06c1c450-c9b5-4f66-b424-fa61f019e3be service nova] Acquiring lock "1633a986-77f2-41b2-a436-8c5029d4c7f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:03:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ad58c38d-5f41-4af9-b970-25fb95a22c35 req-06c1c450-c9b5-4f66-b424-fa61f019e3be service nova] Lock "1633a986-77f2-41b2-a436-8c5029d4c7f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:03:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ad58c38d-5f41-4af9-b970-25fb95a22c35 req-06c1c450-c9b5-4f66-b424-fa61f019e3be service nova] Lock "1633a986-77f2-41b2-a436-8c5029d4c7f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:03:57 user nova-compute[73391]: DEBUG nova.compute.manager [req-ad58c38d-5f41-4af9-b970-25fb95a22c35 req-06c1c450-c9b5-4f66-b424-fa61f019e3be service nova] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] No waiting events found dispatching network-vif-plugged-08226f47-93f7-4b29-a752-7e8e37a665f8 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:03:57 user nova-compute[73391]: WARNING nova.compute.manager [req-ad58c38d-5f41-4af9-b970-25fb95a22c35 req-06c1c450-c9b5-4f66-b424-fa61f019e3be service nova] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Received unexpected event network-vif-plugged-08226f47-93f7-4b29-a752-7e8e37a665f8 for instance with vm_state active and task_state reboot_started.
Aug 15 06:03:57 user nova-compute[73391]: DEBUG nova.compute.manager [req-ad58c38d-5f41-4af9-b970-25fb95a22c35 req-06c1c450-c9b5-4f66-b424-fa61f019e3be service nova] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Received event network-vif-plugged-08226f47-93f7-4b29-a752-7e8e37a665f8 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:03:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ad58c38d-5f41-4af9-b970-25fb95a22c35 req-06c1c450-c9b5-4f66-b424-fa61f019e3be service nova] Acquiring lock "1633a986-77f2-41b2-a436-8c5029d4c7f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:03:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ad58c38d-5f41-4af9-b970-25fb95a22c35 req-06c1c450-c9b5-4f66-b424-fa61f019e3be service nova] Lock "1633a986-77f2-41b2-a436-8c5029d4c7f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:03:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ad58c38d-5f41-4af9-b970-25fb95a22c35 req-06c1c450-c9b5-4f66-b424-fa61f019e3be service nova] Lock "1633a986-77f2-41b2-a436-8c5029d4c7f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:03:57 user nova-compute[73391]: DEBUG nova.compute.manager [req-ad58c38d-5f41-4af9-b970-25fb95a22c35 req-06c1c450-c9b5-4f66-b424-fa61f019e3be service nova] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] No waiting events found dispatching network-vif-plugged-08226f47-93f7-4b29-a752-7e8e37a665f8 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:03:57 user nova-compute[73391]: WARNING nova.compute.manager [req-ad58c38d-5f41-4af9-b970-25fb95a22c35 req-06c1c450-c9b5-4f66-b424-fa61f019e3be service nova] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Received unexpected event network-vif-plugged-08226f47-93f7-4b29-a752-7e8e37a665f8 for instance with vm_state active and task_state reboot_started.
Aug 15 06:03:57 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] During sync_power_state the instance has a pending task (reboot_started). Skip.
Aug 15 06:03:57 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692079437.1498196, 1633a986-77f2-41b2-a436-8c5029d4c7f6 => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:03:57 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] VM Started (Lifecycle Event)
Aug 15 06:03:57 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:03:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2bde4c22-85ce-48eb-b33d-e7627f58a8d0 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "1633a986-77f2-41b2-a436-8c5029d4c7f6" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.227s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:03:57 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 06:03:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:04:00 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:04:03 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:04:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:04:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:04:13 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:04:15 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:04:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:04:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:04:23 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:04:25 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:04:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:04:32 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:04:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:04:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:04:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:04:32 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Auditing locally available compute resources for user (node: user) {{(pid=73391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 06:04:32 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1633a986-77f2-41b2-a436-8c5029d4c7f6/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:04:33 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1633a986-77f2-41b2-a436-8c5029d4c7f6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:04:33 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1633a986-77f2-41b2-a436-8c5029d4c7f6/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:04:33 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1633a986-77f2-41b2-a436-8c5029d4c7f6/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:04:33 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 06:04:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:04:33 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595be11c-24db-43eb-9d5b-56cbeefd6149/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:04:33 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595be11c-24db-43eb-9d5b-56cbeefd6149/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:04:33 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595be11c-24db-43eb-9d5b-56cbeefd6149/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:04:33 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595be11c-24db-43eb-9d5b-56cbeefd6149/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:04:34 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:04:34 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:04:34 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Hypervisor/Node resource view: name=user free_ram=8584MB free_disk=25.026485443115234GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 06:04:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:04:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:04:34 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 595be11c-24db-43eb-9d5b-56cbeefd6149 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:04:34 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 1633a986-77f2-41b2-a436-8c5029d4c7f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:04:34 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 06:04:34 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 06:04:34 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:04:34 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:04:34 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Compute_service record updated for user:user {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 06:04:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.220s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:04:38 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:04:38 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:04:38 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:04:39 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:04:42 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:04:43 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:04:43 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:04:44 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:04:44 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:04:44 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Starting heal instance info cache {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 06:04:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "refresh_cache-1633a986-77f2-41b2-a436-8c5029d4c7f6" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:04:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquired lock "refresh_cache-1633a986-77f2-41b2-a436-8c5029d4c7f6" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:04:44 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Forcefully refreshing network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 06:04:45 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Updating instance_info_cache with network_info: [{"id": "08226f47-93f7-4b29-a752-7e8e37a665f8", "address": "fa:16:3e:3c:b3:e7", "network": {"id": "2a8063f6-42ce-41b8-86f6-72c17f4c2a7b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1765547969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd985a0cd6884c858487187ce252bba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08226f47-93", "ovs_interfaceid": "08226f47-93f7-4b29-a752-7e8e37a665f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:04:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Releasing lock "refresh_cache-1633a986-77f2-41b2-a436-8c5029d4c7f6" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:04:45 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Updated the network info_cache for instance {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 06:04:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:04:48 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:04:48 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:04:48 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 06:04:51 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:04:53 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:04:53 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:04:53 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:04:53 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:04:53 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:04:53 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:04:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:04:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:04:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:04:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:04:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:04:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:05:03 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:05:05 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:05:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:05:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:05:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:05:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:05:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:05:05 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:05:05 user nova-compute[73391]: DEBUG nova.virt.libvirt.imagecache [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Verify base images {{(pid=73391) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Aug 15 06:05:05 user nova-compute[73391]: DEBUG nova.virt.libvirt.imagecache [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Image id 5dcc1e41-6efd-4557-94fe-47a802151660 yields fingerprint cbee69d9bb3d2af939a422103b0abc1d98d60371 {{(pid=73391) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 15 06:05:05 user nova-compute[73391]: INFO nova.virt.libvirt.imagecache [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] image 5dcc1e41-6efd-4557-94fe-47a802151660 at (/opt/stack/data/nova/instances/_base/cbee69d9bb3d2af939a422103b0abc1d98d60371): checking
Aug 15 06:05:05 user nova-compute[73391]: DEBUG nova.virt.libvirt.imagecache [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] image 5dcc1e41-6efd-4557-94fe-47a802151660 at (/opt/stack/data/nova/instances/_base/cbee69d9bb3d2af939a422103b0abc1d98d60371): image is in use {{(pid=73391) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 15 06:05:05 user nova-compute[73391]: DEBUG nova.virt.libvirt.imagecache [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=73391) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 15 06:05:05 user nova-compute[73391]: DEBUG nova.virt.libvirt.imagecache [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Image id 191b1dad-305e-4d1c-9b15-515ec59a3278 yields fingerprint 999b315ba87151d8252d543312ae7790e7e1583b {{(pid=73391) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Aug 15 06:05:05 user nova-compute[73391]: INFO nova.virt.libvirt.imagecache [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] image 191b1dad-305e-4d1c-9b15-515ec59a3278 at (/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b): checking
Aug 15 06:05:05 user nova-compute[73391]: DEBUG nova.virt.libvirt.imagecache [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] image 191b1dad-305e-4d1c-9b15-515ec59a3278 at (/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b): image is in use {{(pid=73391) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Aug 15 06:05:05 user nova-compute[73391]: DEBUG nova.virt.libvirt.imagecache [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] 1633a986-77f2-41b2-a436-8c5029d4c7f6 is a valid instance name {{(pid=73391) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 15 06:05:05 user nova-compute[73391]: DEBUG nova.virt.libvirt.imagecache [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] 1633a986-77f2-41b2-a436-8c5029d4c7f6 has a disk file {{(pid=73391) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 15 06:05:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1633a986-77f2-41b2-a436-8c5029d4c7f6/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:05:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1633a986-77f2-41b2-a436-8c5029d4c7f6/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:05:05 user nova-compute[73391]: DEBUG nova.virt.libvirt.imagecache [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 1633a986-77f2-41b2-a436-8c5029d4c7f6 is backed by cbee69d9bb3d2af939a422103b0abc1d98d60371 {{(pid=73391) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 15 06:05:05 user nova-compute[73391]: DEBUG nova.virt.libvirt.imagecache [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] 595be11c-24db-43eb-9d5b-56cbeefd6149 is a valid instance name {{(pid=73391) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Aug 15 06:05:05 user nova-compute[73391]: DEBUG nova.virt.libvirt.imagecache [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] 595be11c-24db-43eb-9d5b-56cbeefd6149 has a disk file {{(pid=73391) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Aug 15 06:05:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595be11c-24db-43eb-9d5b-56cbeefd6149/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:05:06 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595be11c-24db-43eb-9d5b-56cbeefd6149/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:05:06 user nova-compute[73391]: DEBUG nova.virt.libvirt.imagecache [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 595be11c-24db-43eb-9d5b-56cbeefd6149 is backed by 999b315ba87151d8252d543312ae7790e7e1583b {{(pid=73391) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Aug 15 06:05:06 user nova-compute[73391]: WARNING nova.virt.libvirt.imagecache [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Unknown base file: /opt/stack/data/nova/instances/_base/972c65b3edc3d8b6a61d3e430795d1c50e8d8df8
Aug 15 06:05:06 user nova-compute[73391]: WARNING nova.virt.libvirt.imagecache [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Unknown base file: /opt/stack/data/nova/instances/_base/5879527ac474fa01d95e727ae35634824d86b876
Aug 15 06:05:06 user nova-compute[73391]: WARNING nova.virt.libvirt.imagecache [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Unknown base file: /opt/stack/data/nova/instances/_base/fb1d1e756870131589138eba11abef5fde0e83cc
Aug 15 06:05:06 user nova-compute[73391]: WARNING nova.virt.libvirt.imagecache [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Unknown base file: /opt/stack/data/nova/instances/_base/8fd6a6206a4889a3b85acfa5649b743194df0178
Aug 15 06:05:06 user nova-compute[73391]: WARNING nova.virt.libvirt.imagecache [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Unknown base file: /opt/stack/data/nova/instances/_base/51a1041a69a8c2aa33dc989a0bfada8913b9657f
Aug 15 06:05:06 user nova-compute[73391]: WARNING nova.virt.libvirt.imagecache [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Unknown base file: /opt/stack/data/nova/instances/_base/2c7bea368f90175e09c0878c02431be4aa32d584
Aug 15 06:05:06 user nova-compute[73391]: WARNING nova.virt.libvirt.imagecache [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Unknown base file: /opt/stack/data/nova/instances/_base/83623054bf8d0ebe996f41ab1bf625e0990bf441
Aug 15 06:05:06 user nova-compute[73391]: WARNING nova.virt.libvirt.imagecache [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Unknown base file: /opt/stack/data/nova/instances/_base/633340cb08725de90f042b5867e5e887c024aafa
Aug 15 06:05:06 user nova-compute[73391]: INFO nova.virt.libvirt.imagecache [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Active base files: /opt/stack/data/nova/instances/_base/cbee69d9bb3d2af939a422103b0abc1d98d60371 /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b
Aug 15 06:05:06 user nova-compute[73391]: INFO nova.virt.libvirt.imagecache [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Removable base files: /opt/stack/data/nova/instances/_base/972c65b3edc3d8b6a61d3e430795d1c50e8d8df8 /opt/stack/data/nova/instances/_base/5879527ac474fa01d95e727ae35634824d86b876 /opt/stack/data/nova/instances/_base/fb1d1e756870131589138eba11abef5fde0e83cc /opt/stack/data/nova/instances/_base/8fd6a6206a4889a3b85acfa5649b743194df0178 /opt/stack/data/nova/instances/_base/51a1041a69a8c2aa33dc989a0bfada8913b9657f /opt/stack/data/nova/instances/_base/2c7bea368f90175e09c0878c02431be4aa32d584 /opt/stack/data/nova/instances/_base/83623054bf8d0ebe996f41ab1bf625e0990bf441 /opt/stack/data/nova/instances/_base/633340cb08725de90f042b5867e5e887c024aafa
Aug 15 06:05:06 user nova-compute[73391]: INFO nova.virt.libvirt.imagecache [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/972c65b3edc3d8b6a61d3e430795d1c50e8d8df8
Aug 15 06:05:06 user nova-compute[73391]: INFO nova.virt.libvirt.imagecache [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/5879527ac474fa01d95e727ae35634824d86b876
Aug 15 06:05:06 user nova-compute[73391]: INFO nova.virt.libvirt.imagecache [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/fb1d1e756870131589138eba11abef5fde0e83cc
Aug 15 06:05:06 user nova-compute[73391]: INFO nova.virt.libvirt.imagecache [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8fd6a6206a4889a3b85acfa5649b743194df0178
Aug 15 06:05:06 user nova-compute[73391]: INFO nova.virt.libvirt.imagecache [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/51a1041a69a8c2aa33dc989a0bfada8913b9657f
Aug 15 06:05:06 user nova-compute[73391]: INFO nova.virt.libvirt.imagecache [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2c7bea368f90175e09c0878c02431be4aa32d584
Aug 15 06:05:06 user nova-compute[73391]: INFO nova.virt.libvirt.imagecache [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/83623054bf8d0ebe996f41ab1bf625e0990bf441
Aug 15 06:05:06 user nova-compute[73391]: INFO nova.virt.libvirt.imagecache [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/633340cb08725de90f042b5867e5e887c024aafa
Aug 15 06:05:06 user nova-compute[73391]: DEBUG nova.virt.libvirt.imagecache [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Verification complete {{(pid=73391) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Aug 15 06:05:06 user nova-compute[73391]: DEBUG nova.virt.libvirt.imagecache [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Verify swap images {{(pid=73391) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Aug 15 06:05:06 user nova-compute[73391]: DEBUG nova.virt.libvirt.imagecache [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Verify ephemeral images {{(pid=73391) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Aug 15 06:05:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:05:13 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:05:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:05:23 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:05:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:05:33 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:05:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:05:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:05:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:05:33 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Auditing locally available compute resources for user (node: user) {{(pid=73391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 06:05:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:05:33 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1633a986-77f2-41b2-a436-8c5029d4c7f6/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:05:33 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1633a986-77f2-41b2-a436-8c5029d4c7f6/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:05:33 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1633a986-77f2-41b2-a436-8c5029d4c7f6/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:05:33 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1633a986-77f2-41b2-a436-8c5029d4c7f6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:05:33 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 06:05:33 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595be11c-24db-43eb-9d5b-56cbeefd6149/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:05:33 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595be11c-24db-43eb-9d5b-56cbeefd6149/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:05:33 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595be11c-24db-43eb-9d5b-56cbeefd6149/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:05:34 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595be11c-24db-43eb-9d5b-56cbeefd6149/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:05:34 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:05:34 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:05:34 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Hypervisor/Node resource view: name=user free_ram=8643MB free_disk=25.024303436279297GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 06:05:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:05:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:05:34 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 595be11c-24db-43eb-9d5b-56cbeefd6149 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:05:34 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 1633a986-77f2-41b2-a436-8c5029d4c7f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:05:34 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 06:05:34 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 06:05:34 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:05:34 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:05:34 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Compute_service record updated for user:user {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 06:05:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.348s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:05:38 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:05:39 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:05:39 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:05:41 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:05:41 user nova-compute[73391]: DEBUG nova.compute.manager [req-ee364234-ca93-4861-82e6-2c11206a6f84 req-d91191b4-d8c8-4d63-90b1-a63a13ff9699 service nova] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Received event network-changed-08226f47-93f7-4b29-a752-7e8e37a665f8 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:05:41 user nova-compute[73391]: DEBUG nova.compute.manager [req-ee364234-ca93-4861-82e6-2c11206a6f84 req-d91191b4-d8c8-4d63-90b1-a63a13ff9699 service nova] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Refreshing instance network info cache due to event network-changed-08226f47-93f7-4b29-a752-7e8e37a665f8. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 06:05:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ee364234-ca93-4861-82e6-2c11206a6f84 req-d91191b4-d8c8-4d63-90b1-a63a13ff9699 service nova] Acquiring lock "refresh_cache-1633a986-77f2-41b2-a436-8c5029d4c7f6" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:05:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ee364234-ca93-4861-82e6-2c11206a6f84 req-d91191b4-d8c8-4d63-90b1-a63a13ff9699 service nova] Acquired lock "refresh_cache-1633a986-77f2-41b2-a436-8c5029d4c7f6" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:05:41 user nova-compute[73391]: DEBUG nova.network.neutron [req-ee364234-ca93-4861-82e6-2c11206a6f84 req-d91191b4-d8c8-4d63-90b1-a63a13ff9699 service nova] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Refreshing network info cache for port 08226f47-93f7-4b29-a752-7e8e37a665f8 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 06:05:42 user nova-compute[73391]: DEBUG nova.network.neutron [req-ee364234-ca93-4861-82e6-2c11206a6f84 req-d91191b4-d8c8-4d63-90b1-a63a13ff9699 service nova] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Updated VIF entry in instance network info cache for port 08226f47-93f7-4b29-a752-7e8e37a665f8. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 06:05:42 user nova-compute[73391]: DEBUG nova.network.neutron [req-ee364234-ca93-4861-82e6-2c11206a6f84 req-d91191b4-d8c8-4d63-90b1-a63a13ff9699 service nova] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Updating instance_info_cache with network_info: [{"id": "08226f47-93f7-4b29-a752-7e8e37a665f8", "address": "fa:16:3e:3c:b3:e7", "network": {"id": "2a8063f6-42ce-41b8-86f6-72c17f4c2a7b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1765547969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd985a0cd6884c858487187ce252bba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08226f47-93", "ovs_interfaceid": "08226f47-93f7-4b29-a752-7e8e37a665f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:05:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ee364234-ca93-4861-82e6-2c11206a6f84 req-d91191b4-d8c8-4d63-90b1-a63a13ff9699 service nova] Releasing lock "refresh_cache-1633a986-77f2-41b2-a436-8c5029d4c7f6" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:05:42 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0fcf3dc8-7ef4-4049-93a4-43c366374905 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Acquiring lock "1633a986-77f2-41b2-a436-8c5029d4c7f6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0fcf3dc8-7ef4-4049-93a4-43c366374905 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "1633a986-77f2-41b2-a436-8c5029d4c7f6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:05:43 user nova-compute[73391]: INFO nova.compute.manager [None req-0fcf3dc8-7ef4-4049-93a4-43c366374905 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Detaching volume 9cd06168-d542-4dc3-8682-81400bf9fb26
Aug 15 06:05:43 user nova-compute[73391]: INFO nova.virt.block_device [None req-0fcf3dc8-7ef4-4049-93a4-43c366374905 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Attempting to driver detach volume 9cd06168-d542-4dc3-8682-81400bf9fb26 from mountpoint /dev/vdb
Aug 15 06:05:43 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0fcf3dc8-7ef4-4049-93a4-43c366374905 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Attempting to detach device vdb from instance 1633a986-77f2-41b2-a436-8c5029d4c7f6 from the persistent domain config. {{(pid=73391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-0fcf3dc8-7ef4-4049-93a4-43c366374905 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 06:05:43 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 06:05:43 user nova-compute[73391]:   <source dev="/dev/sdb"/>
Aug 15 06:05:43 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 06:05:43 user nova-compute[73391]:   <serial>9cd06168-d542-4dc3-8682-81400bf9fb26</serial>
Aug 15 06:05:43 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 06:05:43 user nova-compute[73391]: </disk>
Aug 15 06:05:43 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 06:05:43 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-0fcf3dc8-7ef4-4049-93a4-43c366374905 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Successfully detached device vdb from instance 1633a986-77f2-41b2-a436-8c5029d4c7f6 from the persistent domain config.
Aug 15 06:05:43 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0fcf3dc8-7ef4-4049-93a4-43c366374905 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1633a986-77f2-41b2-a436-8c5029d4c7f6 from the live domain config. {{(pid=73391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-0fcf3dc8-7ef4-4049-93a4-43c366374905 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 06:05:43 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 06:05:43 user nova-compute[73391]:   <source dev="/dev/sdb"/>
Aug 15 06:05:43 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 06:05:43 user nova-compute[73391]:   <serial>9cd06168-d542-4dc3-8682-81400bf9fb26</serial>
Aug 15 06:05:43 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 06:05:43 user nova-compute[73391]: </disk>
Aug 15 06:05:43 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Received event <DeviceRemovedEvent: 1692079543.5839562, 1633a986-77f2-41b2-a436-8c5029d4c7f6 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73391) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0fcf3dc8-7ef4-4049-93a4-43c366374905 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1633a986-77f2-41b2-a436-8c5029d4c7f6 {{(pid=73391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 06:05:43 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-0fcf3dc8-7ef4-4049-93a4-43c366374905 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Successfully detached device vdb from instance 1633a986-77f2-41b2-a436-8c5029d4c7f6 from the live domain config.
Aug 15 06:05:43 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fcf3dc8-7ef4-4049-93a4-43c366374905 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fcf3dc8-7ef4-4049-93a4-43c366374905 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:9cd06168-d542-4dc3-8682-81400bf9fb26'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HevPWfKm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:05:43 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-0fcf3dc8-7ef4-4049-93a4-43c366374905 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:05:43 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-0fcf3dc8-7ef4-4049-93a4-43c366374905 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-0fcf3dc8-7ef4-4049-93a4-43c366374905 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fcf3dc8-7ef4-4049-93a4-43c366374905 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9cd06168-d542-4dc3-8682-81400bf9fb26', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecac3c30-4139-496a-9cef-1bc19bb440a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9cd06168-d542-4dc3-8682-81400bf9fb26\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b61577c-44bb-40bc-91ff-41d947800b05]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd06168-d542-4dc3-8682-81400bf9fb26 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fcf3dc8-7ef4-4049-93a4-43c366374905 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd06168-d542-4dc3-8682-81400bf9fb26 (non-flash)
Aug 15 06:05:43 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fcf3dc8-7ef4-4049-93a4-43c366374905 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9cd06168-d542-4dc3-8682-81400bf9fb26 (non-flash)
Aug 15 06:05:43 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fcf3dc8-7ef4-4049-93a4-43c366374905 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77284b4a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9cd06168-d542-4dc3-8682-81400bf9fb26'): ({'sdb'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-0fcf3dc8-7ef4-4049-93a4-43c366374905 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Removing single pathed devices sdb {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[619b1ad3-8779-4681-affe-eeec806572b7]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff56797-a656-4c67-8d6b-c6ea503a4005]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-0fcf3dc8-7ef4-4049-93a4-43c366374905 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Flushing IO for device /dev/sdb {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9fb9b34-31ed-4a3f-a3e4-d73853b6556e]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-0fcf3dc8-7ef4-4049-93a4-43c366374905 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb36dad2-af21-443d-82fa-15cac61eda72]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-0fcf3dc8-7ef4-4049-93a4-43c366374905 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-0fcf3dc8-7ef4-4049-93a4-43c366374905 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] SCSI volumes sdb have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fcf3dc8-7ef4-4049-93a4-43c366374905 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9cd06168-d542-4dc3-8682-81400bf9fb26')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cd06168-d542-4dc3-8682-81400bf9fb26 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cd06168-d542-4dc3-8682-81400bf9fb26 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a13197d0-d443-43ee-94e9-e15ac2343582]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fcf3dc8-7ef4-4049-93a4-43c366374905 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cd06168-d542-4dc3-8682-81400bf9fb26 -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cd06168-d542-4dc3-8682-81400bf9fb26 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2fdada-d4ce-4cd8-b764-c4dca1034893]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:9cd06168-d542-4dc3-8682-81400bf9fb26, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:9cd06168-d542-4dc3-8682-81400bf9fb26, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fcf3dc8-7ef4-4049-93a4-43c366374905 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:9cd06168-d542-4dc3-8682-81400bf9fb26, portal: 172.16.0.220,3260]
Aug 15 06:05:43 user nova-compute[73391]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:9cd06168-d542-4dc3-8682-81400bf9fb26, portal: 172.16.0.220,3260] successful.
Aug 15 06:05:43 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9cd06168-d542-4dc3-8682-81400bf9fb26 -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG nova.compute.manager [req-3a15d7bd-8018-4f7d-bca6-197738e200f6 req-52e93720-0c1c-4e9b-94ef-5edf8e49e3db service nova] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Received event network-changed-08226f47-93f7-4b29-a752-7e8e37a665f8 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG nova.compute.manager [req-3a15d7bd-8018-4f7d-bca6-197738e200f6 req-52e93720-0c1c-4e9b-94ef-5edf8e49e3db service nova] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Refreshing instance network info cache due to event network-changed-08226f47-93f7-4b29-a752-7e8e37a665f8. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-3a15d7bd-8018-4f7d-bca6-197738e200f6 req-52e93720-0c1c-4e9b-94ef-5edf8e49e3db service nova] Acquiring lock "refresh_cache-1633a986-77f2-41b2-a436-8c5029d4c7f6" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-3a15d7bd-8018-4f7d-bca6-197738e200f6 req-52e93720-0c1c-4e9b-94ef-5edf8e49e3db service nova] Acquired lock "refresh_cache-1633a986-77f2-41b2-a436-8c5029d4c7f6" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG nova.network.neutron [req-3a15d7bd-8018-4f7d-bca6-197738e200f6 req-52e93720-0c1c-4e9b-94ef-5edf8e49e3db service nova] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Refreshing network info cache for port 08226f47-93f7-4b29-a752-7e8e37a665f8 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9cd06168-d542-4dc3-8682-81400bf9fb26 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[203d195d-303c-4df8-8821-23a45a92b8f0]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fcf3dc8-7ef4-4049-93a4-43c366374905 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-0fcf3dc8-7ef4-4049-93a4-43c366374905 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.261s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0fcf3dc8-7ef4-4049-93a4-43c366374905 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] <== disconnect_volume: return (262ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:05:43 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0fcf3dc8-7ef4-4049-93a4-43c366374905 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 06:05:44 user nova-compute[73391]: DEBUG nova.network.neutron [req-3a15d7bd-8018-4f7d-bca6-197738e200f6 req-52e93720-0c1c-4e9b-94ef-5edf8e49e3db service nova] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Updated VIF entry in instance network info cache for port 08226f47-93f7-4b29-a752-7e8e37a665f8. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 06:05:44 user nova-compute[73391]: DEBUG nova.network.neutron [req-3a15d7bd-8018-4f7d-bca6-197738e200f6 req-52e93720-0c1c-4e9b-94ef-5edf8e49e3db service nova] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Updating instance_info_cache with network_info: [{"id": "08226f47-93f7-4b29-a752-7e8e37a665f8", "address": "fa:16:3e:3c:b3:e7", "network": {"id": "2a8063f6-42ce-41b8-86f6-72c17f4c2a7b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1765547969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd985a0cd6884c858487187ce252bba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08226f47-93", "ovs_interfaceid": "08226f47-93f7-4b29-a752-7e8e37a665f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:05:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-3a15d7bd-8018-4f7d-bca6-197738e200f6 req-52e93720-0c1c-4e9b-94ef-5edf8e49e3db service nova] Releasing lock "refresh_cache-1633a986-77f2-41b2-a436-8c5029d4c7f6" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:05:44 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:05:44 user nova-compute[73391]: DEBUG nova.objects.instance [None req-0fcf3dc8-7ef4-4049-93a4-43c366374905 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lazy-loading 'flavor' on Instance uuid 1633a986-77f2-41b2-a436-8c5029d4c7f6 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:05:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0fcf3dc8-7ef4-4049-93a4-43c366374905 tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "1633a986-77f2-41b2-a436-8c5029d4c7f6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.737s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:05:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:05:45 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:05:45 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Starting heal instance info cache {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 06:05:45 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Rebuilding the list of instances to heal {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 06:05:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "refresh_cache-595be11c-24db-43eb-9d5b-56cbeefd6149" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:05:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquired lock "refresh_cache-595be11c-24db-43eb-9d5b-56cbeefd6149" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:05:45 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Forcefully refreshing network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 06:05:45 user nova-compute[73391]: DEBUG nova.objects.instance [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lazy-loading 'info_cache' on Instance uuid 595be11c-24db-43eb-9d5b-56cbeefd6149 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:05:46 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Updating instance_info_cache with network_info: [{"id": "3418de64-8dbd-4951-aca0-0dc87257dbcb", "address": "fa:16:3e:05:b7:5b", "network": {"id": "8e7b9da2-83d1-47d1-a352-a9684e3a2cdf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1697315681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a94181609a284eb29f8db71cf34c086b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3418de64-8d", "ovs_interfaceid": "3418de64-8dbd-4951-aca0-0dc87257dbcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:05:46 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Releasing lock "refresh_cache-595be11c-24db-43eb-9d5b-56cbeefd6149" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:05:46 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Updated the network info_cache for instance {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 06:05:46 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:05:46 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Cleaning up deleted instances {{(pid=73391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 06:05:46 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] There are 0 instances to clean {{(pid=73391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 06:05:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:05:48 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:05:48 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 06:05:50 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:05:51 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:05:52 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:05:53 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:05:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:05:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:05:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:05:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:05:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:05:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:05:59 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:06:03 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:06:03 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:06:03 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:06:03 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:06:03 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:06:03 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:06:04 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:06:04 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73391) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 06:06:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:06:13 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:06:13 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:06:13 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:06:13 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:06:13 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:06:13 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:06:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:06:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:06:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:06:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:06:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:06:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:06:23 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:06:23 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:06:23 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:06:23 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:06:23 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:06:23 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:06:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:06:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:06:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:06:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:06:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:06:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:06:32 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:06:32 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Triggering sync for uuid 595be11c-24db-43eb-9d5b-56cbeefd6149 {{(pid=73391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 06:06:32 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Triggering sync for uuid 1633a986-77f2-41b2-a436-8c5029d4c7f6 {{(pid=73391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 06:06:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "595be11c-24db-43eb-9d5b-56cbeefd6149" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:06:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "595be11c-24db-43eb-9d5b-56cbeefd6149" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:06:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "1633a986-77f2-41b2-a436-8c5029d4c7f6" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:06:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "1633a986-77f2-41b2-a436-8c5029d4c7f6" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:06:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "595be11c-24db-43eb-9d5b-56cbeefd6149" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:06:32 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "1633a986-77f2-41b2-a436-8c5029d4c7f6" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.030s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:06:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:06:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:06:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:06:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:06:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:06:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:06:33 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:06:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:06:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:06:33 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:06:33 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Auditing locally available compute resources for user (node: user) {{(pid=73391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 06:06:33 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1633a986-77f2-41b2-a436-8c5029d4c7f6/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:06:33 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1633a986-77f2-41b2-a436-8c5029d4c7f6/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:06:33 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1633a986-77f2-41b2-a436-8c5029d4c7f6/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:06:34 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1633a986-77f2-41b2-a436-8c5029d4c7f6/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:06:34 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595be11c-24db-43eb-9d5b-56cbeefd6149/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:06:34 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595be11c-24db-43eb-9d5b-56cbeefd6149/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:06:34 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595be11c-24db-43eb-9d5b-56cbeefd6149/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:06:34 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/595be11c-24db-43eb-9d5b-56cbeefd6149/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:06:35 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:06:35 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:06:35 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Hypervisor/Node resource view: name=user free_ram=8628MB free_disk=25.022186279296875GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 06:06:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:06:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:06:35 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 595be11c-24db-43eb-9d5b-56cbeefd6149 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:06:35 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 1633a986-77f2-41b2-a436-8c5029d4c7f6 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:06:35 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 06:06:35 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 06:06:35 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Refreshing inventories for resource provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 06:06:35 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Updating ProviderTree inventory for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 06:06:35 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Updating inventory in ProviderTree for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 06:06:35 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Refreshing aggregate associations for resource provider 771708bd-6a2a-4e0c-9869-46d45e6b1896, aggregates: None {{(pid=73391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 06:06:35 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Refreshing trait associations for resource provider 771708bd-6a2a-4e0c-9869-46d45e6b1896, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=73391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 06:06:35 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:06:35 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:06:35 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Compute_service record updated for user:user {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 06:06:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.330s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:06:38 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:06:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-1bb095ef-8a64-48e8-bee3-f56c4e6d3ebc tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Acquiring lock "1633a986-77f2-41b2-a436-8c5029d4c7f6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:06:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-1bb095ef-8a64-48e8-bee3-f56c4e6d3ebc tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "1633a986-77f2-41b2-a436-8c5029d4c7f6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:06:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-1bb095ef-8a64-48e8-bee3-f56c4e6d3ebc tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Acquiring lock "1633a986-77f2-41b2-a436-8c5029d4c7f6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:06:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-1bb095ef-8a64-48e8-bee3-f56c4e6d3ebc tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "1633a986-77f2-41b2-a436-8c5029d4c7f6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:06:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-1bb095ef-8a64-48e8-bee3-f56c4e6d3ebc tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "1633a986-77f2-41b2-a436-8c5029d4c7f6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:06:39 user nova-compute[73391]: INFO nova.compute.manager [None req-1bb095ef-8a64-48e8-bee3-f56c4e6d3ebc tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Terminating instance
Aug 15 06:06:39 user nova-compute[73391]: DEBUG nova.compute.manager [None req-1bb095ef-8a64-48e8-bee3-f56c4e6d3ebc tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Start destroying the instance on the hypervisor. {{(pid=73391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 06:06:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:06:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:06:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:06:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:06:40 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:06:40 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:06:40 user nova-compute[73391]: DEBUG nova.compute.manager [req-d10bdc3b-50bb-4623-b536-b6e7d0f58058 req-28c5b84f-6fc5-4553-bddd-65f047c52e94 service nova] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Received event network-vif-unplugged-08226f47-93f7-4b29-a752-7e8e37a665f8 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:06:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d10bdc3b-50bb-4623-b536-b6e7d0f58058 req-28c5b84f-6fc5-4553-bddd-65f047c52e94 service nova] Acquiring lock "1633a986-77f2-41b2-a436-8c5029d4c7f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:06:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d10bdc3b-50bb-4623-b536-b6e7d0f58058 req-28c5b84f-6fc5-4553-bddd-65f047c52e94 service nova] Lock "1633a986-77f2-41b2-a436-8c5029d4c7f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:06:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-d10bdc3b-50bb-4623-b536-b6e7d0f58058 req-28c5b84f-6fc5-4553-bddd-65f047c52e94 service nova] Lock "1633a986-77f2-41b2-a436-8c5029d4c7f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:06:40 user nova-compute[73391]: DEBUG nova.compute.manager [req-d10bdc3b-50bb-4623-b536-b6e7d0f58058 req-28c5b84f-6fc5-4553-bddd-65f047c52e94 service nova] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] No waiting events found dispatching network-vif-unplugged-08226f47-93f7-4b29-a752-7e8e37a665f8 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:06:40 user nova-compute[73391]: DEBUG nova.compute.manager [req-d10bdc3b-50bb-4623-b536-b6e7d0f58058 req-28c5b84f-6fc5-4553-bddd-65f047c52e94 service nova] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Received event network-vif-unplugged-08226f47-93f7-4b29-a752-7e8e37a665f8 for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 06:06:40 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Instance destroyed successfully.
Aug 15 06:06:40 user nova-compute[73391]: DEBUG nova.objects.instance [None req-1bb095ef-8a64-48e8-bee3-f56c4e6d3ebc tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lazy-loading 'resources' on Instance uuid 1633a986-77f2-41b2-a436-8c5029d4c7f6 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:06:40 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-1bb095ef-8a64-48e8-bee3-f56c4e6d3ebc tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T06:01:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1839119576',display_name='tempest-TestMinimumBasicScenario-server-1839119576',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1839119576',id=51,image_ref='5dcc1e41-6efd-4557-94fe-47a802151660',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE4OcgfFfoCatXKKK7xyUgXJIEGR6qLzFsKkLlMAbbk4KIABOAR8rcawhjQaetz6FNgj1otrzQC6HrGrfCulXQ878JbQ7qSbX7cWn3eWPTIKr241YOKw60gQZSKR05fYww==',key_name='tempest-TestMinimumBasicScenario-892419766',keypairs=<?>,launch_index=0,launched_at=2023-08-15T06:01:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cd985a0cd6884c858487187ce252bba5',ramdisk_id='',reservation_id='r-xvx09grf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='5dcc1e41-6efd-4557-94fe-47a802151660',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-1535355155',owner_user_name='tempest-TestMinimumBasicScenario-1535355155-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T06:03:57Z,user_data=None,user_id='db323067fefa4b1f8aa28f10a997b9d4',uuid=1633a986-77f2-41b2-a436-8c5029d4c7f6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08226f47-93f7-4b29-a752-7e8e37a665f8", "address": "fa:16:3e:3c:b3:e7", "network": {"id": "2a8063f6-42ce-41b8-86f6-72c17f4c2a7b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1765547969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd985a0cd6884c858487187ce252bba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08226f47-93", "ovs_interfaceid": "08226f47-93f7-4b29-a752-7e8e37a665f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 06:06:40 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-1bb095ef-8a64-48e8-bee3-f56c4e6d3ebc tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Converting VIF {"id": "08226f47-93f7-4b29-a752-7e8e37a665f8", "address": "fa:16:3e:3c:b3:e7", "network": {"id": "2a8063f6-42ce-41b8-86f6-72c17f4c2a7b", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1765547969-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd985a0cd6884c858487187ce252bba5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08226f47-93", "ovs_interfaceid": "08226f47-93f7-4b29-a752-7e8e37a665f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:06:40 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-1bb095ef-8a64-48e8-bee3-f56c4e6d3ebc tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:b3:e7,bridge_name='br-int',has_traffic_filtering=True,id=08226f47-93f7-4b29-a752-7e8e37a665f8,network=Network(2a8063f6-42ce-41b8-86f6-72c17f4c2a7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08226f47-93') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:06:40 user nova-compute[73391]: DEBUG os_vif [None req-1bb095ef-8a64-48e8-bee3-f56c4e6d3ebc tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:b3:e7,bridge_name='br-int',has_traffic_filtering=True,id=08226f47-93f7-4b29-a752-7e8e37a665f8,network=Network(2a8063f6-42ce-41b8-86f6-72c17f4c2a7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08226f47-93') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 06:06:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:06:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap08226f47-93, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:06:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:06:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:06:40 user nova-compute[73391]: INFO os_vif [None req-1bb095ef-8a64-48e8-bee3-f56c4e6d3ebc tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:b3:e7,bridge_name='br-int',has_traffic_filtering=True,id=08226f47-93f7-4b29-a752-7e8e37a665f8,network=Network(2a8063f6-42ce-41b8-86f6-72c17f4c2a7b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08226f47-93')
Aug 15 06:06:40 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-1bb095ef-8a64-48e8-bee3-f56c4e6d3ebc tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Deleting instance files /opt/stack/data/nova/instances/1633a986-77f2-41b2-a436-8c5029d4c7f6_del
Aug 15 06:06:40 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-1bb095ef-8a64-48e8-bee3-f56c4e6d3ebc tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Deletion of /opt/stack/data/nova/instances/1633a986-77f2-41b2-a436-8c5029d4c7f6_del complete
Aug 15 06:06:40 user nova-compute[73391]: INFO nova.compute.manager [None req-1bb095ef-8a64-48e8-bee3-f56c4e6d3ebc tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 15 06:06:40 user nova-compute[73391]: DEBUG oslo.service.loopingcall [None req-1bb095ef-8a64-48e8-bee3-f56c4e6d3ebc tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 06:06:40 user nova-compute[73391]: DEBUG nova.compute.manager [-] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Deallocating network for instance {{(pid=73391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 06:06:40 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] deallocate_for_instance() {{(pid=73391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 06:06:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:06:41 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:06:41 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Took 0.79 seconds to deallocate network for instance.
Aug 15 06:06:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-1bb095ef-8a64-48e8-bee3-f56c4e6d3ebc tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:06:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-1bb095ef-8a64-48e8-bee3-f56c4e6d3ebc tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:06:41 user nova-compute[73391]: DEBUG nova.compute.manager [req-8886166c-f6db-4a50-ad21-afe8cfe7d4b0 req-26cca566-ed3e-4126-9d9b-f883d71d8665 service nova] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Received event network-vif-deleted-08226f47-93f7-4b29-a752-7e8e37a665f8 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:06:41 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-1bb095ef-8a64-48e8-bee3-f56c4e6d3ebc tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:06:41 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-1bb095ef-8a64-48e8-bee3-f56c4e6d3ebc tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:06:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-1bb095ef-8a64-48e8-bee3-f56c4e6d3ebc tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.145s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:06:41 user nova-compute[73391]: INFO nova.scheduler.client.report [None req-1bb095ef-8a64-48e8-bee3-f56c4e6d3ebc tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Deleted allocations for instance 1633a986-77f2-41b2-a436-8c5029d4c7f6
Aug 15 06:06:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-1bb095ef-8a64-48e8-bee3-f56c4e6d3ebc tempest-TestMinimumBasicScenario-1535355155 tempest-TestMinimumBasicScenario-1535355155-project-member] Lock "1633a986-77f2-41b2-a436-8c5029d4c7f6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.013s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:06:42 user nova-compute[73391]: DEBUG nova.compute.manager [req-81fea3aa-6106-4c7b-bc06-fdb9de06c797 req-322bbbb8-824e-4945-bdfa-941d0a23a5cc service nova] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Received event network-vif-plugged-08226f47-93f7-4b29-a752-7e8e37a665f8 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:06:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-81fea3aa-6106-4c7b-bc06-fdb9de06c797 req-322bbbb8-824e-4945-bdfa-941d0a23a5cc service nova] Acquiring lock "1633a986-77f2-41b2-a436-8c5029d4c7f6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:06:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-81fea3aa-6106-4c7b-bc06-fdb9de06c797 req-322bbbb8-824e-4945-bdfa-941d0a23a5cc service nova] Lock "1633a986-77f2-41b2-a436-8c5029d4c7f6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:06:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-81fea3aa-6106-4c7b-bc06-fdb9de06c797 req-322bbbb8-824e-4945-bdfa-941d0a23a5cc service nova] Lock "1633a986-77f2-41b2-a436-8c5029d4c7f6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:06:42 user nova-compute[73391]: DEBUG nova.compute.manager [req-81fea3aa-6106-4c7b-bc06-fdb9de06c797 req-322bbbb8-824e-4945-bdfa-941d0a23a5cc service nova] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] No waiting events found dispatching network-vif-plugged-08226f47-93f7-4b29-a752-7e8e37a665f8 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:06:42 user nova-compute[73391]: WARNING nova.compute.manager [req-81fea3aa-6106-4c7b-bc06-fdb9de06c797 req-322bbbb8-824e-4945-bdfa-941d0a23a5cc service nova] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Received unexpected event network-vif-plugged-08226f47-93f7-4b29-a752-7e8e37a665f8 for instance with vm_state deleted and task_state None.
Aug 15 06:06:42 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:06:43 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:06:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:06:45 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:06:45 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Starting heal instance info cache {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 06:06:45 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Didn't find any instances for network info cache update. {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 06:06:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:06:50 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:06:50 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 06:06:52 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:06:54 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:06:55 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692079600.6262937, 1633a986-77f2-41b2-a436-8c5029d4c7f6 => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:06:55 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] VM Stopped (Lifecycle Event)
Aug 15 06:06:55 user nova-compute[73391]: DEBUG nova.compute.manager [None req-7a35995e-5b66-4f7c-a34f-14ed885999e6 None None] [instance: 1633a986-77f2-41b2-a436-8c5029d4c7f6] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:06:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:07:00 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:07:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:07:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:07:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:07:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:07:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:07:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:07:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-bab415ed-4904-4a4d-9372-d3b734038201 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Acquiring lock "595be11c-24db-43eb-9d5b-56cbeefd6149" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:07:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-bab415ed-4904-4a4d-9372-d3b734038201 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Lock "595be11c-24db-43eb-9d5b-56cbeefd6149" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:07:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-bab415ed-4904-4a4d-9372-d3b734038201 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Acquiring lock "595be11c-24db-43eb-9d5b-56cbeefd6149-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:07:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-bab415ed-4904-4a4d-9372-d3b734038201 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Lock "595be11c-24db-43eb-9d5b-56cbeefd6149-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:07:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-bab415ed-4904-4a4d-9372-d3b734038201 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Lock "595be11c-24db-43eb-9d5b-56cbeefd6149-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:07:07 user nova-compute[73391]: INFO nova.compute.manager [None req-bab415ed-4904-4a4d-9372-d3b734038201 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Terminating instance
Aug 15 06:07:07 user nova-compute[73391]: DEBUG nova.compute.manager [None req-bab415ed-4904-4a4d-9372-d3b734038201 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Start destroying the instance on the hypervisor. {{(pid=73391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 06:07:07 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:07:07 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:07:07 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:07:07 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:07:07 user nova-compute[73391]: DEBUG nova.compute.manager [req-936ddf47-fcbf-4e60-91cb-5229c8685324 req-8f3ab86e-bf0b-47b8-a0e1-49e4b3e1ff31 service nova] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Received event network-vif-unplugged-3418de64-8dbd-4951-aca0-0dc87257dbcb {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:07:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-936ddf47-fcbf-4e60-91cb-5229c8685324 req-8f3ab86e-bf0b-47b8-a0e1-49e4b3e1ff31 service nova] Acquiring lock "595be11c-24db-43eb-9d5b-56cbeefd6149-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:07:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-936ddf47-fcbf-4e60-91cb-5229c8685324 req-8f3ab86e-bf0b-47b8-a0e1-49e4b3e1ff31 service nova] Lock "595be11c-24db-43eb-9d5b-56cbeefd6149-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:07:07 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-936ddf47-fcbf-4e60-91cb-5229c8685324 req-8f3ab86e-bf0b-47b8-a0e1-49e4b3e1ff31 service nova] Lock "595be11c-24db-43eb-9d5b-56cbeefd6149-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:07:07 user nova-compute[73391]: DEBUG nova.compute.manager [req-936ddf47-fcbf-4e60-91cb-5229c8685324 req-8f3ab86e-bf0b-47b8-a0e1-49e4b3e1ff31 service nova] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] No waiting events found dispatching network-vif-unplugged-3418de64-8dbd-4951-aca0-0dc87257dbcb {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:07:07 user nova-compute[73391]: DEBUG nova.compute.manager [req-936ddf47-fcbf-4e60-91cb-5229c8685324 req-8f3ab86e-bf0b-47b8-a0e1-49e4b3e1ff31 service nova] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Received event network-vif-unplugged-3418de64-8dbd-4951-aca0-0dc87257dbcb for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 06:07:08 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Instance destroyed successfully.
Aug 15 06:07:08 user nova-compute[73391]: DEBUG nova.objects.instance [None req-bab415ed-4904-4a4d-9372-d3b734038201 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Lazy-loading 'resources' on Instance uuid 595be11c-24db-43eb-9d5b-56cbeefd6149 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:07:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-bab415ed-4904-4a4d-9372-d3b734038201 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T05:58:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-968761111',display_name='tempest-ServersNegativeTestJSON-server-968761111',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-968761111',id=48,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-08-15T05:58:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a94181609a284eb29f8db71cf34c086b',ramdisk_id='',reservation_id='r-jxk348w3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1203747242',owner_user_name='tempest-ServersNegativeTestJSON-1203747242-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T05:58:21Z,user_data=None,user_id='a8a6d1c3cc9d46c98e43e9c8c9caabb5',uuid=595be11c-24db-43eb-9d5b-56cbeefd6149,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3418de64-8dbd-4951-aca0-0dc87257dbcb", "address": "fa:16:3e:05:b7:5b", "network": {"id": "8e7b9da2-83d1-47d1-a352-a9684e3a2cdf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1697315681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a94181609a284eb29f8db71cf34c086b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3418de64-8d", "ovs_interfaceid": "3418de64-8dbd-4951-aca0-0dc87257dbcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 06:07:08 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-bab415ed-4904-4a4d-9372-d3b734038201 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Converting VIF {"id": "3418de64-8dbd-4951-aca0-0dc87257dbcb", "address": "fa:16:3e:05:b7:5b", "network": {"id": "8e7b9da2-83d1-47d1-a352-a9684e3a2cdf", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1697315681-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a94181609a284eb29f8db71cf34c086b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3418de64-8d", "ovs_interfaceid": "3418de64-8dbd-4951-aca0-0dc87257dbcb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:07:08 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-bab415ed-4904-4a4d-9372-d3b734038201 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:b7:5b,bridge_name='br-int',has_traffic_filtering=True,id=3418de64-8dbd-4951-aca0-0dc87257dbcb,network=Network(8e7b9da2-83d1-47d1-a352-a9684e3a2cdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3418de64-8d') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:07:08 user nova-compute[73391]: DEBUG os_vif [None req-bab415ed-4904-4a4d-9372-d3b734038201 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:b7:5b,bridge_name='br-int',has_traffic_filtering=True,id=3418de64-8dbd-4951-aca0-0dc87257dbcb,network=Network(8e7b9da2-83d1-47d1-a352-a9684e3a2cdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3418de64-8d') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 06:07:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:07:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3418de64-8d, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:07:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:07:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:07:08 user nova-compute[73391]: INFO os_vif [None req-bab415ed-4904-4a4d-9372-d3b734038201 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:b7:5b,bridge_name='br-int',has_traffic_filtering=True,id=3418de64-8dbd-4951-aca0-0dc87257dbcb,network=Network(8e7b9da2-83d1-47d1-a352-a9684e3a2cdf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3418de64-8d')
Aug 15 06:07:08 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-bab415ed-4904-4a4d-9372-d3b734038201 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Deleting instance files /opt/stack/data/nova/instances/595be11c-24db-43eb-9d5b-56cbeefd6149_del
Aug 15 06:07:08 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-bab415ed-4904-4a4d-9372-d3b734038201 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Deletion of /opt/stack/data/nova/instances/595be11c-24db-43eb-9d5b-56cbeefd6149_del complete
Aug 15 06:07:08 user nova-compute[73391]: INFO nova.compute.manager [None req-bab415ed-4904-4a4d-9372-d3b734038201 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Took 0.93 seconds to destroy the instance on the hypervisor.
Aug 15 06:07:08 user nova-compute[73391]: DEBUG oslo.service.loopingcall [None req-bab415ed-4904-4a4d-9372-d3b734038201 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 06:07:08 user nova-compute[73391]: DEBUG nova.compute.manager [-] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Deallocating network for instance {{(pid=73391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 06:07:08 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] deallocate_for_instance() {{(pid=73391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 06:07:08 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:07:08 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Took 0.57 seconds to deallocate network for instance.
Aug 15 06:07:08 user nova-compute[73391]: DEBUG nova.compute.manager [req-838f773b-0db6-47e2-a5b0-8646de4923fa req-c3330cdf-a950-4f7e-bd94-69d1b796d977 service nova] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Received event network-vif-deleted-3418de64-8dbd-4951-aca0-0dc87257dbcb {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:07:09 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-bab415ed-4904-4a4d-9372-d3b734038201 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:07:09 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-bab415ed-4904-4a4d-9372-d3b734038201 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:07:09 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-bab415ed-4904-4a4d-9372-d3b734038201 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:07:09 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-bab415ed-4904-4a4d-9372-d3b734038201 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:07:09 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-bab415ed-4904-4a4d-9372-d3b734038201 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.106s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:07:09 user nova-compute[73391]: INFO nova.scheduler.client.report [None req-bab415ed-4904-4a4d-9372-d3b734038201 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Deleted allocations for instance 595be11c-24db-43eb-9d5b-56cbeefd6149
Aug 15 06:07:09 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-bab415ed-4904-4a4d-9372-d3b734038201 tempest-ServersNegativeTestJSON-1203747242 tempest-ServersNegativeTestJSON-1203747242-project-member] Lock "595be11c-24db-43eb-9d5b-56cbeefd6149" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.797s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:07:09 user nova-compute[73391]: DEBUG nova.compute.manager [req-9b0395bc-c092-4396-81c4-23fd4fa0ee32 req-680d6b2c-9f1e-4a41-a1ff-8b48d89707c3 service nova] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Received event network-vif-plugged-3418de64-8dbd-4951-aca0-0dc87257dbcb {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:07:09 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-9b0395bc-c092-4396-81c4-23fd4fa0ee32 req-680d6b2c-9f1e-4a41-a1ff-8b48d89707c3 service nova] Acquiring lock "595be11c-24db-43eb-9d5b-56cbeefd6149-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:07:09 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-9b0395bc-c092-4396-81c4-23fd4fa0ee32 req-680d6b2c-9f1e-4a41-a1ff-8b48d89707c3 service nova] Lock "595be11c-24db-43eb-9d5b-56cbeefd6149-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:07:09 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-9b0395bc-c092-4396-81c4-23fd4fa0ee32 req-680d6b2c-9f1e-4a41-a1ff-8b48d89707c3 service nova] Lock "595be11c-24db-43eb-9d5b-56cbeefd6149-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:07:09 user nova-compute[73391]: DEBUG nova.compute.manager [req-9b0395bc-c092-4396-81c4-23fd4fa0ee32 req-680d6b2c-9f1e-4a41-a1ff-8b48d89707c3 service nova] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] No waiting events found dispatching network-vif-plugged-3418de64-8dbd-4951-aca0-0dc87257dbcb {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:07:09 user nova-compute[73391]: WARNING nova.compute.manager [req-9b0395bc-c092-4396-81c4-23fd4fa0ee32 req-680d6b2c-9f1e-4a41-a1ff-8b48d89707c3 service nova] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Received unexpected event network-vif-plugged-3418de64-8dbd-4951-aca0-0dc87257dbcb for instance with vm_state deleted and task_state None.
Aug 15 06:07:13 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:07:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:07:23 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692079628.3025618, 595be11c-24db-43eb-9d5b-56cbeefd6149 => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:07:23 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] VM Stopped (Lifecycle Event)
Aug 15 06:07:23 user nova-compute[73391]: DEBUG nova.compute.manager [None req-dd6be16a-dfad-4ef6-b671-33db07e2b620 None None] [instance: 595be11c-24db-43eb-9d5b-56cbeefd6149] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:07:23 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:07:23 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:07:23 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:07:23 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:07:23 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:07:23 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:07:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:07:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:07:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:07:34 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:07:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:07:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:07:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:07:34 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Auditing locally available compute resources for user (node: user) {{(pid=73391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 06:07:35 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:07:35 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:07:35 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Hypervisor/Node resource view: name=user free_ram=8898MB free_disk=25.108749389648438GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 06:07:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:07:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:07:35 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 06:07:35 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 06:07:35 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:07:35 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:07:35 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Compute_service record updated for user:user {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 06:07:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.172s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:07:37 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:07:38 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:07:41 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:07:41 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:07:43 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:07:43 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:07:44 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:07:46 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:07:46 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Starting heal instance info cache {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 06:07:46 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Rebuilding the list of instances to heal {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 06:07:46 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Didn't find any instances for network info cache update. {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 06:07:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:07:51 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:07:51 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 06:07:53 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:07:53 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:07:53 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:07:53 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:07:53 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:07:53 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:07:53 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:07:55 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:07:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:07:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:07:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:07:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:07:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:07:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:07:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:08:00 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:08:01 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:08:03 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:08:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:08:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:08:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:08:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:08:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:08:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:08:13 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:08:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:08:23 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:08:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:08:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:08:34 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:08:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:08:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:08:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:08:34 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Auditing locally available compute resources for user (node: user) {{(pid=73391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 06:08:35 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:08:35 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:08:35 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Hypervisor/Node resource view: name=user free_ram=8989MB free_disk=25.107101440429688GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 06:08:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:08:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:08:35 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 06:08:35 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 06:08:35 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:08:35 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:08:35 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Compute_service record updated for user:user {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 06:08:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.118s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:08:38 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:08:43 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:08:43 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:08:43 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:08:43 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:08:46 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:08:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:08:48 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:08:48 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Starting heal instance info cache {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 06:08:48 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Rebuilding the list of instances to heal {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 06:08:48 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Didn't find any instances for network info cache update. {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 06:08:52 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:08:52 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 06:08:53 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:08:55 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:08:57 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:08:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:09:03 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:09:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:09:13 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:09:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:09:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:09:23 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:09:25 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:09:27 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:09:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:09:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:09:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:09:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:09:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:09:34 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:09:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:09:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:09:34 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:09:34 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Auditing locally available compute resources for user (node: user) {{(pid=73391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 06:09:35 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:09:35 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:09:35 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Hypervisor/Node resource view: name=user free_ram=8982MB free_disk=25.10486602783203GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 06:09:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:09:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:09:35 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 06:09:35 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 06:09:35 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:09:35 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:09:35 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Compute_service record updated for user:user {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 06:09:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.108s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:09:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:09:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Acquiring lock "7971bc72-40ad-4a65-ae04-de74afde6046" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:09:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Lock "7971bc72-40ad-4a65-ae04-de74afde6046" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:09:36 user nova-compute[73391]: DEBUG nova.compute.manager [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Starting instance... {{(pid=73391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 06:09:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:09:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:09:36 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 06:09:36 user nova-compute[73391]: INFO nova.compute.claims [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Claim successful on node user
Aug 15 06:09:36 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:09:36 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:09:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.206s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:09:36 user nova-compute[73391]: DEBUG nova.compute.manager [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Start building networks asynchronously for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 06:09:36 user nova-compute[73391]: DEBUG nova.compute.manager [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Allocating IP information in the background. {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 06:09:36 user nova-compute[73391]: DEBUG nova.network.neutron [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] allocate_for_instance() {{(pid=73391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 06:09:36 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 06:09:36 user nova-compute[73391]: DEBUG nova.compute.manager [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Start building block device mappings for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 06:09:36 user nova-compute[73391]: DEBUG nova.policy [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '055196cc17e6481ca02ca94b3a0f2db6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a71ecd9539434dd09177368b4a290208', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73391) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 06:09:36 user nova-compute[73391]: DEBUG nova.compute.manager [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Start spawning the instance on the hypervisor. {{(pid=73391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 06:09:36 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Creating instance directory {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 06:09:36 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Creating image(s)
Aug 15 06:09:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Acquiring lock "/opt/stack/data/nova/instances/7971bc72-40ad-4a65-ae04-de74afde6046/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:09:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Lock "/opt/stack/data/nova/instances/7971bc72-40ad-4a65-ae04-de74afde6046/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:09:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Lock "/opt/stack/data/nova/instances/7971bc72-40ad-4a65-ae04-de74afde6046/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:09:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:09:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.176s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:09:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Acquiring lock "999b315ba87151d8252d543312ae7790e7e1583b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:09:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:09:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:09:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.177s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:09:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/7971bc72-40ad-4a65-ae04-de74afde6046/disk 1073741824 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:09:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/7971bc72-40ad-4a65-ae04-de74afde6046/disk 1073741824" returned: 0 in 0.050s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:09:37 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:09:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:09:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.195s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:09:37 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7971bc72-40ad-4a65-ae04-de74afde6046/disk. size=1073741824 {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 06:09:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7971bc72-40ad-4a65-ae04-de74afde6046/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:09:37 user nova-compute[73391]: DEBUG nova.network.neutron [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Successfully created port: 9258b3ad-d3d7-45b9-afb9-bf39b5b8be55 {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 06:09:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7971bc72-40ad-4a65-ae04-de74afde6046/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:09:37 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Cannot resize image /opt/stack/data/nova/instances/7971bc72-40ad-4a65-ae04-de74afde6046/disk to a smaller size. {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 06:09:37 user nova-compute[73391]: DEBUG nova.objects.instance [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Lazy-loading 'migration_context' on Instance uuid 7971bc72-40ad-4a65-ae04-de74afde6046 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:09:37 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Created local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 06:09:37 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Ensure instance console log exists: /opt/stack/data/nova/instances/7971bc72-40ad-4a65-ae04-de74afde6046/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 06:09:37 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:09:37 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:09:37 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:09:38 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:09:38 user nova-compute[73391]: DEBUG nova.network.neutron [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Successfully updated port: 9258b3ad-d3d7-45b9-afb9-bf39b5b8be55 {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 06:09:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Acquiring lock "refresh_cache-7971bc72-40ad-4a65-ae04-de74afde6046" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:09:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Acquired lock "refresh_cache-7971bc72-40ad-4a65-ae04-de74afde6046" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:09:38 user nova-compute[73391]: DEBUG nova.network.neutron [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 06:09:38 user nova-compute[73391]: DEBUG nova.compute.manager [req-ab4ecc4c-2560-455c-985c-c136b4ab40ab req-86ca3467-7fa8-432a-9c0d-78b30d14af3d service nova] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Received event network-changed-9258b3ad-d3d7-45b9-afb9-bf39b5b8be55 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:09:38 user nova-compute[73391]: DEBUG nova.compute.manager [req-ab4ecc4c-2560-455c-985c-c136b4ab40ab req-86ca3467-7fa8-432a-9c0d-78b30d14af3d service nova] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Refreshing instance network info cache due to event network-changed-9258b3ad-d3d7-45b9-afb9-bf39b5b8be55. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 06:09:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ab4ecc4c-2560-455c-985c-c136b4ab40ab req-86ca3467-7fa8-432a-9c0d-78b30d14af3d service nova] Acquiring lock "refresh_cache-7971bc72-40ad-4a65-ae04-de74afde6046" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:09:38 user nova-compute[73391]: DEBUG nova.network.neutron [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 06:09:38 user nova-compute[73391]: DEBUG nova.network.neutron [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Updating instance_info_cache with network_info: [{"id": "9258b3ad-d3d7-45b9-afb9-bf39b5b8be55", "address": "fa:16:3e:55:40:39", "network": {"id": "ba0174bd-6a67-444e-8a34-ecd99afafac0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1815564766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a71ecd9539434dd09177368b4a290208", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9258b3ad-d3", "ovs_interfaceid": "9258b3ad-d3d7-45b9-afb9-bf39b5b8be55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:09:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Releasing lock "refresh_cache-7971bc72-40ad-4a65-ae04-de74afde6046" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:09:38 user nova-compute[73391]: DEBUG nova.compute.manager [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Instance network_info: |[{"id": "9258b3ad-d3d7-45b9-afb9-bf39b5b8be55", "address": "fa:16:3e:55:40:39", "network": {"id": "ba0174bd-6a67-444e-8a34-ecd99afafac0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1815564766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a71ecd9539434dd09177368b4a290208", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9258b3ad-d3", "ovs_interfaceid": "9258b3ad-d3d7-45b9-afb9-bf39b5b8be55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 06:09:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ab4ecc4c-2560-455c-985c-c136b4ab40ab req-86ca3467-7fa8-432a-9c0d-78b30d14af3d service nova] Acquired lock "refresh_cache-7971bc72-40ad-4a65-ae04-de74afde6046" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:09:38 user nova-compute[73391]: DEBUG nova.network.neutron [req-ab4ecc4c-2560-455c-985c-c136b4ab40ab req-86ca3467-7fa8-432a-9c0d-78b30d14af3d service nova] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Refreshing network info cache for port 9258b3ad-d3d7-45b9-afb9-bf39b5b8be55 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 06:09:38 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Start _get_guest_xml network_info=[{"id": "9258b3ad-d3d7-45b9-afb9-bf39b5b8be55", "address": "fa:16:3e:55:40:39", "network": {"id": "ba0174bd-6a67-444e-8a34-ecd99afafac0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1815564766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a71ecd9539434dd09177368b4a290208", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9258b3ad-d3", "ovs_interfaceid": "9258b3ad-d3d7-45b9-afb9-bf39b5b8be55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '191b1dad-305e-4d1c-9b15-515ec59a3278'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 06:09:38 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:09:38 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:09:38 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 06:09:38 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 06:09:38 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 06:09:38 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 06:09:38 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 06:09:38 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 06:09:38 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 06:09:38 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 06:09:38 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 06:09:38 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 06:09:38 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 06:09:38 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 06:09:38 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 06:09:38 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 06:09:38 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 06:09:38 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 06:09:38 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T06:09:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1634370153',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1634370153',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1634370',id=52,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHAcHE32HG9dDcrmINrtFmQnUNa70fz/aqFn8HMV71Jf+pkZHPin4fsLWupjJmSMjbWc3mSKiLrNd+6mQhQD+w/tXhdi3cihyylgbbL8ksG1mTXJSLh8k8+uIYthaZvQVg==',key_name='tempest-keypair-651558149',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a71ecd9539434dd09177368b4a290208',ramdisk_id='',reservation_id='r-nlis7v5e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1303747324',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:09:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='055196cc17e6481ca02ca94b3a0f2db6',uuid=7971bc72-40ad-4a65-ae04-de74afde6046,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9258b3ad-d3d7-45b9-afb9-bf39b5b8be55", "address": "fa:16:3e:55:40:39", "network": {"id": "ba0174bd-6a67-444e-8a34-ecd99afafac0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1815564766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a71ecd9539434dd09177368b4a290208", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9258b3ad-d3", "ovs_interfaceid": "9258b3ad-d3d7-45b9-afb9-bf39b5b8be55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 06:09:38 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Converting VIF {"id": "9258b3ad-d3d7-45b9-afb9-bf39b5b8be55", "address": "fa:16:3e:55:40:39", "network": {"id": "ba0174bd-6a67-444e-8a34-ecd99afafac0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1815564766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a71ecd9539434dd09177368b4a290208", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9258b3ad-d3", "ovs_interfaceid": "9258b3ad-d3d7-45b9-afb9-bf39b5b8be55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:09:38 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:40:39,bridge_name='br-int',has_traffic_filtering=True,id=9258b3ad-d3d7-45b9-afb9-bf39b5b8be55,network=Network(ba0174bd-6a67-444e-8a34-ecd99afafac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9258b3ad-d3') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:09:38 user nova-compute[73391]: DEBUG nova.objects.instance [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Lazy-loading 'pci_devices' on Instance uuid 7971bc72-40ad-4a65-ae04-de74afde6046 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:09:38 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] End _get_guest_xml xml=<domain type="kvm">
Aug 15 06:09:38 user nova-compute[73391]:   <uuid>7971bc72-40ad-4a65-ae04-de74afde6046</uuid>
Aug 15 06:09:38 user nova-compute[73391]:   <name>instance-00000034</name>
Aug 15 06:09:38 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 06:09:38 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 06:09:38 user nova-compute[73391]:   <metadata>
Aug 15 06:09:38 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 06:09:38 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 06:09:38 user nova-compute[73391]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1634370153</nova:name>
Aug 15 06:09:38 user nova-compute[73391]:       <nova:creationTime>2023-08-15 06:09:38</nova:creationTime>
Aug 15 06:09:38 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 06:09:38 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 06:09:38 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 06:09:38 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 06:09:38 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 06:09:38 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 06:09:38 user nova-compute[73391]:       </nova:flavor>
Aug 15 06:09:38 user nova-compute[73391]:       <nova:owner>
Aug 15 06:09:38 user nova-compute[73391]:         <nova:user uuid="055196cc17e6481ca02ca94b3a0f2db6">tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member</nova:user>
Aug 15 06:09:38 user nova-compute[73391]:         <nova:project uuid="a71ecd9539434dd09177368b4a290208">tempest-TestServerVolumeAttachScenarioOldVersion-1303747324</nova:project>
Aug 15 06:09:38 user nova-compute[73391]:       </nova:owner>
Aug 15 06:09:38 user nova-compute[73391]:       <nova:root type="image" uuid="191b1dad-305e-4d1c-9b15-515ec59a3278"/>
Aug 15 06:09:38 user nova-compute[73391]:       <nova:ports>
Aug 15 06:09:38 user nova-compute[73391]:         <nova:port uuid="9258b3ad-d3d7-45b9-afb9-bf39b5b8be55">
Aug 15 06:09:38 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Aug 15 06:09:38 user nova-compute[73391]:         </nova:port>
Aug 15 06:09:38 user nova-compute[73391]:       </nova:ports>
Aug 15 06:09:38 user nova-compute[73391]:     </nova:instance>
Aug 15 06:09:38 user nova-compute[73391]:   </metadata>
Aug 15 06:09:38 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 06:09:38 user nova-compute[73391]:     <system>
Aug 15 06:09:38 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 06:09:38 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 06:09:38 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 06:09:38 user nova-compute[73391]:       <entry name="serial">7971bc72-40ad-4a65-ae04-de74afde6046</entry>
Aug 15 06:09:38 user nova-compute[73391]:       <entry name="uuid">7971bc72-40ad-4a65-ae04-de74afde6046</entry>
Aug 15 06:09:38 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 06:09:38 user nova-compute[73391]:     </system>
Aug 15 06:09:38 user nova-compute[73391]:   </sysinfo>
Aug 15 06:09:38 user nova-compute[73391]:   <os>
Aug 15 06:09:38 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 06:09:38 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 06:09:38 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 06:09:38 user nova-compute[73391]:   </os>
Aug 15 06:09:38 user nova-compute[73391]:   <features>
Aug 15 06:09:38 user nova-compute[73391]:     <acpi/>
Aug 15 06:09:38 user nova-compute[73391]:     <apic/>
Aug 15 06:09:38 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 06:09:38 user nova-compute[73391]:   </features>
Aug 15 06:09:38 user nova-compute[73391]:   <clock offset="utc">
Aug 15 06:09:38 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 06:09:38 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 06:09:38 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 06:09:38 user nova-compute[73391]:   </clock>
Aug 15 06:09:38 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 06:09:38 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 06:09:38 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 06:09:38 user nova-compute[73391]:   </cpu>
Aug 15 06:09:38 user nova-compute[73391]:   <devices>
Aug 15 06:09:38 user nova-compute[73391]:     <disk type="file" device="disk">
Aug 15 06:09:38 user nova-compute[73391]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 06:09:38 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/7971bc72-40ad-4a65-ae04-de74afde6046/disk"/>
Aug 15 06:09:38 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 06:09:38 user nova-compute[73391]:     </disk>
Aug 15 06:09:38 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 06:09:38 user nova-compute[73391]:       <mac address="fa:16:3e:55:40:39"/>
Aug 15 06:09:38 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 06:09:38 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 06:09:38 user nova-compute[73391]:       <target dev="tap9258b3ad-d3"/>
Aug 15 06:09:38 user nova-compute[73391]:     </interface>
Aug 15 06:09:38 user nova-compute[73391]:     <serial type="pty">
Aug 15 06:09:38 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/7971bc72-40ad-4a65-ae04-de74afde6046/console.log" append="off"/>
Aug 15 06:09:38 user nova-compute[73391]:     </serial>
Aug 15 06:09:38 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 06:09:38 user nova-compute[73391]:     <video>
Aug 15 06:09:38 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 06:09:38 user nova-compute[73391]:     </video>
Aug 15 06:09:38 user nova-compute[73391]:     <rng model="virtio">
Aug 15 06:09:38 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 06:09:38 user nova-compute[73391]:     </rng>
Aug 15 06:09:38 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 06:09:38 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 06:09:38 user nova-compute[73391]:       <stats period="10"/>
Aug 15 06:09:38 user nova-compute[73391]:     </memballoon>
Aug 15 06:09:38 user nova-compute[73391]:   </devices>
Aug 15 06:09:38 user nova-compute[73391]: </domain>
Aug 15 06:09:38 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 06:09:38 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T06:09:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1634370153',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1634370153',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1634370',id=52,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHAcHE32HG9dDcrmINrtFmQnUNa70fz/aqFn8HMV71Jf+pkZHPin4fsLWupjJmSMjbWc3mSKiLrNd+6mQhQD+w/tXhdi3cihyylgbbL8ksG1mTXJSLh8k8+uIYthaZvQVg==',key_name='tempest-keypair-651558149',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a71ecd9539434dd09177368b4a290208',ramdisk_id='',reservation_id='r-nlis7v5e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1303747324',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:09:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='055196cc17e6481ca02ca94b3a0f2db6',uuid=7971bc72-40ad-4a65-ae04-de74afde6046,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9258b3ad-d3d7-45b9-afb9-bf39b5b8be55", "address": "fa:16:3e:55:40:39", "network": {"id": "ba0174bd-6a67-444e-8a34-ecd99afafac0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1815564766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a71ecd9539434dd09177368b4a290208", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9258b3ad-d3", "ovs_interfaceid": "9258b3ad-d3d7-45b9-afb9-bf39b5b8be55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 06:09:38 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Converting VIF {"id": "9258b3ad-d3d7-45b9-afb9-bf39b5b8be55", "address": "fa:16:3e:55:40:39", "network": {"id": "ba0174bd-6a67-444e-8a34-ecd99afafac0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1815564766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a71ecd9539434dd09177368b4a290208", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9258b3ad-d3", "ovs_interfaceid": "9258b3ad-d3d7-45b9-afb9-bf39b5b8be55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:09:38 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:40:39,bridge_name='br-int',has_traffic_filtering=True,id=9258b3ad-d3d7-45b9-afb9-bf39b5b8be55,network=Network(ba0174bd-6a67-444e-8a34-ecd99afafac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9258b3ad-d3') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:09:38 user nova-compute[73391]: DEBUG os_vif [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:40:39,bridge_name='br-int',has_traffic_filtering=True,id=9258b3ad-d3d7-45b9-afb9-bf39b5b8be55,network=Network(ba0174bd-6a67-444e-8a34-ecd99afafac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9258b3ad-d3') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 06:09:38 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:09:38 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:09:38 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 06:09:38 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:09:38 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9258b3ad-d3, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:09:38 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap9258b3ad-d3, col_values=(('external_ids', {'iface-id': '9258b3ad-d3d7-45b9-afb9-bf39b5b8be55', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:40:39', 'vm-uuid': '7971bc72-40ad-4a65-ae04-de74afde6046'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:09:38 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:09:38 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:09:38 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:09:38 user nova-compute[73391]: INFO os_vif [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:40:39,bridge_name='br-int',has_traffic_filtering=True,id=9258b3ad-d3d7-45b9-afb9-bf39b5b8be55,network=Network(ba0174bd-6a67-444e-8a34-ecd99afafac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9258b3ad-d3')
Aug 15 06:09:39 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 06:09:39 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] No VIF found with MAC fa:16:3e:55:40:39, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 06:09:39 user nova-compute[73391]: DEBUG nova.network.neutron [req-ab4ecc4c-2560-455c-985c-c136b4ab40ab req-86ca3467-7fa8-432a-9c0d-78b30d14af3d service nova] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Updated VIF entry in instance network info cache for port 9258b3ad-d3d7-45b9-afb9-bf39b5b8be55. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 06:09:39 user nova-compute[73391]: DEBUG nova.network.neutron [req-ab4ecc4c-2560-455c-985c-c136b4ab40ab req-86ca3467-7fa8-432a-9c0d-78b30d14af3d service nova] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Updating instance_info_cache with network_info: [{"id": "9258b3ad-d3d7-45b9-afb9-bf39b5b8be55", "address": "fa:16:3e:55:40:39", "network": {"id": "ba0174bd-6a67-444e-8a34-ecd99afafac0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1815564766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a71ecd9539434dd09177368b4a290208", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9258b3ad-d3", "ovs_interfaceid": "9258b3ad-d3d7-45b9-afb9-bf39b5b8be55", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:09:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ab4ecc4c-2560-455c-985c-c136b4ab40ab req-86ca3467-7fa8-432a-9c0d-78b30d14af3d service nova] Releasing lock "refresh_cache-7971bc72-40ad-4a65-ae04-de74afde6046" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:09:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:09:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:09:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:09:40 user nova-compute[73391]: DEBUG nova.compute.manager [req-df3e42b5-22e1-4982-9228-91d208a433f2 req-3bc6b99b-ab43-4f22-ab50-930e08fec807 service nova] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Received event network-vif-plugged-9258b3ad-d3d7-45b9-afb9-bf39b5b8be55 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:09:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-df3e42b5-22e1-4982-9228-91d208a433f2 req-3bc6b99b-ab43-4f22-ab50-930e08fec807 service nova] Acquiring lock "7971bc72-40ad-4a65-ae04-de74afde6046-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:09:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-df3e42b5-22e1-4982-9228-91d208a433f2 req-3bc6b99b-ab43-4f22-ab50-930e08fec807 service nova] Lock "7971bc72-40ad-4a65-ae04-de74afde6046-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:09:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-df3e42b5-22e1-4982-9228-91d208a433f2 req-3bc6b99b-ab43-4f22-ab50-930e08fec807 service nova] Lock "7971bc72-40ad-4a65-ae04-de74afde6046-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:09:40 user nova-compute[73391]: DEBUG nova.compute.manager [req-df3e42b5-22e1-4982-9228-91d208a433f2 req-3bc6b99b-ab43-4f22-ab50-930e08fec807 service nova] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] No waiting events found dispatching network-vif-plugged-9258b3ad-d3d7-45b9-afb9-bf39b5b8be55 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:09:40 user nova-compute[73391]: WARNING nova.compute.manager [req-df3e42b5-22e1-4982-9228-91d208a433f2 req-3bc6b99b-ab43-4f22-ab50-930e08fec807 service nova] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Received unexpected event network-vif-plugged-9258b3ad-d3d7-45b9-afb9-bf39b5b8be55 for instance with vm_state building and task_state spawning.
Aug 15 06:09:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:09:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:09:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:09:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:09:42 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692079782.3202045, 7971bc72-40ad-4a65-ae04-de74afde6046 => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:09:42 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] VM Resumed (Lifecycle Event)
Aug 15 06:09:42 user nova-compute[73391]: DEBUG nova.compute.manager [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 06:09:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Guest created on hypervisor {{(pid=73391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 06:09:42 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Instance spawned successfully.
Aug 15 06:09:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 06:09:42 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:09:42 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 06:09:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Found default for hw_cdrom_bus of ide {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:09:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Found default for hw_disk_bus of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:09:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Found default for hw_input_bus of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:09:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Found default for hw_pointer_model of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:09:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Found default for hw_video_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:09:42 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Found default for hw_vif_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:09:42 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 06:09:42 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692079782.3205106, 7971bc72-40ad-4a65-ae04-de74afde6046 => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:09:42 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] VM Started (Lifecycle Event)
Aug 15 06:09:42 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:09:42 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 06:09:42 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 06:09:42 user nova-compute[73391]: INFO nova.compute.manager [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Took 5.68 seconds to spawn the instance on the hypervisor.
Aug 15 06:09:42 user nova-compute[73391]: DEBUG nova.compute.manager [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:09:42 user nova-compute[73391]: INFO nova.compute.manager [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Took 6.19 seconds to build instance.
Aug 15 06:09:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-eaa47295-546c-4c6f-a680-0c242b119ecf tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Lock "7971bc72-40ad-4a65-ae04-de74afde6046" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.291s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:09:42 user nova-compute[73391]: DEBUG nova.compute.manager [req-3747ab1c-8bfe-434c-8edb-c01ffabc012c req-549f050d-a9f1-4f38-beff-e26a225d28e8 service nova] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Received event network-vif-plugged-9258b3ad-d3d7-45b9-afb9-bf39b5b8be55 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:09:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-3747ab1c-8bfe-434c-8edb-c01ffabc012c req-549f050d-a9f1-4f38-beff-e26a225d28e8 service nova] Acquiring lock "7971bc72-40ad-4a65-ae04-de74afde6046-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:09:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-3747ab1c-8bfe-434c-8edb-c01ffabc012c req-549f050d-a9f1-4f38-beff-e26a225d28e8 service nova] Lock "7971bc72-40ad-4a65-ae04-de74afde6046-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:09:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-3747ab1c-8bfe-434c-8edb-c01ffabc012c req-549f050d-a9f1-4f38-beff-e26a225d28e8 service nova] Lock "7971bc72-40ad-4a65-ae04-de74afde6046-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:09:42 user nova-compute[73391]: DEBUG nova.compute.manager [req-3747ab1c-8bfe-434c-8edb-c01ffabc012c req-549f050d-a9f1-4f38-beff-e26a225d28e8 service nova] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] No waiting events found dispatching network-vif-plugged-9258b3ad-d3d7-45b9-afb9-bf39b5b8be55 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:09:42 user nova-compute[73391]: WARNING nova.compute.manager [req-3747ab1c-8bfe-434c-8edb-c01ffabc012c req-549f050d-a9f1-4f38-beff-e26a225d28e8 service nova] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Received unexpected event network-vif-plugged-9258b3ad-d3d7-45b9-afb9-bf39b5b8be55 for instance with vm_state active and task_state None.
Aug 15 06:09:43 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:09:43 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:09:44 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:09:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:09:45 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:09:46 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:09:48 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:09:48 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Starting heal instance info cache {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 06:09:48 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Rebuilding the list of instances to heal {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 06:09:48 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "refresh_cache-7971bc72-40ad-4a65-ae04-de74afde6046" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:09:48 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquired lock "refresh_cache-7971bc72-40ad-4a65-ae04-de74afde6046" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:09:48 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Forcefully refreshing network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 06:09:48 user nova-compute[73391]: DEBUG nova.objects.instance [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lazy-loading 'info_cache' on Instance uuid 7971bc72-40ad-4a65-ae04-de74afde6046 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:09:48 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:09:49 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Updating instance_info_cache with network_info: [{"id": "9258b3ad-d3d7-45b9-afb9-bf39b5b8be55", "address": "fa:16:3e:55:40:39", "network": {"id": "ba0174bd-6a67-444e-8a34-ecd99afafac0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1815564766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a71ecd9539434dd09177368b4a290208", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9258b3ad-d3", "ovs_interfaceid": "9258b3ad-d3d7-45b9-afb9-bf39b5b8be55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:09:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Releasing lock "refresh_cache-7971bc72-40ad-4a65-ae04-de74afde6046" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:09:49 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Updated the network info_cache for instance {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 06:09:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:09:53 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:09:54 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:09:54 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 06:09:55 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:09:58 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:09:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:09:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:09:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:09:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:09:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:09:58 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:10:00 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:10:03 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:10:03 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:10:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:10:08 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:10:10 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:10:13 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:10:18 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:10:23 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:10:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:10:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:10:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:10:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:10:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:10:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:10:33 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:10:35 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:10:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:10:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:10:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:10:35 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Auditing locally available compute resources for user (node: user) {{(pid=73391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 06:10:35 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7971bc72-40ad-4a65-ae04-de74afde6046/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:10:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7971bc72-40ad-4a65-ae04-de74afde6046/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:10:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7971bc72-40ad-4a65-ae04-de74afde6046/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:10:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7971bc72-40ad-4a65-ae04-de74afde6046/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:10:36 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:10:36 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:10:36 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Hypervisor/Node resource view: name=user free_ram=8805MB free_disk=25.075305938720703GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 06:10:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:10:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:10:36 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 7971bc72-40ad-4a65-ae04-de74afde6046 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:10:36 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 06:10:36 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 06:10:36 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:10:36 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:10:36 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Compute_service record updated for user:user {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 06:10:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.247s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:10:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:10:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:10:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:10:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:10:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:10:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:10:44 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:10:44 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:10:44 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:10:44 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:10:44 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:10:44 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:10:45 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:10:45 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:10:46 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:10:46 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:10:47 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:10:48 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:10:48 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Starting heal instance info cache {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 06:10:48 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Rebuilding the list of instances to heal {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 06:10:48 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "refresh_cache-7971bc72-40ad-4a65-ae04-de74afde6046" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:10:48 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquired lock "refresh_cache-7971bc72-40ad-4a65-ae04-de74afde6046" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:10:48 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Forcefully refreshing network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 06:10:48 user nova-compute[73391]: DEBUG nova.objects.instance [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lazy-loading 'info_cache' on Instance uuid 7971bc72-40ad-4a65-ae04-de74afde6046 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:10:49 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:10:49 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:10:49 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:10:49 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:10:49 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:10:49 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:10:49 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Updating instance_info_cache with network_info: [{"id": "9258b3ad-d3d7-45b9-afb9-bf39b5b8be55", "address": "fa:16:3e:55:40:39", "network": {"id": "ba0174bd-6a67-444e-8a34-ecd99afafac0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1815564766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a71ecd9539434dd09177368b4a290208", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9258b3ad-d3", "ovs_interfaceid": "9258b3ad-d3d7-45b9-afb9-bf39b5b8be55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:10:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Releasing lock "refresh_cache-7971bc72-40ad-4a65-ae04-de74afde6046" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:10:49 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Updated the network info_cache for instance {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 06:10:53 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:10:53 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Cleaning up deleted instances {{(pid=73391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 06:10:53 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] There are 0 instances to clean {{(pid=73391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 06:10:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:10:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:10:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:10:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:10:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:10:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:10:54 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:10:54 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 06:10:55 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:10:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:10:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:10:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:10:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:10:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:10:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:10:59 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:11:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:11:07 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:11:07 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73391) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 06:11:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:11:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:11:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:11:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:11:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:11:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:11:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:11:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:11:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:11:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:11:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:11:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:11:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:11:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:11:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:11:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:11:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:11:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:11:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:11:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:11:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:11:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:11:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:11:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:11:27 user nova-compute[73391]: DEBUG nova.compute.manager [req-ee25e37d-609e-479c-bef6-b7ff60f54ca6 req-882067ee-0cec-443d-ba9d-9b53a601d596 service nova] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Received event network-changed-9258b3ad-d3d7-45b9-afb9-bf39b5b8be55 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:11:27 user nova-compute[73391]: DEBUG nova.compute.manager [req-ee25e37d-609e-479c-bef6-b7ff60f54ca6 req-882067ee-0cec-443d-ba9d-9b53a601d596 service nova] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Refreshing instance network info cache due to event network-changed-9258b3ad-d3d7-45b9-afb9-bf39b5b8be55. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 06:11:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ee25e37d-609e-479c-bef6-b7ff60f54ca6 req-882067ee-0cec-443d-ba9d-9b53a601d596 service nova] Acquiring lock "refresh_cache-7971bc72-40ad-4a65-ae04-de74afde6046" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:11:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ee25e37d-609e-479c-bef6-b7ff60f54ca6 req-882067ee-0cec-443d-ba9d-9b53a601d596 service nova] Acquired lock "refresh_cache-7971bc72-40ad-4a65-ae04-de74afde6046" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:11:27 user nova-compute[73391]: DEBUG nova.network.neutron [req-ee25e37d-609e-479c-bef6-b7ff60f54ca6 req-882067ee-0cec-443d-ba9d-9b53a601d596 service nova] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Refreshing network info cache for port 9258b3ad-d3d7-45b9-afb9-bf39b5b8be55 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 06:11:27 user nova-compute[73391]: DEBUG nova.network.neutron [req-ee25e37d-609e-479c-bef6-b7ff60f54ca6 req-882067ee-0cec-443d-ba9d-9b53a601d596 service nova] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Updated VIF entry in instance network info cache for port 9258b3ad-d3d7-45b9-afb9-bf39b5b8be55. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 06:11:27 user nova-compute[73391]: DEBUG nova.network.neutron [req-ee25e37d-609e-479c-bef6-b7ff60f54ca6 req-882067ee-0cec-443d-ba9d-9b53a601d596 service nova] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Updating instance_info_cache with network_info: [{"id": "9258b3ad-d3d7-45b9-afb9-bf39b5b8be55", "address": "fa:16:3e:55:40:39", "network": {"id": "ba0174bd-6a67-444e-8a34-ecd99afafac0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1815564766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a71ecd9539434dd09177368b4a290208", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9258b3ad-d3", "ovs_interfaceid": "9258b3ad-d3d7-45b9-afb9-bf39b5b8be55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:11:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-ee25e37d-609e-479c-bef6-b7ff60f54ca6 req-882067ee-0cec-443d-ba9d-9b53a601d596 service nova] Releasing lock "refresh_cache-7971bc72-40ad-4a65-ae04-de74afde6046" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:11:29 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:11:29 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:11:29 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:11:29 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:11:29 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:11:29 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:11:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:11:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-bbcc8652-0584-4ae6-8ec7-b44f4204521f tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Acquiring lock "7971bc72-40ad-4a65-ae04-de74afde6046" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:11:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-bbcc8652-0584-4ae6-8ec7-b44f4204521f tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Lock "7971bc72-40ad-4a65-ae04-de74afde6046" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:11:31 user nova-compute[73391]: DEBUG nova.objects.instance [None req-bbcc8652-0584-4ae6-8ec7-b44f4204521f tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Lazy-loading 'flavor' on Instance uuid 7971bc72-40ad-4a65-ae04-de74afde6046 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:11:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-bbcc8652-0584-4ae6-8ec7-b44f4204521f tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Lock "7971bc72-40ad-4a65-ae04-de74afde6046" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:11:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-bbcc8652-0584-4ae6-8ec7-b44f4204521f tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Acquiring lock "7971bc72-40ad-4a65-ae04-de74afde6046" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:11:31 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-bbcc8652-0584-4ae6-8ec7-b44f4204521f tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Lock "7971bc72-40ad-4a65-ae04-de74afde6046" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:11:31 user nova-compute[73391]: INFO nova.compute.manager [None req-bbcc8652-0584-4ae6-8ec7-b44f4204521f tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Attaching volume 950457f8-0303-4975-8268-9cefffc431f4 to /dev/vdb
Aug 15 06:11:31 user nova-compute[73391]: DEBUG os_brick.utils [None req-bbcc8652-0584-4ae6-8ec7-b44f4204521f tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:11:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:11:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:11:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b34f6fa-226c-46fc-b741-53c94e3546f4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:11:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:11:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:11:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd1d864-087d-485f-949d-e728f1bd3b7a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:11:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:11:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:11:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5775f183-a536-41a3-a5fd-9eed03d7a9af]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:11:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c66b336e-e00e-4bfe-9e83-8333777e20e7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:11:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-bbcc8652-0584-4ae6-8ec7-b44f4204521f tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:11:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-bbcc8652-0584-4ae6-8ec7-b44f4204521f tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 06:11:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bbcc8652-0584-4ae6-8ec7-b44f4204521f tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 06:11:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:11:31 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 06:11:31 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 06:11:31 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b19040-0a69-4588-a7d1-ee08f44528ba]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:11:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-bbcc8652-0584-4ae6-8ec7-b44f4204521f tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 06:11:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-bbcc8652-0584-4ae6-8ec7-b44f4204521f tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 06:11:31 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-bbcc8652-0584-4ae6-8ec7-b44f4204521f tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 06:11:31 user nova-compute[73391]: DEBUG os_brick.utils [None req-bbcc8652-0584-4ae6-8ec7-b44f4204521f tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:11:31 user nova-compute[73391]: DEBUG nova.virt.block_device [None req-bbcc8652-0584-4ae6-8ec7-b44f4204521f tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Updating existing volume attachment record: 6deded93-3cd5-498b-87e1-4436dd2c63e6 {{(pid=73391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 06:11:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:11:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:11:35 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:11:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:11:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:11:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:11:35 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Auditing locally available compute resources for user (node: user) {{(pid=73391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 06:11:35 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7971bc72-40ad-4a65-ae04-de74afde6046/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:11:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7971bc72-40ad-4a65-ae04-de74afde6046/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:11:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7971bc72-40ad-4a65-ae04-de74afde6046/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:11:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7971bc72-40ad-4a65-ae04-de74afde6046/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:11:36 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:11:36 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:11:36 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Hypervisor/Node resource view: name=user free_ram=8811MB free_disk=25.07445526123047GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 06:11:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:11:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:11:36 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 7971bc72-40ad-4a65-ae04-de74afde6046 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:11:36 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 06:11:36 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 06:11:36 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Refreshing inventories for resource provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 06:11:36 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Updating ProviderTree inventory for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 06:11:36 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Updating inventory in ProviderTree for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 06:11:36 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Refreshing aggregate associations for resource provider 771708bd-6a2a-4e0c-9869-46d45e6b1896, aggregates: None {{(pid=73391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 06:11:36 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Refreshing trait associations for resource provider 771708bd-6a2a-4e0c-9869-46d45e6b1896, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=73391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 06:11:36 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:11:36 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:11:36 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Compute_service record updated for user:user {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 06:11:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.292s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:11:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:11:40 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbcc8652-0584-4ae6-8ec7-b44f4204521f tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 06:11:40 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbcc8652-0584-4ae6-8ec7-b44f4204521f tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:950457f8-0303-4975-8268-9cefffc431f4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oKunLOzd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:11:40 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-bbcc8652-0584-4ae6-8ec7-b44f4204521f tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:11:40 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-bbcc8652-0584-4ae6-8ec7-b44f4204521f tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:11:40 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-bbcc8652-0584-4ae6-8ec7-b44f4204521f tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:11:40 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-bbcc8652-0584-4ae6-8ec7-b44f4204521f tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:11:40 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-bbcc8652-0584-4ae6-8ec7-b44f4204521f tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:950457f8-0303-4975-8268-9cefffc431f4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:11:40 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-bbcc8652-0584-4ae6-8ec7-b44f4204521f tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:950457f8-0303-4975-8268-9cefffc431f4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:11:40 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-bbcc8652-0584-4ae6-8ec7-b44f4204521f tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 06:11:40 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:950457f8-0303-4975-8268-9cefffc431f4 -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:11:40 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:950457f8-0303-4975-8268-9cefffc431f4 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:11:40 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e3eae8-1232-40d7-91ed-1e2ed94f49ee]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:11:40 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbcc8652-0584-4ae6-8ec7-b44f4204521f tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 06:11:40 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:11:40 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:950457f8-0303-4975-8268-9cefffc431f4 -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:11:40 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:950457f8-0303-4975-8268-9cefffc431f4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:11:40 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c584fcd5-5c43-4a6b-bc3d-5e651af8328d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:950457f8-0303-4975-8268-9cefffc431f4] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:11:40 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbcc8652-0584-4ae6-8ec7-b44f4204521f tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:950457f8-0303-4975-8268-9cefffc431f4] added
Aug 15 06:11:40 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:11:40 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:950457f8-0303-4975-8268-9cefffc431f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:11:40 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:950457f8-0303-4975-8268-9cefffc431f4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:11:40 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c75c07-0e11-4945-a215-ed9a22ab2052]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:11:40 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbcc8652-0584-4ae6-8ec7-b44f4204521f tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:11:40 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:950457f8-0303-4975-8268-9cefffc431f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:11:40 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:950457f8-0303-4975-8268-9cefffc431f4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:11:40 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3bd1906-01f5-4a55-a9b3-84115ed886bb]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:11:40 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbcc8652-0584-4ae6-8ec7-b44f4204521f tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:11:40 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:950457f8-0303-4975-8268-9cefffc431f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oKunLOzd {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:11:40 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:950457f8-0303-4975-8268-9cefffc431f4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oKunLOzd" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:11:40 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc00db40-bcc6-4454-9380-e9699d52d094]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:11:40 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbcc8652-0584-4ae6-8ec7-b44f4204521f tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oKunLOzd'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:11:40 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:950457f8-0303-4975-8268-9cefffc431f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:11:40 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:950457f8-0303-4975-8268-9cefffc431f4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:11:40 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ed2360-2005-4723-83f4-b855d42310cc]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:11:40 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbcc8652-0584-4ae6-8ec7-b44f4204521f tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:11:40 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:11:40 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:11:40 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c05efbd-ac66-4de8-800b-b464a24492af]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:11:40 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbcc8652-0584-4ae6-8ec7-b44f4204521f tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 06:11:40 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:11:40 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbcc8652-0584-4ae6-8ec7-b44f4204521f tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 06:11:40 user nova-compute[73391]:  {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:11:40 user nova-compute[73391]: WARNING os_brick.initiator.connectors.iscsi [None req-bbcc8652-0584-4ae6-8ec7-b44f4204521f tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 06:11:40 user nova-compute[73391]: 
Aug 15 06:11:40 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:950457f8-0303-4975-8268-9cefffc431f4 -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:11:40 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:950457f8-0303-4975-8268-9cefffc431f4 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:11:40 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f477e1-5b94-4518-8881-069c4542c1c8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:950457f8-0303-4975-8268-9cefffc431f4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:950457f8-0303-4975-8268-9cefffc431f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:11:40 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbcc8652-0584-4ae6-8ec7-b44f4204521f tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:950457f8-0303-4975-8268-9cefffc431f4, portal: 172.16.0.220,3260]
Aug 15 06:11:40 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:950457f8-0303-4975-8268-9cefffc431f4, portal: 172.16.0.220,3260] successful.
Aug 15 06:11:40 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:11:40 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:950457f8-0303-4975-8268-9cefffc431f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:11:40 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:950457f8-0303-4975-8268-9cefffc431f4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:11:40 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c390b01-c437-425e-9ce5-7ee6c0f87043]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:11:40 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbcc8652-0584-4ae6-8ec7-b44f4204521f tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:11:40 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:11:40 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:11:40 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b38fe53-0b90-42fc-87fe-19ec7103d9a9]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950457f8-0303-4975-8268-9cefffc431f4 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:11:40 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbcc8652-0584-4ae6-8ec7-b44f4204521f tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950457f8-0303-4975-8268-9cefffc431f4 (non-flash)
Aug 15 06:11:40 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:11:40 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbcc8652-0584-4ae6-8ec7-b44f4204521f tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950457f8-0303-4975-8268-9cefffc431f4 (non-flash)
Aug 15 06:11:40 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:11:40 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-bbcc8652-0584-4ae6-8ec7-b44f4204521f tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:950457f8-0303-4975-8268-9cefffc431f4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.258s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:11:40 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbcc8652-0584-4ae6-8ec7-b44f4204521f tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 06:11:40 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-bbcc8652-0584-4ae6-8ec7-b44f4204521f tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] HCTL ('33', '-', '-', 0) found on session 63 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 06:11:40 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-bbcc8652-0584-4ae6-8ec7-b44f4204521f tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 06:11:40 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:11:40 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:11:40 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[138eb654-dbb8-436b-a5d0-c650107a544e]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:11:40 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-bbcc8652-0584-4ae6-8ec7-b44f4204521f tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: None {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 06:11:41 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-bbcc8652-0584-4ae6-8ec7-b44f4204521f tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Searching for a device in session 63 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 06:11:41 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbcc8652-0584-4ae6-8ec7-b44f4204521f tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oKunLOzd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 06:11:41 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-bbcc8652-0584-4ae6-8ec7-b44f4204521f tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.290s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:11:41 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-bbcc8652-0584-4ae6-8ec7-b44f4204521f tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] <== connect_volume: return (1291ms) {'type': 'block', 'scsi_wwn': '23834346134643538', 'path': '/dev/sdb'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:11:41 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bbcc8652-0584-4ae6-8ec7-b44f4204521f tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23834346134643538', 'path': '/dev/sdb'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 06:11:41 user nova-compute[73391]: DEBUG nova.objects.instance [None req-bbcc8652-0584-4ae6-8ec7-b44f4204521f tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Lazy-loading 'flavor' on Instance uuid 7971bc72-40ad-4a65-ae04-de74afde6046 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:11:41 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-bbcc8652-0584-4ae6-8ec7-b44f4204521f tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 06:11:41 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 06:11:41 user nova-compute[73391]:   <source dev="/dev/sdb"/>
Aug 15 06:11:41 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 06:11:41 user nova-compute[73391]:   <serial>950457f8-0303-4975-8268-9cefffc431f4</serial>
Aug 15 06:11:41 user nova-compute[73391]: </disk>
Aug 15 06:11:41 user nova-compute[73391]:  {{(pid=73391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 06:11:41 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-bbcc8652-0584-4ae6-8ec7-b44f4204521f tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 06:11:41 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-bbcc8652-0584-4ae6-8ec7-b44f4204521f tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 06:11:41 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-bbcc8652-0584-4ae6-8ec7-b44f4204521f tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] No VIF found with MAC fa:16:3e:55:40:39, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 06:11:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-bbcc8652-0584-4ae6-8ec7-b44f4204521f tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Lock "7971bc72-40ad-4a65-ae04-de74afde6046" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.423s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:11:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-4424dd93-9eb9-4504-ae1a-813f51df5eba tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Acquiring lock "7971bc72-40ad-4a65-ae04-de74afde6046" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:11:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-4424dd93-9eb9-4504-ae1a-813f51df5eba tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Lock "7971bc72-40ad-4a65-ae04-de74afde6046" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:11:42 user nova-compute[73391]: INFO nova.compute.manager [None req-4424dd93-9eb9-4504-ae1a-813f51df5eba tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Detaching volume 950457f8-0303-4975-8268-9cefffc431f4
Aug 15 06:11:43 user nova-compute[73391]: INFO nova.virt.block_device [None req-4424dd93-9eb9-4504-ae1a-813f51df5eba tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Attempting to driver detach volume 950457f8-0303-4975-8268-9cefffc431f4 from mountpoint /dev/vdb
Aug 15 06:11:43 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-4424dd93-9eb9-4504-ae1a-813f51df5eba tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Attempting to detach device vdb from instance 7971bc72-40ad-4a65-ae04-de74afde6046 from the persistent domain config. {{(pid=73391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 06:11:43 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-4424dd93-9eb9-4504-ae1a-813f51df5eba tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 06:11:43 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 06:11:43 user nova-compute[73391]:   <source dev="/dev/sdb"/>
Aug 15 06:11:43 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 06:11:43 user nova-compute[73391]:   <serial>950457f8-0303-4975-8268-9cefffc431f4</serial>
Aug 15 06:11:43 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 06:11:43 user nova-compute[73391]: </disk>
Aug 15 06:11:43 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 06:11:43 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-4424dd93-9eb9-4504-ae1a-813f51df5eba tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Successfully detached device vdb from instance 7971bc72-40ad-4a65-ae04-de74afde6046 from the persistent domain config.
Aug 15 06:11:43 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-4424dd93-9eb9-4504-ae1a-813f51df5eba tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7971bc72-40ad-4a65-ae04-de74afde6046 from the live domain config. {{(pid=73391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 06:11:43 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-4424dd93-9eb9-4504-ae1a-813f51df5eba tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 06:11:43 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 06:11:43 user nova-compute[73391]:   <source dev="/dev/sdb"/>
Aug 15 06:11:43 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 06:11:43 user nova-compute[73391]:   <serial>950457f8-0303-4975-8268-9cefffc431f4</serial>
Aug 15 06:11:43 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 06:11:43 user nova-compute[73391]: </disk>
Aug 15 06:11:43 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 06:11:43 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Received event <DeviceRemovedEvent: 1692079903.456443, 7971bc72-40ad-4a65-ae04-de74afde6046 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73391) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 06:11:43 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-4424dd93-9eb9-4504-ae1a-813f51df5eba tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7971bc72-40ad-4a65-ae04-de74afde6046 {{(pid=73391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 06:11:43 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-4424dd93-9eb9-4504-ae1a-813f51df5eba tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Successfully detached device vdb from instance 7971bc72-40ad-4a65-ae04-de74afde6046 from the live domain config.
Aug 15 06:11:43 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4424dd93-9eb9-4504-ae1a-813f51df5eba tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 06:11:43 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4424dd93-9eb9-4504-ae1a-813f51df5eba tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:950457f8-0303-4975-8268-9cefffc431f4'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oKunLOzd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:11:43 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-4424dd93-9eb9-4504-ae1a-813f51df5eba tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:11:43 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-4424dd93-9eb9-4504-ae1a-813f51df5eba tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:11:43 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-4424dd93-9eb9-4504-ae1a-813f51df5eba tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:11:43 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4424dd93-9eb9-4504-ae1a-813f51df5eba tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:950457f8-0303-4975-8268-9cefffc431f4', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 06:11:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:11:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:11:43 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[88bbbd43-2b11-4a35-a7dc-f194963fed5f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:950457f8-0303-4975-8268-9cefffc431f4\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:11:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:11:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:11:43 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe644cd4-3f61-4321-969e-df494e24b0e0]: (4, ('tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950457f8-0303-4975-8268-9cefffc431f4 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:11:43 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4424dd93-9eb9-4504-ae1a-813f51df5eba tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950457f8-0303-4975-8268-9cefffc431f4 (non-flash)
Aug 15 06:11:43 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:11:43 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4424dd93-9eb9-4504-ae1a-813f51df5eba tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] iscsi session list stdout=tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:950457f8-0303-4975-8268-9cefffc431f4 (non-flash)
Aug 15 06:11:43 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:11:43 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4424dd93-9eb9-4504-ae1a-813f51df5eba tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f774850a050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:950457f8-0303-4975-8268-9cefffc431f4'): ({'sdb'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 06:11:43 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-4424dd93-9eb9-4504-ae1a-813f51df5eba tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Removing single pathed devices sdb {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 06:11:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:11:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:11:43 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b99d6b-093a-4178-824b-98388a924854]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:11:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:11:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:11:43 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1682f1f-aaa1-4f9b-a4d1-7034b867f73a]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:11:43 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-4424dd93-9eb9-4504-ae1a-813f51df5eba tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Flushing IO for device /dev/sdb {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 06:11:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:11:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:11:43 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2af523f-6f40-4dcc-8de8-3c8dc615dfdf]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:11:43 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-4424dd93-9eb9-4504-ae1a-813f51df5eba tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 06:11:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:11:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.049s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:11:43 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e359e58b-9c74-48b0-b731-c5d6b36f19dd]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:11:43 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-4424dd93-9eb9-4504-ae1a-813f51df5eba tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 06:11:43 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-4424dd93-9eb9-4504-ae1a-813f51df5eba tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] SCSI volumes sdb have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 06:11:43 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4424dd93-9eb9-4504-ae1a-813f51df5eba tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:950457f8-0303-4975-8268-9cefffc431f4')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 06:11:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:950457f8-0303-4975-8268-9cefffc431f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:11:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:950457f8-0303-4975-8268-9cefffc431f4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:11:43 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[83333561-eddf-4561-a9e0-7631a202600a]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:11:43 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4424dd93-9eb9-4504-ae1a-813f51df5eba tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:11:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:950457f8-0303-4975-8268-9cefffc431f4 -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:11:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:950457f8-0303-4975-8268-9cefffc431f4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:11:43 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[942f6603-8ec7-4386-8f59-5c630164fc86]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:950457f8-0303-4975-8268-9cefffc431f4, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:950457f8-0303-4975-8268-9cefffc431f4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:11:43 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4424dd93-9eb9-4504-ae1a-813f51df5eba tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:950457f8-0303-4975-8268-9cefffc431f4, portal: 172.16.0.220,3260]
Aug 15 06:11:43 user nova-compute[73391]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:950457f8-0303-4975-8268-9cefffc431f4, portal: 172.16.0.220,3260] successful.
Aug 15 06:11:43 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:11:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:950457f8-0303-4975-8268-9cefffc431f4 -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:11:43 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:950457f8-0303-4975-8268-9cefffc431f4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:11:43 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5adedb00-a14e-4bdb-9b2a-4075c7e7f2b6]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:11:43 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4424dd93-9eb9-4504-ae1a-813f51df5eba tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:11:43 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-4424dd93-9eb9-4504-ae1a-813f51df5eba tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:11:43 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4424dd93-9eb9-4504-ae1a-813f51df5eba tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] <== disconnect_volume: return (308ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:11:43 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4424dd93-9eb9-4504-ae1a-813f51df5eba tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 06:11:44 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:11:44 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:11:44 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:11:44 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:11:44 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:11:44 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:11:44 user nova-compute[73391]: DEBUG nova.objects.instance [None req-4424dd93-9eb9-4504-ae1a-813f51df5eba tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Lazy-loading 'flavor' on Instance uuid 7971bc72-40ad-4a65-ae04-de74afde6046 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:11:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-4424dd93-9eb9-4504-ae1a-813f51df5eba tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Lock "7971bc72-40ad-4a65-ae04-de74afde6046" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.617s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:11:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:11:47 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:11:47 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:11:47 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:11:49 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:11:49 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:11:49 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Starting heal instance info cache {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 06:11:49 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Rebuilding the list of instances to heal {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 06:11:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "refresh_cache-7971bc72-40ad-4a65-ae04-de74afde6046" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:11:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquired lock "refresh_cache-7971bc72-40ad-4a65-ae04-de74afde6046" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:11:49 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Forcefully refreshing network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 06:11:49 user nova-compute[73391]: DEBUG nova.objects.instance [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lazy-loading 'info_cache' on Instance uuid 7971bc72-40ad-4a65-ae04-de74afde6046 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:11:50 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Updating instance_info_cache with network_info: [{"id": "9258b3ad-d3d7-45b9-afb9-bf39b5b8be55", "address": "fa:16:3e:55:40:39", "network": {"id": "ba0174bd-6a67-444e-8a34-ecd99afafac0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1815564766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a71ecd9539434dd09177368b4a290208", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9258b3ad-d3", "ovs_interfaceid": "9258b3ad-d3d7-45b9-afb9-bf39b5b8be55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:11:50 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Releasing lock "refresh_cache-7971bc72-40ad-4a65-ae04-de74afde6046" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:11:50 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Updated the network info_cache for instance {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 06:11:50 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:11:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:11:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:11:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:11:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:11:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:11:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:11:54 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:11:54 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 06:11:55 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:11:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:11:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:11:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:11:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:11:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:11:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:12:00 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:12:00 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:12:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:12:07 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:12:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:12:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:12:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:12:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:12:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:12:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:12:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:12:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:12:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:12:29 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:12:29 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:12:29 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:12:29 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:12:29 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:12:29 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:12:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:12:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:12:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:12:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:12:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:12:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:12:35 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:12:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:12:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:12:35 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:12:35 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Auditing locally available compute resources for user (node: user) {{(pid=73391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 06:12:35 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7971bc72-40ad-4a65-ae04-de74afde6046/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:12:35 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7971bc72-40ad-4a65-ae04-de74afde6046/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:12:35 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7971bc72-40ad-4a65-ae04-de74afde6046/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:12:36 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7971bc72-40ad-4a65-ae04-de74afde6046/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:12:36 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:12:36 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:12:36 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Hypervisor/Node resource view: name=user free_ram=8809MB free_disk=25.07352066040039GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 06:12:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:12:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:12:36 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance 7971bc72-40ad-4a65-ae04-de74afde6046 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:12:36 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 06:12:36 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 06:12:36 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:12:36 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:12:36 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Compute_service record updated for user:user {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 06:12:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.181s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:12:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-4df1532c-ba9b-42f1-9112-a967590bb9ec tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Acquiring lock "7971bc72-40ad-4a65-ae04-de74afde6046" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:12:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-4df1532c-ba9b-42f1-9112-a967590bb9ec tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Lock "7971bc72-40ad-4a65-ae04-de74afde6046" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:12:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-4df1532c-ba9b-42f1-9112-a967590bb9ec tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Acquiring lock "7971bc72-40ad-4a65-ae04-de74afde6046-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:12:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-4df1532c-ba9b-42f1-9112-a967590bb9ec tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Lock "7971bc72-40ad-4a65-ae04-de74afde6046-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:12:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-4df1532c-ba9b-42f1-9112-a967590bb9ec tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Lock "7971bc72-40ad-4a65-ae04-de74afde6046-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:12:38 user nova-compute[73391]: INFO nova.compute.manager [None req-4df1532c-ba9b-42f1-9112-a967590bb9ec tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Terminating instance
Aug 15 06:12:38 user nova-compute[73391]: DEBUG nova.compute.manager [None req-4df1532c-ba9b-42f1-9112-a967590bb9ec tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Start destroying the instance on the hypervisor. {{(pid=73391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 06:12:38 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:12:38 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:12:38 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:12:38 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:12:38 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:12:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:12:39 user nova-compute[73391]: DEBUG nova.compute.manager [req-2e494fb5-1c1b-4fd0-bf88-3c92de28e189 req-8368022d-e8a8-4866-92d2-e72df0d58458 service nova] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Received event network-vif-unplugged-9258b3ad-d3d7-45b9-afb9-bf39b5b8be55 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:12:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2e494fb5-1c1b-4fd0-bf88-3c92de28e189 req-8368022d-e8a8-4866-92d2-e72df0d58458 service nova] Acquiring lock "7971bc72-40ad-4a65-ae04-de74afde6046-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:12:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2e494fb5-1c1b-4fd0-bf88-3c92de28e189 req-8368022d-e8a8-4866-92d2-e72df0d58458 service nova] Lock "7971bc72-40ad-4a65-ae04-de74afde6046-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:12:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2e494fb5-1c1b-4fd0-bf88-3c92de28e189 req-8368022d-e8a8-4866-92d2-e72df0d58458 service nova] Lock "7971bc72-40ad-4a65-ae04-de74afde6046-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:12:39 user nova-compute[73391]: DEBUG nova.compute.manager [req-2e494fb5-1c1b-4fd0-bf88-3c92de28e189 req-8368022d-e8a8-4866-92d2-e72df0d58458 service nova] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] No waiting events found dispatching network-vif-unplugged-9258b3ad-d3d7-45b9-afb9-bf39b5b8be55 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:12:39 user nova-compute[73391]: DEBUG nova.compute.manager [req-2e494fb5-1c1b-4fd0-bf88-3c92de28e189 req-8368022d-e8a8-4866-92d2-e72df0d58458 service nova] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Received event network-vif-unplugged-9258b3ad-d3d7-45b9-afb9-bf39b5b8be55 for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 06:12:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:12:39 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Instance destroyed successfully.
Aug 15 06:12:39 user nova-compute[73391]: DEBUG nova.objects.instance [None req-4df1532c-ba9b-42f1-9112-a967590bb9ec tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Lazy-loading 'resources' on Instance uuid 7971bc72-40ad-4a65-ae04-de74afde6046 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:12:39 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-4df1532c-ba9b-42f1-9112-a967590bb9ec tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T06:09:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1634370153',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1634370153',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1634370',id=52,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHAcHE32HG9dDcrmINrtFmQnUNa70fz/aqFn8HMV71Jf+pkZHPin4fsLWupjJmSMjbWc3mSKiLrNd+6mQhQD+w/tXhdi3cihyylgbbL8ksG1mTXJSLh8k8+uIYthaZvQVg==',key_name='tempest-keypair-651558149',keypairs=<?>,launch_index=0,launched_at=2023-08-15T06:09:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a71ecd9539434dd09177368b4a290208',ramdisk_id='',reservation_id='r-nlis7v5e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1303747324',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T06:09:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='055196cc17e6481ca02ca94b3a0f2db6',uuid=7971bc72-40ad-4a65-ae04-de74afde6046,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9258b3ad-d3d7-45b9-afb9-bf39b5b8be55", "address": "fa:16:3e:55:40:39", "network": {"id": "ba0174bd-6a67-444e-8a34-ecd99afafac0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1815564766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a71ecd9539434dd09177368b4a290208", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9258b3ad-d3", "ovs_interfaceid": "9258b3ad-d3d7-45b9-afb9-bf39b5b8be55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 06:12:39 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-4df1532c-ba9b-42f1-9112-a967590bb9ec tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Converting VIF {"id": "9258b3ad-d3d7-45b9-afb9-bf39b5b8be55", "address": "fa:16:3e:55:40:39", "network": {"id": "ba0174bd-6a67-444e-8a34-ecd99afafac0", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1815564766-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.38", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a71ecd9539434dd09177368b4a290208", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9258b3ad-d3", "ovs_interfaceid": "9258b3ad-d3d7-45b9-afb9-bf39b5b8be55", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:12:39 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-4df1532c-ba9b-42f1-9112-a967590bb9ec tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:55:40:39,bridge_name='br-int',has_traffic_filtering=True,id=9258b3ad-d3d7-45b9-afb9-bf39b5b8be55,network=Network(ba0174bd-6a67-444e-8a34-ecd99afafac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9258b3ad-d3') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:12:39 user nova-compute[73391]: DEBUG os_vif [None req-4df1532c-ba9b-42f1-9112-a967590bb9ec tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:40:39,bridge_name='br-int',has_traffic_filtering=True,id=9258b3ad-d3d7-45b9-afb9-bf39b5b8be55,network=Network(ba0174bd-6a67-444e-8a34-ecd99afafac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9258b3ad-d3') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 06:12:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:12:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9258b3ad-d3, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:12:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:12:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:12:39 user nova-compute[73391]: INFO os_vif [None req-4df1532c-ba9b-42f1-9112-a967590bb9ec tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:55:40:39,bridge_name='br-int',has_traffic_filtering=True,id=9258b3ad-d3d7-45b9-afb9-bf39b5b8be55,network=Network(ba0174bd-6a67-444e-8a34-ecd99afafac0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9258b3ad-d3')
Aug 15 06:12:39 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-4df1532c-ba9b-42f1-9112-a967590bb9ec tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Deleting instance files /opt/stack/data/nova/instances/7971bc72-40ad-4a65-ae04-de74afde6046_del
Aug 15 06:12:39 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-4df1532c-ba9b-42f1-9112-a967590bb9ec tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Deletion of /opt/stack/data/nova/instances/7971bc72-40ad-4a65-ae04-de74afde6046_del complete
Aug 15 06:12:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:12:39 user nova-compute[73391]: INFO nova.compute.manager [None req-4df1532c-ba9b-42f1-9112-a967590bb9ec tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Took 0.85 seconds to destroy the instance on the hypervisor.
Aug 15 06:12:39 user nova-compute[73391]: DEBUG oslo.service.loopingcall [None req-4df1532c-ba9b-42f1-9112-a967590bb9ec tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 06:12:39 user nova-compute[73391]: DEBUG nova.compute.manager [-] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Deallocating network for instance {{(pid=73391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 06:12:39 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] deallocate_for_instance() {{(pid=73391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 06:12:40 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:12:40 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Took 0.87 seconds to deallocate network for instance.
Aug 15 06:12:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-4df1532c-ba9b-42f1-9112-a967590bb9ec tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:12:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-4df1532c-ba9b-42f1-9112-a967590bb9ec tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:12:40 user nova-compute[73391]: DEBUG nova.compute.manager [req-661e75ac-4f58-4523-be71-768dd498c829 req-0f9b778d-6c24-4c8c-9662-8d4040a08e71 service nova] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Received event network-vif-deleted-9258b3ad-d3d7-45b9-afb9-bf39b5b8be55 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:12:40 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-4df1532c-ba9b-42f1-9112-a967590bb9ec tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:12:40 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-4df1532c-ba9b-42f1-9112-a967590bb9ec tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:12:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-4df1532c-ba9b-42f1-9112-a967590bb9ec tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.129s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:12:40 user nova-compute[73391]: INFO nova.scheduler.client.report [None req-4df1532c-ba9b-42f1-9112-a967590bb9ec tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Deleted allocations for instance 7971bc72-40ad-4a65-ae04-de74afde6046
Aug 15 06:12:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-4df1532c-ba9b-42f1-9112-a967590bb9ec tempest-TestServerVolumeAttachScenarioOldVersion-1303747324 tempest-TestServerVolumeAttachScenarioOldVersion-1303747324-project-member] Lock "7971bc72-40ad-4a65-ae04-de74afde6046" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.039s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:12:41 user nova-compute[73391]: DEBUG nova.compute.manager [req-9794df64-6471-4774-a1b3-31156550ab35 req-6971a32b-9a93-40ee-b70c-30fe9055b06a service nova] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Received event network-vif-plugged-9258b3ad-d3d7-45b9-afb9-bf39b5b8be55 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:12:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-9794df64-6471-4774-a1b3-31156550ab35 req-6971a32b-9a93-40ee-b70c-30fe9055b06a service nova] Acquiring lock "7971bc72-40ad-4a65-ae04-de74afde6046-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:12:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-9794df64-6471-4774-a1b3-31156550ab35 req-6971a32b-9a93-40ee-b70c-30fe9055b06a service nova] Lock "7971bc72-40ad-4a65-ae04-de74afde6046-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:12:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-9794df64-6471-4774-a1b3-31156550ab35 req-6971a32b-9a93-40ee-b70c-30fe9055b06a service nova] Lock "7971bc72-40ad-4a65-ae04-de74afde6046-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:12:41 user nova-compute[73391]: DEBUG nova.compute.manager [req-9794df64-6471-4774-a1b3-31156550ab35 req-6971a32b-9a93-40ee-b70c-30fe9055b06a service nova] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] No waiting events found dispatching network-vif-plugged-9258b3ad-d3d7-45b9-afb9-bf39b5b8be55 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:12:41 user nova-compute[73391]: WARNING nova.compute.manager [req-9794df64-6471-4774-a1b3-31156550ab35 req-6971a32b-9a93-40ee-b70c-30fe9055b06a service nova] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Received unexpected event network-vif-plugged-9258b3ad-d3d7-45b9-afb9-bf39b5b8be55 for instance with vm_state deleted and task_state None.
Aug 15 06:12:44 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:12:48 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:12:48 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:12:49 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:12:49 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:12:49 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:12:50 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:12:50 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Starting heal instance info cache {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 06:12:50 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Rebuilding the list of instances to heal {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 06:12:50 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Didn't find any instances for network info cache update. {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 06:12:54 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692079959.522318, 7971bc72-40ad-4a65-ae04-de74afde6046 => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:12:54 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] VM Stopped (Lifecycle Event)
Aug 15 06:12:54 user nova-compute[73391]: DEBUG nova.compute.manager [None req-6da14d8b-96f7-4134-8b26-78e6886e53f0 None None] [instance: 7971bc72-40ad-4a65-ae04-de74afde6046] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:12:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:12:55 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:12:55 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 06:12:57 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:12:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:13:02 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:13:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:13:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:13:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:13:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:13:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:13:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:13:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:13:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:13:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:13:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:13:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:13:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:13:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:13:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:13:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:13:29 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:13:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:13:32 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:13:34 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:13:36 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:13:36 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:13:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:13:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:13:36 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:13:36 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Auditing locally available compute resources for user (node: user) {{(pid=73391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 06:13:37 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:13:37 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:13:37 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Hypervisor/Node resource view: name=user free_ram=8954MB free_disk=25.100357055664062GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 06:13:37 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:13:37 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:13:37 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 06:13:37 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 06:13:37 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:13:37 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:13:37 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Compute_service record updated for user:user {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 06:13:37 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.311s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:13:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:13:44 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:13:49 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:13:49 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:13:49 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:13:50 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:13:51 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:13:52 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:13:52 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Starting heal instance info cache {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 06:13:52 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Rebuilding the list of instances to heal {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 06:13:52 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Didn't find any instances for network info cache update. {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 06:13:54 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:13:55 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:13:55 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 06:13:57 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:13:59 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:14:02 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:14:04 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:14:04 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:14:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:14:06 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:14:09 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:14:10 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:14:11 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:14:13 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:14:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:14:14 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:14:15 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:14:17 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:14:19 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:14:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:14:22 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Acquiring lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:14:22 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:14:22 user nova-compute[73391]: DEBUG nova.compute.manager [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Starting instance... {{(pid=73391) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Aug 15 06:14:22 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:14:22 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:14:22 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=73391) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Aug 15 06:14:22 user nova-compute[73391]: INFO nova.compute.claims [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Claim successful on node user
Aug 15 06:14:23 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:14:23 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:14:23 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.246s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:14:23 user nova-compute[73391]: DEBUG nova.compute.manager [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Start building networks asynchronously for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Aug 15 06:14:23 user nova-compute[73391]: DEBUG nova.compute.manager [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Allocating IP information in the background. {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Aug 15 06:14:23 user nova-compute[73391]: DEBUG nova.network.neutron [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] allocate_for_instance() {{(pid=73391) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Aug 15 06:14:23 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Aug 15 06:14:23 user nova-compute[73391]: DEBUG nova.compute.manager [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Start building block device mappings for instance. {{(pid=73391) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Aug 15 06:14:23 user nova-compute[73391]: DEBUG nova.policy [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0f8347c6b54f41b8b6c5e652c95d1453', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9ef81b0efb24993b595a2f6d18268fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=73391) authorize /opt/stack/nova/nova/policy.py:203}}
Aug 15 06:14:23 user nova-compute[73391]: DEBUG nova.compute.manager [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Start spawning the instance on the hypervisor. {{(pid=73391) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Aug 15 06:14:23 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Creating instance directory {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Aug 15 06:14:23 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Creating image(s)
Aug 15 06:14:23 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Acquiring lock "/opt/stack/data/nova/instances/aa9d5fa1-a9eb-4330-9ce7-3189fa949726/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:14:23 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "/opt/stack/data/nova/instances/aa9d5fa1-a9eb-4330-9ce7-3189fa949726/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:14:23 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "/opt/stack/data/nova/instances/aa9d5fa1-a9eb-4330-9ce7-3189fa949726/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:14:23 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:14:23 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.184s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:14:23 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Acquiring lock "999b315ba87151d8252d543312ae7790e7e1583b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:14:23 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:14:23 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:14:23 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.191s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:14:23 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/aa9d5fa1-a9eb-4330-9ce7-3189fa949726/disk 1073741824 {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:14:23 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b,backing_fmt=raw /opt/stack/data/nova/instances/aa9d5fa1-a9eb-4330-9ce7-3189fa949726/disk 1073741824" returned: 0 in 0.057s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:14:23 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "999b315ba87151d8252d543312ae7790e7e1583b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:14:23 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:14:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/999b315ba87151d8252d543312ae7790e7e1583b --force-share --output=json" returned: 0 in 0.209s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:14:24 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aa9d5fa1-a9eb-4330-9ce7-3189fa949726/disk. size=1073741824 {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Aug 15 06:14:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9d5fa1-a9eb-4330-9ce7-3189fa949726/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:14:24 user nova-compute[73391]: DEBUG nova.network.neutron [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Successfully created port: 82232ed8-43f1-4c36-9429-f8bb8d7755f0 {{(pid=73391) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Aug 15 06:14:24 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9d5fa1-a9eb-4330-9ce7-3189fa949726/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:14:24 user nova-compute[73391]: DEBUG nova.virt.disk.api [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Cannot resize image /opt/stack/data/nova/instances/aa9d5fa1-a9eb-4330-9ce7-3189fa949726/disk to a smaller size. {{(pid=73391) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Aug 15 06:14:24 user nova-compute[73391]: DEBUG nova.objects.instance [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lazy-loading 'migration_context' on Instance uuid aa9d5fa1-a9eb-4330-9ce7-3189fa949726 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:14:24 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Created local disks {{(pid=73391) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Aug 15 06:14:24 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Ensure instance console log exists: /opt/stack/data/nova/instances/aa9d5fa1-a9eb-4330-9ce7-3189fa949726/console.log {{(pid=73391) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Aug 15 06:14:24 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:14:24 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:14:24 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:14:24 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:14:24 user nova-compute[73391]: DEBUG nova.network.neutron [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Successfully updated port: 82232ed8-43f1-4c36-9429-f8bb8d7755f0 {{(pid=73391) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Aug 15 06:14:24 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Acquiring lock "refresh_cache-aa9d5fa1-a9eb-4330-9ce7-3189fa949726" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:14:24 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Acquired lock "refresh_cache-aa9d5fa1-a9eb-4330-9ce7-3189fa949726" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:14:24 user nova-compute[73391]: DEBUG nova.network.neutron [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Building network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Aug 15 06:14:25 user nova-compute[73391]: DEBUG nova.compute.manager [req-1a775818-a387-4f3d-84a7-0a8d72a5c0e4 req-1f4602b8-74a8-4803-af90-90c34ddd8488 service nova] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Received event network-changed-82232ed8-43f1-4c36-9429-f8bb8d7755f0 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:14:25 user nova-compute[73391]: DEBUG nova.compute.manager [req-1a775818-a387-4f3d-84a7-0a8d72a5c0e4 req-1f4602b8-74a8-4803-af90-90c34ddd8488 service nova] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Refreshing instance network info cache due to event network-changed-82232ed8-43f1-4c36-9429-f8bb8d7755f0. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 06:14:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-1a775818-a387-4f3d-84a7-0a8d72a5c0e4 req-1f4602b8-74a8-4803-af90-90c34ddd8488 service nova] Acquiring lock "refresh_cache-aa9d5fa1-a9eb-4330-9ce7-3189fa949726" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:14:25 user nova-compute[73391]: DEBUG nova.network.neutron [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Instance cache missing network info. {{(pid=73391) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Aug 15 06:14:25 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:14:25 user nova-compute[73391]: DEBUG nova.network.neutron [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Updating instance_info_cache with network_info: [{"id": "82232ed8-43f1-4c36-9429-f8bb8d7755f0", "address": "fa:16:3e:6b:8d:30", "network": {"id": "6a50e346-0341-4f50-a2fa-f5fe5f8ad867", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-542549440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ef81b0efb24993b595a2f6d18268fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82232ed8-43", "ovs_interfaceid": "82232ed8-43f1-4c36-9429-f8bb8d7755f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:14:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Releasing lock "refresh_cache-aa9d5fa1-a9eb-4330-9ce7-3189fa949726" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:14:25 user nova-compute[73391]: DEBUG nova.compute.manager [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Instance network_info: |[{"id": "82232ed8-43f1-4c36-9429-f8bb8d7755f0", "address": "fa:16:3e:6b:8d:30", "network": {"id": "6a50e346-0341-4f50-a2fa-f5fe5f8ad867", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-542549440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ef81b0efb24993b595a2f6d18268fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82232ed8-43", "ovs_interfaceid": "82232ed8-43f1-4c36-9429-f8bb8d7755f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=73391) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Aug 15 06:14:25 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-1a775818-a387-4f3d-84a7-0a8d72a5c0e4 req-1f4602b8-74a8-4803-af90-90c34ddd8488 service nova] Acquired lock "refresh_cache-aa9d5fa1-a9eb-4330-9ce7-3189fa949726" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:14:25 user nova-compute[73391]: DEBUG nova.network.neutron [req-1a775818-a387-4f3d-84a7-0a8d72a5c0e4 req-1f4602b8-74a8-4803-af90-90c34ddd8488 service nova] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Refreshing network info cache for port 82232ed8-43f1-4c36-9429-f8bb8d7755f0 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 06:14:25 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Start _get_guest_xml network_info=[{"id": "82232ed8-43f1-4c36-9429-f8bb8d7755f0", "address": "fa:16:3e:6b:8d:30", "network": {"id": "6a50e346-0341-4f50-a2fa-f5fe5f8ad867", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-542549440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ef81b0efb24993b595a2f6d18268fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82232ed8-43", "ovs_interfaceid": "82232ed8-43f1-4c36-9429-f8bb8d7755f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'size': 0, 'device_name': '/dev/vda', 'boot_index': 0, 'encryption_options': None, 'guest_format': None, 'encryption_secret_uuid': None, 'image_id': '191b1dad-305e-4d1c-9b15-515ec59a3278'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Aug 15 06:14:25 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:14:25 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:14:25 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Aug 15 06:14:25 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] CPU controller missing on host. {{(pid=73391) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Aug 15 06:14:25 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Aug 15 06:14:25 user nova-compute[73391]: DEBUG nova.virt.libvirt.host [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] CPU controller found on host. {{(pid=73391) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Aug 15 06:14:25 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=73391) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Aug 15 06:14:25 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-08-15T05:25:23Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-08-15T05:25:34Z,direct_url=<?>,disk_format='qcow2',id=191b1dad-305e-4d1c-9b15-515ec59a3278,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='b6806eca80d44b87b1a19efa0667e7fc',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-08-15T05:25:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Aug 15 06:14:25 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Flavor limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Aug 15 06:14:25 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Image limits 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Aug 15 06:14:25 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Flavor pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Aug 15 06:14:25 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Image pref 0:0:0 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Aug 15 06:14:25 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=73391) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Aug 15 06:14:25 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Aug 15 06:14:25 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Aug 15 06:14:25 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Got 1 possible topologies {{(pid=73391) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Aug 15 06:14:25 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Aug 15 06:14:25 user nova-compute[73391]: DEBUG nova.virt.hardware [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=73391) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Aug 15 06:14:25 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T06:14:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-530291356',display_name='tempest-SnapshotDataIntegrityTests-server-530291356',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-530291356',id=53,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNHBuKzumIfTQPiAItoUgQm0kGRANtXlwB9lbGSrROXJylPeQ4ovPyDdBV73K35WWzHK2FtNG+kJzeNo7Q5chLP05/MAjtICfHkDBccTJPq95uPI4ydyTO7IklzLCi+7fA==',key_name='tempest-keypair-1162096281',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9ef81b0efb24993b595a2f6d18268fd',ramdisk_id='',reservation_id='r-auxj6yqk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1860568846',owner_user_name='tempest-SnapshotDataIntegrityTests-1860568846-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:14:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f8347c6b54f41b8b6c5e652c95d1453',uuid=aa9d5fa1-a9eb-4330-9ce7-3189fa949726,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82232ed8-43f1-4c36-9429-f8bb8d7755f0", "address": "fa:16:3e:6b:8d:30", "network": {"id": "6a50e346-0341-4f50-a2fa-f5fe5f8ad867", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-542549440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ef81b0efb24993b595a2f6d18268fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82232ed8-43", "ovs_interfaceid": "82232ed8-43f1-4c36-9429-f8bb8d7755f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=73391) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Aug 15 06:14:25 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Converting VIF {"id": "82232ed8-43f1-4c36-9429-f8bb8d7755f0", "address": "fa:16:3e:6b:8d:30", "network": {"id": "6a50e346-0341-4f50-a2fa-f5fe5f8ad867", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-542549440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ef81b0efb24993b595a2f6d18268fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82232ed8-43", "ovs_interfaceid": "82232ed8-43f1-4c36-9429-f8bb8d7755f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:14:25 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:8d:30,bridge_name='br-int',has_traffic_filtering=True,id=82232ed8-43f1-4c36-9429-f8bb8d7755f0,network=Network(6a50e346-0341-4f50-a2fa-f5fe5f8ad867),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82232ed8-43') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:14:25 user nova-compute[73391]: DEBUG nova.objects.instance [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lazy-loading 'pci_devices' on Instance uuid aa9d5fa1-a9eb-4330-9ce7-3189fa949726 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:14:25 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] End _get_guest_xml xml=<domain type="kvm">
Aug 15 06:14:25 user nova-compute[73391]:   <uuid>aa9d5fa1-a9eb-4330-9ce7-3189fa949726</uuid>
Aug 15 06:14:25 user nova-compute[73391]:   <name>instance-00000035</name>
Aug 15 06:14:25 user nova-compute[73391]:   <memory>524288</memory>
Aug 15 06:14:25 user nova-compute[73391]:   <vcpu>1</vcpu>
Aug 15 06:14:25 user nova-compute[73391]:   <metadata>
Aug 15 06:14:25 user nova-compute[73391]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Aug 15 06:14:25 user nova-compute[73391]:       <nova:package version="0.0.0"/>
Aug 15 06:14:25 user nova-compute[73391]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-530291356</nova:name>
Aug 15 06:14:25 user nova-compute[73391]:       <nova:creationTime>2023-08-15 06:14:25</nova:creationTime>
Aug 15 06:14:25 user nova-compute[73391]:       <nova:flavor name="m1.tiny">
Aug 15 06:14:25 user nova-compute[73391]:         <nova:memory>512</nova:memory>
Aug 15 06:14:25 user nova-compute[73391]:         <nova:disk>1</nova:disk>
Aug 15 06:14:25 user nova-compute[73391]:         <nova:swap>0</nova:swap>
Aug 15 06:14:25 user nova-compute[73391]:         <nova:ephemeral>0</nova:ephemeral>
Aug 15 06:14:25 user nova-compute[73391]:         <nova:vcpus>1</nova:vcpus>
Aug 15 06:14:25 user nova-compute[73391]:       </nova:flavor>
Aug 15 06:14:25 user nova-compute[73391]:       <nova:owner>
Aug 15 06:14:25 user nova-compute[73391]:         <nova:user uuid="0f8347c6b54f41b8b6c5e652c95d1453">tempest-SnapshotDataIntegrityTests-1860568846-project-member</nova:user>
Aug 15 06:14:25 user nova-compute[73391]:         <nova:project uuid="b9ef81b0efb24993b595a2f6d18268fd">tempest-SnapshotDataIntegrityTests-1860568846</nova:project>
Aug 15 06:14:25 user nova-compute[73391]:       </nova:owner>
Aug 15 06:14:25 user nova-compute[73391]:       <nova:root type="image" uuid="191b1dad-305e-4d1c-9b15-515ec59a3278"/>
Aug 15 06:14:25 user nova-compute[73391]:       <nova:ports>
Aug 15 06:14:25 user nova-compute[73391]:         <nova:port uuid="82232ed8-43f1-4c36-9429-f8bb8d7755f0">
Aug 15 06:14:25 user nova-compute[73391]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Aug 15 06:14:25 user nova-compute[73391]:         </nova:port>
Aug 15 06:14:25 user nova-compute[73391]:       </nova:ports>
Aug 15 06:14:25 user nova-compute[73391]:     </nova:instance>
Aug 15 06:14:25 user nova-compute[73391]:   </metadata>
Aug 15 06:14:25 user nova-compute[73391]:   <sysinfo type="smbios">
Aug 15 06:14:25 user nova-compute[73391]:     <system>
Aug 15 06:14:25 user nova-compute[73391]:       <entry name="manufacturer">OpenStack Foundation</entry>
Aug 15 06:14:25 user nova-compute[73391]:       <entry name="product">OpenStack Nova</entry>
Aug 15 06:14:25 user nova-compute[73391]:       <entry name="version">0.0.0</entry>
Aug 15 06:14:25 user nova-compute[73391]:       <entry name="serial">aa9d5fa1-a9eb-4330-9ce7-3189fa949726</entry>
Aug 15 06:14:25 user nova-compute[73391]:       <entry name="uuid">aa9d5fa1-a9eb-4330-9ce7-3189fa949726</entry>
Aug 15 06:14:25 user nova-compute[73391]:       <entry name="family">Virtual Machine</entry>
Aug 15 06:14:25 user nova-compute[73391]:     </system>
Aug 15 06:14:25 user nova-compute[73391]:   </sysinfo>
Aug 15 06:14:25 user nova-compute[73391]:   <os>
Aug 15 06:14:25 user nova-compute[73391]:     <type arch="x86_64" machine="pc">hvm</type>
Aug 15 06:14:25 user nova-compute[73391]:     <boot dev="hd"/>
Aug 15 06:14:25 user nova-compute[73391]:     <smbios mode="sysinfo"/>
Aug 15 06:14:25 user nova-compute[73391]:   </os>
Aug 15 06:14:25 user nova-compute[73391]:   <features>
Aug 15 06:14:25 user nova-compute[73391]:     <acpi/>
Aug 15 06:14:25 user nova-compute[73391]:     <apic/>
Aug 15 06:14:25 user nova-compute[73391]:     <vmcoreinfo/>
Aug 15 06:14:25 user nova-compute[73391]:   </features>
Aug 15 06:14:25 user nova-compute[73391]:   <clock offset="utc">
Aug 15 06:14:25 user nova-compute[73391]:     <timer name="pit" tickpolicy="delay"/>
Aug 15 06:14:25 user nova-compute[73391]:     <timer name="rtc" tickpolicy="catchup"/>
Aug 15 06:14:25 user nova-compute[73391]:     <timer name="hpet" present="no"/>
Aug 15 06:14:25 user nova-compute[73391]:   </clock>
Aug 15 06:14:25 user nova-compute[73391]:   <cpu mode="custom" match="exact">
Aug 15 06:14:25 user nova-compute[73391]:     <model>Nehalem</model>
Aug 15 06:14:25 user nova-compute[73391]:     <topology sockets="1" cores="1" threads="1"/>
Aug 15 06:14:25 user nova-compute[73391]:   </cpu>
Aug 15 06:14:25 user nova-compute[73391]:   <devices>
Aug 15 06:14:25 user nova-compute[73391]:     <disk type="file" device="disk">
Aug 15 06:14:25 user nova-compute[73391]:       <driver name="qemu" type="qcow2" cache="none"/>
Aug 15 06:14:25 user nova-compute[73391]:       <source file="/opt/stack/data/nova/instances/aa9d5fa1-a9eb-4330-9ce7-3189fa949726/disk"/>
Aug 15 06:14:25 user nova-compute[73391]:       <target dev="vda" bus="virtio"/>
Aug 15 06:14:25 user nova-compute[73391]:     </disk>
Aug 15 06:14:25 user nova-compute[73391]:     <interface type="ethernet">
Aug 15 06:14:25 user nova-compute[73391]:       <mac address="fa:16:3e:6b:8d:30"/>
Aug 15 06:14:25 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 06:14:25 user nova-compute[73391]:       <mtu size="1442"/>
Aug 15 06:14:25 user nova-compute[73391]:       <target dev="tap82232ed8-43"/>
Aug 15 06:14:25 user nova-compute[73391]:     </interface>
Aug 15 06:14:25 user nova-compute[73391]:     <serial type="pty">
Aug 15 06:14:25 user nova-compute[73391]:       <log file="/opt/stack/data/nova/instances/aa9d5fa1-a9eb-4330-9ce7-3189fa949726/console.log" append="off"/>
Aug 15 06:14:25 user nova-compute[73391]:     </serial>
Aug 15 06:14:25 user nova-compute[73391]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Aug 15 06:14:25 user nova-compute[73391]:     <video>
Aug 15 06:14:25 user nova-compute[73391]:       <model type="virtio"/>
Aug 15 06:14:25 user nova-compute[73391]:     </video>
Aug 15 06:14:25 user nova-compute[73391]:     <rng model="virtio">
Aug 15 06:14:25 user nova-compute[73391]:       <backend model="random">/dev/urandom</backend>
Aug 15 06:14:25 user nova-compute[73391]:     </rng>
Aug 15 06:14:25 user nova-compute[73391]:     <controller type="usb" index="0" model="none"/>
Aug 15 06:14:25 user nova-compute[73391]:     <memballoon model="virtio">
Aug 15 06:14:25 user nova-compute[73391]:       <stats period="10"/>
Aug 15 06:14:25 user nova-compute[73391]:     </memballoon>
Aug 15 06:14:25 user nova-compute[73391]:   </devices>
Aug 15 06:14:25 user nova-compute[73391]: </domain>
Aug 15 06:14:25 user nova-compute[73391]:  {{(pid=73391) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Aug 15 06:14:25 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T06:14:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-530291356',display_name='tempest-SnapshotDataIntegrityTests-server-530291356',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-530291356',id=53,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNHBuKzumIfTQPiAItoUgQm0kGRANtXlwB9lbGSrROXJylPeQ4ovPyDdBV73K35WWzHK2FtNG+kJzeNo7Q5chLP05/MAjtICfHkDBccTJPq95uPI4ydyTO7IklzLCi+7fA==',key_name='tempest-keypair-1162096281',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b9ef81b0efb24993b595a2f6d18268fd',ramdisk_id='',reservation_id='r-auxj6yqk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1860568846',owner_user_name='tempest-SnapshotDataIntegrityTests-1860568846-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-08-15T06:14:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f8347c6b54f41b8b6c5e652c95d1453',uuid=aa9d5fa1-a9eb-4330-9ce7-3189fa949726,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "82232ed8-43f1-4c36-9429-f8bb8d7755f0", "address": "fa:16:3e:6b:8d:30", "network": {"id": "6a50e346-0341-4f50-a2fa-f5fe5f8ad867", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-542549440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ef81b0efb24993b595a2f6d18268fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82232ed8-43", "ovs_interfaceid": "82232ed8-43f1-4c36-9429-f8bb8d7755f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Aug 15 06:14:25 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Converting VIF {"id": "82232ed8-43f1-4c36-9429-f8bb8d7755f0", "address": "fa:16:3e:6b:8d:30", "network": {"id": "6a50e346-0341-4f50-a2fa-f5fe5f8ad867", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-542549440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ef81b0efb24993b595a2f6d18268fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82232ed8-43", "ovs_interfaceid": "82232ed8-43f1-4c36-9429-f8bb8d7755f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:14:25 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:8d:30,bridge_name='br-int',has_traffic_filtering=True,id=82232ed8-43f1-4c36-9429-f8bb8d7755f0,network=Network(6a50e346-0341-4f50-a2fa-f5fe5f8ad867),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82232ed8-43') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:14:25 user nova-compute[73391]: DEBUG os_vif [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:8d:30,bridge_name='br-int',has_traffic_filtering=True,id=82232ed8-43f1-4c36-9429-f8bb8d7755f0,network=Network(6a50e346-0341-4f50-a2fa-f5fe5f8ad867),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82232ed8-43') {{(pid=73391) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Aug 15 06:14:25 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:14:25 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:14:25 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Aug 15 06:14:25 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:14:25 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap82232ed8-43, may_exist=True, interface_attrs={}) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:14:25 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap82232ed8-43, col_values=(('external_ids', {'iface-id': '82232ed8-43f1-4c36-9429-f8bb8d7755f0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:8d:30', 'vm-uuid': 'aa9d5fa1-a9eb-4330-9ce7-3189fa949726'}),), if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:14:25 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:14:25 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:14:25 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:14:25 user nova-compute[73391]: INFO os_vif [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:8d:30,bridge_name='br-int',has_traffic_filtering=True,id=82232ed8-43f1-4c36-9429-f8bb8d7755f0,network=Network(6a50e346-0341-4f50-a2fa-f5fe5f8ad867),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82232ed8-43')
Aug 15 06:14:25 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 06:14:25 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] No VIF found with MAC fa:16:3e:6b:8d:30, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 06:14:26 user nova-compute[73391]: DEBUG nova.network.neutron [req-1a775818-a387-4f3d-84a7-0a8d72a5c0e4 req-1f4602b8-74a8-4803-af90-90c34ddd8488 service nova] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Updated VIF entry in instance network info cache for port 82232ed8-43f1-4c36-9429-f8bb8d7755f0. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 06:14:26 user nova-compute[73391]: DEBUG nova.network.neutron [req-1a775818-a387-4f3d-84a7-0a8d72a5c0e4 req-1f4602b8-74a8-4803-af90-90c34ddd8488 service nova] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Updating instance_info_cache with network_info: [{"id": "82232ed8-43f1-4c36-9429-f8bb8d7755f0", "address": "fa:16:3e:6b:8d:30", "network": {"id": "6a50e346-0341-4f50-a2fa-f5fe5f8ad867", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-542549440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ef81b0efb24993b595a2f6d18268fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82232ed8-43", "ovs_interfaceid": "82232ed8-43f1-4c36-9429-f8bb8d7755f0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:14:26 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-1a775818-a387-4f3d-84a7-0a8d72a5c0e4 req-1f4602b8-74a8-4803-af90-90c34ddd8488 service nova] Releasing lock "refresh_cache-aa9d5fa1-a9eb-4330-9ce7-3189fa949726" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:14:27 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:14:27 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:14:27 user nova-compute[73391]: DEBUG nova.compute.manager [req-7e4d5745-3fdd-4fdf-8842-ea1d8d669c5c req-4bfabcf1-6f4d-4fac-8605-73748b8d71b3 service nova] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Received event network-vif-plugged-82232ed8-43f1-4c36-9429-f8bb8d7755f0 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:14:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-7e4d5745-3fdd-4fdf-8842-ea1d8d669c5c req-4bfabcf1-6f4d-4fac-8605-73748b8d71b3 service nova] Acquiring lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:14:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-7e4d5745-3fdd-4fdf-8842-ea1d8d669c5c req-4bfabcf1-6f4d-4fac-8605-73748b8d71b3 service nova] Lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:14:27 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-7e4d5745-3fdd-4fdf-8842-ea1d8d669c5c req-4bfabcf1-6f4d-4fac-8605-73748b8d71b3 service nova] Lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:14:27 user nova-compute[73391]: DEBUG nova.compute.manager [req-7e4d5745-3fdd-4fdf-8842-ea1d8d669c5c req-4bfabcf1-6f4d-4fac-8605-73748b8d71b3 service nova] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] No waiting events found dispatching network-vif-plugged-82232ed8-43f1-4c36-9429-f8bb8d7755f0 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:14:27 user nova-compute[73391]: WARNING nova.compute.manager [req-7e4d5745-3fdd-4fdf-8842-ea1d8d669c5c req-4bfabcf1-6f4d-4fac-8605-73748b8d71b3 service nova] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Received unexpected event network-vif-plugged-82232ed8-43f1-4c36-9429-f8bb8d7755f0 for instance with vm_state building and task_state spawning.
Aug 15 06:14:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:14:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:14:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:14:28 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:14:29 user nova-compute[73391]: DEBUG nova.compute.manager [req-2aa0fdda-a995-4167-a7b2-663ea2b98e3f req-21e1d4a9-95e8-4d57-a0e3-14392074f928 service nova] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Received event network-vif-plugged-82232ed8-43f1-4c36-9429-f8bb8d7755f0 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:14:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2aa0fdda-a995-4167-a7b2-663ea2b98e3f req-21e1d4a9-95e8-4d57-a0e3-14392074f928 service nova] Acquiring lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:14:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2aa0fdda-a995-4167-a7b2-663ea2b98e3f req-21e1d4a9-95e8-4d57-a0e3-14392074f928 service nova] Lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:14:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-2aa0fdda-a995-4167-a7b2-663ea2b98e3f req-21e1d4a9-95e8-4d57-a0e3-14392074f928 service nova] Lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:14:29 user nova-compute[73391]: DEBUG nova.compute.manager [req-2aa0fdda-a995-4167-a7b2-663ea2b98e3f req-21e1d4a9-95e8-4d57-a0e3-14392074f928 service nova] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] No waiting events found dispatching network-vif-plugged-82232ed8-43f1-4c36-9429-f8bb8d7755f0 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:14:29 user nova-compute[73391]: WARNING nova.compute.manager [req-2aa0fdda-a995-4167-a7b2-663ea2b98e3f req-21e1d4a9-95e8-4d57-a0e3-14392074f928 service nova] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Received unexpected event network-vif-plugged-82232ed8-43f1-4c36-9429-f8bb8d7755f0 for instance with vm_state building and task_state spawning.
Aug 15 06:14:30 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692080070.0261168, aa9d5fa1-a9eb-4330-9ce7-3189fa949726 => Resumed> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:14:30 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] VM Resumed (Lifecycle Event)
Aug 15 06:14:30 user nova-compute[73391]: DEBUG nova.compute.manager [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Instance event wait completed in 0 seconds for  {{(pid=73391) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Aug 15 06:14:30 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Guest created on hypervisor {{(pid=73391) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Aug 15 06:14:30 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Instance spawned successfully.
Aug 15 06:14:30 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Aug 15 06:14:30 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:14:30 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 06:14:30 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Found default for hw_cdrom_bus of ide {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:14:30 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Found default for hw_disk_bus of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:14:30 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Found default for hw_input_bus of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:14:30 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Found default for hw_pointer_model of None {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:14:30 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Found default for hw_video_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:14:30 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Found default for hw_vif_model of virtio {{(pid=73391) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Aug 15 06:14:30 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 06:14:30 user nova-compute[73391]: DEBUG nova.virt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Emitting event <LifecycleEvent: 1692080070.027818, aa9d5fa1-a9eb-4330-9ce7-3189fa949726 => Started> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:14:30 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] VM Started (Lifecycle Event)
Aug 15 06:14:30 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:14:30 user nova-compute[73391]: DEBUG nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=73391) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Aug 15 06:14:30 user nova-compute[73391]: INFO nova.compute.manager [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] During sync_power_state the instance has a pending task (spawning). Skip.
Aug 15 06:14:30 user nova-compute[73391]: INFO nova.compute.manager [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Took 6.79 seconds to spawn the instance on the hypervisor.
Aug 15 06:14:30 user nova-compute[73391]: DEBUG nova.compute.manager [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:14:30 user nova-compute[73391]: INFO nova.compute.manager [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Took 7.46 seconds to build instance.
Aug 15 06:14:30 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-2dad7a56-528d-440a-9195-1b9e3fb83902 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.560s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:14:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:14:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:14:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:14:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:14:37 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:14:37 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:14:37 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:14:37 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:14:37 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Auditing locally available compute resources for user (node: user) {{(pid=73391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 06:14:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9d5fa1-a9eb-4330-9ce7-3189fa949726/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:14:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9d5fa1-a9eb-4330-9ce7-3189fa949726/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:14:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9d5fa1-a9eb-4330-9ce7-3189fa949726/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:14:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9d5fa1-a9eb-4330-9ce7-3189fa949726/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:14:38 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:14:38 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:14:38 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Hypervisor/Node resource view: name=user free_ram=8485MB free_disk=25.08478546142578GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 06:14:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:14:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:14:38 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance aa9d5fa1-a9eb-4330-9ce7-3189fa949726 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:14:38 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 06:14:38 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 06:14:38 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:14:38 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:14:39 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Compute_service record updated for user:user {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 06:14:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.253s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:14:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:14:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:14:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:14:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:14:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:14:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:14:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:14:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:14:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:14:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:14:52 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:14:52 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:14:52 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:14:52 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:14:52 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Starting heal instance info cache {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 06:14:52 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Rebuilding the list of instances to heal {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 06:14:53 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "refresh_cache-aa9d5fa1-a9eb-4330-9ce7-3189fa949726" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:14:53 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquired lock "refresh_cache-aa9d5fa1-a9eb-4330-9ce7-3189fa949726" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:14:53 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Forcefully refreshing network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 06:14:53 user nova-compute[73391]: DEBUG nova.objects.instance [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lazy-loading 'info_cache' on Instance uuid aa9d5fa1-a9eb-4330-9ce7-3189fa949726 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:14:53 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Updating instance_info_cache with network_info: [{"id": "82232ed8-43f1-4c36-9429-f8bb8d7755f0", "address": "fa:16:3e:6b:8d:30", "network": {"id": "6a50e346-0341-4f50-a2fa-f5fe5f8ad867", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-542549440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ef81b0efb24993b595a2f6d18268fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82232ed8-43", "ovs_interfaceid": "82232ed8-43f1-4c36-9429-f8bb8d7755f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:14:53 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Releasing lock "refresh_cache-aa9d5fa1-a9eb-4330-9ce7-3189fa949726" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:14:53 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Updated the network info_cache for instance {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 06:14:53 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:14:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:14:55 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:14:55 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 06:14:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:14:59 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:15:00 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:15:00 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:15:03 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:15:05 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:15:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:15:10 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:15:15 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:15:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:15:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:15:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:15:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:15:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:15:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:15:25 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:15:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:15:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:15:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:15:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:15:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:15:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:15:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:15:37 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:15:37 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:15:37 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:15:37 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:15:37 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Auditing locally available compute resources for user (node: user) {{(pid=73391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 06:15:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9d5fa1-a9eb-4330-9ce7-3189fa949726/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:15:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9d5fa1-a9eb-4330-9ce7-3189fa949726/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:15:37 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9d5fa1-a9eb-4330-9ce7-3189fa949726/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:15:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9d5fa1-a9eb-4330-9ce7-3189fa949726/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:15:38 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:15:38 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:15:38 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Hypervisor/Node resource view: name=user free_ram=8753MB free_disk=25.046463012695312GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 06:15:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:15:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:15:38 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance aa9d5fa1-a9eb-4330-9ce7-3189fa949726 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:15:38 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 06:15:38 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 06:15:38 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:15:39 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:15:39 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Compute_service record updated for user:user {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 06:15:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.434s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:15:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:15:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:15:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:15:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:15:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:15:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:15:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:15:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:15:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:15:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:15:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:15:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:15:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:15:54 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:15:54 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:15:54 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Starting heal instance info cache {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 06:15:54 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Rebuilding the list of instances to heal {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 06:15:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "refresh_cache-aa9d5fa1-a9eb-4330-9ce7-3189fa949726" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:15:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquired lock "refresh_cache-aa9d5fa1-a9eb-4330-9ce7-3189fa949726" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:15:54 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Forcefully refreshing network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 06:15:54 user nova-compute[73391]: DEBUG nova.objects.instance [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lazy-loading 'info_cache' on Instance uuid aa9d5fa1-a9eb-4330-9ce7-3189fa949726 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:15:54 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Updating instance_info_cache with network_info: [{"id": "82232ed8-43f1-4c36-9429-f8bb8d7755f0", "address": "fa:16:3e:6b:8d:30", "network": {"id": "6a50e346-0341-4f50-a2fa-f5fe5f8ad867", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-542549440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ef81b0efb24993b595a2f6d18268fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82232ed8-43", "ovs_interfaceid": "82232ed8-43f1-4c36-9429-f8bb8d7755f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:15:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Releasing lock "refresh_cache-aa9d5fa1-a9eb-4330-9ce7-3189fa949726" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:15:54 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Updated the network info_cache for instance {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 06:15:54 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:15:54 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:15:54 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:15:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:15:56 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:15:56 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 06:15:57 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:15:57 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Cleaning up deleted instances {{(pid=73391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 06:15:57 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] There are 0 instances to clean {{(pid=73391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 06:15:58 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:16:00 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:16:00 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:16:00 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:16:00 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:16:00 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:16:00 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:16:00 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:16:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:16:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:16:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:16:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:16:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:16:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:16:07 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:16:07 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:16:07 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73391) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 06:16:10 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:16:12 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:16:12 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:16:14 user nova-compute[73391]: DEBUG nova.compute.manager [req-a538bcf0-d033-462e-9835-afb018ba2872 req-1844db05-d881-436b-8739-dcf12dfc46e3 service nova] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Received event network-changed-82232ed8-43f1-4c36-9429-f8bb8d7755f0 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:16:14 user nova-compute[73391]: DEBUG nova.compute.manager [req-a538bcf0-d033-462e-9835-afb018ba2872 req-1844db05-d881-436b-8739-dcf12dfc46e3 service nova] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Refreshing instance network info cache due to event network-changed-82232ed8-43f1-4c36-9429-f8bb8d7755f0. {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Aug 15 06:16:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-a538bcf0-d033-462e-9835-afb018ba2872 req-1844db05-d881-436b-8739-dcf12dfc46e3 service nova] Acquiring lock "refresh_cache-aa9d5fa1-a9eb-4330-9ce7-3189fa949726" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:16:14 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-a538bcf0-d033-462e-9835-afb018ba2872 req-1844db05-d881-436b-8739-dcf12dfc46e3 service nova] Acquired lock "refresh_cache-aa9d5fa1-a9eb-4330-9ce7-3189fa949726" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:16:14 user nova-compute[73391]: DEBUG nova.network.neutron [req-a538bcf0-d033-462e-9835-afb018ba2872 req-1844db05-d881-436b-8739-dcf12dfc46e3 service nova] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Refreshing network info cache for port 82232ed8-43f1-4c36-9429-f8bb8d7755f0 {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Aug 15 06:16:15 user nova-compute[73391]: DEBUG nova.network.neutron [req-a538bcf0-d033-462e-9835-afb018ba2872 req-1844db05-d881-436b-8739-dcf12dfc46e3 service nova] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Updated VIF entry in instance network info cache for port 82232ed8-43f1-4c36-9429-f8bb8d7755f0. {{(pid=73391) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Aug 15 06:16:15 user nova-compute[73391]: DEBUG nova.network.neutron [req-a538bcf0-d033-462e-9835-afb018ba2872 req-1844db05-d881-436b-8739-dcf12dfc46e3 service nova] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Updating instance_info_cache with network_info: [{"id": "82232ed8-43f1-4c36-9429-f8bb8d7755f0", "address": "fa:16:3e:6b:8d:30", "network": {"id": "6a50e346-0341-4f50-a2fa-f5fe5f8ad867", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-542549440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ef81b0efb24993b595a2f6d18268fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82232ed8-43", "ovs_interfaceid": "82232ed8-43f1-4c36-9429-f8bb8d7755f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:16:15 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-a538bcf0-d033-462e-9835-afb018ba2872 req-1844db05-d881-436b-8739-dcf12dfc46e3 service nova] Releasing lock "refresh_cache-aa9d5fa1-a9eb-4330-9ce7-3189fa949726" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:16:15 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:16:15 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:16:18 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0156e74e-8532-4329-af69-dcc57a7b9448 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Acquiring lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:16:18 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0156e74e-8532-4329-af69-dcc57a7b9448 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:16:18 user nova-compute[73391]: DEBUG nova.objects.instance [None req-0156e74e-8532-4329-af69-dcc57a7b9448 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lazy-loading 'flavor' on Instance uuid aa9d5fa1-a9eb-4330-9ce7-3189fa949726 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:16:18 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0156e74e-8532-4329-af69-dcc57a7b9448 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:16:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0156e74e-8532-4329-af69-dcc57a7b9448 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Acquiring lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:16:19 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0156e74e-8532-4329-af69-dcc57a7b9448 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:16:19 user nova-compute[73391]: INFO nova.compute.manager [None req-0156e74e-8532-4329-af69-dcc57a7b9448 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Attaching volume 083be69b-d637-44d8-a7a0-d8fb08d06154 to /dev/vdb
Aug 15 06:16:19 user nova-compute[73391]: DEBUG os_brick.utils [None req-0156e74e-8532-4329-af69-dcc57a7b9448 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:16:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:16:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:16:19 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1042fe-a54d-46ad-af39-70619d2c17d0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:16:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:16:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:16:19 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b529e4-4751-4043-b469-5939bc25e513]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:16:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:16:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:16:19 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[00090911-cc8f-43ad-a624-883ae32f9a61]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:16:19 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3bac823-7ddf-4570-a7fb-145e1aadb239]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:16:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-0156e74e-8532-4329-af69-dcc57a7b9448 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:16:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-0156e74e-8532-4329-af69-dcc57a7b9448 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 06:16:19 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0156e74e-8532-4329-af69-dcc57a7b9448 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 06:16:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:16:19 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 06:16:19 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 06:16:19 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[bddc0778-3d2e-4c6a-9203-3e5868c8c5e6]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:16:19 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-0156e74e-8532-4329-af69-dcc57a7b9448 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 06:16:19 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-0156e74e-8532-4329-af69-dcc57a7b9448 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 06:16:19 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-0156e74e-8532-4329-af69-dcc57a7b9448 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 06:16:19 user nova-compute[73391]: DEBUG os_brick.utils [None req-0156e74e-8532-4329-af69-dcc57a7b9448 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:16:19 user nova-compute[73391]: DEBUG nova.virt.block_device [None req-0156e74e-8532-4329-af69-dcc57a7b9448 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Updating existing volume attachment record: deab8b56-7c0f-485e-94da-54fae9a551b9 {{(pid=73391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 06:16:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:16:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:16:25 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:16:25 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:16:27 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0156e74e-8532-4329-af69-dcc57a7b9448 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 06:16:27 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0156e74e-8532-4329-af69-dcc57a7b9448 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:083be69b-d637-44d8-a7a0-d8fb08d06154'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GMvdiqRE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:16:27 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-0156e74e-8532-4329-af69-dcc57a7b9448 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:16:27 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-0156e74e-8532-4329-af69-dcc57a7b9448 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:16:27 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-0156e74e-8532-4329-af69-dcc57a7b9448 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:16:27 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-0156e74e-8532-4329-af69-dcc57a7b9448 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:16:27 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-0156e74e-8532-4329-af69-dcc57a7b9448 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:083be69b-d637-44d8-a7a0-d8fb08d06154" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:16:27 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-0156e74e-8532-4329-af69-dcc57a7b9448 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:083be69b-d637-44d8-a7a0-d8fb08d06154" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:16:27 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-0156e74e-8532-4329-af69-dcc57a7b9448 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 06:16:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:083be69b-d637-44d8-a7a0-d8fb08d06154 -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:16:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:083be69b-d637-44d8-a7a0-d8fb08d06154 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:16:27 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ef2b5a-bcdf-4f55-8c6f-3f1ca46b6574]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:16:27 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0156e74e-8532-4329-af69-dcc57a7b9448 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 06:16:27 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:16:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:083be69b-d637-44d8-a7a0-d8fb08d06154 -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:16:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:083be69b-d637-44d8-a7a0-d8fb08d06154 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:16:27 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[34aab310-b63b-48ba-a0c5-f9b891df8690]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:083be69b-d637-44d8-a7a0-d8fb08d06154] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:16:27 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0156e74e-8532-4329-af69-dcc57a7b9448 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:083be69b-d637-44d8-a7a0-d8fb08d06154] added
Aug 15 06:16:27 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:16:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:083be69b-d637-44d8-a7a0-d8fb08d06154 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:16:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:083be69b-d637-44d8-a7a0-d8fb08d06154 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:16:27 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1fe561-4cc9-4f8d-85aa-ac53d22182a7]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:16:27 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0156e74e-8532-4329-af69-dcc57a7b9448 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:16:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:083be69b-d637-44d8-a7a0-d8fb08d06154 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:16:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:083be69b-d637-44d8-a7a0-d8fb08d06154 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:16:27 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c93f37dc-8909-4f83-ad23-c6a0acb2c6be]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:16:27 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0156e74e-8532-4329-af69-dcc57a7b9448 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:16:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:083be69b-d637-44d8-a7a0-d8fb08d06154 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GMvdiqRE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:16:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:083be69b-d637-44d8-a7a0-d8fb08d06154 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GMvdiqRE" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:16:27 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f8a9156-c900-44d1-ac77-874e8ad7d34c]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:16:27 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0156e74e-8532-4329-af69-dcc57a7b9448 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GMvdiqRE'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:16:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:083be69b-d637-44d8-a7a0-d8fb08d06154 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:16:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:083be69b-d637-44d8-a7a0-d8fb08d06154 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:16:27 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7043d048-d507-44bf-aa25-c0f77936d02a]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:16:27 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0156e74e-8532-4329-af69-dcc57a7b9448 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:16:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:16:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:16:27 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3334b0cc-7dec-4022-9ab5-697dbbc032f0]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:16:27 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0156e74e-8532-4329-af69-dcc57a7b9448 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 06:16:27 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:16:27 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0156e74e-8532-4329-af69-dcc57a7b9448 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 06:16:27 user nova-compute[73391]:  {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:16:27 user nova-compute[73391]: WARNING os_brick.initiator.connectors.iscsi [None req-0156e74e-8532-4329-af69-dcc57a7b9448 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 06:16:27 user nova-compute[73391]: 
Aug 15 06:16:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:083be69b-d637-44d8-a7a0-d8fb08d06154 -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:16:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:083be69b-d637-44d8-a7a0-d8fb08d06154 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:16:27 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d028cd0c-700d-4670-8049-ae7c951976c0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:083be69b-d637-44d8-a7a0-d8fb08d06154, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:083be69b-d637-44d8-a7a0-d8fb08d06154, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:16:27 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0156e74e-8532-4329-af69-dcc57a7b9448 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:083be69b-d637-44d8-a7a0-d8fb08d06154, portal: 172.16.0.220,3260]
Aug 15 06:16:27 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:083be69b-d637-44d8-a7a0-d8fb08d06154, portal: 172.16.0.220,3260] successful.
Aug 15 06:16:27 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:16:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:083be69b-d637-44d8-a7a0-d8fb08d06154 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:16:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:083be69b-d637-44d8-a7a0-d8fb08d06154 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:16:27 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[01bec515-6db7-40ec-a64a-e8c498368b55]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:16:27 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0156e74e-8532-4329-af69-dcc57a7b9448 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:16:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:16:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:16:27 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d128058-152d-4731-9995-311fce0ca0c2]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083be69b-d637-44d8-a7a0-d8fb08d06154 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:16:27 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0156e74e-8532-4329-af69-dcc57a7b9448 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083be69b-d637-44d8-a7a0-d8fb08d06154 (non-flash)
Aug 15 06:16:27 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:16:27 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0156e74e-8532-4329-af69-dcc57a7b9448 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083be69b-d637-44d8-a7a0-d8fb08d06154 (non-flash)
Aug 15 06:16:27 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:16:27 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-0156e74e-8532-4329-af69-dcc57a7b9448 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:083be69b-d637-44d8-a7a0-d8fb08d06154" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.243s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:16:27 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0156e74e-8532-4329-af69-dcc57a7b9448 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 06:16:27 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-0156e74e-8532-4329-af69-dcc57a7b9448 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 06:16:27 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-0156e74e-8532-4329-af69-dcc57a7b9448 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 06:16:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:16:27 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:16:27 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d56fcb7-78ab-4b14-96c7-9f75b245666e]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:16:27 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-0156e74e-8532-4329-af69-dcc57a7b9448 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 06:16:27 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0156e74e-8532-4329-af69-dcc57a7b9448 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GMvdiqRE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 06:16:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-0156e74e-8532-4329-af69-dcc57a7b9448 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.274s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:16:28 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-0156e74e-8532-4329-af69-dcc57a7b9448 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] <== connect_volume: return (1276ms) {'type': 'block', 'scsi_wwn': '23934383466346662', 'path': '/dev/sdb'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:16:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0156e74e-8532-4329-af69-dcc57a7b9448 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934383466346662', 'path': '/dev/sdb'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 06:16:28 user nova-compute[73391]: DEBUG nova.objects.instance [None req-0156e74e-8532-4329-af69-dcc57a7b9448 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lazy-loading 'flavor' on Instance uuid aa9d5fa1-a9eb-4330-9ce7-3189fa949726 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:16:28 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-0156e74e-8532-4329-af69-dcc57a7b9448 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 06:16:28 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 06:16:28 user nova-compute[73391]:   <source dev="/dev/sdb"/>
Aug 15 06:16:28 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 06:16:28 user nova-compute[73391]:   <serial>083be69b-d637-44d8-a7a0-d8fb08d06154</serial>
Aug 15 06:16:28 user nova-compute[73391]: </disk>
Aug 15 06:16:28 user nova-compute[73391]:  {{(pid=73391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 06:16:29 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0156e74e-8532-4329-af69-dcc57a7b9448 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 06:16:29 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0156e74e-8532-4329-af69-dcc57a7b9448 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 06:16:29 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-0156e74e-8532-4329-af69-dcc57a7b9448 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] No VIF found with MAC fa:16:3e:6b:8d:30, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 06:16:29 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-0156e74e-8532-4329-af69-dcc57a7b9448 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.137s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:16:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:16:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:16:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:16:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:16:38 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:16:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:16:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:16:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:16:38 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Auditing locally available compute resources for user (node: user) {{(pid=73391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 06:16:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9d5fa1-a9eb-4330-9ce7-3189fa949726/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:16:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9d5fa1-a9eb-4330-9ce7-3189fa949726/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:16:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9d5fa1-a9eb-4330-9ce7-3189fa949726/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:16:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9d5fa1-a9eb-4330-9ce7-3189fa949726/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:16:39 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=73391) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Aug 15 06:16:39 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:16:39 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:16:39 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Hypervisor/Node resource view: name=user free_ram=8816MB free_disk=25.044906616210938GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 06:16:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:16:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:16:39 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance aa9d5fa1-a9eb-4330-9ce7-3189fa949726 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:16:39 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 06:16:39 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 06:16:39 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Refreshing inventories for resource provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 06:16:39 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Updating ProviderTree inventory for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 06:16:39 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Updating inventory in ProviderTree for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 06:16:39 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Refreshing aggregate associations for resource provider 771708bd-6a2a-4e0c-9869-46d45e6b1896, aggregates: None {{(pid=73391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 06:16:39 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Refreshing trait associations for resource provider 771708bd-6a2a-4e0c-9869-46d45e6b1896, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=73391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 06:16:39 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:16:39 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:16:39 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Compute_service record updated for user:user {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 06:16:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.327s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:16:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:16:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:16:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:16:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:16:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:16:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:16:54 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:16:54 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:16:54 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Starting heal instance info cache {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 06:16:54 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Rebuilding the list of instances to heal {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 06:16:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "refresh_cache-aa9d5fa1-a9eb-4330-9ce7-3189fa949726" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:16:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquired lock "refresh_cache-aa9d5fa1-a9eb-4330-9ce7-3189fa949726" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:16:54 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Forcefully refreshing network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 06:16:54 user nova-compute[73391]: DEBUG nova.objects.instance [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lazy-loading 'info_cache' on Instance uuid aa9d5fa1-a9eb-4330-9ce7-3189fa949726 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:16:54 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Updating instance_info_cache with network_info: [{"id": "82232ed8-43f1-4c36-9429-f8bb8d7755f0", "address": "fa:16:3e:6b:8d:30", "network": {"id": "6a50e346-0341-4f50-a2fa-f5fe5f8ad867", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-542549440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ef81b0efb24993b595a2f6d18268fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82232ed8-43", "ovs_interfaceid": "82232ed8-43f1-4c36-9429-f8bb8d7755f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:16:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Releasing lock "refresh_cache-aa9d5fa1-a9eb-4330-9ce7-3189fa949726" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:16:54 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Updated the network info_cache for instance {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 06:16:54 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:16:54 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:16:54 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._sync_power_states {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:16:54 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Triggering sync for uuid aa9d5fa1-a9eb-4330-9ce7-3189fa949726 {{(pid=73391) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Aug 15 06:16:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:16:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:16:54 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:16:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-90788470-1fd5-4145-9b6c-f385297ed326 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Acquiring lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:16:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-90788470-1fd5-4145-9b6c-f385297ed326 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:16:55 user nova-compute[73391]: INFO nova.compute.manager [None req-90788470-1fd5-4145-9b6c-f385297ed326 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Detaching volume 083be69b-d637-44d8-a7a0-d8fb08d06154
Aug 15 06:16:55 user nova-compute[73391]: INFO nova.virt.block_device [None req-90788470-1fd5-4145-9b6c-f385297ed326 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Attempting to driver detach volume 083be69b-d637-44d8-a7a0-d8fb08d06154 from mountpoint /dev/vdb
Aug 15 06:16:55 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-90788470-1fd5-4145-9b6c-f385297ed326 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Attempting to detach device vdb from instance aa9d5fa1-a9eb-4330-9ce7-3189fa949726 from the persistent domain config. {{(pid=73391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 06:16:55 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-90788470-1fd5-4145-9b6c-f385297ed326 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 06:16:55 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 06:16:55 user nova-compute[73391]:   <source dev="/dev/sdb"/>
Aug 15 06:16:55 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 06:16:55 user nova-compute[73391]:   <serial>083be69b-d637-44d8-a7a0-d8fb08d06154</serial>
Aug 15 06:16:55 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 06:16:55 user nova-compute[73391]: </disk>
Aug 15 06:16:55 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 06:16:55 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-90788470-1fd5-4145-9b6c-f385297ed326 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Successfully detached device vdb from instance aa9d5fa1-a9eb-4330-9ce7-3189fa949726 from the persistent domain config.
Aug 15 06:16:55 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-90788470-1fd5-4145-9b6c-f385297ed326 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance aa9d5fa1-a9eb-4330-9ce7-3189fa949726 from the live domain config. {{(pid=73391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 06:16:55 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-90788470-1fd5-4145-9b6c-f385297ed326 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 06:16:55 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 06:16:55 user nova-compute[73391]:   <source dev="/dev/sdb"/>
Aug 15 06:16:55 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 06:16:55 user nova-compute[73391]:   <serial>083be69b-d637-44d8-a7a0-d8fb08d06154</serial>
Aug 15 06:16:55 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 06:16:55 user nova-compute[73391]: </disk>
Aug 15 06:16:55 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 06:16:55 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:16:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:16:55 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Received event <DeviceRemovedEvent: 1692080215.9392097, aa9d5fa1-a9eb-4330-9ce7-3189fa949726 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73391) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 06:16:55 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-90788470-1fd5-4145-9b6c-f385297ed326 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance aa9d5fa1-a9eb-4330-9ce7-3189fa949726 {{(pid=73391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 06:16:55 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-90788470-1fd5-4145-9b6c-f385297ed326 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Successfully detached device vdb from instance aa9d5fa1-a9eb-4330-9ce7-3189fa949726 from the live domain config.
Aug 15 06:16:55 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90788470-1fd5-4145-9b6c-f385297ed326 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 06:16:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-90788470-1fd5-4145-9b6c-f385297ed326 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:083be69b-d637-44d8-a7a0-d8fb08d06154'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GMvdiqRE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:16:55 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-90788470-1fd5-4145-9b6c-f385297ed326 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:16:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-90788470-1fd5-4145-9b6c-f385297ed326 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:16:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-90788470-1fd5-4145-9b6c-f385297ed326 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:16:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-90788470-1fd5-4145-9b6c-f385297ed326 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:083be69b-d637-44d8-a7a0-d8fb08d06154', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 06:16:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:16:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:16:55 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5482da-b007-4087-b59a-9cfcc2439975]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:083be69b-d637-44d8-a7a0-d8fb08d06154\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:16:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:16:55 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:16:55 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d898158a-e0f3-49cc-bd64-54e11ae1877a]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083be69b-d637-44d8-a7a0-d8fb08d06154 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:16:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-90788470-1fd5-4145-9b6c-f385297ed326 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083be69b-d637-44d8-a7a0-d8fb08d06154 (non-flash)
Aug 15 06:16:55 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:16:55 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-90788470-1fd5-4145-9b6c-f385297ed326 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:083be69b-d637-44d8-a7a0-d8fb08d06154 (non-flash)
Aug 15 06:16:55 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:16:56 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-90788470-1fd5-4145-9b6c-f385297ed326 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7748422050>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:083be69b-d637-44d8-a7a0-d8fb08d06154'): ({'sdb'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 06:16:56 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-90788470-1fd5-4145-9b6c-f385297ed326 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Removing single pathed devices sdb {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 06:16:56 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:16:56 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:16:56 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5593e316-f27d-4740-9f72-95106b7ae35a]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:16:56 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:16:56 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:16:56 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f761bf96-a414-4fe3-9e40-beb09e42cec2]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:16:56 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-90788470-1fd5-4145-9b6c-f385297ed326 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Flushing IO for device /dev/sdb {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 06:16:56 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:16:56 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:16:56 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc7f1cd-c254-4ca7-81ba-1062adbaa590]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:16:56 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-90788470-1fd5-4145-9b6c-f385297ed326 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 06:16:56 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:16:56 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:16:56 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52d14fa-9453-4271-b117-0d88a5b9e637]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:16:56 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-90788470-1fd5-4145-9b6c-f385297ed326 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 06:16:56 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-90788470-1fd5-4145-9b6c-f385297ed326 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] SCSI volumes sdb have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 06:16:56 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-90788470-1fd5-4145-9b6c-f385297ed326 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:083be69b-d637-44d8-a7a0-d8fb08d06154')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 06:16:56 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:083be69b-d637-44d8-a7a0-d8fb08d06154 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:16:56 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:083be69b-d637-44d8-a7a0-d8fb08d06154 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:16:56 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[520c8059-da46-4614-adbe-8e7196fba982]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:16:56 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-90788470-1fd5-4145-9b6c-f385297ed326 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:16:56 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:083be69b-d637-44d8-a7a0-d8fb08d06154 -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:16:56 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:083be69b-d637-44d8-a7a0-d8fb08d06154 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:16:56 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d3331a-27e3-48ea-951c-34cb4fb7ff63]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:083be69b-d637-44d8-a7a0-d8fb08d06154, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:083be69b-d637-44d8-a7a0-d8fb08d06154, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:16:56 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-90788470-1fd5-4145-9b6c-f385297ed326 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:083be69b-d637-44d8-a7a0-d8fb08d06154, portal: 172.16.0.220,3260]
Aug 15 06:16:56 user nova-compute[73391]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:083be69b-d637-44d8-a7a0-d8fb08d06154, portal: 172.16.0.220,3260] successful.
Aug 15 06:16:56 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:16:56 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:083be69b-d637-44d8-a7a0-d8fb08d06154 -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:16:56 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:083be69b-d637-44d8-a7a0-d8fb08d06154 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:16:56 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f29a7844-be48-48fc-819a-986f51f72f26]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:16:56 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-90788470-1fd5-4145-9b6c-f385297ed326 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:16:56 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-90788470-1fd5-4145-9b6c-f385297ed326 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.261s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:16:56 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-90788470-1fd5-4145-9b6c-f385297ed326 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] <== disconnect_volume: return (263ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:16:56 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90788470-1fd5-4145-9b6c-f385297ed326 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 06:16:56 user nova-compute[73391]: DEBUG nova.objects.instance [None req-90788470-1fd5-4145-9b6c-f385297ed326 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lazy-loading 'flavor' on Instance uuid aa9d5fa1-a9eb-4330-9ce7-3189fa949726 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:16:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-90788470-1fd5-4145-9b6c-f385297ed326 tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.600s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:16:58 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:16:58 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 06:17:00 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:17:01 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:17:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:17:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:17:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:17:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:17:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:17:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:17:09 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:17:10 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:17:15 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:17:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:17:25 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:17:25 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:17:25 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:17:25 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:17:25 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:17:25 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:17:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:17:35 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:17:38 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:17:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:17:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:17:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:17:38 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Auditing locally available compute resources for user (node: user) {{(pid=73391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 06:17:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9d5fa1-a9eb-4330-9ce7-3189fa949726/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:17:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9d5fa1-a9eb-4330-9ce7-3189fa949726/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:17:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9d5fa1-a9eb-4330-9ce7-3189fa949726/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:17:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9d5fa1-a9eb-4330-9ce7-3189fa949726/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:17:39 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:17:39 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:17:39 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Hypervisor/Node resource view: name=user free_ram=8828MB free_disk=25.044052124023438GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 06:17:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:17:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:17:39 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance aa9d5fa1-a9eb-4330-9ce7-3189fa949726 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:17:39 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 06:17:39 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 06:17:39 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:17:39 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:17:39 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Compute_service record updated for user:user {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 06:17:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.162s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:17:40 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:17:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:17:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:17:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:17:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:17:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:17:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:17:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-4e072a5b-5ff5-4f4f-85b6-abdc07ea552f tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Acquiring lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:17:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-4e072a5b-5ff5-4f4f-85b6-abdc07ea552f tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:17:49 user nova-compute[73391]: DEBUG nova.objects.instance [None req-4e072a5b-5ff5-4f4f-85b6-abdc07ea552f tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lazy-loading 'flavor' on Instance uuid aa9d5fa1-a9eb-4330-9ce7-3189fa949726 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:17:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-4e072a5b-5ff5-4f4f-85b6-abdc07ea552f tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.050s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:17:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-4e072a5b-5ff5-4f4f-85b6-abdc07ea552f tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Acquiring lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:17:49 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-4e072a5b-5ff5-4f4f-85b6-abdc07ea552f tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:17:49 user nova-compute[73391]: INFO nova.compute.manager [None req-4e072a5b-5ff5-4f4f-85b6-abdc07ea552f tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Attaching volume 0e0bc97d-b486-483c-9111-d98f55dd61f9 to /dev/vdb
Aug 15 06:17:49 user nova-compute[73391]: DEBUG os_brick.utils [None req-4e072a5b-5ff5-4f4f-85b6-abdc07ea552f tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:17:49 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:17:49 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:17:49 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7084db7f-63aa-4174-82f0-b8b3176b20f6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:17:49 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:17:49 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:17:49 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[928271d0-3ed3-4b49-8294-92b301515f0f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:17:49 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:17:50 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:17:50 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[85091659-bd51-4ebc-a340-053be0c14751]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:17:50 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[917924b6-795e-4d43-b56f-a78327c71da6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:17:50 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-4e072a5b-5ff5-4f4f-85b6-abdc07ea552f tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:17:50 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-4e072a5b-5ff5-4f4f-85b6-abdc07ea552f tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 06:17:50 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4e072a5b-5ff5-4f4f-85b6-abdc07ea552f tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 06:17:50 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:17:50 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 06:17:50 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 06:17:50 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7797f82-77d6-4d8d-a9b6-1922e590ac07]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:17:50 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-4e072a5b-5ff5-4f4f-85b6-abdc07ea552f tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 06:17:50 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-4e072a5b-5ff5-4f4f-85b6-abdc07ea552f tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 06:17:50 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-4e072a5b-5ff5-4f4f-85b6-abdc07ea552f tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 06:17:50 user nova-compute[73391]: DEBUG os_brick.utils [None req-4e072a5b-5ff5-4f4f-85b6-abdc07ea552f tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:17:50 user nova-compute[73391]: DEBUG nova.virt.block_device [None req-4e072a5b-5ff5-4f4f-85b6-abdc07ea552f tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Updating existing volume attachment record: be8a04b6-eae4-43d9-a4cc-ff6022e75919 {{(pid=73391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 06:17:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:17:50 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:17:54 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:17:54 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:17:55 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:17:55 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Starting heal instance info cache {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 06:17:55 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Rebuilding the list of instances to heal {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 06:17:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "refresh_cache-aa9d5fa1-a9eb-4330-9ce7-3189fa949726" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:17:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquired lock "refresh_cache-aa9d5fa1-a9eb-4330-9ce7-3189fa949726" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:17:55 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Forcefully refreshing network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 06:17:55 user nova-compute[73391]: DEBUG nova.objects.instance [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lazy-loading 'info_cache' on Instance uuid aa9d5fa1-a9eb-4330-9ce7-3189fa949726 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:17:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:17:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:17:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:17:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:17:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:17:55 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:17:56 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Updating instance_info_cache with network_info: [{"id": "82232ed8-43f1-4c36-9429-f8bb8d7755f0", "address": "fa:16:3e:6b:8d:30", "network": {"id": "6a50e346-0341-4f50-a2fa-f5fe5f8ad867", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-542549440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ef81b0efb24993b595a2f6d18268fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82232ed8-43", "ovs_interfaceid": "82232ed8-43f1-4c36-9429-f8bb8d7755f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:17:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Releasing lock "refresh_cache-aa9d5fa1-a9eb-4330-9ce7-3189fa949726" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:17:56 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Updated the network info_cache for instance {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 06:17:56 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:17:57 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:17:58 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e072a5b-5ff5-4f4f-85b6-abdc07ea552f tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 06:17:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e072a5b-5ff5-4f4f-85b6-abdc07ea552f tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:0e0bc97d-b486-483c-9111-d98f55dd61f9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UjMsbxVp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:17:58 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-4e072a5b-5ff5-4f4f-85b6-abdc07ea552f tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:17:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-4e072a5b-5ff5-4f4f-85b6-abdc07ea552f tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:17:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-4e072a5b-5ff5-4f4f-85b6-abdc07ea552f tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:17:58 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-4e072a5b-5ff5-4f4f-85b6-abdc07ea552f tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:17:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-4e072a5b-5ff5-4f4f-85b6-abdc07ea552f tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e0bc97d-b486-483c-9111-d98f55dd61f9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:17:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-4e072a5b-5ff5-4f4f-85b6-abdc07ea552f tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e0bc97d-b486-483c-9111-d98f55dd61f9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:17:58 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-4e072a5b-5ff5-4f4f-85b6-abdc07ea552f tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 06:17:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e0bc97d-b486-483c-9111-d98f55dd61f9 -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:17:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e0bc97d-b486-483c-9111-d98f55dd61f9 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:17:58 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1cbcfe-c49d-45b6-a962-5b1d4f4f1322]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:17:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e072a5b-5ff5-4f4f-85b6-abdc07ea552f tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 06:17:58 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:17:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e0bc97d-b486-483c-9111-d98f55dd61f9 -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:17:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e0bc97d-b486-483c-9111-d98f55dd61f9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:17:58 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a1aaf5-1eae-443f-9bef-5557cce4920e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e0bc97d-b486-483c-9111-d98f55dd61f9] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:17:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e072a5b-5ff5-4f4f-85b6-abdc07ea552f tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0e0bc97d-b486-483c-9111-d98f55dd61f9] added
Aug 15 06:17:58 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:17:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e0bc97d-b486-483c-9111-d98f55dd61f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:17:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e0bc97d-b486-483c-9111-d98f55dd61f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:17:58 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e975ba2f-2e55-43f0-b5d4-720f587581f4]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:17:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e072a5b-5ff5-4f4f-85b6-abdc07ea552f tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:17:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e0bc97d-b486-483c-9111-d98f55dd61f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:17:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e0bc97d-b486-483c-9111-d98f55dd61f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:17:58 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c231e8-fbbc-4ad8-b3e5-deb3a361a7f3]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:17:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e072a5b-5ff5-4f4f-85b6-abdc07ea552f tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:17:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e0bc97d-b486-483c-9111-d98f55dd61f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UjMsbxVp {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:17:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e0bc97d-b486-483c-9111-d98f55dd61f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UjMsbxVp" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:17:58 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a59284f-cf18-46e4-b23d-d63aadfccf15]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:17:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e072a5b-5ff5-4f4f-85b6-abdc07ea552f tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UjMsbxVp'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:17:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e0bc97d-b486-483c-9111-d98f55dd61f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:17:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e0bc97d-b486-483c-9111-d98f55dd61f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:17:58 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc05f580-1fb5-4a46-b16b-44ce284110f3]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:17:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e072a5b-5ff5-4f4f-85b6-abdc07ea552f tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:17:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:17:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:17:58 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d69f73ea-9e54-407b-910a-49b55b0a92ec]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:17:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e072a5b-5ff5-4f4f-85b6-abdc07ea552f tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 06:17:58 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:17:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e072a5b-5ff5-4f4f-85b6-abdc07ea552f tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 06:17:58 user nova-compute[73391]:  {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:17:58 user nova-compute[73391]: WARNING os_brick.initiator.connectors.iscsi [None req-4e072a5b-5ff5-4f4f-85b6-abdc07ea552f tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 06:17:58 user nova-compute[73391]: 
Aug 15 06:17:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e0bc97d-b486-483c-9111-d98f55dd61f9 -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:17:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e0bc97d-b486-483c-9111-d98f55dd61f9 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:17:58 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ab1b5a-989b-479f-ad3d-28bdab3942e0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e0bc97d-b486-483c-9111-d98f55dd61f9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0e0bc97d-b486-483c-9111-d98f55dd61f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:17:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e072a5b-5ff5-4f4f-85b6-abdc07ea552f tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0e0bc97d-b486-483c-9111-d98f55dd61f9, portal: 172.16.0.220,3260]
Aug 15 06:17:58 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:0e0bc97d-b486-483c-9111-d98f55dd61f9, portal: 172.16.0.220,3260] successful.
Aug 15 06:17:58 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:17:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e0bc97d-b486-483c-9111-d98f55dd61f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:17:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e0bc97d-b486-483c-9111-d98f55dd61f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:17:58 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a48fc2-44dc-48e9-be95-ec36fec303b4]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:17:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e072a5b-5ff5-4f4f-85b6-abdc07ea552f tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:17:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:17:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:17:58 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f52b272-cdc3-4dad-adf8-dd5b32f90692]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e0bc97d-b486-483c-9111-d98f55dd61f9 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:17:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e072a5b-5ff5-4f4f-85b6-abdc07ea552f tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e0bc97d-b486-483c-9111-d98f55dd61f9 (non-flash)
Aug 15 06:17:58 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:17:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e072a5b-5ff5-4f4f-85b6-abdc07ea552f tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e0bc97d-b486-483c-9111-d98f55dd61f9 (non-flash)
Aug 15 06:17:58 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:17:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-4e072a5b-5ff5-4f4f-85b6-abdc07ea552f tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0e0bc97d-b486-483c-9111-d98f55dd61f9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:17:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e072a5b-5ff5-4f4f-85b6-abdc07ea552f tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 06:17:58 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-4e072a5b-5ff5-4f4f-85b6-abdc07ea552f tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 06:17:58 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-4e072a5b-5ff5-4f4f-85b6-abdc07ea552f tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 06:17:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:17:58 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:17:58 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5a7a05-e667-4699-8632-b440246b2e9c]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:17:58 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-4e072a5b-5ff5-4f4f-85b6-abdc07ea552f tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 06:17:58 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e072a5b-5ff5-4f4f-85b6-abdc07ea552f tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UjMsbxVp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 06:17:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-4e072a5b-5ff5-4f4f-85b6-abdc07ea552f tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:17:59 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e072a5b-5ff5-4f4f-85b6-abdc07ea552f tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23139636130643135', 'path': '/dev/sdb'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:17:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e072a5b-5ff5-4f4f-85b6-abdc07ea552f tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139636130643135', 'path': '/dev/sdb'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 06:17:59 user nova-compute[73391]: DEBUG nova.objects.instance [None req-4e072a5b-5ff5-4f4f-85b6-abdc07ea552f tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lazy-loading 'flavor' on Instance uuid aa9d5fa1-a9eb-4330-9ce7-3189fa949726 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:17:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-4e072a5b-5ff5-4f4f-85b6-abdc07ea552f tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 06:17:59 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 06:17:59 user nova-compute[73391]:   <source dev="/dev/sdb"/>
Aug 15 06:17:59 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 06:17:59 user nova-compute[73391]:   <serial>0e0bc97d-b486-483c-9111-d98f55dd61f9</serial>
Aug 15 06:17:59 user nova-compute[73391]: </disk>
Aug 15 06:17:59 user nova-compute[73391]:  {{(pid=73391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 06:17:59 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:17:59 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 06:17:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-4e072a5b-5ff5-4f4f-85b6-abdc07ea552f tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 06:17:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-4e072a5b-5ff5-4f4f-85b6-abdc07ea552f tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 06:17:59 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-4e072a5b-5ff5-4f4f-85b6-abdc07ea552f tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] No VIF found with MAC fa:16:3e:6b:8d:30, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 06:17:59 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-4e072a5b-5ff5-4f4f-85b6-abdc07ea552f tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.127s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:18:00 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:18:00 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:18:00 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:18:00 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:18:00 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:18:00 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:18:01 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:18:02 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-b50ccef2-a3f1-451b-a36c-54b4d052b19a tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Acquiring lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:18:02 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-b50ccef2-a3f1-451b-a36c-54b4d052b19a tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:18:02 user nova-compute[73391]: INFO nova.compute.manager [None req-b50ccef2-a3f1-451b-a36c-54b4d052b19a tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Detaching volume 0e0bc97d-b486-483c-9111-d98f55dd61f9
Aug 15 06:18:02 user nova-compute[73391]: INFO nova.virt.block_device [None req-b50ccef2-a3f1-451b-a36c-54b4d052b19a tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Attempting to driver detach volume 0e0bc97d-b486-483c-9111-d98f55dd61f9 from mountpoint /dev/vdb
Aug 15 06:18:02 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-b50ccef2-a3f1-451b-a36c-54b4d052b19a tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Attempting to detach device vdb from instance aa9d5fa1-a9eb-4330-9ce7-3189fa949726 from the persistent domain config. {{(pid=73391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 06:18:02 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-b50ccef2-a3f1-451b-a36c-54b4d052b19a tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 06:18:02 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 06:18:02 user nova-compute[73391]:   <source dev="/dev/sdb"/>
Aug 15 06:18:02 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 06:18:02 user nova-compute[73391]:   <serial>0e0bc97d-b486-483c-9111-d98f55dd61f9</serial>
Aug 15 06:18:02 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 06:18:02 user nova-compute[73391]: </disk>
Aug 15 06:18:02 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 06:18:02 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-b50ccef2-a3f1-451b-a36c-54b4d052b19a tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Successfully detached device vdb from instance aa9d5fa1-a9eb-4330-9ce7-3189fa949726 from the persistent domain config.
Aug 15 06:18:02 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-b50ccef2-a3f1-451b-a36c-54b4d052b19a tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance aa9d5fa1-a9eb-4330-9ce7-3189fa949726 from the live domain config. {{(pid=73391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 06:18:02 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-b50ccef2-a3f1-451b-a36c-54b4d052b19a tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 06:18:02 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 06:18:02 user nova-compute[73391]:   <source dev="/dev/sdb"/>
Aug 15 06:18:02 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 06:18:02 user nova-compute[73391]:   <serial>0e0bc97d-b486-483c-9111-d98f55dd61f9</serial>
Aug 15 06:18:02 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 06:18:02 user nova-compute[73391]: </disk>
Aug 15 06:18:02 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 06:18:02 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Received event <DeviceRemovedEvent: 1692080282.6992545, aa9d5fa1-a9eb-4330-9ce7-3189fa949726 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73391) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 06:18:02 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-b50ccef2-a3f1-451b-a36c-54b4d052b19a tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance aa9d5fa1-a9eb-4330-9ce7-3189fa949726 {{(pid=73391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 06:18:02 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-b50ccef2-a3f1-451b-a36c-54b4d052b19a tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Successfully detached device vdb from instance aa9d5fa1-a9eb-4330-9ce7-3189fa949726 from the live domain config.
Aug 15 06:18:02 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b50ccef2-a3f1-451b-a36c-54b4d052b19a tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 06:18:02 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b50ccef2-a3f1-451b-a36c-54b4d052b19a tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:0e0bc97d-b486-483c-9111-d98f55dd61f9'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UjMsbxVp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:18:02 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-b50ccef2-a3f1-451b-a36c-54b4d052b19a tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:18:02 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-b50ccef2-a3f1-451b-a36c-54b4d052b19a tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:18:02 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-b50ccef2-a3f1-451b-a36c-54b4d052b19a tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:18:02 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b50ccef2-a3f1-451b-a36c-54b4d052b19a tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e0bc97d-b486-483c-9111-d98f55dd61f9', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 06:18:02 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:18:02 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:18:02 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b7f564-9245-41d6-99ff-b2e5905a9a8a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0e0bc97d-b486-483c-9111-d98f55dd61f9\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:18:02 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:18:02 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:18:02 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb9ee98-1971-4048-8673-d88e3a045cdf]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e0bc97d-b486-483c-9111-d98f55dd61f9 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:18:02 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b50ccef2-a3f1-451b-a36c-54b4d052b19a tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e0bc97d-b486-483c-9111-d98f55dd61f9 (non-flash)
Aug 15 06:18:02 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:18:02 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b50ccef2-a3f1-451b-a36c-54b4d052b19a tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0e0bc97d-b486-483c-9111-d98f55dd61f9 (non-flash)
Aug 15 06:18:02 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:18:02 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b50ccef2-a3f1-451b-a36c-54b4d052b19a tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7728352830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e0bc97d-b486-483c-9111-d98f55dd61f9'): ({'sdb'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 06:18:02 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-b50ccef2-a3f1-451b-a36c-54b4d052b19a tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Removing single pathed devices sdb {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 06:18:02 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:18:02 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:18:02 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c36ed2f-adcc-432b-b1de-a7272d87a05f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:18:02 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:18:02 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:18:02 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[6997f656-f4d6-4034-a935-501cbe729c2b]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:18:02 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-b50ccef2-a3f1-451b-a36c-54b4d052b19a tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Flushing IO for device /dev/sdb {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 06:18:02 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:18:02 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:18:02 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab002af8-3a1d-45e5-ad59-3d66b6eea4d4]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:18:02 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-b50ccef2-a3f1-451b-a36c-54b4d052b19a tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 06:18:02 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:18:02 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:18:02 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4066ac15-fcf0-476c-8b6b-dd0b4f4e2ac3]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:18:02 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-b50ccef2-a3f1-451b-a36c-54b4d052b19a tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 06:18:02 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-b50ccef2-a3f1-451b-a36c-54b4d052b19a tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] SCSI volumes sdb have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 06:18:02 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b50ccef2-a3f1-451b-a36c-54b4d052b19a tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0e0bc97d-b486-483c-9111-d98f55dd61f9')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 06:18:02 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e0bc97d-b486-483c-9111-d98f55dd61f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:18:02 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e0bc97d-b486-483c-9111-d98f55dd61f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:18:02 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7801ec91-03f4-49fd-8d50-b404861333dd]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:18:02 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b50ccef2-a3f1-451b-a36c-54b4d052b19a tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:18:02 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e0bc97d-b486-483c-9111-d98f55dd61f9 -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:18:02 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e0bc97d-b486-483c-9111-d98f55dd61f9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:18:02 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9928af-576a-41da-b7c1-24affe076279]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:0e0bc97d-b486-483c-9111-d98f55dd61f9, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:0e0bc97d-b486-483c-9111-d98f55dd61f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:18:02 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b50ccef2-a3f1-451b-a36c-54b4d052b19a tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:0e0bc97d-b486-483c-9111-d98f55dd61f9, portal: 172.16.0.220,3260]
Aug 15 06:18:02 user nova-compute[73391]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:0e0bc97d-b486-483c-9111-d98f55dd61f9, portal: 172.16.0.220,3260] successful.
Aug 15 06:18:02 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:18:02 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0e0bc97d-b486-483c-9111-d98f55dd61f9 -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:18:02 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0e0bc97d-b486-483c-9111-d98f55dd61f9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:18:02 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8304f9-1e8f-4840-aec8-3c14701d4bef]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:18:02 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b50ccef2-a3f1-451b-a36c-54b4d052b19a tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:18:02 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-b50ccef2-a3f1-451b-a36c-54b4d052b19a tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:18:02 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b50ccef2-a3f1-451b-a36c-54b4d052b19a tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] <== disconnect_volume: return (283ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:18:02 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b50ccef2-a3f1-451b-a36c-54b4d052b19a tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 06:18:03 user nova-compute[73391]: DEBUG nova.objects.instance [None req-b50ccef2-a3f1-451b-a36c-54b4d052b19a tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lazy-loading 'flavor' on Instance uuid aa9d5fa1-a9eb-4330-9ce7-3189fa949726 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:18:03 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-b50ccef2-a3f1-451b-a36c-54b4d052b19a tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.627s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:18:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:18:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:18:10 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:18:11 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:18:16 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:18:16 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:18:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:18:25 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:18:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:18:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:18:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:18:30 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:18:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:18:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:18:36 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:18:38 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:18:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:18:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:18:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:18:38 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Auditing locally available compute resources for user (node: user) {{(pid=73391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 06:18:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9d5fa1-a9eb-4330-9ce7-3189fa949726/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:18:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9d5fa1-a9eb-4330-9ce7-3189fa949726/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:18:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9d5fa1-a9eb-4330-9ce7-3189fa949726/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:18:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9d5fa1-a9eb-4330-9ce7-3189fa949726/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:18:39 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:18:39 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:18:39 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Hypervisor/Node resource view: name=user free_ram=8825MB free_disk=25.04303741455078GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 06:18:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:18:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:18:39 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance aa9d5fa1-a9eb-4330-9ce7-3189fa949726 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:18:39 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 06:18:39 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 06:18:39 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:18:39 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:18:39 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Compute_service record updated for user:user {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 06:18:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.170s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:18:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:18:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:18:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:18:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:18:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:18:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:18:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:18:51 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:18:51 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:18:51 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:18:51 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:18:51 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:18:51 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:18:54 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:18:55 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:18:55 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:18:55 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Starting heal instance info cache {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 06:18:55 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Rebuilding the list of instances to heal {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 06:18:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "refresh_cache-aa9d5fa1-a9eb-4330-9ce7-3189fa949726" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:18:55 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquired lock "refresh_cache-aa9d5fa1-a9eb-4330-9ce7-3189fa949726" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:18:55 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Forcefully refreshing network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 06:18:55 user nova-compute[73391]: DEBUG nova.objects.instance [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lazy-loading 'info_cache' on Instance uuid aa9d5fa1-a9eb-4330-9ce7-3189fa949726 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:18:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:18:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:18:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:18:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:18:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:18:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:18:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-b2b6c247-d5ce-4483-b429-e8254e2a1fda tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Acquiring lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:18:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-b2b6c247-d5ce-4483-b429-e8254e2a1fda tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:18:56 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Updating instance_info_cache with network_info: [{"id": "82232ed8-43f1-4c36-9429-f8bb8d7755f0", "address": "fa:16:3e:6b:8d:30", "network": {"id": "6a50e346-0341-4f50-a2fa-f5fe5f8ad867", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-542549440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ef81b0efb24993b595a2f6d18268fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82232ed8-43", "ovs_interfaceid": "82232ed8-43f1-4c36-9429-f8bb8d7755f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:18:56 user nova-compute[73391]: DEBUG nova.objects.instance [None req-b2b6c247-d5ce-4483-b429-e8254e2a1fda tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lazy-loading 'flavor' on Instance uuid aa9d5fa1-a9eb-4330-9ce7-3189fa949726 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:18:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Releasing lock "refresh_cache-aa9d5fa1-a9eb-4330-9ce7-3189fa949726" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:18:56 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Updated the network info_cache for instance {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 06:18:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-b2b6c247-d5ce-4483-b429-e8254e2a1fda tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.046s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:18:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-b2b6c247-d5ce-4483-b429-e8254e2a1fda tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Acquiring lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:18:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-b2b6c247-d5ce-4483-b429-e8254e2a1fda tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:18:56 user nova-compute[73391]: INFO nova.compute.manager [None req-b2b6c247-d5ce-4483-b429-e8254e2a1fda tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Attaching volume 60437208-fd42-4177-97d1-8f6e879c5371 to /dev/vdb
Aug 15 06:18:56 user nova-compute[73391]: DEBUG os_brick.utils [None req-b2b6c247-d5ce-4483-b429-e8254e2a1fda tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:18:56 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:18:56 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:18:56 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80e5259-265d-4d69-8b3b-a0f663912d17]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:18:56 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:18:56 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:18:56 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[686e9499-6117-4330-983a-bee40211b85e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:18:56 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:18:56 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:18:56 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3858b44d-b161-435a-b295-84a80d1fdc72]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:18:56 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d14ed2-ea54-4088-bcba-96585c902fe6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:18:56 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-b2b6c247-d5ce-4483-b429-e8254e2a1fda tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:18:56 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-b2b6c247-d5ce-4483-b429-e8254e2a1fda tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 06:18:56 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b2b6c247-d5ce-4483-b429-e8254e2a1fda tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 06:18:56 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:18:56 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 06:18:56 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 06:18:56 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[079ce76f-989f-4a16-bc7f-d0d99c3d81fa]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:18:56 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-b2b6c247-d5ce-4483-b429-e8254e2a1fda tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 06:18:56 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-b2b6c247-d5ce-4483-b429-e8254e2a1fda tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 06:18:56 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-b2b6c247-d5ce-4483-b429-e8254e2a1fda tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 06:18:56 user nova-compute[73391]: DEBUG os_brick.utils [None req-b2b6c247-d5ce-4483-b429-e8254e2a1fda tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:18:56 user nova-compute[73391]: DEBUG nova.virt.block_device [None req-b2b6c247-d5ce-4483-b429-e8254e2a1fda tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Updating existing volume attachment record: f17609df-eb12-4c84-83cf-e8517e320463 {{(pid=73391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 06:18:58 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:18:59 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:18:59 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:18:59 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 06:19:00 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:19:01 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:19:03 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:19:04 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2b6c247-d5ce-4483-b429-e8254e2a1fda tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 06:19:04 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b6c247-d5ce-4483-b429-e8254e2a1fda tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:60437208-fd42-4177-97d1-8f6e879c5371'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OApSoWre', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:19:04 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-b2b6c247-d5ce-4483-b429-e8254e2a1fda tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:19:04 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-b2b6c247-d5ce-4483-b429-e8254e2a1fda tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:19:04 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-b2b6c247-d5ce-4483-b429-e8254e2a1fda tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:19:04 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-b2b6c247-d5ce-4483-b429-e8254e2a1fda tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:19:04 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-b2b6c247-d5ce-4483-b429-e8254e2a1fda tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60437208-fd42-4177-97d1-8f6e879c5371" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:19:04 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-b2b6c247-d5ce-4483-b429-e8254e2a1fda tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60437208-fd42-4177-97d1-8f6e879c5371" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:19:04 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-b2b6c247-d5ce-4483-b429-e8254e2a1fda tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 06:19:04 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60437208-fd42-4177-97d1-8f6e879c5371 -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:19:04 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60437208-fd42-4177-97d1-8f6e879c5371 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:19:04 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b381e50-bc02-4be8-ac52-cfc69a25a853]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:19:04 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b6c247-d5ce-4483-b429-e8254e2a1fda tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 06:19:04 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:19:04 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60437208-fd42-4177-97d1-8f6e879c5371 -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:19:04 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60437208-fd42-4177-97d1-8f6e879c5371 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:19:04 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[93974f54-6024-4017-8793-473fbf588e44]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60437208-fd42-4177-97d1-8f6e879c5371] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:19:04 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b6c247-d5ce-4483-b429-e8254e2a1fda tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60437208-fd42-4177-97d1-8f6e879c5371] added
Aug 15 06:19:04 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:19:04 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60437208-fd42-4177-97d1-8f6e879c5371 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:19:04 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60437208-fd42-4177-97d1-8f6e879c5371 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:19:04 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e0554b-7fd2-4e69-8a6f-1416f3242409]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:19:04 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b6c247-d5ce-4483-b429-e8254e2a1fda tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:19:04 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60437208-fd42-4177-97d1-8f6e879c5371 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:19:04 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60437208-fd42-4177-97d1-8f6e879c5371 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:19:04 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[09fc86f3-f3b2-4dab-86ed-be278ffe2395]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:19:04 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b6c247-d5ce-4483-b429-e8254e2a1fda tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:19:04 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60437208-fd42-4177-97d1-8f6e879c5371 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OApSoWre {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:19:04 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60437208-fd42-4177-97d1-8f6e879c5371 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OApSoWre" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:19:04 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ed8986-c1e0-4d59-b386-5676ef494a14]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:19:04 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b6c247-d5ce-4483-b429-e8254e2a1fda tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OApSoWre'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:19:04 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60437208-fd42-4177-97d1-8f6e879c5371 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:19:04 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60437208-fd42-4177-97d1-8f6e879c5371 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:19:04 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd6ec8b-b8eb-4cf8-9b51-cc6382a466ac]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:19:04 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b6c247-d5ce-4483-b429-e8254e2a1fda tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:19:04 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:19:04 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:19:04 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f143ba-0003-42cf-8ea5-4e6e630c3c19]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:19:04 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b6c247-d5ce-4483-b429-e8254e2a1fda tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 06:19:04 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:19:04 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b6c247-d5ce-4483-b429-e8254e2a1fda tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 06:19:04 user nova-compute[73391]:  {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:19:04 user nova-compute[73391]: WARNING os_brick.initiator.connectors.iscsi [None req-b2b6c247-d5ce-4483-b429-e8254e2a1fda tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 06:19:04 user nova-compute[73391]: 
Aug 15 06:19:04 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60437208-fd42-4177-97d1-8f6e879c5371 -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:19:04 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60437208-fd42-4177-97d1-8f6e879c5371 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:19:04 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2a36f7-ef81-40e2-9cb3-fa981e790d5f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:60437208-fd42-4177-97d1-8f6e879c5371, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:60437208-fd42-4177-97d1-8f6e879c5371, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:19:04 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b6c247-d5ce-4483-b429-e8254e2a1fda tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:60437208-fd42-4177-97d1-8f6e879c5371, portal: 172.16.0.220,3260]
Aug 15 06:19:04 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:60437208-fd42-4177-97d1-8f6e879c5371, portal: 172.16.0.220,3260] successful.
Aug 15 06:19:04 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:19:04 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60437208-fd42-4177-97d1-8f6e879c5371 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:19:04 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60437208-fd42-4177-97d1-8f6e879c5371 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:19:04 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9846601-3620-4050-9a35-8129ba101338]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:19:04 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b6c247-d5ce-4483-b429-e8254e2a1fda tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:19:04 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:19:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:19:05 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6873b76-52a1-4fb2-a534-c1d404e97984]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60437208-fd42-4177-97d1-8f6e879c5371 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:19:05 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b6c247-d5ce-4483-b429-e8254e2a1fda tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60437208-fd42-4177-97d1-8f6e879c5371 (non-flash)
Aug 15 06:19:05 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:19:05 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b6c247-d5ce-4483-b429-e8254e2a1fda tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60437208-fd42-4177-97d1-8f6e879c5371 (non-flash)
Aug 15 06:19:05 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:19:05 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-b2b6c247-d5ce-4483-b429-e8254e2a1fda tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60437208-fd42-4177-97d1-8f6e879c5371" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:19:05 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b6c247-d5ce-4483-b429-e8254e2a1fda tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 06:19:05 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-b2b6c247-d5ce-4483-b429-e8254e2a1fda tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 06:19:05 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-b2b6c247-d5ce-4483-b429-e8254e2a1fda tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 06:19:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:19:05 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:19:05 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f503b9-d9bc-40bc-a586-31ea9edd2abf]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:19:05 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-b2b6c247-d5ce-4483-b429-e8254e2a1fda tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: None {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 06:19:06 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:19:06 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:19:06 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:19:06 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:19:06 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:19:06 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:19:06 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-b2b6c247-d5ce-4483-b429-e8254e2a1fda tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 06:19:06 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b6c247-d5ce-4483-b429-e8254e2a1fda tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OApSoWre', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 06:19:06 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-b2b6c247-d5ce-4483-b429-e8254e2a1fda tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:19:06 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2b6c247-d5ce-4483-b429-e8254e2a1fda tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '26666643034666261', 'path': '/dev/sdb'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:19:06 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2b6c247-d5ce-4483-b429-e8254e2a1fda tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26666643034666261', 'path': '/dev/sdb'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 06:19:06 user nova-compute[73391]: DEBUG nova.objects.instance [None req-b2b6c247-d5ce-4483-b429-e8254e2a1fda tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lazy-loading 'flavor' on Instance uuid aa9d5fa1-a9eb-4330-9ce7-3189fa949726 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:19:06 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-b2b6c247-d5ce-4483-b429-e8254e2a1fda tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 06:19:06 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 06:19:06 user nova-compute[73391]:   <source dev="/dev/sdb"/>
Aug 15 06:19:06 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 06:19:06 user nova-compute[73391]:   <serial>60437208-fd42-4177-97d1-8f6e879c5371</serial>
Aug 15 06:19:06 user nova-compute[73391]: </disk>
Aug 15 06:19:06 user nova-compute[73391]:  {{(pid=73391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 06:19:06 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-b2b6c247-d5ce-4483-b429-e8254e2a1fda tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 06:19:06 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-b2b6c247-d5ce-4483-b429-e8254e2a1fda tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 06:19:06 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-b2b6c247-d5ce-4483-b429-e8254e2a1fda tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] No VIF found with MAC fa:16:3e:6b:8d:30, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 06:19:06 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-b2b6c247-d5ce-4483-b429-e8254e2a1fda tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.193s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:19:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-73b05d54-05de-46ad-92c8-682d76fc449b tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Acquiring lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:19:08 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-73b05d54-05de-46ad-92c8-682d76fc449b tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:19:08 user nova-compute[73391]: INFO nova.compute.manager [None req-73b05d54-05de-46ad-92c8-682d76fc449b tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Detaching volume 60437208-fd42-4177-97d1-8f6e879c5371
Aug 15 06:19:08 user nova-compute[73391]: INFO nova.virt.block_device [None req-73b05d54-05de-46ad-92c8-682d76fc449b tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Attempting to driver detach volume 60437208-fd42-4177-97d1-8f6e879c5371 from mountpoint /dev/vdb
Aug 15 06:19:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-73b05d54-05de-46ad-92c8-682d76fc449b tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Attempting to detach device vdb from instance aa9d5fa1-a9eb-4330-9ce7-3189fa949726 from the persistent domain config. {{(pid=73391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 06:19:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-73b05d54-05de-46ad-92c8-682d76fc449b tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 06:19:08 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 06:19:08 user nova-compute[73391]:   <source dev="/dev/sdb"/>
Aug 15 06:19:08 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 06:19:08 user nova-compute[73391]:   <serial>60437208-fd42-4177-97d1-8f6e879c5371</serial>
Aug 15 06:19:08 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 06:19:08 user nova-compute[73391]: </disk>
Aug 15 06:19:08 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 06:19:08 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-73b05d54-05de-46ad-92c8-682d76fc449b tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Successfully detached device vdb from instance aa9d5fa1-a9eb-4330-9ce7-3189fa949726 from the persistent domain config.
Aug 15 06:19:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-73b05d54-05de-46ad-92c8-682d76fc449b tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance aa9d5fa1-a9eb-4330-9ce7-3189fa949726 from the live domain config. {{(pid=73391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 06:19:08 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-73b05d54-05de-46ad-92c8-682d76fc449b tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 06:19:08 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 06:19:08 user nova-compute[73391]:   <source dev="/dev/sdb"/>
Aug 15 06:19:08 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 06:19:08 user nova-compute[73391]:   <serial>60437208-fd42-4177-97d1-8f6e879c5371</serial>
Aug 15 06:19:08 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 06:19:08 user nova-compute[73391]: </disk>
Aug 15 06:19:08 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 06:19:09 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Received event <DeviceRemovedEvent: 1692080349.1954641, aa9d5fa1-a9eb-4330-9ce7-3189fa949726 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73391) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 06:19:09 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-73b05d54-05de-46ad-92c8-682d76fc449b tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance aa9d5fa1-a9eb-4330-9ce7-3189fa949726 {{(pid=73391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 06:19:09 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-73b05d54-05de-46ad-92c8-682d76fc449b tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Successfully detached device vdb from instance aa9d5fa1-a9eb-4330-9ce7-3189fa949726 from the live domain config.
Aug 15 06:19:09 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73b05d54-05de-46ad-92c8-682d76fc449b tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 06:19:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-73b05d54-05de-46ad-92c8-682d76fc449b tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:60437208-fd42-4177-97d1-8f6e879c5371'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OApSoWre', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:19:09 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-73b05d54-05de-46ad-92c8-682d76fc449b tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:19:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-73b05d54-05de-46ad-92c8-682d76fc449b tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:19:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-73b05d54-05de-46ad-92c8-682d76fc449b tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:19:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-73b05d54-05de-46ad-92c8-682d76fc449b tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60437208-fd42-4177-97d1-8f6e879c5371', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 06:19:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:19:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:19:09 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[337ca370-4ba3-4acc-a04c-21c893e7421c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60437208-fd42-4177-97d1-8f6e879c5371\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:19:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:19:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:19:09 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1460133-eb9c-48ec-9129-069c62755fae]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60437208-fd42-4177-97d1-8f6e879c5371 (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:19:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-73b05d54-05de-46ad-92c8-682d76fc449b tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60437208-fd42-4177-97d1-8f6e879c5371 (non-flash)
Aug 15 06:19:09 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:19:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-73b05d54-05de-46ad-92c8-682d76fc449b tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60437208-fd42-4177-97d1-8f6e879c5371 (non-flash)
Aug 15 06:19:09 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:19:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-73b05d54-05de-46ad-92c8-682d76fc449b tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7748223b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60437208-fd42-4177-97d1-8f6e879c5371'): ({'sdb'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 06:19:09 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-73b05d54-05de-46ad-92c8-682d76fc449b tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Removing single pathed devices sdb {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 06:19:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:19:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:19:09 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[39335917-507c-490b-8391-da359b2b6fad]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:19:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:19:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:19:09 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e379062a-d23a-4edb-8c52-591d2652fdc3]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:19:09 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-73b05d54-05de-46ad-92c8-682d76fc449b tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Flushing IO for device /dev/sdb {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 06:19:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:19:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:19:09 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c9383e-d697-4e77-8d51-56036b547373]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:19:09 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-73b05d54-05de-46ad-92c8-682d76fc449b tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 06:19:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:19:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:19:09 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b0f370-a207-4242-af2a-9602567b3e88]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:19:09 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-73b05d54-05de-46ad-92c8-682d76fc449b tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 06:19:09 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-73b05d54-05de-46ad-92c8-682d76fc449b tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] SCSI volumes sdb have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 06:19:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-73b05d54-05de-46ad-92c8-682d76fc449b tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60437208-fd42-4177-97d1-8f6e879c5371')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 06:19:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60437208-fd42-4177-97d1-8f6e879c5371 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:19:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60437208-fd42-4177-97d1-8f6e879c5371 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:19:09 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[674cd5d7-d082-4b7f-a5aa-50c6fee01f94]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:19:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-73b05d54-05de-46ad-92c8-682d76fc449b tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:19:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60437208-fd42-4177-97d1-8f6e879c5371 -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:19:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60437208-fd42-4177-97d1-8f6e879c5371 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:19:09 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4be8b2d-cd18-439b-a0eb-358116b0a61d]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:60437208-fd42-4177-97d1-8f6e879c5371, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:60437208-fd42-4177-97d1-8f6e879c5371, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:19:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-73b05d54-05de-46ad-92c8-682d76fc449b tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:60437208-fd42-4177-97d1-8f6e879c5371, portal: 172.16.0.220,3260]
Aug 15 06:19:09 user nova-compute[73391]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:60437208-fd42-4177-97d1-8f6e879c5371, portal: 172.16.0.220,3260] successful.
Aug 15 06:19:09 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:19:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60437208-fd42-4177-97d1-8f6e879c5371 -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:19:09 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60437208-fd42-4177-97d1-8f6e879c5371 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:19:09 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf80156b-8cad-4916-a120-e8e3a3246124]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:19:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-73b05d54-05de-46ad-92c8-682d76fc449b tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:19:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-73b05d54-05de-46ad-92c8-682d76fc449b tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.266s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:19:09 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-73b05d54-05de-46ad-92c8-682d76fc449b tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] <== disconnect_volume: return (268ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:19:09 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73b05d54-05de-46ad-92c8-682d76fc449b tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 06:19:10 user nova-compute[73391]: DEBUG nova.objects.instance [None req-73b05d54-05de-46ad-92c8-682d76fc449b tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lazy-loading 'flavor' on Instance uuid aa9d5fa1-a9eb-4330-9ce7-3189fa949726 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:19:10 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-73b05d54-05de-46ad-92c8-682d76fc449b tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.638s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:19:10 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:19:11 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:19:11 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:19:16 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:19:21 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:19:21 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:19:21 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:19:21 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:19:21 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:19:21 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:19:26 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:19:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:19:36 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:19:36 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:19:36 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:19:36 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:19:36 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:19:36 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:19:38 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:19:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:19:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:19:38 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:19:38 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Auditing locally available compute resources for user (node: user) {{(pid=73391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 06:19:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9d5fa1-a9eb-4330-9ce7-3189fa949726/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:19:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9d5fa1-a9eb-4330-9ce7-3189fa949726/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:19:38 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9d5fa1-a9eb-4330-9ce7-3189fa949726/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:19:39 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9d5fa1-a9eb-4330-9ce7-3189fa949726/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:19:39 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:19:39 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:19:39 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Hypervisor/Node resource view: name=user free_ram=8815MB free_disk=25.04205322265625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 06:19:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:19:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:19:39 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance aa9d5fa1-a9eb-4330-9ce7-3189fa949726 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:19:39 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 06:19:39 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 06:19:39 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:19:39 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:19:39 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Compute_service record updated for user:user {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 06:19:39 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.159s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:19:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:19:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:19:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:19:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:19:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:19:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:19:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:19:51 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:19:51 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:19:51 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:19:51 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:19:51 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:19:51 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:19:55 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:19:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:19:56 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:19:56 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Starting heal instance info cache {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 06:19:56 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Rebuilding the list of instances to heal {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 06:19:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "refresh_cache-aa9d5fa1-a9eb-4330-9ce7-3189fa949726" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:19:56 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquired lock "refresh_cache-aa9d5fa1-a9eb-4330-9ce7-3189fa949726" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:19:56 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Forcefully refreshing network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 06:19:56 user nova-compute[73391]: DEBUG nova.objects.instance [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lazy-loading 'info_cache' on Instance uuid aa9d5fa1-a9eb-4330-9ce7-3189fa949726 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:19:57 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Updating instance_info_cache with network_info: [{"id": "82232ed8-43f1-4c36-9429-f8bb8d7755f0", "address": "fa:16:3e:6b:8d:30", "network": {"id": "6a50e346-0341-4f50-a2fa-f5fe5f8ad867", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-542549440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ef81b0efb24993b595a2f6d18268fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82232ed8-43", "ovs_interfaceid": "82232ed8-43f1-4c36-9429-f8bb8d7755f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:19:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Releasing lock "refresh_cache-aa9d5fa1-a9eb-4330-9ce7-3189fa949726" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:19:57 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Updated the network info_cache for instance {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 06:19:58 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:19:59 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:19:59 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:19:59 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:19:59 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 06:20:01 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:20:01 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:20:01 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:20:01 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:20:01 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:20:01 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:20:02 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-560f1b2d-f4fe-4582-9f69-2f6be549bc1e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Acquiring lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:20:02 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-560f1b2d-f4fe-4582-9f69-2f6be549bc1e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:20:02 user nova-compute[73391]: DEBUG nova.objects.instance [None req-560f1b2d-f4fe-4582-9f69-2f6be549bc1e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lazy-loading 'flavor' on Instance uuid aa9d5fa1-a9eb-4330-9ce7-3189fa949726 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:20:03 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-560f1b2d-f4fe-4582-9f69-2f6be549bc1e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:20:03 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-560f1b2d-f4fe-4582-9f69-2f6be549bc1e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Acquiring lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:20:03 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-560f1b2d-f4fe-4582-9f69-2f6be549bc1e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:20:03 user nova-compute[73391]: INFO nova.compute.manager [None req-560f1b2d-f4fe-4582-9f69-2f6be549bc1e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Attaching volume a3aea301-db50-4449-9952-1df66079f78f to /dev/vdb
Aug 15 06:20:03 user nova-compute[73391]: DEBUG os_brick.utils [None req-560f1b2d-f4fe-4582-9f69-2f6be549bc1e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:20:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:20:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:20:03 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3c7a10-a8ad-485f-b400-d9d808f5657f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:b5834c4eadb3\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:20:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:20:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:20:03 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e637f654-e78b-4290-bc11-bdd3d2702958]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:20:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:20:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:20:03 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace4ae7c-e33e-4710-ace9-2c269c003582]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:20:03 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea189f5-25b6-40f7-b0f7-a207c6952fbe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:20:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-560f1b2d-f4fe-4582-9f69-2f6be549bc1e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Running cmd (subprocess): nvme version {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:20:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-560f1b2d-f4fe-4582-9f69-2f6be549bc1e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] 'nvme version' failed. Not Retrying. {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 06:20:03 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.nvmeof [None req-560f1b2d-f4fe-4582-9f69-2f6be549bc1e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] nvme not present on system {{(pid=73391) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Aug 15 06:20:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:20:03 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Aug 15 06:20:03 user nova-compute[73391]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Aug 15 06:20:03 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e4ceffe-a698-4eeb-a81f-7ce4ed4166a9]: (4, '') {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:20:03 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-560f1b2d-f4fe-4582-9f69-2f6be549bc1e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=73391) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Aug 15 06:20:03 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-560f1b2d-f4fe-4582-9f69-2f6be549bc1e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Aug 15 06:20:03 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.lightos [None req-560f1b2d-f4fe-4582-9f69-2f6be549bc1e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] LIGHTOS: no hostnqn found. {{(pid=73391) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Aug 15 06:20:03 user nova-compute[73391]: DEBUG os_brick.utils [None req-560f1b2d-f4fe-4582-9f69-2f6be549bc1e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:b5834c4eadb3', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:20:03 user nova-compute[73391]: DEBUG nova.virt.block_device [None req-560f1b2d-f4fe-4582-9f69-2f6be549bc1e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Updating existing volume attachment record: 01423949-3966-4456-9b7a-2c386cd940e2 {{(pid=73391) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Aug 15 06:20:04 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:20:05 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:20:06 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:20:11 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:20:11 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:20:11 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:20:11 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:20:11 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:20:11 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:20:11 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-560f1b2d-f4fe-4582-9f69-2f6be549bc1e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Calling os-brick to attach iSCSI Volume {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Aug 15 06:20:11 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-560f1b2d-f4fe-4582-9f69-2f6be549bc1e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, 'connection_properties': {'target_iqns': ['iqn.2010-10.org.openstack:a3aea301-db50-4449-9952-1df66079f78f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LnNYUliT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:20:11 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-560f1b2d-f4fe-4582-9f69-2f6be549bc1e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:20:11 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-560f1b2d-f4fe-4582-9f69-2f6be549bc1e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:20:11 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-560f1b2d-f4fe-4582-9f69-2f6be549bc1e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:20:11 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-560f1b2d-f4fe-4582-9f69-2f6be549bc1e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:20:11 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-560f1b2d-f4fe-4582-9f69-2f6be549bc1e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3aea301-db50-4449-9952-1df66079f78f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:20:11 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-560f1b2d-f4fe-4582-9f69-2f6be549bc1e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3aea301-db50-4449-9952-1df66079f78f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:20:11 user nova-compute[73391]: INFO os_brick.initiator.connectors.iscsi [None req-560f1b2d-f4fe-4582-9f69-2f6be549bc1e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Aug 15 06:20:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3aea301-db50-4449-9952-1df66079f78f -p 172.16.0.220:3260 {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:20:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3aea301-db50-4449-9952-1df66079f78f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:20:11 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2788ec3-33c9-4753-aa77-a23d354059c2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:20:11 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-560f1b2d-f4fe-4582-9f69-2f6be549bc1e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Aug 15 06:20:11 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:20:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3aea301-db50-4449-9952-1df66079f78f -p 172.16.0.220:3260 --interface default --op new {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:20:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3aea301-db50-4449-9952-1df66079f78f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:20:11 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0931a8e-5f53-49cb-9c24-3408dcf10532]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3aea301-db50-4449-9952-1df66079f78f] added\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:20:11 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-560f1b2d-f4fe-4582-9f69-2f6be549bc1e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a3aea301-db50-4449-9952-1df66079f78f] added
Aug 15 06:20:11 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:20:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3aea301-db50-4449-9952-1df66079f78f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:20:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3aea301-db50-4449-9952-1df66079f78f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:20:11 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a8678a-cae8-4cad-aa8b-51d9cd1d5cd3]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:20:11 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-560f1b2d-f4fe-4582-9f69-2f6be549bc1e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:20:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3aea301-db50-4449-9952-1df66079f78f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:20:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3aea301-db50-4449-9952-1df66079f78f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:20:11 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b062141-efe4-492f-84ac-cac0dbac31bb]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:20:11 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-560f1b2d-f4fe-4582-9f69-2f6be549bc1e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:20:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3aea301-db50-4449-9952-1df66079f78f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LnNYUliT {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:20:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3aea301-db50-4449-9952-1df66079f78f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LnNYUliT" returned: 0 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:20:11 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[017c0180-24aa-49d8-a6e7-3a3c5902c861]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:20:11 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-560f1b2d-f4fe-4582-9f69-2f6be549bc1e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LnNYUliT'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:20:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3aea301-db50-4449-9952-1df66079f78f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:20:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3aea301-db50-4449-9952-1df66079f78f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:20:11 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a5280c-c3b8-436d-a5e5-cd0687765c30]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:20:11 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-560f1b2d-f4fe-4582-9f69-2f6be549bc1e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:20:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:20:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:20:11 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1587c78-39fd-4ab8-981b-3233d0a6d5da]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:20:11 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-560f1b2d-f4fe-4582-9f69-2f6be549bc1e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Aug 15 06:20:11 user nova-compute[73391]:  {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:20:11 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-560f1b2d-f4fe-4582-9f69-2f6be549bc1e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Aug 15 06:20:11 user nova-compute[73391]:  {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:20:11 user nova-compute[73391]: WARNING os_brick.initiator.connectors.iscsi [None req-560f1b2d-f4fe-4582-9f69-2f6be549bc1e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Aug 15 06:20:11 user nova-compute[73391]: 
Aug 15 06:20:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3aea301-db50-4449-9952-1df66079f78f -p 172.16.0.220:3260 --login {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:20:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3aea301-db50-4449-9952-1df66079f78f -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:20:11 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2315eba-91e9-402d-a5ac-1b1b26f2285b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3aea301-db50-4449-9952-1df66079f78f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a3aea301-db50-4449-9952-1df66079f78f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:20:11 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-560f1b2d-f4fe-4582-9f69-2f6be549bc1e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a3aea301-db50-4449-9952-1df66079f78f, portal: 172.16.0.220,3260]
Aug 15 06:20:11 user nova-compute[73391]: Login to [iface: default, target: iqn.2010-10.org.openstack:a3aea301-db50-4449-9952-1df66079f78f, portal: 172.16.0.220,3260] successful.
Aug 15 06:20:11 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:20:11 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3aea301-db50-4449-9952-1df66079f78f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:20:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3aea301-db50-4449-9952-1df66079f78f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:20:12 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[80666fd2-b737-4808-8951-f6115e882485]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:20:12 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-560f1b2d-f4fe-4582-9f69-2f6be549bc1e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:20:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:20:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:20:12 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10b3731-86bf-4159-8993-769aae7d9ab8]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3aea301-db50-4449-9952-1df66079f78f (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:20:12 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-560f1b2d-f4fe-4582-9f69-2f6be549bc1e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3aea301-db50-4449-9952-1df66079f78f (non-flash)
Aug 15 06:20:12 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:20:12 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-560f1b2d-f4fe-4582-9f69-2f6be549bc1e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3aea301-db50-4449-9952-1df66079f78f (non-flash)
Aug 15 06:20:12 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:20:12 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-560f1b2d-f4fe-4582-9f69-2f6be549bc1e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a3aea301-db50-4449-9952-1df66079f78f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.269s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:20:12 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-560f1b2d-f4fe-4582-9f69-2f6be549bc1e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Connected to 172.16.0.220:3260 {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:633}}
Aug 15 06:20:12 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-560f1b2d-f4fe-4582-9f69-2f6be549bc1e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=73391) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:694}}
Aug 15 06:20:12 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-560f1b2d-f4fe-4582-9f69-2f6be549bc1e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=73391) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:719}}
Aug 15 06:20:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:20:12 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:20:12 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[74933c94-d0ba-45f5-8e02-56e71a788c8b]: (4, ('- - 0', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:20:12 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-560f1b2d-f4fe-4582-9f69-2f6be549bc1e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: None {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 06:20:13 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-560f1b2d-f4fe-4582-9f69-2f6be549bc1e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=73391) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:713}}
Aug 15 06:20:13 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-560f1b2d-f4fe-4582-9f69-2f6be549bc1e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Connected to sdb using {'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LnNYUliT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'target_portal': '172.16.0.220:3260', 'target_iqn'} {{(pid=73391) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:661}}
Aug 15 06:20:13 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-560f1b2d-f4fe-4582-9f69-2f6be549bc1e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:20:13 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-560f1b2d-f4fe-4582-9f69-2f6be549bc1e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23664623633316233', 'path': '/dev/sdb'} {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:20:13 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-560f1b2d-f4fe-4582-9f69-2f6be549bc1e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664623633316233', 'path': '/dev/sdb'} {{(pid=73391) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Aug 15 06:20:13 user nova-compute[73391]: DEBUG nova.objects.instance [None req-560f1b2d-f4fe-4582-9f69-2f6be549bc1e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lazy-loading 'flavor' on Instance uuid aa9d5fa1-a9eb-4330-9ce7-3189fa949726 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:20:13 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-560f1b2d-f4fe-4582-9f69-2f6be549bc1e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] attach device xml: <disk type="block" device="disk">
Aug 15 06:20:13 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 06:20:13 user nova-compute[73391]:   <source dev="/dev/sdb"/>
Aug 15 06:20:13 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 06:20:13 user nova-compute[73391]:   <serial>a3aea301-db50-4449-9952-1df66079f78f</serial>
Aug 15 06:20:13 user nova-compute[73391]: </disk>
Aug 15 06:20:13 user nova-compute[73391]:  {{(pid=73391) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Aug 15 06:20:13 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-560f1b2d-f4fe-4582-9f69-2f6be549bc1e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] No BDM found with device name vda, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 06:20:13 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-560f1b2d-f4fe-4582-9f69-2f6be549bc1e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] No BDM found with device name vdb, not building metadata. {{(pid=73391) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Aug 15 06:20:13 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-560f1b2d-f4fe-4582-9f69-2f6be549bc1e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] No VIF found with MAC fa:16:3e:6b:8d:30, not building metadata {{(pid=73391) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Aug 15 06:20:13 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-560f1b2d-f4fe-4582-9f69-2f6be549bc1e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.490s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:20:13 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:20:15 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-44aa4207-e9e4-4bbd-9256-a4ae58971b0e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Acquiring lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:20:15 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-44aa4207-e9e4-4bbd-9256-a4ae58971b0e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:20:15 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:20:15 user nova-compute[73391]: INFO nova.compute.manager [None req-44aa4207-e9e4-4bbd-9256-a4ae58971b0e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Detaching volume a3aea301-db50-4449-9952-1df66079f78f
Aug 15 06:20:15 user nova-compute[73391]: INFO nova.virt.block_device [None req-44aa4207-e9e4-4bbd-9256-a4ae58971b0e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Attempting to driver detach volume a3aea301-db50-4449-9952-1df66079f78f from mountpoint /dev/vdb
Aug 15 06:20:15 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-44aa4207-e9e4-4bbd-9256-a4ae58971b0e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Attempting to detach device vdb from instance aa9d5fa1-a9eb-4330-9ce7-3189fa949726 from the persistent domain config. {{(pid=73391) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Aug 15 06:20:15 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-44aa4207-e9e4-4bbd-9256-a4ae58971b0e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 06:20:15 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 06:20:15 user nova-compute[73391]:   <source dev="/dev/sdb"/>
Aug 15 06:20:15 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 06:20:15 user nova-compute[73391]:   <serial>a3aea301-db50-4449-9952-1df66079f78f</serial>
Aug 15 06:20:15 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 06:20:15 user nova-compute[73391]: </disk>
Aug 15 06:20:15 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 06:20:15 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-44aa4207-e9e4-4bbd-9256-a4ae58971b0e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Successfully detached device vdb from instance aa9d5fa1-a9eb-4330-9ce7-3189fa949726 from the persistent domain config.
Aug 15 06:20:15 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-44aa4207-e9e4-4bbd-9256-a4ae58971b0e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance aa9d5fa1-a9eb-4330-9ce7-3189fa949726 from the live domain config. {{(pid=73391) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Aug 15 06:20:15 user nova-compute[73391]: DEBUG nova.virt.libvirt.guest [None req-44aa4207-e9e4-4bbd-9256-a4ae58971b0e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] detach device xml: <disk type="block" device="disk">
Aug 15 06:20:15 user nova-compute[73391]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Aug 15 06:20:15 user nova-compute[73391]:   <source dev="/dev/sdb"/>
Aug 15 06:20:15 user nova-compute[73391]:   <target dev="vdb" bus="virtio"/>
Aug 15 06:20:15 user nova-compute[73391]:   <serial>a3aea301-db50-4449-9952-1df66079f78f</serial>
Aug 15 06:20:15 user nova-compute[73391]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Aug 15 06:20:15 user nova-compute[73391]: </disk>
Aug 15 06:20:15 user nova-compute[73391]:  {{(pid=73391) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Aug 15 06:20:15 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-70c5ccde-07b7-408e-9e8e-73678a09d226 None None] Received event <DeviceRemovedEvent: 1692080415.9300714, aa9d5fa1-a9eb-4330-9ce7-3189fa949726 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=73391) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Aug 15 06:20:15 user nova-compute[73391]: DEBUG nova.virt.libvirt.driver [None req-44aa4207-e9e4-4bbd-9256-a4ae58971b0e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance aa9d5fa1-a9eb-4330-9ce7-3189fa949726 {{(pid=73391) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Aug 15 06:20:15 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-44aa4207-e9e4-4bbd-9256-a4ae58971b0e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Successfully detached device vdb from instance aa9d5fa1-a9eb-4330-9ce7-3189fa949726 from the live domain config.
Aug 15 06:20:15 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44aa4207-e9e4-4bbd-9256-a4ae58971b0e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] calling os-brick to detach iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Aug 15 06:20:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-44aa4207-e9e4-4bbd-9256-a4ae58971b0e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f772870d060>, {'target_iqns': ['iqn.2010-10.org.openstack:a3aea301-db50-4449-9952-1df66079f78f'], 'target_portals': ['172.16.0.220:3260'], 'target_luns': [0], 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LnNYUliT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:175}}
Aug 15 06:20:15 user nova-compute[73391]: WARNING os_brick.initiator.connectors.base [None req-44aa4207-e9e4-4bbd-9256-a4ae58971b0e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Aug 15 06:20:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-44aa4207-e9e4-4bbd-9256-a4ae58971b0e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Aug 15 06:20:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-44aa4207-e9e4-4bbd-9256-a4ae58971b0e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Aug 15 06:20:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-44aa4207-e9e4-4bbd-9256-a4ae58971b0e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3aea301-db50-4449-9952-1df66079f78f', 0)] {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:819}}
Aug 15 06:20:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:20:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:20:15 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[e948bf44-57f5-4f51-9941-27fa7d1ad708]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a3aea301-db50-4449-9952-1df66079f78f\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:20:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:20:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:20:15 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[10108930-efc2-471a-ac76-2cf6f6a9a65a]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3aea301-db50-4449-9952-1df66079f78f (non-flash)\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:20:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-44aa4207-e9e4-4bbd-9256-a4ae58971b0e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3aea301-db50-4449-9952-1df66079f78f (non-flash)
Aug 15 06:20:15 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Aug 15 06:20:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-44aa4207-e9e4-4bbd-9256-a4ae58971b0e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a3aea301-db50-4449-9952-1df66079f78f (non-flash)
Aug 15 06:20:15 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Aug 15 06:20:15 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-44aa4207-e9e4-4bbd-9256-a4ae58971b0e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f77283137f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3aea301-db50-4449-9952-1df66079f78f'): ({'sdb'}, set())}) {{(pid=73391) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:852}}
Aug 15 06:20:15 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-44aa4207-e9e4-4bbd-9256-a4ae58971b0e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Removing single pathed devices sdb {{(pid=73391) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:309}}
Aug 15 06:20:15 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:20:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:20:16 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c46da3a-8058-410b-8fc4-807ca7bb7c68]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:20:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:20:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:20:16 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[2611436c-6a17-4e9d-bb1e-1a0fa090765f]: (4, ('ok\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:20:16 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-44aa4207-e9e4-4bbd-9256-a4ae58971b0e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Flushing IO for device /dev/sdb {{(pid=73391) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:369}}
Aug 15 06:20:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:20:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:20:16 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a763af5-4a10-470c-8c56-4ac4b458a7d2]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:20:16 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-44aa4207-e9e4-4bbd-9256-a4ae58971b0e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=73391) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:83}}
Aug 15 06:20:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:20:16 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:20:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:20:16 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[032c0604-6d7a-4ab7-8ac7-2b94ca5da39b]: (4, ('1', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:20:16 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-44aa4207-e9e4-4bbd-9256-a4ae58971b0e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:91}}
Aug 15 06:20:16 user nova-compute[73391]: DEBUG os_brick.initiator.linuxscsi [None req-44aa4207-e9e4-4bbd-9256-a4ae58971b0e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] SCSI volumes sdb have been removed. {{(pid=73391) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:101}}
Aug 15 06:20:16 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-44aa4207-e9e4-4bbd-9256-a4ae58971b0e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a3aea301-db50-4449-9952-1df66079f78f')] {{(pid=73391) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Aug 15 06:20:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3aea301-db50-4449-9952-1df66079f78f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:20:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3aea301-db50-4449-9952-1df66079f78f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:20:16 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[60eba0b5-375e-4601-8da9-d5e0b82571af]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:20:16 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-44aa4207-e9e4-4bbd-9256-a4ae58971b0e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:20:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3aea301-db50-4449-9952-1df66079f78f -p 172.16.0.220:3260 --logout {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:20:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3aea301-db50-4449-9952-1df66079f78f -p 172.16.0.220:3260 --logout" returned: 0 in 0.036s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:20:16 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[8602ba50-1e5f-49da-ac57-2b8aafbba2a6]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:a3aea301-db50-4449-9952-1df66079f78f, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:a3aea301-db50-4449-9952-1df66079f78f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:20:16 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-44aa4207-e9e4-4bbd-9256-a4ae58971b0e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:a3aea301-db50-4449-9952-1df66079f78f, portal: 172.16.0.220,3260]
Aug 15 06:20:16 user nova-compute[73391]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:a3aea301-db50-4449-9952-1df66079f78f, portal: 172.16.0.220,3260] successful.
Aug 15 06:20:16 user nova-compute[73391]:  stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:20:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a3aea301-db50-4449-9952-1df66079f78f -p 172.16.0.220:3260 --op delete {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:20:16 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a3aea301-db50-4449-9952-1df66079f78f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=84527) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:20:16 user nova-compute[73391]: DEBUG oslo.privsep.daemon [-] privsep: reply[0251fd87-a973-401a-87d6-27f209b858e6]: (4, ('', '')) {{(pid=84527) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:501}}
Aug 15 06:20:16 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-44aa4207-e9e4-4bbd-9256-a4ae58971b0e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=73391) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Aug 15 06:20:16 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.base [None req-44aa4207-e9e4-4bbd-9256-a4ae58971b0e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.229s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Aug 15 06:20:16 user nova-compute[73391]: DEBUG os_brick.initiator.connectors.iscsi [None req-44aa4207-e9e4-4bbd-9256-a4ae58971b0e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] <== disconnect_volume: return (230ms) None {{(pid=73391) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:202}}
Aug 15 06:20:16 user nova-compute[73391]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44aa4207-e9e4-4bbd-9256-a4ae58971b0e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Disconnected iSCSI Volume {{(pid=73391) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Aug 15 06:20:16 user nova-compute[73391]: DEBUG nova.objects.instance [None req-44aa4207-e9e4-4bbd-9256-a4ae58971b0e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lazy-loading 'flavor' on Instance uuid aa9d5fa1-a9eb-4330-9ce7-3189fa949726 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:20:16 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-44aa4207-e9e4-4bbd-9256-a4ae58971b0e tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.529s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:20:20 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:20:20 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:20:21 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:20:26 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:20:26 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:20:26 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:20:26 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:20:26 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:20:26 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:20:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:20:36 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:20:40 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:20:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:20:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:20:40 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:20:40 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Auditing locally available compute resources for user (node: user) {{(pid=73391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 06:20:40 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9d5fa1-a9eb-4330-9ce7-3189fa949726/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:20:40 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9d5fa1-a9eb-4330-9ce7-3189fa949726/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:20:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9d5fa1-a9eb-4330-9ce7-3189fa949726/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:20:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:20:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9d5fa1-a9eb-4330-9ce7-3189fa949726/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:20:41 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:20:41 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:20:41 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Hypervisor/Node resource view: name=user free_ram=8800MB free_disk=25.041019439697266GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 06:20:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:20:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:20:41 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance aa9d5fa1-a9eb-4330-9ce7-3189fa949726 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:20:41 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 06:20:41 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 06:20:41 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:20:41 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:20:41 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Compute_service record updated for user:user {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 06:20:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.364s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:20:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:20:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:20:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:20:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:20:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:20:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:20:51 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:20:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:20:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:20:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:20:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:20:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:20:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:20:57 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:20:57 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Starting heal instance info cache {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 06:20:57 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Rebuilding the list of instances to heal {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 06:20:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "refresh_cache-aa9d5fa1-a9eb-4330-9ce7-3189fa949726" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Aug 15 06:20:57 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquired lock "refresh_cache-aa9d5fa1-a9eb-4330-9ce7-3189fa949726" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Aug 15 06:20:57 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Forcefully refreshing network info cache for instance {{(pid=73391) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Aug 15 06:20:57 user nova-compute[73391]: DEBUG nova.objects.instance [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lazy-loading 'info_cache' on Instance uuid aa9d5fa1-a9eb-4330-9ce7-3189fa949726 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:20:58 user nova-compute[73391]: DEBUG nova.network.neutron [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Updating instance_info_cache with network_info: [{"id": "82232ed8-43f1-4c36-9429-f8bb8d7755f0", "address": "fa:16:3e:6b:8d:30", "network": {"id": "6a50e346-0341-4f50-a2fa-f5fe5f8ad867", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-542549440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ef81b0efb24993b595a2f6d18268fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82232ed8-43", "ovs_interfaceid": "82232ed8-43f1-4c36-9429-f8bb8d7755f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:20:58 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Releasing lock "refresh_cache-aa9d5fa1-a9eb-4330-9ce7-3189fa949726" {{(pid=73391) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Aug 15 06:20:58 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Updated the network info_cache for instance {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Aug 15 06:20:58 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:20:58 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:20:58 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Cleaning up deleted instances {{(pid=73391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Aug 15 06:20:58 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] There are 0 instances to clean {{(pid=73391) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Aug 15 06:20:59 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:21:00 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:21:00 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:21:00 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 06:21:01 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:21:01 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:21:06 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:21:06 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:21:08 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:21:09 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:21:09 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Cleaning up deleted instances with incomplete migration  {{(pid=73391) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Aug 15 06:21:11 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:21:13 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:21:16 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:21:21 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:21:21 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:21:21 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:21:21 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:21:21 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:21:21 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:21:26 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:21:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:21:36 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:21:36 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:21:36 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:21:36 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:21:36 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:21:36 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:21:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:21:41 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:21:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:21:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:21:41 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:21:41 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Auditing locally available compute resources for user (node: user) {{(pid=73391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 06:21:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9d5fa1-a9eb-4330-9ce7-3189fa949726/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:21:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9d5fa1-a9eb-4330-9ce7-3189fa949726/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:21:41 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9d5fa1-a9eb-4330-9ce7-3189fa949726/disk --force-share --output=json {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Aug 15 06:21:42 user nova-compute[73391]: DEBUG oslo_concurrency.processutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa9d5fa1-a9eb-4330-9ce7-3189fa949726/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=73391) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Aug 15 06:21:42 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:21:42 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:21:42 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Hypervisor/Node resource view: name=user free_ram=8822MB free_disk=25.040077209472656GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 06:21:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:21:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:21:42 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Instance aa9d5fa1-a9eb-4330-9ce7-3189fa949726 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=73391) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Aug 15 06:21:42 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 06:21:42 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 06:21:42 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Refreshing inventories for resource provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Aug 15 06:21:42 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Updating ProviderTree inventory for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Aug 15 06:21:42 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Updating inventory in ProviderTree for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Aug 15 06:21:42 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Refreshing aggregate associations for resource provider 771708bd-6a2a-4e0c-9869-46d45e6b1896, aggregates: None {{(pid=73391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Aug 15 06:21:42 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Refreshing trait associations for resource provider 771708bd-6a2a-4e0c-9869-46d45e6b1896, traits: COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_DEVICE_TAGGING,HW_CPU_X86_SSE41,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000E,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_STORAGE_BUS_SATA,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_NE2K_PCI {{(pid=73391) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Aug 15 06:21:42 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:21:42 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:21:42 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Compute_service record updated for user:user {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 06:21:42 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.286s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:21:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-fd431d22-9366-4cd7-acf1-7731e11e08fc tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Acquiring lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:21:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-fd431d22-9366-4cd7-acf1-7731e11e08fc tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:21:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-fd431d22-9366-4cd7-acf1-7731e11e08fc tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Acquiring lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:21:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-fd431d22-9366-4cd7-acf1-7731e11e08fc tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:21:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-fd431d22-9366-4cd7-acf1-7731e11e08fc tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:21:45 user nova-compute[73391]: INFO nova.compute.manager [None req-fd431d22-9366-4cd7-acf1-7731e11e08fc tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Terminating instance
Aug 15 06:21:45 user nova-compute[73391]: DEBUG nova.compute.manager [None req-fd431d22-9366-4cd7-acf1-7731e11e08fc tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Start destroying the instance on the hypervisor. {{(pid=73391) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Aug 15 06:21:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:21:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:21:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:21:45 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:21:45 user nova-compute[73391]: DEBUG nova.compute.manager [req-dd6ac452-659c-4596-a0d7-46dfb5866de2 req-78035e5b-ac0d-4ac7-bd1e-cbddbb67925f service nova] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Received event network-vif-unplugged-82232ed8-43f1-4c36-9429-f8bb8d7755f0 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:21:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-dd6ac452-659c-4596-a0d7-46dfb5866de2 req-78035e5b-ac0d-4ac7-bd1e-cbddbb67925f service nova] Acquiring lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:21:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-dd6ac452-659c-4596-a0d7-46dfb5866de2 req-78035e5b-ac0d-4ac7-bd1e-cbddbb67925f service nova] Lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:21:45 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-dd6ac452-659c-4596-a0d7-46dfb5866de2 req-78035e5b-ac0d-4ac7-bd1e-cbddbb67925f service nova] Lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:21:45 user nova-compute[73391]: DEBUG nova.compute.manager [req-dd6ac452-659c-4596-a0d7-46dfb5866de2 req-78035e5b-ac0d-4ac7-bd1e-cbddbb67925f service nova] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] No waiting events found dispatching network-vif-unplugged-82232ed8-43f1-4c36-9429-f8bb8d7755f0 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:21:45 user nova-compute[73391]: DEBUG nova.compute.manager [req-dd6ac452-659c-4596-a0d7-46dfb5866de2 req-78035e5b-ac0d-4ac7-bd1e-cbddbb67925f service nova] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Received event network-vif-unplugged-82232ed8-43f1-4c36-9429-f8bb8d7755f0 for instance with task_state deleting. {{(pid=73391) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Aug 15 06:21:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:21:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:21:46 user nova-compute[73391]: INFO nova.virt.libvirt.driver [-] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Instance destroyed successfully.
Aug 15 06:21:46 user nova-compute[73391]: DEBUG nova.objects.instance [None req-fd431d22-9366-4cd7-acf1-7731e11e08fc tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lazy-loading 'resources' on Instance uuid aa9d5fa1-a9eb-4330-9ce7-3189fa949726 {{(pid=73391) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1140}}
Aug 15 06:21:46 user nova-compute[73391]: DEBUG nova.virt.libvirt.vif [None req-fd431d22-9366-4cd7-acf1-7731e11e08fc tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-08-15T06:14:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-530291356',display_name='tempest-SnapshotDataIntegrityTests-server-530291356',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-530291356',id=53,image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNHBuKzumIfTQPiAItoUgQm0kGRANtXlwB9lbGSrROXJylPeQ4ovPyDdBV73K35WWzHK2FtNG+kJzeNo7Q5chLP05/MAjtICfHkDBccTJPq95uPI4ydyTO7IklzLCi+7fA==',key_name='tempest-keypair-1162096281',keypairs=<?>,launch_index=0,launched_at=2023-08-15T06:14:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b9ef81b0efb24993b595a2f6d18268fd',ramdisk_id='',reservation_id='r-auxj6yqk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='191b1dad-305e-4d1c-9b15-515ec59a3278',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1860568846',owner_user_name='tempest-SnapshotDataIntegrityTests-1860568846-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-08-15T06:14:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0f8347c6b54f41b8b6c5e652c95d1453',uuid=aa9d5fa1-a9eb-4330-9ce7-3189fa949726,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "82232ed8-43f1-4c36-9429-f8bb8d7755f0", "address": "fa:16:3e:6b:8d:30", "network": {"id": "6a50e346-0341-4f50-a2fa-f5fe5f8ad867", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-542549440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ef81b0efb24993b595a2f6d18268fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82232ed8-43", "ovs_interfaceid": "82232ed8-43f1-4c36-9429-f8bb8d7755f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Aug 15 06:21:46 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-fd431d22-9366-4cd7-acf1-7731e11e08fc tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Converting VIF {"id": "82232ed8-43f1-4c36-9429-f8bb8d7755f0", "address": "fa:16:3e:6b:8d:30", "network": {"id": "6a50e346-0341-4f50-a2fa-f5fe5f8ad867", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-542549440-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b9ef81b0efb24993b595a2f6d18268fd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap82232ed8-43", "ovs_interfaceid": "82232ed8-43f1-4c36-9429-f8bb8d7755f0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Aug 15 06:21:46 user nova-compute[73391]: DEBUG nova.network.os_vif_util [None req-fd431d22-9366-4cd7-acf1-7731e11e08fc tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:8d:30,bridge_name='br-int',has_traffic_filtering=True,id=82232ed8-43f1-4c36-9429-f8bb8d7755f0,network=Network(6a50e346-0341-4f50-a2fa-f5fe5f8ad867),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82232ed8-43') {{(pid=73391) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Aug 15 06:21:46 user nova-compute[73391]: DEBUG os_vif [None req-fd431d22-9366-4cd7-acf1-7731e11e08fc tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:8d:30,bridge_name='br-int',has_traffic_filtering=True,id=82232ed8-43f1-4c36-9429-f8bb8d7755f0,network=Network(6a50e346-0341-4f50-a2fa-f5fe5f8ad867),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82232ed8-43') {{(pid=73391) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Aug 15 06:21:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 17 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:21:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap82232ed8-43, bridge=br-int, if_exists=True) {{(pid=73391) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Aug 15 06:21:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:21:46 user nova-compute[73391]: INFO os_vif [None req-fd431d22-9366-4cd7-acf1-7731e11e08fc tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:8d:30,bridge_name='br-int',has_traffic_filtering=True,id=82232ed8-43f1-4c36-9429-f8bb8d7755f0,network=Network(6a50e346-0341-4f50-a2fa-f5fe5f8ad867),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap82232ed8-43')
Aug 15 06:21:46 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-fd431d22-9366-4cd7-acf1-7731e11e08fc tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Deleting instance files /opt/stack/data/nova/instances/aa9d5fa1-a9eb-4330-9ce7-3189fa949726_del
Aug 15 06:21:46 user nova-compute[73391]: INFO nova.virt.libvirt.driver [None req-fd431d22-9366-4cd7-acf1-7731e11e08fc tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Deletion of /opt/stack/data/nova/instances/aa9d5fa1-a9eb-4330-9ce7-3189fa949726_del complete
Aug 15 06:21:46 user nova-compute[73391]: INFO nova.compute.manager [None req-fd431d22-9366-4cd7-acf1-7731e11e08fc tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Took 0.88 seconds to destroy the instance on the hypervisor.
Aug 15 06:21:46 user nova-compute[73391]: DEBUG oslo.service.loopingcall [None req-fd431d22-9366-4cd7-acf1-7731e11e08fc tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=73391) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Aug 15 06:21:46 user nova-compute[73391]: DEBUG nova.compute.manager [-] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Deallocating network for instance {{(pid=73391) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Aug 15 06:21:46 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] deallocate_for_instance() {{(pid=73391) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Aug 15 06:21:47 user nova-compute[73391]: DEBUG nova.network.neutron [-] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Updating instance_info_cache with network_info: [] {{(pid=73391) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Aug 15 06:21:47 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Took 1.19 seconds to deallocate network for instance.
Aug 15 06:21:47 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-fd431d22-9366-4cd7-acf1-7731e11e08fc tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:21:47 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-fd431d22-9366-4cd7-acf1-7731e11e08fc tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:21:47 user nova-compute[73391]: DEBUG nova.compute.manager [req-5a981d4a-6be0-4c53-b94a-62a0cb68bb5f req-337233da-c160-4f51-bba6-14b8c39f886f service nova] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Received event network-vif-deleted-82232ed8-43f1-4c36-9429-f8bb8d7755f0 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:21:47 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-fd431d22-9366-4cd7-acf1-7731e11e08fc tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:21:47 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-fd431d22-9366-4cd7-acf1-7731e11e08fc tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:21:47 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-fd431d22-9366-4cd7-acf1-7731e11e08fc tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.124s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:21:47 user nova-compute[73391]: INFO nova.scheduler.client.report [None req-fd431d22-9366-4cd7-acf1-7731e11e08fc tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Deleted allocations for instance aa9d5fa1-a9eb-4330-9ce7-3189fa949726
Aug 15 06:21:47 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-fd431d22-9366-4cd7-acf1-7731e11e08fc tempest-SnapshotDataIntegrityTests-1860568846 tempest-SnapshotDataIntegrityTests-1860568846-project-member] Lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.393s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:21:47 user nova-compute[73391]: DEBUG nova.compute.manager [req-a6f66852-eb02-4729-a357-18219e488937 req-4fbb3eb9-99ee-4c1c-bcf8-e1fcb29c52ba service nova] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Received event network-vif-plugged-82232ed8-43f1-4c36-9429-f8bb8d7755f0 {{(pid=73391) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Aug 15 06:21:47 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-a6f66852-eb02-4729-a357-18219e488937 req-4fbb3eb9-99ee-4c1c-bcf8-e1fcb29c52ba service nova] Acquiring lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:21:47 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-a6f66852-eb02-4729-a357-18219e488937 req-4fbb3eb9-99ee-4c1c-bcf8-e1fcb29c52ba service nova] Lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:21:47 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [req-a6f66852-eb02-4729-a357-18219e488937 req-4fbb3eb9-99ee-4c1c-bcf8-e1fcb29c52ba service nova] Lock "aa9d5fa1-a9eb-4330-9ce7-3189fa949726-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:21:47 user nova-compute[73391]: DEBUG nova.compute.manager [req-a6f66852-eb02-4729-a357-18219e488937 req-4fbb3eb9-99ee-4c1c-bcf8-e1fcb29c52ba service nova] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] No waiting events found dispatching network-vif-plugged-82232ed8-43f1-4c36-9429-f8bb8d7755f0 {{(pid=73391) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Aug 15 06:21:47 user nova-compute[73391]: WARNING nova.compute.manager [req-a6f66852-eb02-4729-a357-18219e488937 req-4fbb3eb9-99ee-4c1c-bcf8-e1fcb29c52ba service nova] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Received unexpected event network-vif-plugged-82232ed8-43f1-4c36-9429-f8bb8d7755f0 for instance with vm_state deleted and task_state None.
Aug 15 06:21:51 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:21:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:21:57 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:21:57 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Starting heal instance info cache {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 06:21:57 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Rebuilding the list of instances to heal {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 06:21:57 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Didn't find any instances for network info cache update. {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 06:21:57 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:22:00 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:22:01 user nova-compute[73391]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1692080506.2797055, aa9d5fa1-a9eb-4330-9ce7-3189fa949726 => Stopped> {{(pid=73391) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Aug 15 06:22:01 user nova-compute[73391]: INFO nova.compute.manager [-] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] VM Stopped (Lifecycle Event)
Aug 15 06:22:01 user nova-compute[73391]: DEBUG nova.compute.manager [None req-b97f0b04-fb77-4a5a-817a-48117a5a4f9f None None] [instance: aa9d5fa1-a9eb-4330-9ce7-3189fa949726] Checking state {{(pid=73391) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Aug 15 06:22:01 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:22:01 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:22:02 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:22:02 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=73391) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Aug 15 06:22:03 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:22:06 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:22:06 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:22:06 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:22:06 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:22:06 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:22:06 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:22:07 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:22:11 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:22:15 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:22:16 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:22:21 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:22:24 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:22:26 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:22:26 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:22:26 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=73391) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Aug 15 06:22:26 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:22:26 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=73391) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Aug 15 06:22:26 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:22:31 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:22:36 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:22:36 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:22:39 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:22:41 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:22:42 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:22:43 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager.update_available_resource {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:22:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:22:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:22:43 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:22:43 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Auditing locally available compute resources for user (node: user) {{(pid=73391) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Aug 15 06:22:44 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:22:44 user nova-compute[73391]: WARNING nova.virt.libvirt.driver [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Aug 15 06:22:44 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Hypervisor/Node resource view: name=user free_ram=8968MB free_disk=25.066791534423828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=73391) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Aug 15 06:22:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Aug 15 06:22:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Aug 15 06:22:44 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Aug 15 06:22:44 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=73391) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Aug 15 06:22:44 user nova-compute[73391]: DEBUG nova.compute.provider_tree [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed in ProviderTree for provider: 771708bd-6a2a-4e0c-9869-46d45e6b1896 {{(pid=73391) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Aug 15 06:22:44 user nova-compute[73391]: DEBUG nova.scheduler.client.report [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Inventory has not changed for provider 771708bd-6a2a-4e0c-9869-46d45e6b1896 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=73391) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Aug 15 06:22:44 user nova-compute[73391]: DEBUG nova.compute.resource_tracker [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Compute_service record updated for user:user {{(pid=73391) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Aug 15 06:22:44 user nova-compute[73391]: DEBUG oslo_concurrency.lockutils [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.137s {{(pid=73391) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Aug 15 06:22:46 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:22:51 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 21 {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Aug 15 06:22:56 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:22:59 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:22:59 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Starting heal instance info cache {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Aug 15 06:22:59 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Rebuilding the list of instances to heal {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Aug 15 06:22:59 user nova-compute[73391]: DEBUG nova.compute.manager [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Didn't find any instances for network info cache update. {{(pid=73391) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Aug 15 06:22:59 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:23:01 user nova-compute[73391]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=73391) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Aug 15 06:23:01 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:23:01 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Aug 15 06:23:03 user nova-compute[73391]: DEBUG oslo_service.periodic_task [None req-3bde50a1-1843-44ac-8712-872b6fb30167 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=73391) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}